AIRTA Red Team vs RedForge
AIRTA Red Team
airtasystems.comRedForge
github.comSide by side
| Figure | AIRTA Red Team | RedForge |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | Yes | — |
| Web | Yes | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 2 | 1 |
| Spec score · AI Security Testing Tools | 9.0 (#1) | 7.7 (#17) |
| Deployment | The maker documents local Docker deployment with python start.py, CLI operation with main.py, CI use, behind-firewall staging and authorized external black-box testing. | The Docker instructions say the container runs as non-root user redforge (UID 1001) with a read-only filesystem. |
| Integrations | The tool can export assessment results to AIRTA Systems through its bulk import API for review and regression tracking. | It can export SARIF for GitHub Code Scanning and documents a GitHub Actions workflow that uploads the SARIF file. |
| Purpose | AIRTA Red Team runs authorized adversarial security assessments against LLMs and LLM-driven applications. | RedForge is an LLM security testing platform for red teaming and vulnerability scanning. |
Plans
In their own words
AIRTA Red Team
AIRTA Red Team is a self-hosted tool for authorized adversarial security assessments of LLMs and LLM-driven applications. It builds test suites from security playbooks, discovers target components and authentication, runs attacks, assesses outcomes, and exports reports. Listed playbooks include OWASP LLM, OWASP Agent, MITRE ATLAS, jailbreak, system prompt exfiltration, and custom scenarios. Strategies include zero-shot, multi-shot, few-shot, iterative, multimodal, jailbreak, and chain-of-thought testing. Targets can be reached through a Playwright browser runner or direct HTTP API transports, including file uploads and tool calls. It can run locally in Docker, behind a firewall, in CI, or against external endpoints for authorized black-box assessments. Runs record prompts, uploads, responses, and tool calls in attack_log.json; pipeline_report.json summarizes categories and severity. Results can be exported to AIRTA Systems for review and regression tracking. The free plan has no license fee or subscription, but users must supply an LLM API key. Assessments focus on observable runtime behavior, not source-code static analysis. The repository says the tool is deprecated and no longer maintained.
RedForge
RedForge is a free, open-source LLM security testing platform for red teaming and vulnerability scanning. It runs on Linux, through an API and as self-hosted software. The project lists more than 49 probes, full OWASP LLM Top 10 coverage and YAML probe additions without Python. Attack modules include PAIR, Crescendo multi-turn escalation, Skeleton Key, many-shot jailbreaking and GCG adversarial suffixes. Its mutation engine expands two payloads into 37 variants using encoding, Unicode, cognitive reframing and structural injection strategies. Provider adapters cover OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace and generic REST endpoints. Ollama runs locally without an API key. Scans create JSON, JSONL audit and failures reports, with HTML, Markdown and SARIF also available. Compliance reports cover NIST AI RMF, EU AI Act, ISO/IEC 42001, GDPR and OWASP LLM Top 10. RedForge is Apache 2.0 software for authorized use.