AgentDojo vs RedForge
AgentDojo
agentdojo.spylab.aiRedForge
github.comSide by side
| Figure | AgentDojo | RedForge |
|---|---|---|
| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | — |
| Open source | — | — |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 1 |
| Spec score · AI Security Testing Tools | 7.8 (#12) | 7.7 (#17) |
| License | The project's GitHub page identifies its license as MIT. | The project is released under the Apache 2.0 license, and the README says probe payloads are released under CC0. |
| Model providers | Documented tool-calling LLM implementations support OpenAI, Anthropic, Google, and Cohere; the docs also describe using Llama 3 70B through TogetherAI’s API. | It lists adapters for OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace, and generic REST endpoints. |
| Purpose | AgentDojo is a dynamic environment for evaluating prompt injection attacks and defenses for LLM agents. | RedForge is an LLM security testing platform for red teaming and vulnerability scanning. |
Plans
In their own words
AgentDojo
AgentDojo has no write-up on Specifiction yet; its figures are above.
RedForge
RedForge is a free, open-source LLM security testing platform for red teaming and vulnerability scanning. It runs on Linux, through an API and as self-hosted software. The project lists more than 49 probes, full OWASP LLM Top 10 coverage and YAML probe additions without Python. Attack modules include PAIR, Crescendo multi-turn escalation, Skeleton Key, many-shot jailbreaking and GCG adversarial suffixes. Its mutation engine expands two payloads into 37 variants using encoding, Unicode, cognitive reframing and structural injection strategies. Provider adapters cover OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace and generic REST endpoints. Ollama runs locally without an API key. Scans create JSON, JSONL audit and failures reports, with HTML, Markdown and SARIF also available. Compliance reports cover NIST AI RMF, EU AI Act, ISO/IEC 42001, GDPR and OWASP LLM Top 10. RedForge is Apache 2.0 software for authorized use.