Skip to content
SPECIFICTION
Get listed

DeepTeam vs Rogue

DeepTeam

trydeepteam.com

Rogue

github.com

Side by side

FigureDeepTeamRogue
Price fromFreeFree
Free planYesYes
Free trial——
Open source——
APIYes—
Self-hostedYesYes
Plans published12
Spec score · AI Red Teaming Tools7.8 (#10)7.7 (#14)
LicenseThe site describes DeepTeam as an open-source LLM red teaming framework licensed under Apache 2.0.The repository license is the Qualifire OSS License, combining MIT terms with a Commons Clause that excludes selling the software or offering it as a paid hosted service.
MakerThe site credits Confident AI Inc. and says DeepTeam is brought to users by the team behind DeepEval.The license identifies Qualifire ltd as Rogue's licensor.
Model providersThe site lists OpenAI, Claude, Gemini, Azure OpenAI, AWS Bedrock, Vertex AI, Mistral, LiteLLM, and Portkey among model providers.Rogue lists OpenAI, Anthropic, and Google models via LiteLLM and requires an LLM API key to get started.
PurposeDeepTeam is an open-source framework for red teaming LLM systems and finding risks and vulnerabilities.Rogue is an AI agent evaluator and red team platform for stress-testing agents before attackers do.
Risk scoringDeepTeam evaluates LLM outputs with vulnerability-specific LLM-as-a-Judge metrics that return a binary score and reasoning.Rogue assigns vulnerabilities a CVSS-based risk score from 0 to 10.

Plans

DeepTeam

  • Open-source frameworkFree

DeepTeam pricing →

Rogue

  • Personal and internal useFree
  • Commercial hostingPriced on request

Rogue pricing →

In their own words

DeepTeam

DeepTeam is an open-source Python framework for red teaming large language model systems. It offers more than 50 ready-to-use vulnerability checks covering bias, toxicity, personal-information leakage, prompt leakage, and security risks. Simulated attacks include jailbreaks, prompt injection, automated evasion, data extraction, and response manipulation. Vulnerability-specific LLM-as-a-Judge metrics return a binary score with reasoning. Supported reference frameworks include OWASP, NIST AI RMF, MITRE ATLAS, the EU AI Act, BeaverTails, and Aegis. Listed model providers include OpenAI, Claude, Gemini, Azure OpenAI, AWS Bedrock, Vertex AI, Mistral, LiteLLM, and Portkey. CI/CD listings include GitHub Actions, GitLab CI, Jenkins, CircleCI, Buildkite, and Azure Pipelines. Installation uses pip in a Python virtual environment, and attacks are dynamically simulated without a prepared dataset. Results can be saved locally or sent to Confident AI for centralized viewing and production red teaming through a UI. The framework is Apache 2.0 licensed and supports self-hosted or API use.

Visit trydeepteam.com

Rogue

Rogue is a self-hosted platform for evaluating AI agents and conducting security red-team exercises. Automatic checks compare agent behavior with business policies and expected behavior, then produce pass/fail reports with reasoning. Its documented coverage spans more than 75 vulnerabilities, 12 security categories and 20 attack techniques, including encoding, social engineering and injection. Each vulnerability receives a CVSS-based score from 0 to 10. Rogue maps tests to frameworks such as OWASP LLM Top 10, MITRE ATLAS, NIST AI RMF, ISO/IEC 42001, the EU AI Act, GDPR and OWASP API Top 10. It offers a server, terminal interface and non-interactive CLI for CI/CD. Supported protocols include A2A over HTTP, MCP over SSE or Streamable HTTP, and direct Python calls. OpenAI, Anthropic and Google models are available through LiteLLM. Reports export to Markdown, CSV or JSON, and seeded scans can be reproducible. The free plan costs nothing for personal and internal use; commercial hosting requires licensing.

Visit github.com