AgentScan vs RedForge

AgentScan provides automated security testing for LLMs, RAG pipelines, and autonomous agents through a cloud API and web dashboard. It tests attack patterns including prompt injection, data exfiltration, jailbreaks, and MCP attacks. The product describes 412 vectors across 19 categories, though the Free, Starter, and Pro plans provide smaller subsets. Scan reports include a 0–100 risk score, severity breakdown, remediation advice, and evidence export in JSON or PDF. The dashboard detects agent formats, tracks progress and errors, and lets users adjust throttling. The REST API queues scans, returns a scan ID, and supports completion webhooks. AgentScan maps vulnerabilities to OWASP LLM Top 10 risks and describes links to EU AI Act articles and NIST AI RMF functions; its OWASP mapping excludes Model Denial of Service and Model Theft. Free includes 5 scans per month; paid plans start at $29 a month. The terms restrict scans to agents the customer owns or has explicit written authorization to test.

RedForge is a free, open-source LLM security testing platform for red teaming and vulnerability scanning. It runs on Linux, through an API and as self-hosted software. The project lists more than 49 probes, full OWASP LLM Top 10 coverage and YAML probe additions without Python. Attack modules include PAIR, Crescendo multi-turn escalation, Skeleton Key, many-shot jailbreaking and GCG adversarial suffixes. Its mutation engine expands two payloads into 37 variants using encoding, Unicode, cognitive reframing and structural injection strategies. Provider adapters cover OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, Ollama, HuggingFace and generic REST endpoints. Ollama runs locally without an API key. Scans create JSON, JSONL audit and failures reports, with HTML, Markdown and SARIF also available. Compliance reports cover NIST AI RMF, EU AI Act, ISO/IEC 42001, GDPR and OWASP LLM Top 10. RedForge is Apache 2.0 software for authorized use.