AIRTA Red Team vs AIRTaaS

AIRTA Red Team is a self-hosted tool for authorized adversarial security assessments of LLMs and LLM-driven applications. It builds test suites from security playbooks, discovers target components and authentication, runs attacks, assesses outcomes, and exports reports. Listed playbooks include OWASP LLM, OWASP Agent, MITRE ATLAS, jailbreak, system prompt exfiltration, and custom scenarios. Strategies include zero-shot, multi-shot, few-shot, iterative, multimodal, jailbreak, and chain-of-thought testing. Targets can be reached through a Playwright browser runner or direct HTTP API transports, including file uploads and tool calls. It can run locally in Docker, behind a firewall, in CI, or against external endpoints for authorized black-box assessments. Runs record prompts, uploads, responses, and tool calls in attack_log.json; pipeline_report.json summarizes categories and severity. Results can be exported to AIRTA Systems for review and regression tracking. The free plan has no license fee or subscription, but users must supply an LLM API key. Assessments focus on observable runtime behavior, not source-code static analysis. The repository says the tool is deprecated and no longer maintained.

AIRTaaS is a web platform for continuous security testing and validation of agentic AI applications. Teams connect an AI agent or application, define policies and business rules, then launch red-team and guardrail validations. Tests can rerun when agents, prompts, or policies change, surfacing risks and regressions. Coverage includes prompt injection, jailbreaks, data leakage, hallucinations, bias, harmful outputs, agent chaining abuse, and tool, API, or policy violations. Results provide pass/fail outcomes, risk severity, and reports about attack scenarios, policy violations, and the threat landscape. The platform lists on-demand validations, secured reports, customer-shareable views, controlled sharing, and outcome assurance summaries. Progress tracking includes version history, risk trends, improvement tracking, regression detection, and maturity scoring. Marketplace resources include buyer trust signals, procurement and review support, and validation links or badges. AIRTaaS has a free plan at free and is made by Giggso, headquartered in Michigan, USA.