Basilisk vs Crucible
Basilisk
basilisk.rothackers.comCrucible
crucible-security.github.ioSide by side
| Figure | Basilisk | Crucible |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 1 | 3 |
| Spec score · AI Security Testing Tools | 8.0 (#11) | 7.8 (#14) |
| CI/CD | GitHub Actions and GitLab CI integration uses SARIF output and can fail pipelines on critical findings. | The GitHub Actions integration can fail a build when an agent's security score drops below a configured threshold. |
| License | Basilisk is released under the AGPL-3.0 license, permitting use, copying, modification, and distribution subject to the license and terms. | The core engine and test modules are described as Apache 2.0 and free, with no feature gating on security tests. |
| Privacy | The CLI and Desktop app do not send telemetry, scan results, API keys, or personal data to Basilisk. | The site says local scanning requires no signup and has no telemetry by default. |
| Purpose | Basilisk is an open-source AI/LLM red teaming framework for authorized security testing, vulnerability research, and academic study. | Crucible stress-tests AI agents against attack vectors including prompt injection, goal hijacking, and tool misuse before production. |
| Reports | Basilisk exports HTML, SARIF 2.1.0, JSON, Markdown, and PDF reports. | Scans produce an A–F graded report with severity, OWASP mapping, and reproduction steps. |
| Support | Security issues and privacy questions can be reported to [email protected]. | The Community plan lists Discord support, while Team lists priority support and Enterprise lists dedicated security engineering support. |
Plans
In their own words
Basilisk
Basilisk is an open-source framework for authorized security testing, vulnerability research, and academic study of AI and LLM systems. It includes 32 attack modules across eight categories mapped to the OWASP LLM Top 10. Its Smart Prompt Evolution engine combines 15 mutation operators, five crossover strategies, and multi-signal fitness scoring. Multi-turn modules examine prompt cultivation, authority escalation, and sycophancy exploitation, with guardrail drift monitoring. Basilisk connects to providers including OpenAI, Anthropic, Google, xAI Grok, Groq, Azure OpenAI, GitHub Models, and Ollama, plus custom HTTP or WebSocket endpoints. Reports can be exported as HTML, SARIF 2.1.0, JSON, Markdown, or PDF. GitHub Actions and GitLab CI integrations use SARIF output and can fail pipelines on critical findings. Install options include desktop packages for Windows, macOS, and Linux, pip, Docker, and source. The CLI requires Python 3.11 or higher and an API key for the provider being tested. Prompt evolution, payload mutation, and report generation run locally. It is free under AGPL-3.0. Users must have explicit written authorization before testing systems they do not own.
Crucible
Crucible is a self-hosted security scanner for testing AI agents before production. It checks attack behavior such as prompt injection, goal hijacking, jailbreaks, unsafe output, and tool misuse. Instead of reviewing generated text alone, it evaluates tool calls, side effects, and outcomes. The site lists 11 modules and 153 attack vectors, covering eight of ten OWASP Agentic risks, with two in development. Crucible runs 90 attack payloads in under 60 seconds and produces an A–F report with severity, OWASP mapping, and reproduction steps. It supports LangChain, CrewAI, AutoGen, raw MCP endpoints, and agents with HTTP or MCP interfaces. The pip-installed CLI supports Python 3.10+. Local scanning needs no signup and has no telemetry by default. Community is free; Team and Enterprise add monitoring, dashboards, support, SSO, audit logs, deployment options, and custom modules.