Skip to content
SPECIFICTION
Get listed

Basilisk vs Project Moonshot

Basilisk

basilisk.rothackers.com

Project Moonshot

aiverifyfoundation.sg

Side by side

FigureBasiliskProject Moonshot
Price fromFreeFree
Free planYesYes
Free trial——
Open source——
Web—Yes
WindowsYesYes
macOSYesYes
LinuxYesYes
API—Yes
Self-hosted—Yes
Plans published11
Spec score · AI Security Testing Tools8.0 (#11)8.3 (#8)
PurposeBasilisk is an open-source AI/LLM red teaming framework for authorized security testing, vulnerability research, and academic study.Project Moonshot is an open-source toolkit for testing the safety and reliability of LLMs and LLM applications through benchmarking and red teaming.
ReportsBasilisk exports HTML, SARIF 2.1.0, JSON, Markdown, and PDF reports.Moonshot provides interactive HTML reports and downloadable raw JSON results for programmatic analysis.
SupportSecurity issues and privacy questions can be reported to [email protected].The Moonshot FAQ directs users who need more help to raise an issue on GitHub.

Plans

Basilisk

  • AGPL-3.0 open-source softwareFree

Basilisk pricing →

Project Moonshot

  • Project MoonshotFree

Project Moonshot pricing →

In their own words

Basilisk

Basilisk is an open-source framework for authorized security testing, vulnerability research, and academic study of AI and LLM systems. It includes 32 attack modules across eight categories mapped to the OWASP LLM Top 10. Its Smart Prompt Evolution engine combines 15 mutation operators, five crossover strategies, and multi-signal fitness scoring. Multi-turn modules examine prompt cultivation, authority escalation, and sycophancy exploitation, with guardrail drift monitoring. Basilisk connects to providers including OpenAI, Anthropic, Google, xAI Grok, Groq, Azure OpenAI, GitHub Models, and Ollama, plus custom HTTP or WebSocket endpoints. Reports can be exported as HTML, SARIF 2.1.0, JSON, Markdown, or PDF. GitHub Actions and GitLab CI integrations use SARIF output and can fail pipelines on critical findings. Install options include desktop packages for Windows, macOS, and Linux, pip, Docker, and source. The CLI requires Python 3.11 or higher and an API key for the provider being tested. Prompt evolution, payload mutation, and report generation run locally. It is free under AGPL-3.0. Users must have explicit written authorization before testing systems they do not own.

Visit basilisk.rothackers.com

Project Moonshot

Project Moonshot is an open-source toolkit for evaluating the safety and reliability of large language models and applications. It runs benchmark tests using open-source datasets and metrics, and generates adversarial prompts to probe possible vulnerabilities and misuse. Users can build custom evaluations with their own datasets, optional prompt templates, metrics, and grading scales. Results appear in interactive HTML reports and downloadable raw JSON. Moonshot provides a Web UI, interactive command-line interface, library APIs, and Web APIs, with configurable connections to model providers including OpenAI, Anthropic, Together, and Hugging Face. Users can also create connectors for other models or applications hosted on custom servers. The toolkit implements benchmarks recommended in IMDA’s Starter Kit for safety testing LLM-based applications. Moonshot is free beta software under Apache License 2.0. Installation uses pip and requires Python 3.11; the Web UI additionally requires Node.js 20.11.1 LTS or later, and test assets are needed to run tests. The installation guide recommends Chrome for the Web UI and notes possible installation difficulties on x86 Macs with moonshot-data dependencies.

Visit aiverifyfoundation.sg