Basilisk vs OpenSecureAI Scanner

Basilisk is an open-source framework for authorized security testing, vulnerability research, and academic study of AI and LLM systems. It includes 32 attack modules across eight categories mapped to the OWASP LLM Top 10. Its Smart Prompt Evolution engine combines 15 mutation operators, five crossover strategies, and multi-signal fitness scoring. Multi-turn modules examine prompt cultivation, authority escalation, and sycophancy exploitation, with guardrail drift monitoring. Basilisk connects to providers including OpenAI, Anthropic, Google, xAI Grok, Groq, Azure OpenAI, GitHub Models, and Ollama, plus custom HTTP or WebSocket endpoints. Reports can be exported as HTML, SARIF 2.1.0, JSON, Markdown, or PDF. GitHub Actions and GitLab CI integrations use SARIF output and can fail pipelines on critical findings. Install options include desktop packages for Windows, macOS, and Linux, pip, Docker, and source. The CLI requires Python 3.11 or higher and an API key for the provider being tested. Prompt evolution, payload mutation, and report generation run locally. It is free under AGPL-3.0. Users must have explicit written authorization before testing systems they do not own.

OpenSecureAI Scanner checks untrusted text for patterns that may indicate prompt injection, jailbreaks, system-prompt leaks, or data exfiltration. Its scanPrompt library API returns a 0–100 score, a risk level, and findings for individual rules. Developers can access it as an npm package, CLI, GitHub Action, or REST API; the package targets Node 18+ and has zero runtime dependencies. Authenticated hosted API calls add detections for obfuscation and encoding evasions, indirect injection, tool abuse, multilingual overrides, and de-obfuscation. The LLM Gateway can route prompts to a selected OpenAI, Anthropic, xAI, or Groq provider and scan the response. Documentation says authenticated scans save a summary to the dashboard but do not store raw prompt text; gateway provider keys are not stored or logged. Free access includes in-browser tools and npm packages, while the anonymous API uses the basic engine with IP rate limiting. The Free plan lists 2,000 API requests per month. Pro costs $49 a month, but paid checkout is not self-serve and requires contacting sales.