garak vs OpenSecureAI Scanner

garak is a command-line scanner for probing language models and systems that use them for security weaknesses. Its checks cover issues such as hallucination, data leakage, prompt injection, misinformation, toxicity generation, and jailbreaks. Probes try to elicit failures, while detectors inspect responses for patterns such as unsafe content or a failure to refuse. A standard scan can run without supervision and produce a report, with scan settings available for customization. Integrations include OpenAI, Hugging Face, Cohere, Replicate, AWS Bedrock, LiteLLM, REST-accessible models, and custom Python integrations. Hugging Face models can run locally or be accessed through an inference API or private endpoint. Output includes screen results, a detailed report log, a hit log, and a debug log. garak assesses text output only. It is developed in Linux and OSX and can be installed with pip or from source; listed platforms include Linux, macOS, Windows, and self-hosted use. It is free, with a free plan and no free trial. Listed capabilities include custom metrics, LLM-as-a-judge, and safety evaluations.

OpenSecureAI Scanner checks untrusted text for patterns that may indicate prompt injection, jailbreaks, system-prompt leaks, or data exfiltration. Its scanPrompt library API returns a 0–100 score, a risk level, and findings for individual rules. Developers can access it as an npm package, CLI, GitHub Action, or REST API; the package targets Node 18+ and has zero runtime dependencies. Authenticated hosted API calls add detections for obfuscation and encoding evasions, indirect injection, tool abuse, multilingual overrides, and de-obfuscation. The LLM Gateway can route prompts to a selected OpenAI, Anthropic, xAI, or Groq provider and scan the response. Documentation says authenticated scans save a summary to the dashboard but do not store raw prompt text; gateway provider keys are not stored or logged. Free access includes in-browser tools and npm packages, while the anonymous API uses the basic engine with IP rate limiting. The Free plan lists 2,000 API requests per month. Pro costs $49 a month, but paid checkout is not self-serve and requires contacting sales.