OpenSecureAI Scanner vs Promptfoo

OpenSecureAI Scanner checks untrusted text for patterns that may indicate prompt injection, jailbreaks, system-prompt leaks, or data exfiltration. Its scanPrompt library API returns a 0–100 score, a risk level, and findings for individual rules. Developers can access it as an npm package, CLI, GitHub Action, or REST API; the package targets Node 18+ and has zero runtime dependencies. Authenticated hosted API calls add detections for obfuscation and encoding evasions, indirect injection, tool abuse, multilingual overrides, and de-obfuscation. The LLM Gateway can route prompts to a selected OpenAI, Anthropic, xAI, or Groq provider and scan the response. Documentation says authenticated scans save a summary to the dashboard but do not store raw prompt text; gateway provider keys are not stored or logged. Free access includes in-browser tools and npm packages, while the anonymous API uses the basic engine with IP rate limiting. The Free plan lists 2,000 API requests per month. Pro costs $49 a month, but paid checkout is not self-serve and requires contacting sales.

Promptfoo helps developers and enterprises evaluate prompts and test AI applications for security risks. It compares prompt outputs across multiple models in a web view. Red-team testing simulates users to look for prompt injections, jailbreaks, data leaks, business rule violations and insecure agent tool use. Its getting-started guide lists more than 60 providers, including OpenAI, Anthropic, Google and local models such as Ollama. Integrations include CI systems such as GitHub Actions, GitLab CI, Jenkins, Azure Pipelines, CircleCI and Bitbucket Pipelines, plus Splunk, Burp Suite, Google Sheets and MCP. Installation is available through npm, npx or Homebrew. Promptfoo requires Node.js 22.22.0 or newer and recommends Node.js 24 LTS. The free Community plan includes all LLM evaluation features and 10k red-team probes per month, and can run locally or be self-hosted. Enterprise includes managed cloud deployment; On-Premise runs on customer infrastructure. Promptfoo says it is based in San Francisco, is now part of OpenAI and remains open source.