ProofHound
proofhound.org
What it is
ProofHound is a prompt-optimization platform for LLM classification work, available through an API, self-hosted deployment, or the web. It examines error cases, iterates prompts, validates outputs, and provides controlled deployment and rollback. Dataset uploads accept CSV, TSV, JSONL, JSON arrays, and ZIP files, with field mapping in the interface. Optimization can target overall accuracy or category measures such as recall for high-risk categories and precision for error-prone classes. Immutable prompt versions retain variable configurations, output rules, and differences between revisions. Experiment records include datasets, model configurations, sample judgments, and overall and category metrics. Release controls include gray traffic, A/B testing, full rollout, and one-click rollback. Connections include the web UI, webhooks, API tokens, and MCP. Customers supply their own model provider, and ProofHound says model calls are not charged. A free plan is listed at free, while self-hosted open source is also free.
Spec sheet
- Purpose
- ProofHound automates prompt optimization for LLM classification tasks by analyzing error cases, iterating prompts, validating results, and supporting deployment and rollback.Read 2 Oct 2026 · proofhound.org
- Intended users
- The product targets critical classification workflows including risk control, financial judgment, content moderation, and customer service intent recognition, including low-code work by operations, risk, and analyst teams.Read 2 Oct 2026 · proofhound.org
- Integrations
- The site lists Web UI, Webhook, API Token, and MCP as connection options for business systems and AI agents.Read 2 Oct 2026 · proofhound.org
- Support
- The site lists GitHub, Discord, a Chinese-speaking QQ group, and email for community discussion, product updates, and business contact.Read 2 Oct 2026 · proofhound.org
- Dataset inputs
- The product supports CSV, TSV, JSONL, JSON array, and ZIP dataset uploads, with flexible field mapping in the UI.Read 2 Oct 2026 · proofhound.org
- Experiment audit
- The platform records prompt versions, datasets, model configurations, sample judgments, and overall and category metrics for traceable and reproducible experiments.Read 2 Oct 2026 · proofhound.org
- Model usage
- Customers bring their own model provider, and ProofHound says it does not charge per model call.Read 2 Oct 2026 · proofhound.org
- Optimization targets
- Users can optimize overall accuracy or tune category-specific metrics such as recall for high-risk categories and precision for error-prone classes.Read 2 Oct 2026 · proofhound.org
- Production controls
- ProofHound supports gray traffic release, A/B testing, full rollout, and one-click rollback for prompt deployments.Read 2 Oct 2026 · proofhound.org
- Roadmap
- Evaluation, comparison, and optimization for generative LLM tasks and ProofHound Cloud Managed Enterprise Edition are listed as upcoming.Read 2 Oct 2026 · proofhound.org
- Security and data control
- The self-hosted edition supports private deployment and private data storage on the user's own infrastructure; hosted data is retained until user deletion subject to plan quota.Read 2 Oct 2026 · proofhound.org
- Version history
- ProofHound records immutable prompt versions with variable configurations, output rules, and version differences.Read 2 Oct 2026 · proofhound.org
Plans and prices
Strong points and limits
Strong points
- Accepts five dataset formats plus ZIP uploads
- Optimizes overall or category-specific metrics
- Immutable prompt versions preserve configuration differences
- Supports gray releases, A/B tests, and rollback
- Free and self-hosted plans listed
Limits
- Free plan limits projects, members, calls, storage, and uploads
- Pro checkout is not open yet
- Hosted data remains until user deletion, subject to quota
Who it suits
It suits operations, risk, and analyst teams handling critical classification workflows such as risk control, financial judgment, content moderation, or customer-service intent recognition. Self-hosting fits organizations needing private infrastructure and data storage.
Verdict
ProofHound combines prompt iteration, experiment records, and deployment controls for classification teams. Its free and self-hosted options are clearly specified, while larger usage depends on plan limits and the not-yet-open Pro checkout.
Where Specifiction places it
- Prompting Tool#7 of 257.6
- AI Prompt Generators#18 of 287.7
- Prompt Management Software#18 of 267.7
- AI Prompt Management Software#18 of 257.6
- Prompt Engineering Tools#18 of 257.7