Langfuse vs Rhesis AI
Langfuse
langfuse.comRhesis AI
rhesis.aiSide by side
| Figure | Langfuse | Rhesis AI |
|---|---|---|
| Price from | $29/mo | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | Yes | — |
| Web | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 10 | 2 |
| Spec score · AI LLM Evaluation Tools | 9.1 (#4) | 7.5 (#23) |
| Evaluations | Evaluation supports LLM-as-a-Judge, heuristic or code evaluators, human review, annotation queues, and scoring of production data or experiments. | Rhesis runs test sets against an application endpoint, evaluates responses using configured metrics, and records results in test runs. |
| Headquarters | Berlin, Germany; San Francisco, United States | Potsdam, Germany |
| Product | Langfuse is an open-source AI engineering platform that helps teams collaboratively debug, analyze, and iterate on AI agent applications. | Rhesis is an open-source collaboration layer that brings domain-expert knowledge into AI agent development. |
| Support | Hobby includes community support via GitHub, Core includes in-app support, Pro includes prioritized in-app support, and Enterprise includes support SLA and a named lead support engineer. | The getting-started page points users to in-app support, documentation, a support email, GitHub, and Discord. |
Plans
Langfuse
- HobbyFree
- HobbyFree
- Core$29 a month
- Core$29 a month
- Pro$199 a month
- Pro$199 a month
- Teams Add-on$300 a month
- Teams Add-on$300 a month
- Enterprise$2,499 a month
- Enterprise$2,499 a month
In their own words
Langfuse
Langfuse is an open-source AI engineering platform for teams debugging, analyzing, and iterating on AI agent applications. Its tracing records prompts, model responses, token use, latency, tool calls, retrieval steps, and metadata. Prompt Management stores, versions, deploys, and tests prompts, then links them to traces. Evaluation features include LLM-as-a-judge, code evaluators, user feedback, manual labeling, datasets, and experiments. Integrations include Python and JS/TS SDKs, OpenTelemetry, an API, CLI, MCP Server, and popular AI frameworks. Teams can self-host the MIT-licensed core on customer infrastructure using Docker, with options including Docker Compose, Kubernetes, AWS, and Azure. Langfuse reports annual SOC 2 Type 2 and ISO 27001 audits, external penetration tests, GDPR compliance, a DPA, and a HIPAA-ready region. Its Cloud traffic uses TLS 1.2+ and stored data uses AES-256 encryption. The free Hobby plan is free and includes 50k units per month, 30 days of data access, two users, and community support via GitHub. Core costs $29 a month, billed monthly.
Rhesis AI
Rhesis AI is an open-source collaboration layer for developing and evaluating AI agents. Domain experts, engineers, and product managers can work in a shared space to review test cases and agent versions, annotate them, and record expectations. Teams can generate test sets from application requirements or constraints, including single-turn prompts and multi-turn conversations, then run them against an application endpoint and evaluate responses using configured metrics. Results are saved in test runs. Rhesis Tracing uses OpenTelemetry to capture language-model calls, tool invocations, and retrieval operations in test or production mode. Evaluation options include offline evaluation, online trace metrics, LLM-as-a-judge, custom metrics, and adversarial red-teaming. Model providers connect through LiteLLM, including cloud and local options such as OpenAI, Anthropic, Google Gemini, Mistral, Ollama, and vLLM. Teams can use DeepEval and Ragas metrics or import Garak probes. A REST API supports test sets, runs, results, and trace inspection for integrations and CI/CD. Rhesis offers managed, Docker-local, and self-hosted use; it says it is developed in Germany and hosted in the EU. Both listed free editions cost $0.