Opik

AI Agent Observability Tools

Free planFree trialAPILinuxSelf-hostedWeb

7.5#4 of 32$19/mofirst paid tier

Overview

Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior across development, testing, and production. It captures and visualizes traces, supports annotation, and provides audit logs. Its evaluation tools include more than 30 metrics for outcomes such as answer relevance, context precision, task completion, and hallucination. In production, Opik can evaluate traces in real time, alert when criteria fail, and track token use and model costs. Test Suites offer pass/fail assertions, an Agent Playground supports end-to-end tests, and a Prompt Optimizer provides six algorithms. Core observability and evaluation features are available as open-source code for local use. Opik includes a REST API and Python client, with Python and TypeScript SDKs listed, and integrations with more than 40 frameworks, model providers, and gateways. Free Cloud allows up to 10 team members, 25,000 spans per month, and 60-day retention. Pro Cloud costs 19.00 USD per month and lists up to 50 team members and 100,000 spans monthly.

Who it is for

Opik suits teams developing applications or agents that make calls to an LLM and want tracing and evaluation across the development cycle. Its free plans are described as suitable for development and testing.

What is good

Includes more than 30 evaluation metrics.
Can evaluate production traces in real time.
Tracks token usage and model costs.
Open-source code can be run locally.
Free Cloud includes 25,000 spans monthly.

What to know first

Free Cloud is limited to 10 team members.
Free Cloud retains data for 60 days.
Pro Cloud costs 19.00 USD per month.
Enterprise pricing is custom and not listed.

Verdict

Opik covers tracing, evaluation, testing, and production monitoring, with both hosted plans and an open-source local option. Check span and retention limits against your team's workload before selecting a plan.

Opik plans and pricing

All plans

Free Cloud Free $0; Free plan Up to 10 team members · 25k spans per month · 60-day data retention comet.com · 30 Sept 2026

Open Source Free $0; Free Full AI observability and agent testing feature set · same codebase as hosted versions · self-hosted comet.com · 30 Sept 2026

Pro Cloud $19/mo $19 per month Up to 50 team members · 100k spans per month · 60-day data retention · customizable span limits and retention comet.com · 30 Sept 2026

Enterprise Not published Custom Unlimited team members · custom usage plans · flexible deployments · dedicated support and SLAs comet.com · 30 Sept 2026

Compared on AI agent observability tools

Free plan: Yescomet.com
Paid from: $19/mocomet.com

Facts

Purpose: Opik logs agent actions and provides automated evaluation workflows to find and fix errors across development, testing, and production.comet.com · 30 Sept 2026
Tracing and debugging: Opik captures and visualizes agent actions, supports trace annotation, and provides audit logs.comet.com · 30 Sept 2026
Evaluation: The product page says Opik includes more than 30 metrics for evaluating answer relevance, context precision, task completion, hallucination, and other outcomes.comet.com · 30 Sept 2026
Production monitoring: Opik can evaluate production traces in real time, alert on failed criteria, and track token usage and model costs.comet.com · 30 Sept 2026
Prompt and agent testing: Opik offers Test Suites with pass/fail assertions, an Agent Playground for end-to-end tests, and a Prompt Optimizer with six algorithms.comet.com · 30 Sept 2026
Open source: The core observability and evaluation feature set is available as open-source code that users can download and run locally.comet.com · 30 Sept 2026
Integrations: The pricing page describes integrations with more than 40 AI frameworks, model providers, and AI gateways, naming LangChain, OpenAI, Google ADK, and LangGraph as examples.comet.com · 30 Sept 2026
API and SDKs: The product includes a REST API and Python client, and the pricing page lists Python and TypeScript SDKs.comet.com · 30 Sept 2026
Free plan limits: The Free Cloud plan lists up to 10 team members, 25,000 spans per month, and 60-day data retention.comet.com · 30 Sept 2026
Pro plan limit: The Pro Cloud plan lists up to 50 team members and 100,000 spans per month, with customizable span limits and data retention periods.comet.com · 30 Sept 2026
Security and compliance: The Trust Center lists ISO 9001:2015, ISO/IEC 27001:2022, and SOC 2 Type 2 compliance for Comet.trust.comet.com · 30 Sept 2026
Enterprise security: The pricing page lists enterprise SSO and SOC 2, ISO 27001, ISO 9001, HIPAA, and GDPR compliance for the Enterprise plan.comet.com · 30 Sept 2026
Support: The pricing page lists community and self-service support across plans, email support for Pro and Enterprise, and dedicated support and SLAs for Enterprise.comet.com · 30 Sept 2026
Audience: The pricing page describes Opik as a platform for teams building applications or agents that make calls to an LLM, and says its free plans suit development and testing.comet.com · 30 Sept 2026