Skip to content
SPECIFICTION
Get listed

Deepchecks vs Opik

Deepchecks

deepchecks.com

Opik

comet.com

Side by side

FigureDeepchecksOpik
Price fromFree$19/mo
Free planYesYes
Free trialYesYes
Open sourceYesYes
WebYesYes
Windows—Yes
macOSYesYes
LinuxYesYes
APIYesYes
Self-hostedYesYes
Plans published84
Spec score · Machine Learning Model Monitoring Software8.9 (#2)8.8 (#4)
Spec score · Model Monitoring Software8.9 (#6)8.8 (#7)
Company profileLinkedIn lists Deepchecks as a privately held software-development company founded in 2019 with 11–50 employees and now within Check Point.Comet is a privately held software-development company headquartered in New York with 51–200 employees and a 2017 founding year.
EvaluationThe platform offers automated scoring, version comparison, custom and off-the-shelf properties, and golden set management.Opik supports datasets, experiments, assertions and LLM-as-a-judge metrics for issues such as hallucination, relevance and moderation.
FundingTechCrunch reported a $14 million seed round announced June 15, 2023, combining $4.4 million pre-seed and $9.5 million seed tranches.TechCrunch reported a $50 million Series B in November 2021, bringing Comet's reported total raised to almost $70 million.
HeadquartersRamat Gan, IsraelNew York City, United States
IntegrationsThe integrations page describes Deepchecks integrations with pytest, Apache Airflow, ZenML, and CML.The integration catalog covers TypeScript, Python, Java, .NET and Ruby ecosystems plus no-code tools and OpenTelemetry.
LicenseThe deepchecks and monitoring projects are AGPL 3.0, while monitoring enterprise components under the ee directory use a commercial license.The repository and full platform are released under the Apache-2.0 license.
Production monitoringProduction monitoring covers hallucinations, harmful content, quality degradation and pipeline breaks.Online evaluation rules can score incoming traces while dashboards track feedback, latency, cost and errors.
Rating on G2Deepchecks scores 4.4 out of 5 from 22 reviews.No rating; 0 reviews listed for Opik
Security and complianceDeepchecks states support for SOC 2 Type 2, GDPR, HIPAA, SSO and AWS GovCloud.Enterprise pricing lists SSO, service accounts, view-only users, flexible deployments and SOC 2, ISO 27001, ISO 9001, HIPAA and GDPR compliance.
Self-hostingThe monitoring service can be self-hosted with Docker containers and docker-compose, while SaaS users skip local service installation.Self-hosting exposes the full feature set but omits user-management features; local Docker installation is for getting started, while Kubernetes is the production deployment option.
What it doesDeepchecks provides enterprise AI testing, observability and monitoring for production AI systems and LLM applications.Opik records agent interactions, retrieval, tool calls and model responses, then evaluates and monitors them across development, testing and production.

Plans

Deepchecks

  • BasicFree
  • Open-Source MonitoringFree
  • Startup MonitoringPriced on request
  • BasicPriced on request
  • Dedicated MonitoringPriced on request
  • EnterprisePriced on request
  • Partnership MonitoringPriced on request
  • ScalePriced on request

Deepchecks pricing →

Opik

  • Free CloudFree
  • Open SourceFree
  • Pro Cloud$19 a month
  • EnterprisePriced on request

Opik pricing →

In their own words

Deepchecks

Deepchecks has no write-up on Specifiction yet; its figures are above.

Visit deepchecks.com

Opik

Opik helps teams building applications or agents that call an LLM log actions and evaluate behavior across development, testing, and production. It captures and visualizes traces, supports annotation, and provides audit logs. Its evaluation tools include more than 30 metrics for outcomes such as answer relevance, context precision, task completion, and hallucination. In production, Opik can evaluate traces in real time, alert when criteria fail, and track token use and model costs. Test Suites offer pass/fail assertions, an Agent Playground supports end-to-end tests, and a Prompt Optimizer provides six algorithms. Core observability and evaluation features are available as open-source code for local use. Opik includes a REST API and Python client, with Python and TypeScript SDKs listed, and integrations with more than 40 frameworks, model providers, and gateways. Free Cloud allows up to 10 team members, 25,000 spans per month, and 60-day retention. Pro Cloud costs $19 a month and lists up to 50 team members and 100,000 spans monthly.

Visit comet.com