Deepchecks vs NannyML
Deepchecks
deepchecks.com
NannyML
nannyml.comSide by side
| Figure | Deepchecks | NannyML |
|---|---|---|
| Price from | Free | $99/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | Yes |
| Open source | Yes | Yes |
| Web | Yes | Yes |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 8 | 7 |
| Spec score · Machine Learning Model Monitoring Software | 8.9 (#2) | 8.8 (#3) |
| Spec score · Model Monitoring Software | 8.9 (#6) | 8.7 (#8) |
| Data locality | For its AWS-managed deployment, the site says in-app data and artifacts do not leave the environment perimeter. | For the managed-application deployment, NannyML says the application and required infrastructure are provisioned within the customer's Azure or AWS subscription. |
| Funding | TechCrunch reported a $14 million seed round announced June 15, 2023, combining $4.4 million pre-seed and $9.5 million seed tranches. | An October 2024 European Innovation Council list names NannyML NV's EU-AURA project for blended finance funding consideration. |
| Installation | The testing library installs with pip or conda and offers NLP and vision extras. | The open-source library can be installed with pip, Conda, Docker or directly from the Git repository. |
| Integrations | The integrations page describes Deepchecks integrations with pytest, Apache Airflow, ZenML, and CML. | NannyML Cloud is offered through both Azure Marketplace and AWS Marketplace. |
| Rating on G2 | Deepchecks scores 4.4 out of 5 from 22 reviews. | No public NannyML rating; 0 reviews listed |
| Security | The site lists SOC 2 Type 2, GDPR, HIPAA compliance, single sign-on, and AWS GovCloud support. | For its Azure managed application, NannyML documents TLS-encrypted traffic, Azure-managed disks encrypted by default, and support-team access only after customer approval. |
| What it does | Deepchecks provides enterprise AI testing, observability and monitoring for production AI systems and LLM applications. | NannyML monitors production machine-learning models, estimates performance when labels are delayed or absent, detects drift and links alerts to performance changes. |
Plans
Deepchecks
- BasicFree
- Open-Source MonitoringFree
- Startup MonitoringPriced on request
- BasicPriced on request
- Dedicated MonitoringPriced on request
- EnterprisePriced on request
- Partnership MonitoringPriced on request
- ScalePriced on request
NannyML
- Open SourceFree
- Starter (beta)$99 a month
- Starter$399 a month
- Scale$999 a month
- Pro (beta)$3,800 a month
- EnterprisePriced on request
- Enterprise (beta)Priced on request
In their own words
Deepchecks
Deepchecks has no write-up on Specifiction yet; its figures are above.
NannyML
NannyML monitors deployed machine-learning models and estimates their performance when ground truth is delayed or unavailable. It detects concept drift as well as multivariate and univariate data drift, and connects alerts to changes in model performance. Data-quality checks and ranked drift alerts can help teams investigate features associated with performance issues. Users can relate model performance to monetary or other business outcomes. NannyML Cloud supports webhooks for retraining actions and an SDK for automating monitoring-data ingestion. Cloud is available through Azure and AWS marketplaces as SaaS or a managed application. With the managed-application option, the application and required infrastructure are provisioned within the customer's cloud subscription. For its Azure managed application, NannyML documents encrypted traffic and disks, but says automated backups were still being implemented and advises customers to safeguard model inputs and outputs elsewhere. The open-source library installs with pip or conda. Direct local dataset uploads through the Cloud UI must be smaller than 100 MB. Plans include a free self-managed Open Source option, Starter at $399 a month, and Scale at $999 a month.