NannyML vs Qualdo-MQX
NannyML
nannyml.comQualdo-MQX
qualdo.aiSide by side
| Figure | NannyML | Qualdo-MQX |
|---|---|---|
| Price from | $99/mo | $79/mo |
| Free plan | Yes | — |
| Free trial | Yes | Yes |
| Open source | Yes | — |
| Web | Yes | Yes |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 7 | 3 |
| Spec score · Model Monitoring Software | 8.7 (#8) | 7.7 (#23) |
| Founded | Belgian company records state that NannyML was established on 19 March 2020. | 2017 |
| Integrations | NannyML Cloud is offered through both Azure Marketplace and AWS Marketplace. | The product page says it integrates with AI, machine-learning, and notification tools but does not name them there. |
| Purpose | NannyML monitors deployed machine-learning models and estimates model performance even when ground truth is delayed or absent. | Qualdo-MQX monitors ML model performance, model errors, and data quality issues. |
| Security | For its Azure managed application, NannyML documents TLS-encrypted traffic, Azure-managed disks encrypted by default, and support-team access only after customer approval. | The product page says Qualdo's infrastructure systems and personnel follow multiple security best practices. |
| Support | The pricing page lists email support for Starter, private Slack for Scale, and 24/7 support for Enterprise. | Starter lists email and chat support, while Professional lists email, chat, and phone support. |
Plans
NannyML
- Open SourceFree
- Starter (beta)$99 a month
- Starter$399 a month
- Scale$999 a month
- Pro (beta)$3,800 a month
- EnterprisePriced on request
- Enterprise (beta)Priced on request
In their own words
NannyML
NannyML monitors deployed machine-learning models and estimates their performance when ground truth is delayed or unavailable. It detects concept drift as well as multivariate and univariate data drift, and connects alerts to changes in model performance. Data-quality checks and ranked drift alerts can help teams investigate features associated with performance issues. Users can relate model performance to monetary or other business outcomes. NannyML Cloud supports webhooks for retraining actions and an SDK for automating monitoring-data ingestion. Cloud is available through Azure and AWS marketplaces as SaaS or a managed application. With the managed-application option, the application and required infrastructure are provisioned within the customer's cloud subscription. For its Azure managed application, NannyML documents encrypted traffic and disks, but says automated backups were still being implemented and advises customers to safeguard model inputs and outputs elsewhere. The open-source library installs with pip or conda. Direct local dataset uploads through the Cloud UI must be smaller than 100 MB. Plans include a free self-managed Open Source option, Starter at $399 a month, and Scale at $999 a month.
Qualdo-MQX
Qualdo-MQX monitors machine-learning models for performance changes, errors, and data quality issues after deployment. It tracks feature drift and declines in accuracy or response, with metrics, alerts, notifications, and visualizations. Supported model types include classification, regression, clustering, and recommendations. Most model types require training, serving, prediction, and response datasets as inputs; clustering monitoring needs only a serving dataset. Qualdo-MQX is available for Azure, AWS, and Google Cloud ecosystems, with SaaS and Enterprise deployment options. Listed databases and warehouses include MySQL, SQL Server, PostgreSQL, Snowflake, BigQuery, Azure Data Lake, and Amazon Redshift. Qualdo says the product does not store user data. The Free plan covers up to 10 GB and two models. Starter costs $79 a month for up to 100 GB and 10 models; Professional costs $295 a month for up to 750 GB and 40 models. The pricing note separately lists paid plans from $88/mo. Qualdo was created by Saturam Inc.; the maker says Saturam began in 2017 and Qualdo launched in 2019.