Experimently vs Segmently
Experimently
getexperimently.comSegmently
segmently.usSide by side
| Figure | Experimently | Segmently |
|---|---|---|
| Price from | Free | $49/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | Yes | — |
| Web | Yes | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| iOS | Yes | — |
| Android | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 2 | 4 |
| Spec score · A/B Testing Tools | 8.7 (#9) | 7.6 (#33) |
| Integrations | The documentation lists connections for Snowflake, BigQuery, Redshift, Databricks, ClickHouse, MySQL, Jira, Salesforce, GitHub, Slack, and email. | Slack notifications are available on Professional and higher; GA4 and Mixpanel sync are listed for Business and higher, while outbound webhooks require Enterprise. |
| Product | Experimently is an open-source experimentation platform for A/B testing and feature flags that runs on your own infrastructure. | Segmently provides A/B testing and personalization for websites, targeting visitors by device, geography, behavior, and user attributes. |
| Support | The maker lists [email protected] as its contact email. | The pricing page lists documentation and a contact form for Free, email support for Professional, live chat and priority email for Business, and a dedicated account manager with live chat for Enterprise. |
Plans
Segmently
- FreeFree
- Professional$49 a month
- Business$149 a month
- Enterprise$1,499 a month
In their own words
Experimently
Experimently is an open-source experimentation platform for A/B testing and feature flags that runs on infrastructure you manage. Its Free Preview costs nothing when self-hosted on your AWS account, with all features included; there is no hosted tier. The platform supports A/B and multivariate tests, sequential testing, CUPED, multi-armed bandits, Bayesian testing, split URL testing and LLM/model evaluation. Rollout controls include sticky assignment, staged rollouts, mutual-exclusion groups, a global holdout and automatic rollback based on error-rate and latency thresholds. Targeting offers more than 20 operators, while analysis includes frequentist and Bayesian methods, sequential mSPRT and segment breakdowns with Bonferroni correction. SDKs are listed for many programming languages and mobile platforms, but the maker says they are not yet on package registries; installation directions are in each guide. Deployment options include Docker Compose, Kubernetes through Helm, or an AWS CDK app for services in your AWS account. Assignment data stays on your infrastructure. Integrations include data platforms, business tools and email. The platform lists security and compliance features including role-based access control, SSO and audit logging.