Experimently vs Featureflip

Experimently is an open-source experimentation platform for A/B testing and feature flags that runs on infrastructure you manage. Its Free Preview costs nothing when self-hosted on your AWS account, with all features included; there is no hosted tier. The platform supports A/B and multivariate tests, sequential testing, CUPED, multi-armed bandits, Bayesian testing, split URL testing and LLM/model evaluation. Rollout controls include sticky assignment, staged rollouts, mutual-exclusion groups, a global holdout and automatic rollback based on error-rate and latency thresholds. Targeting offers more than 20 operators, while analysis includes frequentist and Bayesian methods, sequential mSPRT and segment breakdowns with Bonferroni correction. SDKs are listed for many programming languages and mobile platforms, but the maker says they are not yet on package registries; installation directions are in each guide. Deployment options include Docker Compose, Kubernetes through Helm, or an AWS CDK app for services in your AWS account. Assignment data stays on your infrastructure. Integrations include data platforms, business tools and email. The platform lists security and compliance features including role-based access control, SSO and audit logging.

Featureflip provides feature flags for changing functionality in a running application without deploying new code. It supports percentage rollouts, targeting rules, kill switches, A/B tests, and isolated environments. When a flag is no longer needed, its GitHub Action can open a reviewable pull request to remove the code path across thirteen languages and archive the flag after merge. Teams can manage flags through a REST Management API or evaluate them through the Evaluation API; thirteen SDKs and OpenFeature providers are listed. Server SDKs evaluate locally from in-memory configuration and keep using the last configuration if the service is unreachable. Featureflip also offers an MCP server for Claude Code, Cursor, Copilot, and Cline, plus a Terraform provider. Its service and PostgreSQL database run on Hetzner Cloud in the European Union. The Free plan is free and is limited to one project, 10 flags per project, two environments, and up to three team members. Team is $49 a month; Pro is $99 a month; Business is $249 a month. Enterprise pricing is negotiated directly.