Experimently vs Webtrends Optimize

Experimently is an open-source experimentation platform for A/B testing and feature flags that runs on infrastructure you manage. Its Free Preview costs nothing when self-hosted on your AWS account, with all features included; there is no hosted tier. The platform supports A/B and multivariate tests, sequential testing, CUPED, multi-armed bandits, Bayesian testing, split URL testing and LLM/model evaluation. Rollout controls include sticky assignment, staged rollouts, mutual-exclusion groups, a global holdout and automatic rollback based on error-rate and latency thresholds. Targeting offers more than 20 operators, while analysis includes frequentist and Bayesian methods, sequential mSPRT and segment breakdowns with Bonferroni correction. SDKs are listed for many programming languages and mobile platforms, but the maker says they are not yet on package registries; installation directions are in each guide. Deployment options include Docker Compose, Kubernetes through Helm, or an AWS CDK app for services in your AWS account. Assignment data stays on your infrastructure. Integrations include data platforms, business tools and email. The platform lists security and compliance features including role-based access control, SSO and audit logging.

Webtrends Optimize is a conversion optimisation platform for experiments, personalisation, and recommendations. It supports A/B and A/Bn tests, full and fractional factorial multivariate tests, URL split testing, personalisation, targeting, and multi-armed bandits. Implementation options include a website JavaScript tag, server-side methods, REST and JSONP APIs, and stateful URL redirects. A no-code widget builder creates hello bars, lightboxes, lower-corner promotions, and push notification signup prompts. Its recommendation engine uses browsing and sales data to serve product or content suggestions. Reporting includes views, conversions, lift, chance to beat control, and significance calculations. The feature list names analytics and behavior-tool integrations, plus Slack. Data is retained for 12 months by default, with raw event data export to CSV. Trial access lasts 30 days, requires no credit card or purchase commitment, and is unrestricted. Websites with fewer than 10,000 monthly sessions are eligible for a free account with the same features as the paid version. Other plan prices are available on request. The company was founded in 2000 and is headquartered in Egham, Surrey, United Kingdom.