Memoturn
memoturn.com
What it is
Memoturn is an open-source platform for tracing and managing applications built with large language models. It brings together trace inspection, cost and latency metrics, evaluations, prompt management, monitoring, and datasets. Traces, spans, generations, and scores appear in a waterfall timeline, with session views and per-user rollups. Teams can run offline experiments on datasets, evaluate sampled production traces, or send examples to human reviewers for scoring. The prompt registry keeps versions in production, staging, and custom channels, and can split live traffic for A/B experiments.
Memoturn accepts OpenTelemetry data and supports OTLP/JSON with GenAI semantic conventions. It lists TypeScript, Python, and Go SDKs, plus a REST API. Deployment options include local operation, Docker Compose, and Helm on Kubernetes; operators can use Apache Doris or PostgreSQL for telemetry storage. The project is licensed under Apache-2.0 and can keep telemetry on infrastructure the operator owns. The listed plan is free.
Spec sheet
- Product
- Memoturn is an open-source AI engineering platform for LLM tracing, evaluation, metrics, prompt management, and datasets.Read 7 Oct 2026 · memoturn.com
- Intended users
- The maker positions Memoturn for teams building LLM applications who need to debug production traffic, track spend, catch quality regressions, and manage prompts.Read 7 Oct 2026 · memoturn.com
- Deployment
- The maker documents local setup, Docker Compose deployment, and Helm on Kubernetes.Read 7 Oct 2026 · memoturn.com
- Integrations
- The maker lists OpenTelemetry, OpenAI, Anthropic, LangChain, LiteLLM, and MCP, and its integration guide documents additional model providers, frameworks, and vector stores.Read 7 Oct 2026 · docs.memoturn.com
- License
- The project is licensed under Apache-2.0.Read 4 Oct 2026 · memoturn.com
- Agent IDE support
- Its MCP server exposes prompts, datasets, and review queues to agent IDEs such as Claude Code and Cursor, locally or over Streamable HTTP.Read 4 Oct 2026 · memoturn.com
- Automations
- Alert rules and cost budgets are evaluated every minute, and event rules can send webhooks or Slack messages when scores drop or spend spikes.Read 4 Oct 2026 · memoturn.com
- Data location
- Memoturn describes itself as self-hostable and says telemetry stays on infrastructure the operator owns.Read 7 Oct 2026 · memoturn.com
- Evaluations
- It supports offline dataset experiments, online evaluation of sampled production traces, and human review queues.Read 7 Oct 2026 · memoturn.com
- Metrics and alerts
- Dashboards report cost, tokens, and latency, while alert rules and cost budgets can trigger Slack messages or webhooks.Read 7 Oct 2026 · memoturn.com
- Notable integration limit
- The integration guide marks first-party wrappers for some integrations as TypeScript-only or Python-only, while Go coverage includes OTel export helpers and manual tracing.Read 7 Oct 2026 · docs.memoturn.com
- Prompt management
- Its versioned prompt registry supports deployment channels and A/B experiments that compare versions by score.Read 7 Oct 2026 · memoturn.com
- SDKs
- The product lists TypeScript, Python, and Go SDKs.Read 4 Oct 2026 · memoturn.com
- SDKs and API
- The maker lists TypeScript, Python, and Go SDKs, plus an OpenTelemetry receiver and a REST API.Read 7 Oct 2026 · memoturn.com
- Security controls
- The Apache-2.0 core includes OIDC and SAML SSO, organization roles, audit logs, PII masking at ingest, retention policies, and scheduled NDJSON exports.Read 7 Oct 2026 · memoturn.com
- Self-hosting
- Memoturn says it is self-hostable and that telemetry stays on infrastructure the user owns.Read 4 Oct 2026 · memoturn.com
- Storage options
- The deployment guide supports Apache Doris or PostgreSQL as the telemetry engine, with PostgreSQL described for smaller installs.Read 7 Oct 2026 · docs.memoturn.com
- Telemetry
- Memoturn accepts OpenTelemetry data and supports OTLP/JSON with GenAI semantic conventions.Read 4 Oct 2026 · memoturn.com
- Tracing
- It shows traces, spans, generations, and scores on a waterfall timeline, with sessions and per-user rollups.Read 7 Oct 2026 · memoturn.com
Plans and prices
Strong points and limits
Strong points
- Trace timeline includes sessions and per-user rollups.
- Supports offline and production-trace evaluations.
- Versioned prompts include traffic-splitting experiments.
- Includes OIDC and SAML SSO, audit logs, and PII masking.
- Runs locally, with Docker Compose, or on Kubernetes.
Limits
- Some first-party wrappers are TypeScript-only or Python-only.
- PostgreSQL is described for smaller installs.
Who it suits
It suits teams building LLM applications that need to debug production traffic, track spending, monitor quality, and manage prompts. Self-hosting and data-location controls may suit operators who want telemetry kept on infrastructure they own.
Verdict
Memoturn combines LLM tracing, evaluation, prompt workflows, and cost monitoring in a self-hostable, Apache-2.0 project. Teams should check integration language coverage, since some wrappers are limited to TypeScript or Python.
Where Specifiction places it
- Model Monitoring Software#20 of 248.0