Memoturn vs W&B Weave
Memoturn
memoturn.comW&B Weave
site.wandb.aiSide by side
| Figure | Memoturn | W&B Weave |
|---|---|---|
| Price from | Free | $60/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | Yes |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | Yes | Yes |
| iOS | — | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 4 |
| Spec score · Model Monitoring Software | 8.0 (#20) | 8.6 (#10) |
| Evaluations | It supports offline dataset experiments, online evaluation of sampled production traces, and human review queues. | An imperative evaluation API compares application or model changes with visualizations intended to expose regressions. |
| Integrations | The maker lists OpenTelemetry, OpenAI, Anthropic, LangChain, LiteLLM, and MCP, and its integration guide documents additional model providers, frameworks, and vector stores. | The deployment guide lists integrations for OpenAI, Anthropic, Cohere, Mistral, LangChain, LlamaIndex, DSPy, Google Gemini, Amazon Bedrock, Together and Groq. |
| SDKs and API | The maker lists TypeScript, Python, and Go SDKs, plus an OpenTelemetry receiver and a REST API. | Weave provides Python and TypeScript libraries and supports sending OpenTelemetry traces to its OTLP endpoint. |
| Tracing | It shows traces, spans, generations, and scores on a waterfall timeline, with sessions and per-user rollups. | Weave organizes traces into sessions and turns and represents steps, tools, and sub-agents as first-class concepts. |
Plans
In their own words
Memoturn
Memoturn is an open-source platform for tracing and managing applications built with large language models. It brings together trace inspection, cost and latency metrics, evaluations, prompt management, monitoring, and datasets. Traces, spans, generations, and scores appear in a waterfall timeline, with session views and per-user rollups. Teams can run offline experiments on datasets, evaluate sampled production traces, or send examples to human reviewers for scoring. The prompt registry keeps versions in production, staging, and custom channels, and can split live traffic for A/B experiments.
Memoturn accepts OpenTelemetry data and supports OTLP/JSON with GenAI semantic conventions. It lists TypeScript, Python, and Go SDKs, plus a REST API. Deployment options include local operation, Docker Compose, and Helm on Kubernetes; operators can use Apache Doris or PostgreSQL for telemetry storage. The project is licensed under Apache-2.0 and can keep telemetry on infrastructure the operator owns. The listed plan is free.
W&B Weave
W&B Weave provides observability and continuous-improvement tools for production AI agents. It structures traces as sessions and turns, with steps, tools, and sub-agents represented individually. Built-in and custom signals classify interactions, and alerts can be sent through Slack notifications or webhook automations. Its evaluation tools compare results and visualize regressions before deployment; the Playground lets teams compare models and prompting methods against production traces. Safety scorers cover toxicity, bias, personal information, and hallucinations, while quality scorers assess coherence, fluency, and context relevance. Weave works with LangChain and LlamaIndex and supports models from OpenAI, Meta, Amazon Bedrock, and Anthropic. Python and TypeScript libraries are available, as is OpenTelemetry trace submission through an OTLP endpoint. Weave runs on API, Linux, macOS, self-hosted, web, and Windows platforms. The Free plan costs nothing and includes 1 GB of monthly ingestion and 5 GB of storage. Pro costs $60 a month, with 1.5 GB of monthly ingestion; extra ingestion costs $0.10 per MB. A 30-day trial is listed.