Manifest
manifest.build
What it is
Manifest is an open-source LLM gateway for routing model requests, switching providers, repairing certain failures, and tracking inference spending. It provides one endpoint compatible with OpenAI and Anthropic models and subscriptions. When a provider goes down, fallback routing retries through another provider. Autofix repairs malformed requests and resends them when retries alone cannot resolve the error. Observability shows spending by harness, which models handled requests, and what failed. Manifest connects API keys, paid subscriptions, local models, and custom endpoints, including Ollama, llama.cpp, and LM Studio. The self-hosted gateway runs with Docker, works offline, requires no account, and supports amd64 and arm64. Self-hosted routing and request data remain on customer servers except documented telemetry and Autofix flows. The Cloud Free plan allows 10,000 routed requests per calendar month and cannot reach local models on the user's machine. Free includes unlimited self-hosted use; Pro costs $19 a month with unlimited Cloud requests and 365-day dashboard retention.
Spec sheet
- What it does
- Manifest is an open-source LLM gateway that routes AI-agent requests across providers, applies fallbacks, repairs failed requests and tracks inference costs.Read 15 Oct 2026 · manifest.build
- Product
- Manifest is an open-source LLM gateway that routes requests, provides fallbacks, repairs failing requests with Autofix, and tracks spending.Read 1 Oct 2026 · manifest.build
- Audience
- Manifest says its gateway helps AI builders, teams and startups, and platforms or providers create reliable agents and workflows and manage inference consumption.Read 1 Oct 2026 · manifest.build
- Integrations
- Manifest connects API keys, paid subscriptions, local models, and custom endpoints; named local integrations include Ollama, llama.cpp, and LM Studio.Read 1 Oct 2026 · manifest.build
- Security
- Manifest states that data in transit uses TLS, passwords are hashed, and Gateway provider credentials are encrypted with AES-256-GCM.Read 1 Oct 2026 · manifest.build
- Compliance
- The Enterprise plan lists HIPAA and custom BAAs, SSO/SAML, audit logs, custom retention, and a contractual uptime SLA.Read 1 Oct 2026 · manifest.build
- Support
- Free includes community support through Discord, Pro includes basic platform and billing support, and Enterprise includes dedicated Slack and email support.Read 1 Oct 2026 · manifest.build
- API example
- The documented chat endpoint is POST /v1/chat/completions with a harness key beginning mnfst_.Read 15 Oct 2026 · manifest.build
- Autofix
- Autofix repairs malformed provider requests and resends them before the agent receives an error.Read 15 Oct 2026 · manifest.build
- Bring-your-own keys
- Users can connect their own provider API keys and OAuth-backed subscriptions and pay providers directly.Read 15 Oct 2026 · manifest.build
- CLI
- The documentation says the CLI can create harnesses, connect providers, configure routing and read request logs.Read 15 Oct 2026 · manifest.build
- Cloud limit
- The Cloud Free plan includes 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.Read 1 Oct 2026 · manifest.build
- Cloud limitation
- The free Cloud plan is limited to 10,000 routed requests per calendar month and cannot reach local models running on the user's machine.Read 15 Oct 2026 · manifest.build
- Community integration
- A GitHub issue author called the self-hosted router clean and effective for request-complexity routing and failover, including self-hosted models.Read 15 Oct 2026 · github.com
- Company headquarters
- LinkedIn lists Berkeley, California as Manifest's headquarters.Read 15 Oct 2026 · linkedin.com
- Company size
- LinkedIn lists Manifest as a 2–10 employee software-development company.Read 15 Oct 2026 · linkedin.com
- Data residency
- For the self-hosted version, routing and request data stay on the customer's servers except for documented telemetry and Autofix flows.Read 1 Oct 2026 · manifest.build
- Deployment options
- Repository deployment guides cover Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, Koyeb and Apple Containers.Read 15 Oct 2026 · github.com
- Documentation depth
- The documentation includes installation, first-request examples, provider setup, environment variables, CLI guidance and deployment paths.Read 15 Oct 2026 · manifest.build
- Enterprise compliance
- Enterprise pricing lists SSO/SAML, audit logs, contractual uptime SLAs, HIPAA and custom business associate agreements.Read 15 Oct 2026 · manifest.build
- Fallbacks
- Manifest automatically retries another provider when a selected provider fails.Read 15 Oct 2026 · manifest.build
- Founded year
- LinkedIn lists Manifest as founded in 2025.Read 15 Oct 2026 · linkedin.com
- Independent praise: fallbacks
- The same reviewer reported that automatic fallbacks kept an agent working during a provider outage.Read 15 Oct 2026 · andrew.ooo
- Independent praise: routing
- An independent reviewer praised the transparent scoring, subscription routing, MIT licence and open dashboard after moving a personal agent stack to Manifest.Read 15 Oct 2026 · andrew.ooo
- Licence
- The repository publishes the software under the MIT licence.Read 15 Oct 2026 · github.com
- Limit: beta maturity
- An independent review describes Manifest as beta software with breaking changes and recommends pinning Docker tags.Read 15 Oct 2026 · andrew.ooo
- Limit: database requirement
- The review reports that PostgreSQL is required and SQLite support was not yet shipped.Read 15 Oct 2026 · andrew.ooo
- Limit: fallback tools
- The review warns that a fallback model lacking the primary model's tool-schema support can fail tool-calling requests.Read 15 Oct 2026 · andrew.ooo
- Limit: no request cache
- The review reports that repeated identical prompts are billed again because semantic request caching is absent.Read 15 Oct 2026 · andrew.ooo
- Limit: routing accuracy
- The reviewer observed that default complexity classification can send short but difficult prompts to an overly simple model.Read 15 Oct 2026 · andrew.ooo
- Limit: single point of failure
- The review states that if a Manifest instance goes down, agents fail unless operators configure direct-provider fallback or redundant instances.Read 15 Oct 2026 · andrew.ooo
- Limit: subscription authentication
- The review says some subscription connections rely on browser-session authentication that may require reauthentication after cookie or MFA changes.Read 15 Oct 2026 · andrew.ooo
- Local models
- Self-hosted Manifest can route to Ollama, LM Studio and llama.cpp or another local server.Read 15 Oct 2026 · manifest.build
- Maker team
- The About page names Bruno Perez and Sébastien Conejo as co-founders.Read 15 Oct 2026 · manifest.build
- Model routing
- Sending model auto applies routing rules, fallback behavior and per-harness spending limits.Read 15 Oct 2026 · manifest.build
- Notable news
- Axios reported on May 18, 2023 that the separate Manifest Cyber startup raised a $6 million seed round and announced DHS and Air Force contracts.Read 15 Oct 2026 · axios.com
- Observability
- Usage views show spending, selected models, token consumption and failed requests for each harness.Read 15 Oct 2026 · manifest.build
- Provider coverage
- The public repository lists 35 built-in provider connections, 18 subscription flows, 300-plus models and custom OpenAI- or Anthropic-compatible endpoints.Read 15 Oct 2026 · github.com
- Request logs
- The dashboard records and displays complete provider request and response bodies.Read 15 Oct 2026 · manifest.build
- Retention
- Cloud request recordings are retained for 7 days on Free and 365 days on Pro.Read 1 Oct 2026 · manifest.build
- Routing API
- The gateway provides one OpenAI- and Anthropic-compatible endpoint for models and subscriptions.Read 1 Oct 2026 · manifest.build
- SDK compatibility
- Because the API is OpenAI-compatible, existing OpenAI-style SDKs and agents can point at Manifest by changing the base URL.Read 15 Oct 2026 · manifest.build
- Security practice
- Published Docker images are signed with keyless Sigstore cosign signing and the self-hosting guide gives a verification command.Read 15 Oct 2026 · manifest.build
- Self-hosting
- Docker installation runs the full gateway stack locally without requiring Node.js and starts a dashboard on port 2099.Read 15 Oct 2026 · manifest.build
- Unified endpoint
- The gateway exposes OpenAI- and Anthropic-compatible endpoints so clients can use one URL for multiple models and subscriptions.Read 15 Oct 2026 · manifest.build
Plans and prices
Strong points and limits
Strong points
- OpenAI- and Anthropic-compatible endpoint
- Fallback routing across providers
- Autofix repairs malformed requests
- Docker self-hosting works offline
- Usage and spending analytics
Limits
- Cloud Free limits 10,000 monthly requests
- Cloud Free cannot reach local models
- Pro costs $19 a month
Who it suits
Manifest suits AI builders, teams, startups, and platforms managing model access and inference consumption. Self-hosting fits users needing offline operation or server-side data retention.
Verdict
Manifest combines provider routing, request repair, local-model connections, and spending visibility. Its free self-hosted option is broad, while Cloud limits and plan differences matter for hosted use.
Where Specifiction places it
- LLM gateways#1 of 339.4
- LLM Gateway Software#4 of 349.0