AI Agents that don't break
🦚 Keep your apps up with self-healing APIs
Manifest fixes API errors in real time, so your apps, workflows and agents keep running instead of breaking on failed requests.
Get started
Manifest fixes failed API requests in real time, before they break your app. This open-source LLM gateway is a Manifest product and stays maintained.
Manifest LLM Gateway is an open-source LLM gateway for AI agents and apps. Connect your API keys, subscriptions, and local models to one OpenAI-compatible endpoint, and each query goes to the right model. No single-provider lock-in.
- 🔀 Custom Routing: API keys, Subscriptions, Local models, Custom providers
- 💾 Full Body Logs for Success and Error Messages
- 📊 Track every single dollar, setup notifications and limits
- 🚑 Fallback on different models when queries fail, Self-heals your bad requests
Go to app.manifest.build and follow the guide.
Manifest ships as a Docker image. One command:
bash <(curl -sSL https://raw.githubusercontent.com/mnfst/llm-gateway/main/docker/install.sh)Open http://localhost:2099 and sign up — the first account you create becomes the admin. Full self-hosting guide: docker/DOCKER_README.md.
| Platform | Notes |
|---|---|
| Railway | Best path. Template includes Manifest, PostgreSQL, and S3-compatible storage for request recordings. |
| Render | Blueprint includes Manifest, PostgreSQL, and a persistent recording disk. |
| DigitalOcean | App Platform and PostgreSQL; provide a private Space for recordings. |
| AWS | CloudFormation provisions ECS, RDS, and a private recording bucket. |
| GCP | DeployStack provisions Cloud Run, Cloud SQL, and Cloud Storage. |
Every deployment path now uses durable request-recording storage. Railway, AWS, GCP, and Fly.io provision it natively; Render, Coolify, Easypanel, Docker, and Apple Containers mount persistent storage. DigitalOcean, Heroku, and Koyeb collect external S3-compatible settings during setup. Volume-backed templates are single-instance; use S3-compatible storage before scaling horizontally.
Full deployment guides: Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, Koyeb, and Apple Containers.
The old npm-based self-hosting path is no longer supported. Use the Docker image or one of the deployment guides above.
Manifest connects to 300+ models through 35 built-in provider connections plus any custom OpenAI/Anthropic-compatible endpoint. Bring your own API key, reuse one of 18 subscription flows, or run models locally. Everything is routed through the same OpenAI-compatible endpoint — send "model": "auto" and Manifest picks the model.
Provider catalogs are discovered dynamically when credentials are connected. The examples below are representative, not exhaustive.
| Provider | API key / local | Subscription | Model catalog |
|---|---|---|---|
| OpenAI | ✅ | ✅ ChatGPT Plus / Pro / Team | GPT-5.6 (Sol / Terra / Luna), GPT-5.5, GPT-5.4, Codex, o-series |
| Anthropic | ✅ | ✅ Claude Max / Pro | Claude Opus 5, Sonnet 5, Fable 5, Haiku 4.5 |
| ✅ | ✅ Sign in with Google | Gemini 3.5 Flash, 3.1 Flash-Lite, Gemini 2.5 | |
| Google Vertex AI | ✅ | — | Gemini models via Vertex AI |
| Gemini Free | ✅ Managed key | — | Free Gemini models through Manifest's managed gateway |
| Meta | ✅ | — | Muse Spark 1.2 / 1.1 + Contributor route (Meta Model API) |
| xAI | ✅ | ✅ Grok subscription | Grok 4.5, Grok 4.3, Grok Build, Grok 4.20 |
| AWS Bedrock | ✅ | — | Claude, GPT, Kimi, MiniMax, Nemotron, Nova via Bedrock |
| Alibaba Cloud / Qwen | ✅ | ✅ Qwen Token Plan | Qwen 3.7 Max / Plus / Flash, DeepSeek, Kimi, GLM |
| DeepSeek | ✅ | — | DeepSeek V4 Pro, V4 Flash, V3.2, R1 |
| Mistral | ✅ | ✅ Mistral Vibe | Mistral Large, Medium 3.5, Devstral, Codestral |
| Moonshot (Kimi) | ✅ | ✅ Kimi Coding Plan | Kimi K3, K2.7 Code, Kimi for Coding |
| MiniMax | ✅ | ✅ MiniMax Coding Plan | MiniMax M3, M2.7, M2.5 |
| Xiaomi MiMo | ✅ | ✅ MiMo Token Plan | MiMo V2.5 Pro, V2.5, Flash |
| Z.ai | ✅ | ✅ GLM Coding Plan | GLM 5.2, GLM 5.1, GLM 5 Turbo |
| BytePlus | — | ✅ ModelArk Coding Plan | Ark Code, Seed Code, GLM, Kimi, DeepSeek, GPT-OSS |
| GitHub Copilot | — | ✅ Copilot subscription | Claude, GPT, Gemini, Grok via Copilot |
| Kiro | — | ✅ Kiro subscription | kiro/auto, Claude, DeepSeek, MiniMax, GLM, Qwen |
| Command Code | — | ✅ Command Code subscription | Claude, DeepSeek V4, Qwen 3.7, Gemini, Kimi |
| ClinePass | — | ✅ ClinePass subscription | cline-pass/glm-5.2, Kimi, DeepSeek, MiMo, MiniMax, Qwen |
| NousResearch | — | ✅ NousResearch subscription | NousResearch Portal model catalog |
| OpenCode Go | — | ✅ OpenCode Go | DeepSeek V4, Qwen 3.7, GLM, Kimi, MiMo |
| Ollama / Ollama Cloud | 🖥️ Local | ✅ Ollama Cloud | Local tags: Llama, Qwen, Gemma. Cloud: DeepSeek V4, GLM, Kimi |
| LM Studio | 🖥️ Local | — | Local GGUF models, port 1234 |
| llama.cpp | 🖥️ Local | — | Local GGUF models, port 8080 |
| OpenRouter | ✅ | — | 300+ models across labs |
| OpenCode Zen | ✅ | — | Curated Claude, GPT, DeepSeek, MiMo, Nemotron |
| Kilo | ✅ | — | Kilo Gateway catalog |
| Cerebras | ✅ | — | GPT-OSS, GLM, Gemma on Cerebras inference |
| Fireworks AI | ✅ | — | DeepSeek V4, Kimi K2.7, Qwen 3.7, Nemotron |
| Groq | ✅ | — | Llama 4, Qwen 3.6, GPT-OSS, Gemma |
| Hugging Face | ✅ | — | Open models through Hugging Face Inference Providers |
| NVIDIA NIM | ✅ | — | Nemotron 3, GLM, Kimi, MiniMax, Qwen |
| Pioneer | ✅ | — | OpenAI-compatible and fine-tuned Pioneer models |
| Custom | ✅ | — | Any /v1/chat/completions or /v1/messages endpoint |
- Docs
- n8n community node —
n8n-nodes-manifeston npm - Discord
- Discussions
- Contributing
- GitHub