Profile
Back to NewsBack
GitHub Trending 4 min
Reader Mode
mnfst/llm-gateway: Connect Your Agents And Harnesses With Any Provider 🦚

mnfst/llm-gateway: Connect Your Agents And Harnesses With Any Provider 🦚

9 hours ago

Manifest

AI Agents that don't break

!manifest-gh

Deploy on Render Deploy on Railway Deploy on AWS Deploy on GCP

GitHub stars   Docker pulls   Docker image size   CI status   Codecov   license   Discord

mnfst%2Fllm-gateway | Trendshift

Manifest is becoming the self-healing layer for APIs. We're building a new product that fixes failed API requests on the fly, independently of the gateway. The open-source gateway stays available and maintained.

What is Manifest?

Manifest is an open-source LLM gateway for AI agents and apps. Connect your API keys, subscriptions, and local models to one OpenAI-compatible endpoint, and each query goes to the right model. No single-provider lock-in.

  • 🔀 Custom Routing: API keys, Subscriptions, Local models, Custom providers
  • 💾 Full Body Logs for Success and Error Messages
  • 📊 Track every single dollar, setup notifications and limits
  • 🚑 Fallback on different models when queries fail, Self-heals your bad requests

Quick start

Cloud version

Go to gateway.manifest.build and follow the guide.

Self-hosted

Manifest ships as a Docker image. One command:

bash <(curl -sSL https://raw.githubusercontent.com/mnfst/llm-gateway/main/docker/install.sh)

Open http://localhost:2099 and sign up — the first account you create becomes the admin. Full self-hosting guide: docker/DOCKER_README.md.

Deploy with one click

| Platform | Notes | | -------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------- | | Railway | Best path. Template includes Manifest, PostgreSQL, and S3-compatible storage for request recordings. | | Render | Blueprint includes Manifest, PostgreSQL, and a persistent recording disk. | | DigitalOcean | App Platform and PostgreSQL; provide a private Space for recordings. | | AWS | CloudFormation provisions ECS, RDS, and a private recording bucket. | | GCP | DeployStack provisions Cloud Run, Cloud SQL, and Cloud Storage. |

Every deployment path now uses durable request-recording storage. Railway, AWS, GCP, and Fly.io provision it natively; Render, Coolify, Easypanel, Docker, and Apple Containers mount persistent storage. DigitalOcean, Heroku, and Koyeb collect external S3-compatible settings during setup. Volume-backed templates are single-instance; use S3-compatible storage before scaling horizontally.

Full deployment guides: Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, Koyeb, and Apple Containers.

The old npm-based self-hosting path is no longer supported. Use the Docker image or one of the deployment guides above.

Providers

Manifest connects to 300+ models through 35 built-in provider connections plus any custom OpenAI/Anthropic-compatible endpoint. Bring your own API key, reuse one of 18 subscription flows, or run models locally. Everything is routed through the same OpenAI-compatible endpoint — send "model": "auto" and Manifest picks the model.

Provider catalogs are discovered dynamically when credentials are connected. The examples below are representative, not exhaustive.

| Provider | API key / local | Subscription | Model catalog | | ---------------------------------------------------------------------------------------- | :-------------: | :--------------------------- | --------------------------------------------------------------- | | OpenAI | ✅ | ✅ ChatGPT Plus / Pro / Team | GPT-5.6 (Sol / Terra / Luna), GPT-5.5, GPT-5.4, Codex, o-series | | Anthropic | ✅ | ✅ Claude Max / Pro | Claude Opus 5, Sonnet 5, Fable 5, Haiku 4.5 | | Google | ✅ | ✅ Sign in with Google | Gemini 3.5 Flash, 3.1 Flash-Lite, Gemini 2.5 | | Google Vertex AI | ✅ | — | Gemini models via Vertex AI | | Gemini Free | ✅ Managed key | — | Free Gemini models through Manifest's managed gateway | | Meta | ✅ | — | Muse Spark 1.2 / 1.1 + Contributor route (Meta Model API) | | xAI | ✅ | ✅ Grok subscription | Grok 4.5, Grok 4.3, Grok Build, Grok 4.20 | | AWS Bedrock | ✅ | — | Claude, GPT, Kimi, MiniMax, Nemotron, Nova via Bedrock | | Alibaba Cloud / Qwen | ✅ | ✅ Qwen Token Plan | Qwen 3.7 Max / Plus / Flash, DeepSeek, Kimi, GLM | | DeepSeek | ✅ | — | DeepSeek V4 Pro, V4 Flash, V3.2, R1 | | Mistral | ✅ | ✅ Mistral Vibe | Mistral Large, Medium 3.5, Devstral, Codestral | | Moonshot (Kimi) | ✅ | ✅ Kimi Coding Plan | Kimi K3, K2.7 Code, Kimi for Coding | | MiniMax | ✅ | ✅ MiniMax Coding Plan | MiniMax M3, M2.7, M2.5 | | Xiaomi MiMo | ✅ | ✅ MiMo Token Plan | MiMo V2.5 Pro, V2.5, Flash | | Z.ai | ✅ | ✅ GLM Coding Plan | GLM 5.2, GLM 5.1, GLM 5 Turbo | | BytePlus | — | ✅ ModelArk Coding Plan | Ark Code, Seed Code, GLM, Kimi, DeepSeek, GPT-OSS | | GitHub Copilot | — | ✅ Copilot subscription | Claude, GPT, Gemini, Grok via Copilot | | Kiro | — | ✅ Kiro subscription | kiro/auto, Claude, DeepSeek, MiniMax, GLM, Qwen | | Command Code | — | ✅ Command Code subscription | Claude, DeepSeek V4, Qwen 3.7, Gemini, Kimi | | ClinePass | — | ✅ ClinePass subscription | cline-pass/glm-5.2, Kimi, DeepSeek, MiMo, MiniMax, Qwen | | NousResearch | — | ✅ NousResearch subscription | NousResearch Portal model catalog | | OpenCode Go | — | ✅ OpenCode Go | DeepSeek V4, Qwen 3.7, GLM, Kimi, MiMo | | Ollama / Ollama Cloud | 🖥️ Local | ✅ Ollama Cloud | Local tags: Llama, Qwen, Gemma. Cloud: DeepSeek V4, GLM, Kimi | | LM Studio | 🖥️ Local | — | Local GGUF models, port 1234 | | llama.cpp | 🖥️ Local | — | Local GGUF models, port 8080 | | OpenRouter | ✅ | — | 300+ models across labs | | OpenCode Zen | ✅ | — | Curated Claude, GPT, DeepSeek, MiMo, Nemotron | | Kilo | ✅ | — | Kilo Gateway catalog | | Cerebras | ✅ | — | GPT-OSS, GLM, Gemma on Cerebras inference | | Fireworks AI | ✅ | — | DeepSeek V4, Kimi K2.7, Qwen 3.7, Nemotron | | Groq | ✅ | — | Llama 4, Qwen 3.6, GPT-OSS, Gemma | | Hugging Face | ✅ | — | Open models through Hugging Face Inference Providers | | NVIDIA NIM | ✅ | — | Nemotron 3, GLM, Kimi, MiniMax, Qwen | | Pioneer | ✅ | — | OpenAI-compatible and fine-tuned Pioneer models | | Custom | ✅ | — | Any /v1/chat/completions or /v1/messages endpoint |

Quick links

License

MIT

Chat with me