New
Bifrost
Updated 2026-07-28
1 / 2
Embeds
Add interesting embeds to your website or README.
License
LightDark
<a href="https://embedcatalog.com/projects/bifrost" target="_blank" rel="noreferrer noopener"><img src="https://embedcatalog.com/embed/bifrost/license.png" alt="Bifrost on EmbedCatalog" style="width: 160px; height: 28px;" width="160" height="28" /></a>Added to
LightDark
<a href="https://embedcatalog.com/projects/bifrost" target="_blank" rel="noreferrer noopener"><img src="https://embedcatalog.com/embed/bifrost/added.png" alt="Bifrost on EmbedCatalog" style="width: 200px; height: 28px;" width="200" height="28" /></a>PremiumOrganization
LightDark
<a href="https://embedcatalog.com/projects/bifrost" target="_blank" rel="noreferrer noopener"><img src="https://embedcatalog.com/embed/bifrost/organization.png" alt="Bifrost on EmbedCatalog" style="width: 200px; height: 48px;" width="200" height="48" /></a>Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
To be honest, I can describe the project simply and quickly. If you want a powerful LLM Gateway for your project, and at the same time deploy it in a user-friendly interface without setting up a bunch of configs and other things, then this project is for you.
To set up a project, just enter a command in the terminal and wait 5 seconds:
npx -y @maximhq/bifrost
Key advantages
- 40x lower overhead than another gateways (12µs vs 440µs)
- 68% less memory usage
- 100% success rate at 5,000 RPS
- Code Mode - Models generate orchestration code instead of step-by-step calls
- Semantic caching - 40-60% cost reduction on similar queries
- Built-in control - RBAC, rate limiting, cost tracking, audit logs
Tags
ai-gatewayllmopenaiload-balancingmcpgo