All 145 Dependencies
Every package LLM Gateway depends on, ranked by repo health score.
LLM Gateway is an open-source API gateway that gives developers and enterprises a single OpenAI-compatible endpoint for every major language model provider — OpenAI, Anthropic, Google Vertex AI, AWS Bedrock, Azure, DeepSeek, Mistral, and dozens more. Instead of maintaining separate integrations and API key sets for each vendor, you point your existing SDK at LLM Gateway and let it handle provider selection, failover, and cost tracking centrally.
At its core, the gateway is a Hono-based proxy that authenticates requests against your stored API keys, resolves which provider and model to use, translates the OpenAI-compatible payload to the target provider's format, streams the response back, and asynchronously logs cost and performance data. A background worker persists logs to PostgreSQL, keeping the hot path latency minimal. Redis caches frequently-read configuration (routing rules, key health state, organization settings) so most requests never hit the database.
The routing layer goes beyond simple round-robin. The gateway tracks a sliding-window health score per API key, permanently blacklists keys that return authentication errors, and uses configurable weights — uptime, latency, cost — to pick the best available provider for each request. Enterprise teams can define per-project routing configurations with custom weights and thresholds, compliance policies that restrict routing to specific geographic regions, and guardrails that evaluate every request against a rule engine before it ever reaches an LLM provider.
The platform ships with a Next.js dashboard for usage analytics, a live chat playground supporting text, image generation, and reasoning models, a dedicated admin interface, and a documentation site. It can be self-hosted as a single unified Docker container or as separate services via Docker Compose, and also supports Helm chart deployment to Kubernetes for teams that need production-grade orchestration.
