All 121 Dependencies

Every package LiteLLM depends on, ranked by repo health score.

LiteLLM is an open source AI gateway and Python SDK from BerriAI (Y Combinator S23) that gives engineering teams a single, OpenAI-compatible interface for calling more than 100 LLM providers, including OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Cohere, Hugging Face, and self-hosted models served through Ollama or vLLM. Instead of writing provider-specific integration code for every model a team wants to use, developers call `litellm.completion()` in Python, or POST to a `/chat/completions`-style endpoint, and LiteLLM handles the translation, so switching providers becomes a config change instead of a rewrite.

The project ships two ways to use it. The Python SDK embeds directly in application code and adds a Router with retry and fallback logic, load balancing across multiple deployments of the same model (for example several Azure regions), and cost tracking. The AI Gateway is a standalone FastAPI proxy server meant to run as shared infrastructure for a whole organization: it adds authentication, per-project and per-user virtual keys, budgets and spend tracking backed by PostgreSQL and Redis, and an admin dashboard UI, so a platform team can hand out scoped LLM access to internal teams without every team managing its own provider credentials.

Beyond routing requests, LiteLLM bundles a guardrails framework for content moderation, PII detection, and prompt-injection checks; more than 80 logging and observability integrations covering tools like Langfuse, Datadog, Arize, and MLflow; semantic and exact-match response caching backed by Redis, Qdrant, or S3; and gateways for newer agent protocols including MCP (Model Context Protocol) and A2A (Agent-to-Agent). A growing Rust core (`litellm-rust`, exposed via a PyO3 bridge) is being phased in underneath the Python proxy for latency-sensitive request transforms, while auth, routing, and callbacks stay in Python.

Because it is self-hosted, LiteLLM sits opposite hosted LLM routing services like OpenRouter: teams get the same "one API for many models" convenience but keep credentials, logs, and spend data inside their own infrastructure, at the cost of running and operating the proxy themselves.

29 identity-obj-proxy 3.0.0 38 python-diskcache >=5.6.3,<6.0 40 react-json-view-lite 2.5.0 40 remark-gfm 4.0.1 42 fastuuid >=0.14.0,<1.0 42 tw-animate-css 1.4.0 43 react-copy-to-clipboard 5.1.1 45 uuid v1.6.0 48 Tailwind CSS Forms 0.5.11 49 Ant Design CSS-in-JS 1.24.0 outdated 49 prism-react-renderer 2.4.1 49 prisma-client-py >=0.11.0,<1.0 50 Google Generative AI JavaScript SDK 0.24.1 50 Tremor React 3.18.7 50 heroicons 1.0.6 outdated 53 Jinja >=3.1.6,<4.0 54 Headless UI 0.2.2 outdated 55 rich >=13.9.4,<14.0 outdated 58 jest-dom 6.8.0 outdated 59 jwt-decode 4.0.0 60 PyYAML >=6.0.3,<7.0 60 React Testing Library 14.3.1 outdated 62 @ant-design/icons 5.6.1 outdated 62 React Syntax Highlighter 15.6.6 outdated 63 DOM Testing Library 10.4.1 outdated 63 HTTPX >=0.27.0 63 react-markdown 9.1.0 outdated 64 imageio-ffmpeg >=0.4.9 64 tiktoken >=0.8.0,<1.0 67 PyNaCl >=1.6.2,<2.0 67 eslint-config-prettier 10.1.8 68 prisma-cli 5.17.0 outdated 69 python-soundfile >=0.12.1,<1.0 70 orjson >=3.11.6,<4.0 72 user-event 14.6.1 outdated 72 uuid 14.0.0 outdated 74 openapi-typescript ^0.17.0 outdated 74 openapi-typescript ^0.5.4 outdated 74 openapi-typescript 7.13.0 74 python-dotenv >=1.0.0,<2.0 77 Requests >=2.32.0,<3.0 78 TanStack Pacer 0.22.1 outdated 79 PapaParse 5.5.3 outdated 79 python-multipart >=0.0.27,<1.0 80 APScheduler >=3.11.2,<4.0 80 Day.js 1.11.19 outdated 80 date-fns ^4.4.0 84 Gunicorn >=23.0.0,<24.0 outdated 84 Resend Python SDK >=2.23.0,<3.0 84 Vertex AI SDK for Node.js 1.12.0 84 cryptography >=48.0.1,<49.0 outdated 85 Moment.js 2.30.1 outdated 85 futures 0.3 85 prometheus-client >=0.20.0,<1.0 87 Granian >=2.7.4,<3.0 87 PyJWT >=2.13.0,<3.0 88 Base UI ^1.6.0 outdated 88 tailwind-merge 3.4.0 outdated 89 Click >=8.0.0,<9.0 89 python-sdk >=1.28.1,<2.0 outdated 90 Recharts 3.9.2 outdated 90 Uvicorn >=0.33.0,<1.0 90 jsdom 27.4.0 outdated 90 jsonschema >=4.0.0,<5.0 90 pydantic-settings >=2.14.1,<3.0 90 websockets >=15.0.1 91 Tailwind CSS 4.3.2 outdated 91 Tailwind CSS 4.3.2 outdated 91 boto3 >=1.43.1,<2.0 91 importlib_metadata >=8.0.0,<9.0 outdated 91 prettier 3.2.5 outdated 92 FastAPI >=0.136.3,<1.0 92 Pillow >=10.0.0 92 Playwright 1.58.1 outdated 92 Polars >=1.38.1,<2.0 outdated 92 RQ >=2.7.0,<3.0 92 TanStack Query 5.100.7 outdated 92 TanStack Table 8.21.3 outdated 92 lucide-react 0.513.0 outdated 92 postcss 8.5.13 outdated 93 Anthropic TypeScript SDK 0.92.0 outdated 93 LiteLLM ==1.83.14 outdated 93 Pydantic >=2.10.0,<3.0.0 93 Starlette >=1.0.1,<2.0 93 Vitest 3.2.6 outdated 93 Vitest 3.2.6 outdated 93 agents >=1.3.12 93 dd-trace-py >=4.8.2,<5.0 94 Ant Design 5.29.1 outdated 94 Google Gen AI Python SDK >=1.37.0,<2.0 outdated 94 OpenTelemetry Prometheus Exporter ==1.28.0 outdated 94 OpenTelemetry Prometheus Exporter ==1.28.0 outdated 94 OpenTelemetry Python SDK ==1.28.0 outdated 94 jest 29.7.0 outdated 94 jest 29.7.0 outdated 94 typescript-eslint 8.60.1 outdated 95 Anthropic Python SDK >=0.84.0,<1.0 outdated 95 ESLint 9.39.2 outdated 95 ESLint 9.39.2 outdated 95 OpenAI 4.104.0 outdated 95 TypeScript 5.9.3 outdated 95 aiohttp >=3.10,<4.0 95 pypdf >=6.12.0,<7.0 outdated 96 MLflow >=3.11.1,<4.0 96 Next.js 16.2.6 outdated 96 Next.js 16.2.6 outdated 96 NumPy >=1.26.0 96 Tokenizers >=0.21.0,<1.0 96 sentry-sdk >=2.21.0,<3.0 97 OpenAI Python SDK >=2.20.0,<3.0.0 outdated 97 OpenTelemetry Instrumentation for kafka-python ==0.49b0 outdated 97 google-cloud-aiplatform >=1.133.0,<2.0 outdated 98 Azure Container Service Management (Python) >=4.10.0,<5.0 outdated 98 Azure Container Service Management (Python) >=12.20.0,<13.0 outdated 98 Azure Identity (Python) >=1.25.2,<2.0 98 Azure Storage Blob >=12.28.0,<13.0 98 React 18.3.1 outdated 98 React DOM 18.3.1 outdated 98 gRPC Python (grpcio) ==1.78.0 outdated 98 google-auth >=2.19.1,<3.0 98 google-auth >=2.24.2,<3.0

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers