All 122 Dependencies

Every package LiteLLM depends on, ranked by repo health score.

LiteLLM is an open source AI gateway and Python SDK from BerriAI (Y Combinator S23) that gives engineering teams a single, OpenAI-compatible interface for calling more than 100 LLM providers, including OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Cohere, Hugging Face, and self-hosted models served through Ollama or vLLM. Instead of writing provider-specific integration code for every model a team wants to use, developers call `litellm.completion()` in Python, or POST to a `/chat/completions`-style endpoint, and LiteLLM handles the translation, so switching providers becomes a config change instead of a rewrite.

The project ships two ways to use it. The Python SDK embeds directly in application code and adds a Router with retry and fallback logic, load balancing across multiple deployments of the same model (for example several Azure regions), and cost tracking. The AI Gateway is a standalone FastAPI proxy server meant to run as shared infrastructure for a whole organization: it adds authentication, per-project and per-user virtual keys, budgets and spend tracking backed by PostgreSQL and Redis, and an admin dashboard UI, so a platform team can hand out scoped LLM access to internal teams without every team managing its own provider credentials.

Beyond routing requests, LiteLLM bundles a guardrails framework for content moderation, PII detection, and prompt-injection checks; more than 80 logging and observability integrations covering tools like Langfuse, Datadog, Arize, and MLflow; semantic and exact-match response caching backed by Redis, Qdrant, or S3; and gateways for newer agent protocols including MCP (Model Context Protocol) and A2A (Agent-to-Agent). A growing Rust core (`litellm-rust`, exposed via a PyO3 bridge) is being phased in underneath the Python proxy for latency-sensitive request transforms, while auth, routing, and callbacks stay in Python.

Because it is self-hosted, LiteLLM sits opposite hosted LLM routing services like OpenRouter: teams get the same "one API for many models" convenience but keep credentials, logs, and spend data inside their own infrastructure, at the cost of running and operating the proxy themselves.

29 identity-obj-proxy 3.0.0 38 python-diskcache >=5.6.3,<6.0 40 remark-gfm 4.0.1 41 imageio-ffmpeg >=0.4.9 41 react-json-view-lite 2.5.0 42 fastuuid >=0.14.0,<1.0 42 tw-animate-css 1.4.0 44 backoff >=2.2.1,<3.0 44 react-copy-to-clipboard 5.1.1 45 uuid v1.6.0 49 Tailwind CSS Forms 0.5.11 49 prism-react-renderer 2.4.1 49 prisma-client-py >=0.11.0,<1.0 50 Ant Design CSS-in-JS 1.24.0 outdated 50 Google Generative AI JavaScript SDK 0.24.1 50 React Syntax Highlighter 15.6.6 outdated 50 Tremor React 3.18.7 51 heroicons 1.0.6 outdated 53 Jinja >=3.1.6,<4.0 53 PyYAML >=6.0.3,<7.0 55 Headless UI 0.2.2 outdated 56 HTTPX >=0.27.0 56 python-soundfile >=0.12.1,<1.0 57 rich >=13.9.4,<14.0 outdated 60 jwt-decode 4.0.0 63 python-dotenv >=1.0.0,<2.0 64 PyNaCl >=1.6.2,<2.0 64 React Testing Library 14.3.1 outdated 65 jest-dom 6.8.0 outdated 66 react-markdown 9.1.0 outdated 67 @ant-design/icons 5.6.1 outdated 67 DOM Testing Library 10.4.1 outdated 67 prisma-cli 5.17.0 outdated 67 tiktoken >=0.8.0,<1.0 68 eslint-config-prettier 10.1.8 68 orjson >=3.11.6,<4.0 69 python-multipart >=0.0.27,<1.0 69 uuid 14.0.0 outdated 74 TanStack Pacer 0.22.1 outdated 77 APScheduler >=3.11.2,<4.0 77 user-event 14.6.1 outdated 78 Day.js 1.11.19 outdated 78 date-fns ^4.4.0 78 openapi-typescript ^0.17.0 outdated 78 openapi-typescript ^0.5.4 outdated 78 openapi-typescript 7.13.0 79 PapaParse 5.5.3 outdated 79 prometheus-client >=0.20.0,<1.0 81 Requests >=2.32.0,<3.0 82 importlib_metadata >=8.0.0,<9.0 outdated 84 Resend Python SDK >=2.23.0,<3.0 84 cryptography >=48.0.1,<49.0 outdated 85 Vertex AI SDK for Node.js 1.12.0 86 Granian >=2.7.4,<3.0 86 PyJWT >=2.13.0,<3.0 86 tailwind-merge 3.4.0 outdated 87 Moment.js 2.30.1 outdated 88 Base UI ^1.6.0 outdated 88 Click >=8.0.0,<9.0 88 Gunicorn >=23.0.0,<24.0 outdated 89 jsdom 27.4.0 outdated 89 pydantic-settings >=2.14.1,<3.0 89 python-sdk >=1.28.1,<2.0 outdated 90 RQ >=2.7.0,<3.0 90 Tailwind CSS 4.3.2 outdated 90 Tailwind CSS 4.3.2 outdated 90 futures 0.3 90 jsonschema >=4.0.0,<5.0 90 websockets >=15.0.1 91 FastAPI >=0.136.3,<1.0 91 Recharts 3.9.2 outdated 91 TanStack Table 8.21.3 outdated 91 Uvicorn >=0.33.0,<1.0 91 boto3 >=1.43.1,<2.0 91 prettier 3.2.5 outdated 92 LiteLLM ==1.83.14 outdated 92 Pillow >=10.0.0 92 Playwright 1.58.1 outdated 92 Polars >=1.38.1,<2.0 92 TanStack Query 5.100.7 outdated 92 agents >=1.3.12 92 lucide-react 0.513.0 outdated 92 postcss 8.5.13 outdated 93 Anthropic TypeScript SDK 0.92.0 outdated 93 OpenTelemetry Prometheus Exporter ==1.28.0 outdated 93 OpenTelemetry Prometheus Exporter ==1.28.0 outdated 93 OpenTelemetry Python SDK ==1.28.0 outdated 93 Pydantic >=2.10.0,<3.0.0 93 Vitest 3.2.6 outdated 93 Vitest 3.2.6 outdated 93 dd-trace-py >=4.8.2,<5.0 94 Ant Design 5.29.1 outdated 94 Google Gen AI Python SDK >=1.37.0,<2.0 outdated 94 OpenTelemetry Instrumentation for kafka-python ==0.49b0 outdated 94 Starlette >=1.0.1,<2.0 94 pypdf >=6.12.0,<7.0 94 typescript-eslint 8.60.1 outdated 95 Anthropic Python SDK >=0.84.0,<1.0 outdated 95 ESLint 9.39.2 outdated 95 ESLint 9.39.2 outdated 95 NumPy >=1.26.0 95 OpenAI 4.104.0 outdated 95 aiohttp >=3.10,<4.0 95 jest 29.7.0 outdated 95 jest 29.7.0 outdated 96 Next.js 16.2.6 outdated 96 Next.js 16.2.6 outdated 96 Tokenizers >=0.21.0,<1.0 96 sentry-sdk >=2.21.0,<3.0 97 MLflow >=3.11.1,<4.0 97 OpenAI Python SDK >=2.20.0,<3.0.0 outdated 97 TypeScript 5.9.3 outdated 97 gRPC Python (grpcio) ==1.78.0 outdated 97 google-cloud-aiplatform >=1.133.0,<2.0 outdated 98 Azure Container Service Management (Python) >=4.10.0,<5.0 outdated 98 Azure Container Service Management (Python) >=12.20.0,<13.0 outdated 98 Azure Identity (Python) >=1.25.2,<2.0 98 Azure Storage Blob >=12.28.0,<13.0 98 React 18.3.1 outdated 98 React DOM 18.3.1 outdated 98 google-auth >=2.19.1,<3.0 98 google-auth >=2.24.2,<3.0

All 122 Dependencies

Join founders buildingwith open source