All 45 Dependencies

Every package otari depends on, ranked by repo health score.

Otari is a self-hosted, OpenAI- and Anthropic-compatible LLM gateway from Mozilla AI. It sits between applications and 40+ model providers behind a single endpoint, so client code targets one URL and one wire format instead of juggling a different SDK, auth scheme, and error format per provider. Requests to `/v1/chat/completions`, `/v1/responses`, and `/v1/messages` are authenticated, budget-checked, dispatched through the any-llm routing layer, logged, and billed, all before or immediately after the call reaches the underlying provider.

Access control is built around three primitives: users (the identity spend and usage attach to), API keys (the credential clients present, each scoped to a user and optionally restricted to a model allow-list), and budgets (spending caps with optional reset periods, enforced by reserving the estimated cost before a request runs rather than reconciling after the invoice arrives). Provider credentials are supplied once as environment variables or added through the built-in admin dashboard, encrypted at rest with a Fernet key, and never exposed to calling clients, who only ever see their own `gw-` virtual key.

Beyond routing, Otari runs two opt-in tools itself: a sandboxed Python REPL (`otari_code_execution`) and a web-search tool, giving any model, including open-weight ones with no native tool support, feature parity with what frontier provider APIs expose natively. A request-level guardrails field lets a caller run a prompt-injection (or other) check before the provider is ever called, either in monitor mode, where the verdict is surfaced on a response header, or block mode, where the request is rejected with a 403 and no provider call is made.

Otari runs standalone with its own SQLite or Postgres database, or in hybrid mode connected to the hosted otari.ai platform, which takes over provider routing, auth, and usage tracking and adds multi-provider fallback. It ships as a Docker image, a Docker Compose stack with profiles for the code-execution, web-search, and guardrails services, and one-click templates for Render and Railway, alongside official Python, TypeScript, Rust, and Go client SDKs and a CLI.

40 aiosqlite >=0.19.0 42 clsx 2.1.1 48 psycopg2 >=2.9.9 52 asyncpg >=0.29.0 55 HTTPX >=0.27 56 PyYAML >=6.0 66 React Testing Library ^16.1.0 66 python-dotenv >=1.0.0 66 python-multipart >=0.0.31 68 jest-dom ^6.6.3 outdated 79 prometheus-client >=0.20.0 80 user-event ^14.5.2 84 cryptography >=44.0.0 85 Alembic >=1.13.0 85 pypdfium2 >=4.30.0 86 MarkItDown >=0.1.0 87 genai-prices >=0.0.66 87 React Aria ^1.18.0 outdated 88 RapidOCR >=1.3.0 89 Click >=8.1.0 89 pydantic-settings >=2.14.2 90 Tailwind CSS 4.3.1 outdated 90 boto3 >=1.42.0 90 python-sdk >=1.28.1 90 Tailwind CSS 4.3.1 outdated 90 Uvicorn >=0.30.0 91 HeroUI 3.2.1 outdated 91 HeroUI 3.2.1 outdated 91 Playwright ^1.61.1 91 FastAPI >=0.115.0 91 Recharts ^3.10.0 92 TanStack Query ^5.62.7 92 @vitejs/plugin-react ^4.3.4 outdated 92 jsdom ^25.0.1 outdated 92 Pillow >=12.3.0 92 Vitest ^3.0.0 outdated 93 OpenTelemetry Prometheus Exporter >=1.39.1 outdated 93 OpenTelemetry Prometheus Exporter >=1.39.1 outdated 93 SQLAlchemy >=2.0.0 93 Vite ^6.0.0 outdated 94 React Router ^7.18.1 outdated 96 NumPy >=1.26.0 96 TypeScript 5.6.3 outdated 97 React ^19.0.0 97 React DOM ^19.0.0

All 45 Dependencies

Join founders buildingwith open source

Search