All 180 Dependencies

Every package TensorZero depends on, ranked by repo health score.

TensorZero is an open-source LLMOps platform that collapses the usual sprawl of separate gateway, observability, evaluation, and optimization tools into a single self-hosted stack. At its center is a Rust-based gateway that speaks the OpenAI API format and routes to every major model provider — Anthropic, AWS Bedrock, Azure, Google, Groq, Mistral, Together AI, vLLM, and more — while adding retries, fallbacks, load balancing, caching, and tool use on top.

Every inference and piece of feedback the gateway sees is stored in your own database, powering the open-source TensorZero UI for debugging individual calls, monitoring aggregate metrics, and replaying historical inferences with new prompts or models. That same data feeds the platform's evaluation and optimization layers: heuristic and LLM-judge evaluations for both single inferences and multi-step workflows, and optimization techniques like supervised fine-tuning, dynamic in-context learning, and automated prompt engineering (GEPA).

A built-in experimentation layer adds adaptive A/B testing and principled routing across prompts, models, and inference strategies, so teams can turn production feedback into a genuine data flywheel rather than manually tuning prompts by hand. The project is used in production from early-stage AI startups up to Fortune 10 companies, and its authors report it handles roughly 1% of global LLM API spend today.

23 @lezer/highlight 1.2.3 outdated 24 tree-sitter-toml 0.7.0 25 @codemirror/lang-json ^6.0.2 25 @codemirror/search 6.5.11 outdated 26 @codemirror/language ^6.12.2 28 pathdiff 0.2 29 urlencoding 2.1.3 32 CodeMirror State ^6.5.4 34 deno_error 0.7 34 tailwindcss-animate ^1.0.7 35 httpx-sse >=0.4 35 mime_guess 2.0.5 36 grandalf >=0.8 36 hex 0.4.3 38 lang-markdown ^6.3.3 40 @codemirror/legacy-modes ^6.5.1 40 http-status-codes ^2.3.0 40 once_cell 1.21.4 40 remark-gfm ^4.0.1 41 @codemirror/view ^6.39.16 42 clsx ^2.1.1 43 dacite >=1.9.2 44 cmdk ^1.1.1 45 ArcSwap 1.9.1 45 paste 1.0.15 45 uuid v1.6.0 46 Strum 0.28.0 49 backon 1.6.0 49 match-sorter ^8.0.3 52 DashMap 6.2.1 52 Tower 0.5.3 52 pyo3-async-runtimes 0.26 outdated 53 PyYAML >=6.0 56 HTTPX >=0.24.0 56 isbot ^5.1.25 56 mimalloc 0.1.50 56 tree-sitter-python 0.25.0 56 tree-sitter-rust 0.24.0 56 tree-sitter-typescript 0.23.2 57 mockall 0.14 outdated 57 python-markdownify 58 tracing 0.1.43 58 tracing 0.2.5 outdated 58 tracing 0.3.23 outdated 60 tree-sitter-md 0.5.1 63 Ajv ^8.18.0 63 rayon 1.11.0 63 url 2 64 arxiv.py >=2.2.0 65 jsonwebtoken 10.4 outdated 65 quote 1.0.44 66 Moka 0.12.15 66 base64 0.22.1 outdated 66 itertools 0.14.0 outdated 66 metrics 0.24.6 66 react-markdown ^10.1.0 67 Lodash ^4.18.1 67 anyhow 1 67 bytes 1.10.0 67 proc-macro2 1.0.103 67 sha2 0.11.0 68 bb8 0.9.1 68 indexmap 2.13.1 69 http-body 1.0.1 69 react-day-picker ^9.14.0 outdated 69 uuid ^14.0.0 71 log 0.4.29 71 rust-brotli 8.0.2 outdated 72 serde_json 1 73 Chrono 0.4.41 73 flate2 1.1.8 73 uuid-utils >=0.9.0 74 Proptest 1 74 Radix UI ^1.2.6 74 Radix UI ^1.4.3 74 num-bigint 0.4 74 pin-project 1.1.13 75 React CodeMirror ^4.24.0 75 React CodeMirror ^4.24.0 75 http 1.4.0 75 testify v1.10.0 outdated 76 serde 1.0.204 76 vite-tsconfig-paths ^5.1.4 outdated 77 git2-rs 0.20.4 outdated 77 indicatif 0.18.4 77 regex 1.12.2 77 smol-toml ^1.6.1 78 async-trait 0.1 78 dotenv ^17.2.1 outdated 78 ipywidgets >=8.1.6 78 tokio-rustls 0.26.1 79 @octokit/core ^7.0.6 79 thiserror 2 80 hyper-util 0.1.19 80 image 0.25.10 80 rand 0.10.0 80 typing_extensions >=4.12.2 81 Markdown >=3.4.0 81 Requests >=2.33.1 81 uuid 1.19.0 82 class-variance-authority ^0.7.1 82 type-fest ^4.41.0 outdated 83 asyncpg >=0.30 83 rcgen 0.14.8 83 zstd 0.13.3 outdated 85 @hookform/resolvers ^5.1.1 86 tailwind-merge ^3.3.1 88 Click >=8.0 88 OpenAI Go v3.15.0 outdated 88 rmcp 1.7.0 outdated 88 tsx ^4.21.0 89 Ariakit ^0.4.17 89 icu >=2.1, <2.2 outdated 89 jsonschema 0.46.5 outdated 89 napi-rs 3.9.0 89 napi-rs 3.5.6 89 python-sdk >=1.6.0 89 tonic 0.14.6 90 @clickhouse/client ^1.11.2 90 Clap 4.6.1 90 Oxlint ^1.50.0 90 Tailwind CSS ^4.1.15 90 Tailwind CSS ^4.1.11 90 futures 0.3.30 90 futures 0.3.30 90 futures 0.3.31 90 ipykernel 90 tqdm >=4.67.1 91 CrewAI >=0.126.0 91 PyMuPDF >=1.25.5 91 Recharts ^2.15.4 outdated 91 TanStack Table ^8.21.3 outdated 91 syn 2.0.117 outdated 92 LangGraph >=0.3.29 92 Playwright ^1.56.1 92 Playwright ^1.56.1 92 React Hook Form ^7.60.0 92 TanStack Query ^5.83.0 92 Zod ^3.25.76 outdated 92 lucide-react ^0.487.0 outdated 93 @vitejs/plugin-react ^5.0.4 outdated 93 Pydantic >=2.0 93 Vitest ^4.0.8 outdated 93 Vitest ^4.0.8 outdated 93 Vitest ^4.1.0 outdated 93 aws-config 1.8 93 aws-config 1.2.2 93 aws-config 1.3 93 aws-config 0.60 outdated 93 aws-config 1.11.0 93 aws-config 1.4.7 93 aws-config 1.3.6 93 aws-sdk-s3 1.132.0 93 hyper 1.9.0 93 rustls 0.23.40 94 Vite ^7.3.2 outdated 94 scikit-learn >=1.6.1 94 typescript-eslint ^8.57.1 95 ESLint ^9.39.4 outdated 95 ESLint ^9.39.4 outdated 95 NumPy 95 OpenAI ^6.29.0 outdated 95 PyArrow 95 React Router ^7.12.0 outdated 95 React Router ^7.12.0 outdated 95 React Router ^7.12.0 outdated 95 React Router ^7.12.0 outdated 95 Storybook ^10.2.1 95 Storybook ^10.2.1 95 Storybook ^10.2.1 95 Storybook ^10.2.1 95 Storybook ^10.2.17 95 Tokio 1 95 Tokio 0.7 outdated 95 tree-sitter 0.26.3 outdated 97 OpenAI Python SDK >=2.6.1 97 TypeScript ^5.9.3 outdated 98 React ^19.2.1 98 React DOM ^19.2.1 98 pandas

All 180 Dependencies

Join founders buildingwith open source