All 171 Dependencies

Every package TensorZero depends on, ranked by repo health score.

TensorZero is an open-source LLMOps platform that collapses the usual sprawl of separate gateway, observability, evaluation, and optimization tools into a single self-hosted stack. At its center is a Rust-based gateway that speaks the OpenAI API format and routes to every major model provider — Anthropic, AWS Bedrock, Azure, Google, Groq, Mistral, Together AI, vLLM, and more — while adding retries, fallbacks, load balancing, caching, and tool use on top.

Every inference and piece of feedback the gateway sees is stored in your own database, powering the open-source TensorZero UI for debugging individual calls, monitoring aggregate metrics, and replaying historical inferences with new prompts or models. That same data feeds the platform's evaluation and optimization layers: heuristic and LLM-judge evaluations for both single inferences and multi-step workflows, and optimization techniques like supervised fine-tuning, dynamic in-context learning, and automated prompt engineering (GEPA).

A built-in experimentation layer adds adaptive A/B testing and principled routing across prompts, models, and inference strategies, so teams can turn production feedback into a genuine data flywheel rather than manually tuning prompts by hand. The project is used in production from early-stage AI startups up to Fortune 10 companies, and its authors report it handles roughly 1% of global LLM API spend today.

20 deno_error 0.7 23 @lezer/highlight 1.2.3 24 tree-sitter-toml 0.7.0 25 @codemirror/lang-json ^6.0.2 25 @codemirror/search 6.5.11 outdated 26 @codemirror/language ^6.12.2 28 pathdiff 0.2 29 urlencoding 2.1.3 32 CodeMirror State ^6.5.4 34 tailwindcss-animate ^1.0.7 35 mime_guess 2.0.5 35 httpx-sse >=0.4 36 hex 0.4.3 36 grandalf >=0.8 38 lang-markdown ^6.3.3 40 once_cell 1.21.4 40 @codemirror/legacy-modes ^6.5.1 40 http-status-codes ^2.3.0 40 remark-gfm ^4.0.1 41 @codemirror/view ^6.39.16 42 clsx ^2.1.1 43 dacite >=1.9.2 44 cmdk ^1.1.1 45 uuid v1.6.0 45 paste 1.0.15 46 Strum 0.28.0 46 ArcSwap 1.9.1 49 backon 1.6.0 50 match-sorter ^8.0.3 52 metrics 0.24.6 52 asyncpg >=0.30 53 DashMap 6.2.1 54 HTTPX >=0.24.0 54 pyo3-async-runtimes 0.26 outdated 55 Tower 0.5.3 55 PyYAML >=6.0 57 mimalloc 0.1.50 57 tree-sitter-rust 0.24.0 57 tree-sitter-typescript 0.23.2 57 tree-sitter-python 0.25.0 58 tracing 0.1.43 58 tracing 0.3.23 outdated 58 tracing 0.2.5 outdated 58 python-markdownify 59 isbot ^5.1.25 60 jsonwebtoken 10.4 outdated 61 tree-sitter-md 0.5.1 62 mockall 0.14 outdated 62 React CodeMirror ^4.24.0 62 React CodeMirror ^4.24.0 64 rayon 1.11.0 64 react-markdown ^10.1.0 65 Proptest 1 65 Ajv ^8.18.0 66 url 2 66 arxiv.py >=2.2.0 67 Moka 0.12.15 67 itertools 0.14.0 outdated 67 base64 0.22.1 outdated 69 indexmap 2.13.1 69 bytes 1.10.0 70 sha2 0.11.0 70 react-day-picker ^9.14.0 outdated 71 pin-project 1.1.13 71 http-body 1.0.1 71 proc-macro2 1.0.103 72 uuid ^14.0.0 72 bb8 0.9.1 73 testify v1.10.0 outdated 73 rust-brotli 8.0.2 outdated 74 anyhow 1 74 dotenv ^17.2.1 75 thiserror 2 75 flate2 1.1.8 75 hyper-util 0.1.19 75 num-bigint 0.4 75 serde_json 1 75 Radix UI ^1.2.6 75 Radix UI ^1.4.3 75 smol-toml ^1.6.1 76 async-trait 0.1 76 log 0.4.29 76 quote 1.0.44 76 serde 1.0.204 76 Lodash ^4.18.1 77 Markdown >=3.4.0 77 http 1.4.0 77 rcgen 0.14.8 78 vite-tsconfig-paths ^5.1.4 outdated 79 indicatif 0.18.4 79 uuid-utils >=0.9.0 79 git2-rs 0.20.4 outdated 79 Chrono 0.4.41 79 regex 1.12.2 80 @octokit/core ^7.0.6 80 image 0.25.10 80 ipywidgets >=8.1.6 82 tokio-rustls 0.26.1 82 rand 0.10.0 outdated 82 Requests >=2.33.1 82 @hookform/resolvers ^5.1.1 83 class-variance-authority ^0.7.1 83 type-fest ^4.41.0 outdated 85 zstd 0.13.3 outdated 85 uuid 1.19.0 86 typing_extensions >=4.12.2 86 tsx ^4.21.0 87 tailwind-merge ^3.3.1 88 OpenAI Go v3.15.0 outdated 88 rmcp 1.7.0 outdated 88 Click >=8.0 89 tqdm >=4.67.1 89 python-sdk >=1.6.0 89 Ariakit ^0.4.17 90 Clap 4.6.1 90 jsonschema 0.46.5 outdated 90 tonic 0.14.6 90 napi-rs 3.9.0 90 napi-rs 3.5.6 90 icu >=2.1, <2.2 outdated 90 PyMuPDF >=1.25.5 90 Tailwind CSS ^4.1.15 90 Oxlint ^1.50.0 90 Tailwind CSS ^4.1.11 91 syn 2.0.117 outdated 91 ipykernel 91 CrewAI >=0.126.0 91 React Hook Form ^7.60.0 91 Recharts ^2.15.4 outdated 91 Zod ^3.25.76 outdated 92 futures 0.3.31 92 futures 0.3.30 92 aws-sdk-s3 1.132.0 92 futures 0.3.30 92 LangGraph >=0.3.29 92 @clickhouse/client ^1.11.2 92 TanStack Query ^5.83.0 92 lucide-react ^0.487.0 outdated 92 Playwright ^1.56.1 92 Playwright ^1.56.1 93 Vitest ^4.1.0 outdated 93 Tokio 0.7 outdated 93 hyper 1.9.0 93 aws-config 1.8 93 aws-config 1.3.6 93 aws-config 1.2.2 93 aws-config 1.3 93 aws-config 1.11.0 93 Pydantic >=2.0 93 Tokio 1 93 TanStack Table ^8.21.3 outdated 93 @vitejs/plugin-react ^5.0.4 outdated 93 Vitest ^4.0.8 outdated 93 Vitest ^4.0.8 outdated 94 typescript-eslint ^8.57.1 94 rustls 0.23.40 94 Vite ^7.3.2 outdated 95 OpenAI ^6.29.0 outdated 95 ESLint ^9.39.4 outdated 95 ESLint ^9.39.4 outdated 95 tree-sitter 0.26.3 outdated 95 scikit-learn >=1.6.1 95 React Router ^7.12.0 outdated 95 Storybook ^10.2.17 95 PyArrow 96 OpenAI Python SDK >=2.6.1 96 NumPy 97 TypeScript ^5.9.3 outdated 98 pandas 98 React ^19.2.1 98 React DOM ^19.2.1

All 171 Dependencies

Join founders buildingwith open source

Search