All 214 Dependencies
Every package Promptfoo depends on, ranked by repo health score.
Promptfoo treats LLM application quality as a testing problem rather than a guessing game: instead of manually eyeballing model outputs, you define test cases and assertions, run them across prompts/models/configurations, and get structured pass/fail results comparable in a CI pipeline the way unit tests would be.
Beyond correctness evals, Promptfoo has a dedicated red-teaming mode for probing LLM applications for vulnerabilities — prompt injection, jailbreaks, data leakage, and other adversarial failure modes — treating security testing as part of the same evaluation workflow rather than a separate concern.
The project was acquired by OpenAI but remains MIT-licensed and fully open source per the project's own announcement, distributed as an npm package (CLI and library) with active development and a large community.
34 exceptiongroup ==1.2.0
outdated
34 proxy-from-env ^2.1.0 36 ansi-to-html ^0.7.2 37 fastest-levenshtein ^1.0.16 38 gray-matter ^4.0.3 39 h11 ==0.16.0 40 dedent ^1.7.2 40 remark-gfm ^4.0.1 41 cli-table3 ^0.6.5 41 fast-safe-stringify ^2.1.1 41 pdf-parse ^2.4.5 42 ajv-formats ^3.0.1 42 clsx ^2.1.1 43 fast-deep-equal ^3.1.3 45 JSON5 ^2.2.3 45 six ==1.16.0
outdated
46 @swc/jest ^0.2.39 47 canvas-confetti ^1.9.4 48 python-shell ^5.0.0 49 keyv-file ^5.3.3 49 nunjucks ^3.2.4 49 prism-react-renderer ^2.4.1 50 lru-cache ^11.3.0 51 cors ^2.8.6 51 idb-keyval ^6.2.2 53 @monaco-editor/react ^4.7.0 53 annotated-types ==0.6.0
outdated
53 httpcore ==1.0.2
outdated
53 python-dateutil ==2.9.0.post0 55 HTTPX ==0.26.0
outdated
56 LangChain Community ==0.4.1
outdated
56 minimatch ^10.2.4 59 glob ^13.0.6 59 ora ^9.3.0 59 use-debounce ^10.1.0 60 distro ==1.9.0 61 Chart.js ^4.5.1 61 chokidar 5.0.0 61 diff ^9.0.0 62 Commander.js ^14.0.3
outdated
62 PyJWT >=2.9.0 63 compression ^1.8.1 64 Emotion ^11.14.0 64 Emotion ^11.14.1
outdated
64 async ^3.2.6 64 mathjs ^15.1.1 64 proxy-agent ^8.0.0 64 simple-git ^3.33.0 65 Chalk ^5.6.2
outdated
65 react-markdown ^10.1.0 66 DOM Testing Library ^10.4.1 66 React Testing Library ^16.3.2 66 Ajv ^8.18.0 66 Certifi ==2025.10.5
outdated
66 node-sql-parser ^5.4.0 66 python-dotenv ==1.2.2
outdated
67 Winston ^3.19.0 68 jest-dom ^6.9.1
outdated
68 Prism ^1.30.0 69 semver ^7.7.4 70 libSQL Client (TypeScript) ^0.17.3
outdated
70 uuid ^14.0.0 71 MDX ^3.1.1 72 csv-parse ^7.0.0 72 csv-parse ^6.7.0
outdated
72 react-error-boundary ^6.1.1 73 Drizzle ORM ^0.31.10
outdated
73 Drizzle ORM ^0.45.1 75 dotenv ^17.2.3 76 Radix UI ^1.1.15 76 Radix UI ^1.3.3 76 Radix UI ^1.1.12 76 Radix UI ^1.1.15 76 Radix UI ^2.1.16
outdated
76 Radix UI ^2.1.8
outdated
76 Radix UI ^1.2.14 76 Radix UI ^1.1.15 76 Radix UI ^1.1.8 76 Radix UI ^1.3.8 76 Radix UI ^2.2.6
outdated
76 Radix UI ^1.1.8 76 Radix UI ^1.3.6 76 Radix UI ^1.2.4 76 Radix UI ^1.2.6 76 Radix UI ^1.1.13 76 Radix UI ^1.2.8 76 execa ^9.6.1
outdated
77 go-openai v1.37.0
outdated
78 Motion ^12.34.3
outdated
78 structlog ==24.2.0
outdated
79 concurrently ^9.2.3
outdated
80 user-event ^14.6.1 80 idna ==3.15
outdated
80 Zustand ^5.0.12 81 js-yaml 5.2.1
outdated
81 Satori ^0.26.0
outdated
82 yaml ^2.9.0 83 Octokit REST ^22.0.1 83 Charset Normalizer ==3.3.2
outdated
83 class-variance-authority ^0.7.1 83 Requests ==2.33.0
outdated
83 RxJS ^7.8.2 84 Langfuse JS/TS SDK (@langfuse/client) ^5.4.0 85 AnyIO ==4.2.0
outdated
85 esbuild ^0.28.0 85 express-rate-limit ^8.2.1 85 ws ^8.19.0 86 Cacheable ^7.2.8
outdated
86 Express ^5.2.1 86 fast-xml-parser ^5.7.1 87 Strands Agents >=1.0.0,<2.0.0 88 TanStack Virtual (React) ^3.13.22 88 docker-py ==7.1.0
outdated
88 OpenAI Agents SDK >=0.14.1,<0.15
outdated
88 tailwind-merge ^3.5.0 88 tsx ^4.21.0 89 Chroma ==1.5.9 89 Google Agent Development Kit (ADK) >=1.32.0,<2
outdated
90 MCP TypeScript SDK ^1.29.0 90 @openai/agents ^0.11.3
outdated
90 Smithy Core (@smithy/core) ^4.13.0
outdated
90 SWC ^1.15.41 90 Tailwind CSS ^4.2.2 90 CrewAI >=0.203.0 90 DOMPurify ^3.4.8 90 keyv ^5.6.0 90 python-sdk >=1.0.0 90 prettier ^3.8.1 90 Pydantic AI ==1.102.0
outdated
90 Tailwind CSS ^4.2.2 90 tqdm ==4.67.3
outdated
90 Uvicorn >=0.32.0 90 Zod ^4.3.6 91 Faker ^10.2.0 91 FastAPI >=0.115.0 91 Gradio >=5.49.1 91 lucide-react ^1.0.0 91 Playwright ^1.60.0 91 pytest-asyncio >=0.24.0 91 Recharts ^3.8.0 91 Socket.IO ^4.8.3 91 Socket.IO ^4.8.3 92 AI SDK ^3.0.41
outdated
92 Docusaurus ^3.9.2 92 Docusaurus ^3.9.2 92 Docusaurus ^3.9.2 92 Docusaurus ^3.9.2 92 Docusaurus ^3.9.2 92 Docusaurus ^3.9.2 92 TanStack Query ^5.91.0 92 TanStack Table ^8.21.3
outdated
92 TanStack Table ^8.21.3
outdated
92 @vitejs/plugin-react ^6.0.1 92 Vitest ^4.1.0
outdated
92 Vitest ^4.1.0
outdated
92 AI SDK ^6.0.190
outdated
92 jsdom ^29.0.0
outdated
92 LangChain DeepSeek ==1.1.0 92 LangChain DeepSeek ==1.3.3
outdated
92 LangChain DeepSeek ==1.2.1
outdated
92 LangChain DeepSeek ==1.1.2
outdated
92 Pillow ==12.2.0
outdated
92 playwright-python >=1.55.0 92 postcss ^8.5.10 92 Pydantic ==2.13.4
outdated
92 urllib3 ==2.7.0 92 Vitest ^4.0.18
outdated
93 Anthropic TypeScript SDK 0.110.0
outdated
93 AWS SDK for JavaScript (S3 Client) ^3.1045.0 93 AWS SDK for JavaScript (S3 Client) ^3.1003.0 93 AWS SDK for JavaScript (S3 Client) ^3.1045.0 93 AWS SDK for JavaScript (S3 Client) ^3.973.5 93 OpenTelemetry Prometheus Exporter >=1.30.0
outdated
93 OpenTelemetry Prometheus Exporter >=1.30.0
outdated
93 OpenTelemetry Python SDK >=1.30.0 93 OpenTelemetry Prometheus Exporter >=0.49b0 93 posthog-js 1.379.1
outdated
93 posthog-js ~5.24.10
outdated
93 undici >=7.28.0 <8
outdated
93 Vite ^8.0.16 94 @babel/core ^7.29.6
outdated
94 Datasets ==4.2.0
outdated
94 jest ^30.2.0 94 protobuf.js ^8.0.0 94 pypdf ==6.13.3
outdated
94 React Router ^7.18.0
outdated
95 Anthropic Python SDK >=0.40.0 95 OpenAI ^6.37.0
outdated
95 OpenAI Python SDK ==2.26.0
outdated
95 Storybook ^10.4.0 95 Swiper ^14.0.0 95 Transformers >=4.0.0 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.9.0 96 OpenTelemetry JavaScript (@opentelemetry/api) 2.9.0
outdated
96 OpenTelemetry JavaScript (@opentelemetry/api) ^0.220.0
outdated
96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0
outdated
96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.6.0
outdated
96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0
outdated
96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.39.0
outdated
96 NumPy ==1.26.4
outdated
96 pytest >=8.0.0 96 PyTorch >=1.0.0 96 TypeScript ^6.0.2
outdated
97 @azure/identity ^4.13.0 97 React ^1.0.0
outdated
97 React ^19.2.4 97 React DOM ^19.2.4 97 React DOM ^19.2.4 97 webpack 5.108.4
outdated
98 Google Cloud Storage ^8.1.2
outdated
98 pandas ==2.3.3
outdated
