All 227 Dependencies

Every package Promptfoo depends on, ranked by repo health score.

Promptfoo treats LLM application quality as a testing problem rather than a guessing game: instead of manually eyeballing model outputs, you define test cases and assertions, run them across prompts/models/configurations, and get structured pass/fail results comparable in a CI pipeline the way unit tests would be.

Beyond correctness evals, Promptfoo has a dedicated red-teaming mode for probing LLM applications for vulnerabilities — prompt injection, jailbreaks, data leakage, and other adversarial failure modes — treating security testing as part of the same evaluation workflow rather than a separate concern.

The project was acquired by OpenAI but remains MIT-licensed and fully open source per the project's own announcement, distributed as an npm package (CLI and library) with active development and a large community.

33 proxy-from-env ^2.1.0 35 keyv-file ^5.3.3 36 ansi-to-html ^0.7.2 36 pdf-parse ^2.4.5 37 fastest-levenshtein ^1.0.16 38 gray-matter ^4.0.3 39 dedent ^1.7.2 40 cli-table3 ^0.6.5 40 h11 ==0.16.0 40 remark-gfm ^4.0.1 41 fast-safe-stringify ^2.1.1 41 idb-keyval ^6.2.2 42 clsx ^2.1.1 43 ajv-formats ^3.0.1 43 fast-deep-equal ^3.1.3 44 six ==1.16.0 outdated 47 canvas-confetti ^1.9.4 47 python-shell ^5.0.0 49 cors ^2.8.6 49 prism-react-renderer ^2.4.1 50 Winston ^3.19.0 50 distro ==1.9.0 51 lru-cache ^11.3.0 52 LangChain Community ==0.4.1 outdated 53 RxJS ^7.8.2 53 httpcore ==1.0.2 outdated 53 use-debounce ^10.1.0 56 @swc/jest ^0.2.39 56 node-sql-parser ^5.4.0 58 jest-dom ^6.9.1 outdated 58 nunjucks ^3.2.4 59 Ajv ^8.18.0 60 React Testing Library ^16.3.2 60 exceptiongroup ==1.2.0 outdated 60 libSQL Client (TypeScript) ^0.17.3 outdated 62 @monaco-editor/react ^4.7.0 63 DOM Testing Library ^10.4.1 63 HTTPX ==0.26.0 outdated 63 react-markdown ^10.1.0 64 Emotion ^11.14.0 64 Emotion ^11.14.1 outdated 65 Chalk ^5.6.2 outdated 65 esbuild ^0.28.0 66 Certifi ==2025.10.5 outdated 66 annotated-types ==0.6.0 outdated 66 compression ^1.8.1 66 ora ^9.3.0 outdated 68 semver ^7.7.4 69 MDX ^3.1.1 69 diff ^9.0.0 70 proxy-agent ^8.0.0 71 structlog ==24.2.0 outdated 72 user-event ^14.6.1 72 uuid ^14.0.0 74 python-dotenv ==1.2.2 outdated 74 tqdm ==4.67.3 outdated 74 tsx ^4.21.0 75 Drizzle ORM ^0.31.10 outdated 75 Drizzle ORM ^0.45.1 75 glob ^13.0.6 outdated 75 go-openai v1.37.0 outdated 75 mathjs ^15.1.1 77 Radix UI ^1.1.15 77 Radix UI ^1.3.3 77 Radix UI ^1.1.12 77 Radix UI ^1.1.15 77 Radix UI ^2.1.16 outdated 77 Radix UI ^2.1.8 outdated 77 Radix UI ^1.2.14 77 Radix UI ^1.1.15 77 Radix UI ^1.1.8 77 Radix UI ^1.3.8 77 Radix UI ^2.2.6 outdated 77 Radix UI ^1.1.8 77 Radix UI ^1.3.6 77 Radix UI ^1.2.4 77 Radix UI ^1.2.6 77 Radix UI ^1.1.13 77 Radix UI ^1.2.8 77 Requests ==2.33.0 outdated 77 chokidar 5.0.0 outdated 77 dotenv ^17.2.3 outdated 78 concurrently ^9.2.3 outdated 78 csv-parse ^7.0.0 78 csv-parse ^6.7.0 outdated 78 yaml ^2.9.0 79 Motion ^12.34.3 outdated 79 react-error-boundary ^6.1.1 79 simple-git ^3.33.0 outdated 81 idna ==3.15 outdated 81 js-yaml 5.2.1 outdated 81 minimatch ^10.2.4 outdated 82 JSON5 ^2.2.3 82 Prism ^1.30.0 82 async ^3.2.6 83 Commander.js ^14.0.3 outdated 83 class-variance-authority ^0.7.1 84 Chart.js ^4.5.1 84 Octokit REST ^22.0.1 85 Charset Normalizer ==3.3.2 outdated 85 GitHub Actions Toolkit (@actions/artifact) ^3.0.0 outdated 85 GitHub Actions Toolkit (@actions/artifact) ^3.0.0 outdated 85 GitHub Actions Toolkit (@actions/artifact) ^9.1.0 outdated 85 Langfuse JS/TS SDK (@langfuse/client) ^5.4.0 outdated 85 Zustand ^5.0.12 85 docker-py ==7.1.0 outdated 85 express-rate-limit ^8.2.1 85 ws ^8.19.0 86 fast-xml-parser ^5.7.1 87 PyJWT >=2.9.0 87 execa ^9.6.1 outdated 87 python-dateutil ==2.9.0.post0 outdated 88 Cacheable ^7.2.8 outdated 88 Strands Agents >=1.0.0,<2.0.0 88 protobuf.js ^8.0.0 88 tailwind-merge ^3.5.0 89 AnyIO ==4.2.0 outdated 89 Google Agent Development Kit (ADK) >=1.32.0,<2 outdated 89 MCP TypeScript SDK ^1.29.0 89 OpenAI Agents SDK >=0.14.1,<0.15 outdated 89 python-sdk >=1.0.0 90 Express ^5.2.1 90 Inquirer.js ^5.1.0 outdated 90 Inquirer.js ^6.0.8 outdated 90 Inquirer.js ^11.1.5 outdated 90 Inquirer.js ^5.0.8 outdated 90 Inquirer.js ^5.0.8 outdated 90 Inquirer.js ^4.1.8 outdated 90 Inquirer.js ^5.1.0 outdated 90 Recharts ^3.8.0 90 SWC ^1.15.41 90 Satori ^0.26.0 outdated 90 Uvicorn >=0.32.0 90 jsdom ^29.0.0 outdated 90 keyv ^5.6.0 outdated 91 @openai/agents ^0.11.3 outdated 91 Chroma ==1.5.9 91 DOMPurify ^3.4.8 91 Faker ^10.2.0 91 Pydantic AI ==1.102.0 outdated 91 Smithy Core (@smithy/core) ^4.13.0 outdated 91 Tailwind CSS ^4.2.2 91 Tailwind CSS ^4.2.2 91 TanStack Virtual (React) ^3.13.22 91 prettier ^3.8.1 92 @vitejs/plugin-react ^6.0.1 92 AI SDK ^3.0.41 outdated 92 AI SDK ^6.0.190 outdated 92 CrewAI >=0.203.0 92 FastAPI >=0.115.0 92 Gradio >=5.49.1 92 Pillow ==12.2.0 outdated 92 Playwright ^1.60.0 92 TanStack Query ^5.91.0 92 TanStack Table ^8.21.3 outdated 92 TanStack Table ^8.21.3 outdated 92 Zod ^4.3.6 92 lucide-react ^1.0.0 92 postcss ^8.5.10 92 pytest-asyncio >=0.24.0 92 undici >=7.28.0 <8 outdated 93 Anthropic TypeScript SDK 0.110.0 outdated 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 LangChain DeepSeek ==1.1.0 outdated 93 LangChain DeepSeek ==1.3.3 outdated 93 LangChain DeepSeek ==1.2.1 outdated 93 LangChain DeepSeek ==1.1.2 outdated 93 Pydantic ==2.13.4 outdated 93 Vitest ^4.1.0 outdated 93 Vitest ^4.1.0 outdated 93 Vitest ^4.0.18 outdated 93 posthog-js 1.379.1 outdated 93 posthog-js ~5.24.10 outdated 93 urllib3 ==2.7.0 outdated 94 AWS SDK for JavaScript (S3 Client) ^3.1045.0 94 AWS SDK for JavaScript (S3 Client) ^3.1003.0 94 AWS SDK for JavaScript (S3 Client) ^3.1045.0 94 AWS SDK for JavaScript (S3 Client) ^3.973.5 94 OpenTelemetry Prometheus Exporter >=1.30.0 outdated 94 OpenTelemetry Prometheus Exporter >=1.30.0 outdated 94 OpenTelemetry Prometheus Exporter >=0.49b0 94 OpenTelemetry Python SDK >=1.30.0 94 Vite ^8.0.16 94 jest ^30.2.0 94 playwright-python >=1.55.0 95 @babel/core ^7.29.6 outdated 95 Anthropic Python SDK >=0.40.0 95 OpenAI ^6.37.0 outdated 95 React Router ^7.18.0 outdated 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Swiper ^14.0.0 95 Transformers >=4.0.0 95 TypeScript ^6.0.2 outdated 95 pypdf ==6.13.3 outdated 96 Datasets ==4.2.0 outdated 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 NumPy ==1.26.4 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.9.0 96 OpenTelemetry JavaScript (@opentelemetry/api) 2.9.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^0.220.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.6.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.39.0 outdated 96 PyTorch >=1.0.0 96 Socket.IO ^4.8.3 96 Socket.IO ^4.8.3 96 pytest >=8.0.0 97 @azure/identity ^4.13.0 97 OpenAI Python SDK ==2.26.0 outdated 97 webpack 5.108.4 outdated 98 Google Cloud Storage ^8.1.2 98 React ^1.0.0 outdated 98 React ^19.2.4 98 React DOM ^19.2.4 98 React DOM ^19.2.4 98 pandas ==2.3.3 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers