All 227 Dependencies

Every package Promptfoo depends on, ranked by repo health score.

Promptfoo treats LLM application quality as a testing problem rather than a guessing game: instead of manually eyeballing model outputs, you define test cases and assertions, run them across prompts/models/configurations, and get structured pass/fail results comparable in a CI pipeline the way unit tests would be.

Beyond correctness evals, Promptfoo has a dedicated red-teaming mode for probing LLM applications for vulnerabilities — prompt injection, jailbreaks, data leakage, and other adversarial failure modes — treating security testing as part of the same evaluation workflow rather than a separate concern.

The project was acquired by OpenAI but remains MIT-licensed and fully open source per the project's own announcement, distributed as an npm package (CLI and library) with active development and a large community.

34 proxy-from-env ^2.1.0 35 keyv-file ^5.3.3 36 ansi-to-html ^0.7.2 36 pdf-parse ^2.4.5 37 fastest-levenshtein ^1.0.16 38 gray-matter ^4.0.3 39 dedent ^1.7.2 40 cli-table3 ^0.6.5 40 h11 ==0.16.0 40 remark-gfm ^4.0.1 41 @swc/jest ^0.2.39 41 fast-safe-stringify ^2.1.1 41 idb-keyval ^6.2.2 42 ajv-formats ^3.0.1 42 clsx ^2.1.1 42 exceptiongroup ==1.2.0 outdated 43 fast-deep-equal ^3.1.3 44 six ==1.16.0 outdated 47 canvas-confetti ^1.9.4 47 python-shell ^5.0.0 49 cors ^2.8.6 49 prism-react-renderer ^2.4.1 51 Winston ^3.19.0 51 distro ==1.9.0 52 @monaco-editor/react ^4.7.0 52 LangChain Community ==0.4.1 outdated 52 lru-cache ^11.3.0 52 minimatch ^10.2.4 53 httpcore ==1.0.2 outdated 55 use-debounce ^10.1.0 57 node-sql-parser ^5.4.0 57 ora ^9.3.0 58 annotated-types ==0.6.0 outdated 59 glob ^13.0.6 59 jest-dom ^6.9.1 outdated 60 Ajv ^8.18.0 60 nunjucks ^3.2.4 61 React Testing Library ^16.3.2 61 libSQL Client (TypeScript) ^0.17.3 outdated 62 Commander.js ^14.0.3 outdated 63 mathjs ^15.1.1 64 DOM Testing Library ^10.4.1 64 proxy-agent ^8.0.0 64 semver ^7.7.4 65 react-markdown ^10.1.0 66 Emotion ^11.14.0 66 Emotion ^11.14.1 outdated 66 HTTPX ==0.26.0 outdated 67 Certifi ==2025.10.5 outdated 69 compression ^1.8.1 70 Chalk ^5.6.2 outdated 70 MDX ^3.1.1 71 diff ^9.0.0 72 python-dotenv ==1.2.2 outdated 73 uuid ^14.0.0 75 Drizzle ORM ^0.31.10 outdated 75 Drizzle ORM ^0.45.1 75 chokidar 5.0.0 outdated 76 Requests ==2.33.0 outdated 76 simple-git ^3.33.0 outdated 77 structlog ==24.2.0 outdated 78 Radix UI ^1.1.15 78 Radix UI ^1.3.3 78 Radix UI ^1.1.12 78 Radix UI ^1.1.15 78 Radix UI ^2.1.16 outdated 78 Radix UI ^2.1.8 outdated 78 Radix UI ^1.2.14 78 Radix UI ^1.1.15 78 Radix UI ^1.1.8 78 Radix UI ^1.3.8 78 Radix UI ^2.2.6 outdated 78 Radix UI ^1.1.8 78 Radix UI ^1.3.6 78 Radix UI ^1.2.4 78 Radix UI ^1.2.6 78 Radix UI ^1.1.13 78 Radix UI ^1.2.8 78 concurrently ^9.2.3 outdated 78 csv-parse ^7.0.0 78 csv-parse ^6.7.0 outdated 78 dotenv ^17.2.3 outdated 78 react-error-boundary ^6.1.1 79 Motion ^12.34.3 outdated 79 RxJS ^7.8.2 79 esbuild ^0.28.0 80 go-openai v1.37.0 outdated 80 user-event ^14.6.1 80 yaml ^2.9.0 81 JSON5 ^2.2.3 81 Zustand ^5.0.12 81 async ^3.2.6 81 fast-xml-parser ^5.7.1 81 idna ==3.15 outdated 81 js-yaml 5.2.1 outdated 82 class-variance-authority ^0.7.1 83 Charset Normalizer ==3.3.2 outdated 83 Prism ^1.30.0 83 docker-py ==7.1.0 outdated 84 ws ^8.19.0 85 GitHub Actions Toolkit (@actions/artifact) ^3.0.0 outdated 85 GitHub Actions Toolkit (@actions/artifact) ^3.0.0 outdated 85 GitHub Actions Toolkit (@actions/artifact) ^9.1.0 outdated 85 Langfuse JS/TS SDK (@langfuse/client) ^5.4.0 outdated 85 express-rate-limit ^8.2.1 85 tqdm ==4.67.3 outdated 85 tsx ^4.21.0 86 Chart.js ^4.5.1 87 AnyIO ==4.2.0 outdated 87 Cacheable ^7.2.8 outdated 87 Octokit REST ^22.0.1 87 PyJWT >=2.9.0 88 OpenAI Agents SDK >=0.14.1,<0.15 outdated 88 Strands Agents >=1.0.0,<2.0.0 88 python-dateutil ==2.9.0.post0 outdated 89 Google Agent Development Kit (ADK) >=1.32.0,<2 outdated 89 SWC ^1.15.41 89 keyv ^5.6.0 outdated 89 tailwind-merge ^3.5.0 90 Express ^5.2.1 90 MCP TypeScript SDK ^1.29.0 90 Satori ^0.26.0 outdated 90 Tailwind CSS ^4.2.2 90 Tailwind CSS ^4.2.2 90 Uvicorn >=0.32.0 90 execa ^9.6.1 outdated 90 jsdom ^29.0.0 outdated 90 pytest-asyncio >=0.24.0 90 python-sdk >=1.0.0 91 @openai/agents ^0.11.3 outdated 91 Chroma ==1.5.9 91 DOMPurify ^3.4.8 91 Faker ^10.2.0 91 Inquirer.js ^5.1.0 outdated 91 Inquirer.js ^6.0.8 outdated 91 Inquirer.js ^11.1.5 outdated 91 Inquirer.js ^5.0.8 outdated 91 Inquirer.js ^5.0.8 outdated 91 Inquirer.js ^4.1.8 outdated 91 Inquirer.js ^5.1.0 outdated 91 Pydantic AI ==1.102.0 outdated 91 Recharts ^3.8.0 91 Smithy Core (@smithy/core) ^4.13.0 outdated 91 TanStack Virtual (React) ^3.13.22 91 Zod ^4.3.6 91 prettier ^3.8.1 92 @vitejs/plugin-react ^6.0.1 92 AI SDK ^3.0.41 outdated 92 AI SDK ^6.0.190 outdated 92 CrewAI >=0.203.0 92 FastAPI >=0.115.0 92 Gradio >=5.49.1 92 Pillow ==12.2.0 outdated 92 Playwright ^1.60.0 92 Socket.IO ^4.8.3 92 Socket.IO ^4.8.3 92 TanStack Query ^5.91.0 92 TanStack Table ^8.21.3 outdated 92 TanStack Table ^8.21.3 outdated 92 lucide-react ^1.0.0 92 postcss ^8.5.10 92 protobuf.js ^8.0.0 92 undici >=7.28.0 <8 outdated 93 AWS SDK for JavaScript (S3 Client) ^3.1045.0 93 AWS SDK for JavaScript (S3 Client) ^3.1003.0 93 AWS SDK for JavaScript (S3 Client) ^3.1045.0 93 AWS SDK for JavaScript (S3 Client) ^3.973.5 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 Docusaurus ^3.9.2 93 LangChain DeepSeek ==1.1.0 outdated 93 LangChain DeepSeek ==1.3.3 outdated 93 LangChain DeepSeek ==1.2.1 outdated 93 LangChain DeepSeek ==1.1.2 outdated 93 Pydantic ==2.13.4 outdated 93 Vitest ^4.1.0 outdated 93 Vitest ^4.1.0 outdated 93 Vitest ^4.0.18 outdated 93 posthog-js 1.379.1 outdated 93 posthog-js ~5.24.10 outdated 93 urllib3 ==2.7.0 outdated 94 Anthropic TypeScript SDK 0.110.0 outdated 94 OpenTelemetry Prometheus Exporter >=1.30.0 outdated 94 OpenTelemetry Prometheus Exporter >=1.30.0 outdated 94 OpenTelemetry Prometheus Exporter >=0.49b0 94 OpenTelemetry Python SDK >=1.30.0 94 Vite ^8.0.16 94 jest ^30.2.0 94 playwright-python >=1.55.0 95 @babel/core ^7.29.6 outdated 95 OpenAI ^6.37.0 outdated 95 React Router ^7.18.0 outdated 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Storybook ^10.4.0 95 Transformers >=4.0.0 95 TypeScript ^6.0.2 outdated 95 pypdf ==6.13.3 outdated 96 Anthropic Python SDK >=0.40.0 96 Datasets ==4.2.0 outdated 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 Material UI ^9.0.0 96 NumPy ==1.26.4 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.9.0 96 OpenTelemetry JavaScript (@opentelemetry/api) 2.9.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^0.220.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.6.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^2.5.0 outdated 96 OpenTelemetry JavaScript (@opentelemetry/api) ^1.39.0 outdated 96 PyTorch >=1.0.0 96 Swiper ^14.0.0 96 pytest >=8.0.0 97 @azure/identity ^4.13.0 97 OpenAI Python SDK ==2.26.0 outdated 97 webpack 5.108.4 outdated 98 Google Cloud Storage ^8.1.2 98 React ^1.0.0 outdated 98 React ^19.2.4 98 React DOM ^19.2.4 98 React DOM ^19.2.4 98 pandas ==2.3.3 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers