All 227 Dependencies
Every package Promptfoo depends on, ranked by repo health score.
Promptfoo treats LLM application quality as a testing problem rather than a guessing game: instead of manually eyeballing model outputs, you define test cases and assertions, run them across prompts/models/configurations, and get structured pass/fail results comparable in a CI pipeline the way unit tests would be.
Beyond correctness evals, Promptfoo has a dedicated red-teaming mode for probing LLM applications for vulnerabilities — prompt injection, jailbreaks, data leakage, and other adversarial failure modes — treating security testing as part of the same evaluation workflow rather than a separate concern.
The project was acquired by OpenAI but remains MIT-licensed and fully open source per the project's own announcement, distributed as an npm package (CLI and library) with active development and a large community.
33
exceptiongroup
==1.2.0
outdated
34
proxy-from-env
^2.1.0
36
ansi-to-html
^0.7.2
37
fastest-levenshtein
^1.0.16
37
keyv-file
^5.3.3
37
pdf-parse
^2.4.5
38
gray-matter
^4.0.3
39
h11
==0.16.0
40
dedent
^1.7.2
40
remark-gfm
^4.0.1
41
cli-table3
^0.6.5
41
fast-safe-stringify
^2.1.1
42
ajv-formats
^3.0.1
42
clsx
^2.1.1
43
@swc/jest
^0.2.39
43
fast-deep-equal
^3.1.3
45
JSON5
^2.2.3
45
six
==1.16.0
outdated
47
canvas-confetti
^1.9.4
47
idb-keyval
^6.2.2
48
nunjucks
^3.2.4
48
python-shell
^5.0.0
49
prism-react-renderer
^2.4.1
50
cors
^2.8.6
52
annotated-types
==0.6.0
outdated
53
@monaco-editor/react
^4.7.0
53
LangChain Community
==0.4.1
outdated
53
httpcore
==1.0.2
outdated
54
minimatch
^10.2.4
56
HTTPX
==0.26.0
outdated
57
use-debounce
^10.1.0
58
distro
==1.9.0
58
lru-cache
^11.3.0
59
chokidar
5.0.0
59
glob
^13.0.6
60
Winston
^3.19.0
60
ora
^9.3.0
60
semver
^7.7.4
62
Commander.js
^14.0.3
outdated
62
Emotion
^11.14.0
62
Emotion
^11.14.1
outdated
63
Ajv
^8.18.0
63
Certifi
==2025.10.5
outdated
63
diff
^9.0.0
63
libSQL Client (TypeScript)
^0.17.3
outdated
63
python-dotenv
==1.2.2
outdated
64
React Testing Library
^16.3.2
64
node-sql-parser
^5.4.0
65
jest-dom
^6.9.1
outdated
66
mathjs
^15.1.1
66
proxy-agent
^8.0.0
66
react-markdown
^10.1.0
67
DOM Testing Library
^10.4.1
69
compression
^1.8.1
69
uuid
^14.0.0
72
Chalk
^5.6.2
outdated
73
MDX
^3.1.1
73
python-dateutil
==2.9.0.post0
74
Radix UI
^1.1.15
74
Radix UI
^1.3.3
74
Radix UI
^1.1.12
74
Radix UI
^1.1.15
74
Radix UI
^2.1.16
outdated
74
Radix UI
^2.1.8
outdated
74
Radix UI
^1.2.14
74
Radix UI
^1.1.15
74
Radix UI
^1.1.8
74
Radix UI
^1.3.8
74
Radix UI
^2.2.6
outdated
74
Radix UI
^1.1.8
74
Radix UI
^1.3.6
74
Radix UI
^1.2.4
74
Radix UI
^1.2.6
74
Radix UI
^1.1.13
74
Radix UI
^1.2.8
76
react-error-boundary
^6.1.1
76
structlog
==24.2.0
outdated
77
csv-parse
^7.0.0
77
csv-parse
^6.7.0
outdated
77
execa
^9.6.1
outdated
77
user-event
^14.6.1
78
Prism
^1.30.0
78
Zustand
^5.0.12
78
concurrently
^9.2.3
outdated
78
dotenv
^17.2.3
outdated
79
Drizzle ORM
^0.31.10
outdated
79
Drizzle ORM
^0.45.1
79
Motion
^12.34.3
outdated
79
simple-git
^3.33.0
outdated
80
Octokit REST
^22.0.1
80
idna
==3.15
outdated
81
Cacheable
^7.2.8
outdated
81
Charset Normalizer
==3.3.2
outdated
81
Chart.js
^4.5.1
81
GitHub Actions Toolkit (@actions/artifact)
^3.0.0
outdated
81
GitHub Actions Toolkit (@actions/artifact)
^3.0.0
outdated
81
GitHub Actions Toolkit (@actions/artifact)
^9.1.0
outdated
81
Requests
==2.33.0
outdated
81
RxJS
^7.8.2
81
esbuild
^0.28.0
81
express-rate-limit
^8.2.1
81
fast-xml-parser
^5.7.1
82
Satori
^0.26.0
outdated
82
async
^3.2.6
82
class-variance-authority
^0.7.1
82
go-openai
v1.37.0
outdated
82
js-yaml
5.2.1
outdated
84
Langfuse JS/TS SDK (@langfuse/client)
^5.4.0
84
ws
^8.19.0
85
Express
^5.2.1
86
AnyIO
==4.2.0
outdated
86
PyJWT
>=2.9.0
86
tailwind-merge
^3.5.0
87
Strands Agents
>=1.0.0,<2.0.0
88
Google Agent Development Kit (ADK)
>=1.32.0,<2
outdated
88
tsx
^4.21.0
88
yaml
^2.9.0
89
DOMPurify
^3.4.8
89
OpenAI Agents SDK
>=0.14.1,<0.15
outdated
89
jsdom
^29.0.0
outdated
89
python-sdk
>=1.0.0
90
@openai/agents
^0.11.3
outdated
90
Inquirer.js
^5.1.0
outdated
90
Inquirer.js
^6.0.8
outdated
90
Inquirer.js
^11.1.5
outdated
90
Inquirer.js
^5.0.8
outdated
90
Inquirer.js
^5.0.8
outdated
90
Inquirer.js
^4.1.8
outdated
90
Inquirer.js
^5.1.0
outdated
90
MCP TypeScript SDK
^1.29.0
90
SWC
^1.15.41
90
Smithy Core (@smithy/core)
^4.13.0
outdated
90
Tailwind CSS
^4.2.2
90
Tailwind CSS
^4.2.2
90
TanStack Virtual (React)
^3.13.22
90
docker-py
==7.1.0
outdated
90
keyv
^5.6.0
90
tqdm
==4.67.3
outdated
91
Chroma
==1.5.9
91
CrewAI
>=0.203.0
91
Faker
^10.2.0
91
FastAPI
>=0.115.0
91
Pydantic AI
==1.102.0
outdated
91
Recharts
^3.8.0
91
TanStack Table
^8.21.3
outdated
91
TanStack Table
^8.21.3
outdated
91
Uvicorn
>=0.32.0
91
playwright-python
>=1.55.0
91
prettier
^3.8.1
91
pytest-asyncio
>=0.24.0
92
AI SDK
^3.0.41
outdated
92
AI SDK
^6.0.190
outdated
92
Docusaurus
^3.9.2
92
Docusaurus
^3.9.2
92
Docusaurus
^3.9.2
92
Docusaurus
^3.9.2
92
Docusaurus
^3.9.2
92
Docusaurus
^3.9.2
92
Gradio
>=5.49.1
92
LangChain DeepSeek
==1.1.0
outdated
92
LangChain DeepSeek
==1.3.3
outdated
92
LangChain DeepSeek
==1.2.1
outdated
92
LangChain DeepSeek
==1.1.2
outdated
92
Pillow
==12.2.0
outdated
92
Playwright
^1.60.0
92
TanStack Query
^5.91.0
92
Zod
^4.3.6
92
lucide-react
^1.0.0
92
postcss
^8.5.10
92
undici
>=7.28.0 <8
outdated
93
@vitejs/plugin-react
^6.0.1
93
Anthropic TypeScript SDK
0.110.0
outdated
93
OpenTelemetry Prometheus Exporter
>=1.30.0
outdated
93
OpenTelemetry Prometheus Exporter
>=1.30.0
outdated
93
OpenTelemetry Prometheus Exporter
>=0.49b0
93
OpenTelemetry Python SDK
>=1.30.0
93
Pydantic
==2.13.4
outdated
93
Swiper
^14.0.0
93
Vitest
^4.1.0
outdated
93
Vitest
^4.1.0
outdated
93
Vitest
^4.0.18
outdated
93
posthog-js
1.379.1
outdated
93
posthog-js
~5.24.10
outdated
93
protobuf.js
^8.0.0
93
urllib3
==2.7.0
outdated
94
@babel/core
^7.29.6
outdated
94
AWS SDK for JavaScript (S3 Client)
^3.1045.0
94
AWS SDK for JavaScript (S3 Client)
^3.1003.0
94
AWS SDK for JavaScript (S3 Client)
^3.1045.0
94
AWS SDK for JavaScript (S3 Client)
^3.973.5
94
Vite
^8.0.16
94
pypdf
==6.13.3
outdated
95
Anthropic Python SDK
>=0.40.0
95
Datasets
==4.2.0
outdated
95
NumPy
==1.26.4
outdated
95
OpenAI
^6.37.0
outdated
95
React Router
^7.18.0
outdated
95
Socket.IO
^4.8.3
95
Socket.IO
^4.8.3
95
Storybook
^10.4.0
95
Storybook
^10.4.0
95
Storybook
^10.4.0
95
Storybook
^10.4.0
95
Transformers
>=4.0.0
95
jest
^30.2.0
96
Material UI
^9.0.0
96
Material UI
^9.0.0
96
Material UI
^9.0.0
96
OpenTelemetry JavaScript (@opentelemetry/api)
^1.9.0
96
OpenTelemetry JavaScript (@opentelemetry/api)
2.9.0
outdated
96
OpenTelemetry JavaScript (@opentelemetry/api)
^0.220.0
outdated
96
OpenTelemetry JavaScript (@opentelemetry/api)
^2.5.0
outdated
96
OpenTelemetry JavaScript (@opentelemetry/api)
^2.6.0
outdated
96
OpenTelemetry JavaScript (@opentelemetry/api)
^2.5.0
outdated
96
OpenTelemetry JavaScript (@opentelemetry/api)
^1.39.0
outdated
96
PyTorch
>=1.0.0
96
pytest
>=8.0.0
97
@azure/identity
^4.13.0
97
Google Cloud Storage
^8.1.2
97
OpenAI Python SDK
==2.26.0
outdated
97
TypeScript
^6.0.2
outdated
97
webpack
5.108.4
outdated
98
React
^1.0.0
outdated
98
React
^19.2.4
98
React DOM
^19.2.4
98
React DOM
^19.2.4
98
pandas
==2.3.3
outdated
