All 48 Dependencies

Every package PrivateGPT depends on, ranked by repo health score.

PrivateGPT is an open-source API layer that sits between your applications and locally running LLMs, providing the higher-level building blocks needed to build real AI products without cloud dependencies. Rather than running models itself, PrivateGPT connects to any OpenAI-compatible inference server and wraps it with production-grade capabilities: document ingestion and retrieval, built-in tools for web search and code execution, MCP connector support, database querying, and a skills system for reusable AI behaviors.

Version 1.0 represents a complete rebuild from its viral 2023 origins as a document chat script. The project now follows the Claude API specification as its reference model, making it a drop-in local backend for tools like Claude Code, Claude Desktop, and Microsoft 365 Office add-ins. Developers point their existing Claude API clients at PrivateGPT and get private, offline-capable inference with the same messages format, streaming, tool use, and retrieval-with-citations they expect from the hosted API.

PrivateGPT is maintained by Zylon, a company building enterprise AI infrastructure for regulated organizations. The open-source project powers Zylon's commercial platform, which adds Kubernetes orchestration, LDAP integration, SIEM audit logs, and managed deployment on top of the same API layer.

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers

Search