All 154 Dependencies

Every package PostgresML depends on, ranked by repo health score.

PostgresML is a PostgreSQL extension that brings machine learning and large language model inference directly into the database engine. Built in Rust using the pgrx framework, it exposes SQL functions like pgml.train, pgml.predict, pgml.embed, pgml.rank, and pgml.transform that execute ML operations in the same process as PostgreSQL — eliminating external API calls, data serialization overhead, and the latency of moving data to separate model servers.

The core insight is architectural: data for ML systems is inherently larger and more dynamic than the models themselves, so it is more efficient to bring models to the data rather than constantly moving data to the models. PostgresML realizes this by embedding Python bindings (via PyO3) inside the Rust extension, enabling direct invocation of Hugging Face Transformers, scikit-learn, XGBoost, LightGBM, and other libraries from within SQL queries — with optional GPU acceleration through CUDA.

The ecosystem extends beyond the extension itself. The project includes a Rocket-based web dashboard for managing models and visualizing metrics, a multi-language SDK (Rust, Python, JavaScript, C) for building RAG pipelines, integration with pgvector for approximate nearest neighbor search, and pgcat for horizontal connection pooling and sharding. Both self-hosted Docker deployments and a managed cloud service are available, making it accessible from local development to production-scale workloads.

22 @codemirror/lang-cpp ^6.0.2 22 @codemirror/lang-rust ^6.0.1 22 file-lock 2 24 @codemirror/lang-json ^6.0.1 24 @codemirror/lang-python ^6.1.3 24 blas-src 0.10 outdated 27 transformers-stream-generator 28 blas 0.22 outdated 29 hash32 =0.2.1 outdated 29 is-terminal 0.4 32 lang-javascript ^6.2.1 32 md5 0.7 outdated 33 csv-async 1 34 mdurl ==0.1.2 35 pyo3-asyncio 0.18 outdated 39 once_cell 1 40 dotenv (Rust) 0.15 43 colored 2 outdated 43 ndarray-stats 0.5 outdated 43 num-traits 0.2 43 walkdir 2.4.0 44 aho-corasick 0.7 outdated 44 six ==1.16.0 outdated 45 csv 1.3 45 openblas-src 0.10 45 yaml-rust 0.4 46 base64 0.21 outdated 48 markdown-rs 1.0.0-alpha.14 48 rmp-serde 1.3 48 typetag 0.2 51 convert_case 0.6 outdated 53 ctrlc 3 54 owo-colors 3 outdated 55 console-subscriber * 55 einops 55 glob 0.3 55 pgvector-rust 0.3 outdated 55 rich ^13.4.2 outdated 59 SacreBLEU 59 proc-macro2 1.0 60 Chrono 0.4 60 PyYAML ==6.0.1 outdated 61 lazy_static 1.4 63 async-trait 0.1.71 63 indexmap 2.7 64 quote 1.0.9 66 Certifi ==2023.7.22 outdated 66 signal-hook 0.3 outdated 66 tzdata ==2023.3 outdated 68 Pygments ==2.16.1 outdated 68 multiprocess ==0.70.15 outdated 68 url 2.4 69 Evaluate 69 Scraper 0.17 outdated 69 anyhow 1 70 orjson 70 regex 1 71 itertools 0.10 outdated 71 pytz ==2023.3 outdated 72 ndarray 0.15 outdated 72 serde 1 73 attrs ==23.1.0 outdated 73 rand 0.8 outdated 74 heapless 0.7 outdated 74 python-dotenv ^1.0.0 74 tqdm ==4.66.1 outdated 75 neon 0.10 outdated 76 aiosignal ==1.3.1 outdated 76 inquire 0.6 outdated 76 xFormers 77 Requests ^2.31.0 77 dotenv ^16.3.1 outdated 77 pendulum ^2.1.2 outdated 77 sailfish 0.8 outdated 77 toml 0.7 outdated 78 indicatif 0.17.6 outdated 78 pgrx =0.12.9 outdated 78 pgrx =0.12.9 outdated 78 reqwest 0.11 outdated 79 sea-query 0.30.7 outdated 79 sea-query 0.5.0 outdated 80 SQLx 0.7.3 outdated 80 tracing 0.1.37 80 tracing 0.3.17 outdated 80 xxhash ==3.3.0 outdated 81 dill ==0.3.7 outdated 81 idna ==3.4 outdated 81 parking_lot 0.12 outdated 81 torchaudio 82 flate2 1.0 82 frozenlist ==1.4.0 outdated 82 fsspec ==2023.6.0 outdated 82 serde_json 1 83 env_logger 0.10 outdated 84 Optimum 84 log 0.4 84 markdown-it-py ==3.0.0 outdated 84 sqlparser 0.38 outdated 84 time 0.3 85 Charset Normalizer ==3.2.0 outdated 85 bitsandbytes 85 futures 0.3.29 85 typing_extensions ==4.7.1 outdated 86 notify 6 outdated 86 notify 0.3 outdated 86 packaging ==23.1 outdated 86 serde_with 3.8.1 87 filelock ==3.12.3 outdated 87 lopdf 0.31.0 outdated 87 python-dateutil ==2.8.2 outdated 87 uuid 1.3.3 88 tantivy 0.19 outdated 89 Click ^8.1.6 89 dbt-postgres ^1.5.2 90 Black ^23.7.0 outdated 90 Clap 4 90 PEFT 90 PyO3 0.23 outdated 90 multidict ==6.0.4 outdated 90 syn 2.0.17 outdated 91 DOMPurify ^3.0.6 91 comrak 0.17 outdated 92 accelerate 92 pytest-asyncio 93 LangChain 93 PyArrow ==13.0.0 outdated 93 Sentry Rust SDK 0.31 outdated 93 Sentry Rust SDK 0.31 outdated 93 Sentry Rust SDK 0.31 outdated 93 sentence-transformers 93 urllib3 ==2.0.4 outdated 93 yarl ==1.9.2 outdated 94 CatBoost 94 DeepSpeed 94 LightGBM 94 Marked ^9.1.0 outdated 94 TRL 94 jest ^29.6.1 outdated 94 vision 95 Bolt for Python ^1.18.0 95 Tokio 1 95 Transformers 95 TypeScript ^5.1.6 outdated 95 aiohttp ==3.8.5 outdated 95 dbt-core ^1.5.2 96 Datasets 96 NumPy ==1.25.2 outdated 96 PyTorch 96 Tokenizers 96 huggingface_hub 96 pytest 97 OpenAI Python SDK >=1.3.7 98 XGBoost 98 pandas ==2.0.3 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers