All 159 Dependencies

Every package PostgresML depends on, ranked by repo health score.

PostgresML is a PostgreSQL extension that brings machine learning and large language model inference directly into the database engine. Built in Rust using the pgrx framework, it exposes SQL functions like pgml.train, pgml.predict, pgml.embed, pgml.rank, and pgml.transform that execute ML operations in the same process as PostgreSQL — eliminating external API calls, data serialization overhead, and the latency of moving data to separate model servers.

The core insight is architectural: data for ML systems is inherently larger and more dynamic than the models themselves, so it is more efficient to bring models to the data rather than constantly moving data to the models. PostgresML realizes this by embedding Python bindings (via PyO3) inside the Rust extension, enabling direct invocation of Hugging Face Transformers, scikit-learn, XGBoost, LightGBM, and other libraries from within SQL queries — with optional GPU acceleration through CUDA.

The ecosystem extends beyond the extension itself. The project includes a Rocket-based web dashboard for managing models and visualizing metrics, a multi-language SDK (Rust, Python, JavaScript, C) for building RAG pipelines, integration with pgvector for approximate nearest neighbor search, and pgcat for horizontal connection pooling and sharding. Both self-hosted Docker deployments and a managed cloud service are available, making it accessible from local development to production-scale workloads.

22 @codemirror/lang-cpp ^6.0.2 22 @codemirror/lang-rust ^6.0.1 22 file-lock 2 24 @codemirror/lang-json ^6.0.1 24 @codemirror/lang-python ^6.1.3 24 blas-src 0.10 outdated 27 transformers-stream-generator 28 blas 0.22 outdated 29 hash32 =0.2.1 outdated 29 is-terminal 0.4 31 CodeMirror State ^6.2.1 32 lang-javascript ^6.2.1 33 csv-async 1 33 md5 0.7 outdated 34 mdurl ==0.1.2 35 pyo3-asyncio 0.18 outdated 36 CodeMirror ^6.0.1 39 pgvector-rust 0.3 outdated 40 @codemirror/view ^6.21.0 40 dotenv (Rust) 0.15 40 once_cell 1 43 colored 2 outdated 43 ndarray-stats 0.5 outdated 43 num-traits 0.2 44 ctrlc 3 44 six ==1.16.0 outdated 44 walkdir 2.4.0 45 async-timeout ==4.0.3 outdated 45 yaml-rust 0.4 46 openblas-src 0.10 47 Autosize ^6.0.1 48 markdown-rs 1.0.0-alpha.14 48 rmp-serde 1.3 50 aho-corasick 0.7 outdated 50 csv 1.3 51 typetag 0.2 52 convert_case 0.6 outdated 55 owo-colors 3 outdated 56 base64 0.21 outdated 56 einops 56 rich ^13.4.2 outdated 57 glob 0.3 57 url 2.4 59 quote 1.0.9 60 SacreBLEU 60 console-subscriber * 60 proc-macro2 1.0 61 PyYAML ==6.0.1 outdated 61 inquire 0.6 outdated 61 lazy_static 1.4 62 signal-hook 0.3 outdated 64 indexmap 2.7 65 Chrono 0.4 65 tzdata ==2023.3 outdated 67 Certifi ==2023.7.22 outdated 67 Scraper 0.17 outdated 67 anyhow 1 68 Evaluate 68 multiprocess ==0.70.15 outdated 68 pytz ==2023.3 outdated 69 async-trait 0.1.71 70 itertools 0.10 outdated 71 orjson 72 neon 0.10 outdated 72 python-dotenv ^1.0.0 73 Pygments ==2.16.1 outdated 73 ndarray 0.15 outdated 73 serde 1 74 indicatif 0.17.6 outdated 75 aiosignal ==1.3.1 outdated 75 rand 0.8 outdated 75 toml 0.7 outdated 76 Requests ^2.31.0 76 SQLx 0.7.3 outdated 76 regex 1 76 sea-query 0.30.7 outdated 76 sea-query 0.5.0 outdated 76 xFormers 77 pendulum ^2.1.2 outdated 77 tracing 0.1.37 77 tracing 0.3.17 outdated 78 dotenv ^16.3.1 outdated 78 sailfish 0.8 outdated 79 log 0.4 80 dill ==0.3.7 outdated 80 xxhash ==3.3.0 outdated 81 Optimum 81 flate2 1.0 81 idna ==3.4 outdated 81 pgrx =0.12.9 outdated 81 pgrx =0.12.9 outdated 81 reqwest 0.11 outdated 81 torchaudio 82 attrs ==23.1.0 outdated 82 frozenlist ==1.4.0 outdated 82 heapless 0.7 outdated 83 Charset Normalizer ==3.2.0 outdated 83 env_logger 0.10 outdated 83 fsspec ==2023.6.0 outdated 83 futures 0.3.29 83 parking_lot 0.12 outdated 84 markdown-it-py ==3.0.0 outdated 84 serde_json 1 84 sqlparser 0.38 outdated 84 typing_extensions ==4.7.1 outdated 85 packaging ==23.1 outdated 85 tqdm ==4.66.1 outdated 86 bitsandbytes 86 notify 6 outdated 86 notify 0.3 outdated 87 Click ^8.1.6 87 filelock ==3.12.3 outdated 87 serde_with 3.8.1 87 syn 2.0.17 outdated 87 uuid 1.3.3 88 Clap 4 88 dbt-postgres ^1.5.2 88 lopdf 0.31.0 outdated 88 python-dateutil ==2.8.2 outdated 88 tantivy 0.19 outdated 89 time 0.3 90 comrak 0.17 outdated 90 multidict ==6.0.4 outdated 90 pytest-asyncio 91 Black ^23.7.0 outdated 91 DOMPurify ^3.0.6 91 PEFT 91 PyO3 0.23 outdated 92 Sentry Rust SDK 0.31 outdated 92 Sentry Rust SDK 0.31 outdated 92 Sentry Rust SDK 0.31 outdated 92 accelerate 93 LangChain 93 Tokio 1 93 sentence-transformers 93 urllib3 ==2.0.4 outdated 93 yarl ==1.9.2 outdated 94 Bolt for Python ^1.18.0 94 DeepSpeed 94 Marked ^9.1.0 outdated 94 TRL 94 jest ^29.6.1 outdated 94 vision 95 LightGBM 95 PyArrow ==13.0.0 outdated 95 Transformers 95 TypeScript ^5.1.6 outdated 95 aiohttp ==3.8.5 outdated 95 dbt-core ^1.5.2 96 CatBoost 96 Datasets 96 NumPy ==1.25.2 outdated 96 PyTorch 96 Tokenizers 96 huggingface_hub 96 pytest 97 OpenAI Python SDK >=1.3.7 98 XGBoost 98 pandas ==2.0.3 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers