All 130 Dependencies

Every package PeerDB depends on, ranked by repo health score.

PeerDB is an open-source ETL/ELT tool purpose-built for streaming data out of PostgreSQL rather than treating it as one generic connector among hundreds. Instead of a YAML config file or a SaaS console, PeerDB fronts its pipelines with `nexus`, a Rust-built server that speaks the Postgres wire protocol on port 9900 — so a pipeline (a "mirror") is created, monitored, and torn down with plain SQL statements like `CREATE MIRROR`, run from psql, pgAdmin, a BI tool, or a migration framework like Flyway.

Under the hood, a Go service (`flow`) defines Temporal workflows — `CDCFlowWorkflow`, `QRepFlowWorkflow`, `SnapshotFlowWorkflow`, `SetupFlowWorkflow`, `DropFlowWorkflow`, and `MaintenanceFlowWorkflow` — that orchestrate the actual data movement. Sources are captured via PostgreSQL logical replication (WAL), MySQL binlog (GTID or file-position), or MongoDB change streams; a dedicated snapshot worker parallelizes the initial full-table backfill by partition before CDC takes over for ongoing changes. Destinations include Snowflake, BigQuery, ClickHouse, PostgreSQL, S3, Kafka, Event Hubs, Pub/Sub, and Elasticsearch, with a catalog Postgres database tracking peers, flows, table-schema mappings, and per-batch state, and MinIO staging AVRO files between pull and load.

The project puts real engineering into problems that generic ETL tools often gloss over for Postgres specifically: efficient streaming of large TOASTed columns without re-fetching whole rows, tuned logical-replication configs and parallel WAL-slot reads for 10x faster CDC, and automatic detection and replay of source schema changes (tracked in a `schema_delta_audit` table). Fault tolerance comes from Temporal's built-in state persistence, retries, and crash recovery, with Slack and email alerting wired in for mirror failures.

PeerDB is licensed AGPL-3.0 and the self-hosted stack (Docker Compose or Tilt for local dev) ships with the full connector set and no license-gated features; PeerDB Cloud (peerdb.io) is a separately hosted managed offering built on the same open-source core, and the project is also available natively inside ClickHouse Cloud's ClickPipes.

27 urlencoding 2 31 tokio-postgres-rustls 0.14 34 pem 3.0 outdated 34 tailwindcss-animate ^1.0.7 36 hex 0.4 36 rustls-pemfile 2.0 40 prop-types ^15.8.1 42 reflect2 v1.0.3-0.20250322232337-35a7c28c31ee 44 gcp-bigquery-client 0.28 45 uuid v1.6.0 46 base64 0.22 outdated 46 go-ruleguard dsl v0.3.23 46 jsoniter v1.1.12 49 godotenv v1.5.1 50 gopher-lua v1.1.2 51 pbjson 0.8 outdated 51 pbjson 0.8 outdated 52 classnames ^2.5.1 52 pglogrepl v0.0.0-20260401131349-e37c41485510 55 dotenvy 0.15.7 55 react-select ^5.10.1 57 rustls-pki-types 1.0 58 NextAuth.js ^4.24.13 58 jsonwebtoken 10 outdated 62 @monaco-editor/react ^4.7.0 63 async-trait 0.1 64 prost 0.14 66 react-chartjs-2 ^5.3.0 67 eslint-config-prettier ^10.1.2 68 bytes 1.0 68 secrecy 0.10 68 tokio-postgres 0.19.10 outdated 68 tokio-postgres 0.2.5 outdated 68 tokio-postgres 0.7.6 69 anyhow 1.0 70 go-grpc-middleware v2.3.3 70 logr v1.4.3 outdated 70 similar 3 71 refinery 0.9 outdated 72 Pebble v2.1.6 outdated 72 serde 1.0 73 rand 0.10 73 sha2 0.11 74 aes-gcm 0.11.0-rc.1 74 testify v1.11.1 outdated 76 SWR ^2.3.3 77 Radix UI ^1.2.3 77 Radix UI ^1.1.8 77 Radix UI ^1.1.11 77 Radix UI ^2.1.12 outdated 77 Radix UI ^0.1.4 outdated 77 Radix UI ^1.1.11 77 Radix UI ^1.1.4 77 Radix UI ^1.3.4 77 Radix UI ^1.2.2 77 Radix UI ^1.1.9 77 Radix UI ^1.2.11 77 Radix UI ^1.0.3 77 Radix UI ^1.1.7 77 Radix UI ^1.2.4 77 tokio-rustls 0.26 77 toxiproxy v2.12.0 outdated 78 go-elasticsearch v8.19.6 78 material-symbols ^0.45.0 outdated 78 mysql_async 0.37 78 react-spinners ^0.17.0 78 reqwest 0.12 outdated 79 react-toastify ^11.0.5 80 date-fns ^4.1.0 80 franz-go v1.21.4 outdated 80 franz-go v1.18.0 outdated 80 franz-go v1.0.0 outdated 80 tracing 0.2 outdated 80 tracing 0.3 outdated 81 rsa 0.9.2 outdated 82 serde_json 1.0 83 decimal v1.4.0 outdated 83 go-mysql v1.15.1-0.20260701093637-35ca5c6ee8c8 outdated 84 Chart.js ^4.5.1 84 pgx v4 v5.10.0 84 sqlparser 0.62 outdated 85 Moment Timezone ^0.6.0 85 Moment.js ^2.30.1 85 futures 0.3.28 85 futures 0.3 87 styled-components ^6.1.17 87 uuid 1.0 88 protobuf.js ^8.0.0 89 jwx v3.1.1 outdated 90 Clap 4.0 91 Protobuf-ES ^2.10.0 91 Tailwind CSS ^4.1.4 91 Tailwind CSS ^4.0.17 91 prettier ^3.5.3 92 Zod ^4.0.0 92 postcss ^8.5.3 92 testcontainers-go v0.43.0 outdated 92 tonic 0.14 92 tonic 0.14 92 tonic 0.14 92 urfave/cli v3.10.1 93 aws-config 1 93 aws-sdk-s3 1 94 rustls 0.23 95 AWS SDK for Go v2 v1.42.0 outdated 95 AWS SDK for Go v2 v1.32.26 outdated 95 AWS SDK for Go v2 v1.19.25 outdated 95 AWS SDK for Go v2 v1.6.29 outdated 95 AWS SDK for Go v2 v1.21.0 outdated 95 AWS SDK for Go v2 v1.53.5 95 AWS SDK for Go v2 v1.104.1 95 AWS SDK for Go v2 v1.35.3 outdated 95 AWS SDK for Go v2 v1.43.4 outdated 95 ESLint ^9.39.2 outdated 95 Tokio 0.1 outdated 95 Tokio 0.7 outdated 95 TypeScript ^6.0.0 outdated 95 clickhouse-go v2.47.0 outdated 95 grpc-gateway v2.29.0 outdated 95 slack v0.27.0 outdated 96 Next.js ^16.0.0 96 Next.js ^16.0.7 97 TiDB v0.0.0-20250130070702-43f2fb91d740 outdated 97 TiDB v0.0.0-20260504140133-511dba1dbe17 outdated 97 azcore v1.14.0 outdated 97 azcore v2.0.2 97 azcore v1.3.0 outdated 97 webpack ^5.99.7 98 React ^19.2.1 98 React DOM ^19.2.1

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers