All 122 Dependencies

Every package Arroyo depends on, ranked by repo health score.

Arroyo is an open-source distributed stream processing engine written in Rust that lets you write standard SQL to run stateful, real-time computations over both bounded and unbounded data — turning what would otherwise be a batch job into a pipeline that emits results the moment data arrives. It targets the same class of problem as Apache Flink or Kafka Streams, but ships as a single self-contained binary (or Docker image / Helm chart) rather than requiring a JVM cluster, and treats SQL as a first-class interface instead of an afterthought bolted onto a lower-level API.

Under the hood, submitted queries are parsed and optimized by a planner built on Apache DataFusion and Arrow, then compiled into a dataflow graph that Arroyo's controller schedules across a pool of worker processes. Pipelines can maintain windows, joins, and other stateful operators across upstream failures because Arroyo checkpoints operator state directly to object storage (S3-compatible or similar) using a Parquet-based backend, giving pipelines fault tolerance and the ability to rescale without losing progress. For logic that doesn't fit neatly into SQL, Arroyo supports user-defined functions in both Rust and Python, dynamically compiled and loaded by a dedicated compiler service at pipeline build time.

Arroyo ships with a wide range of built-in connectors — Kafka, Confluent, Kinesis, Fluvio, MQTT, NATS, Redis, RabbitMQ, webhooks, WebSockets, and filesystem/Iceberg sinks among them — so pipelines can read from and write to the systems most real-time architectures already use, without writing custom I/O code. A bundled web console (built as a separate TypeScript application) provides a visual pipeline graph, a SQL/Monaco-based query editor, and job monitoring, so operators aren't limited to the CLI for day-to-day use.

The project is dual-licensed under Apache 2.0 and MIT with no enterprise-only fork or license-gated feature set, and it has attracted an active open-source community with regular releases and ongoing commit activity, backed by ArroyoSystems, the company behind it.

18 sasl2-sys 0.1.22 20 aws-msk-iam-sasl-signer 1.0.0 23 clio 0.3.5 28 murmur3 0.5.2 29 integer-encoding 4.0.2 29 tracing-logfmt 0.2.0 outdated 30 nkeys 0.3.0 outdated 31 mini-moka 0.10.3 33 similar-asserts 1.6.1 outdated 33 tokio-postgres-rustls 0.13 outdated 35 mime_guess 2.0.4 36 figment 0.10 36 rustls-pemfile 2 38 shlex 1.3 outdated 39 json-subscriber 0.2.6 outdated 40 prop-types ^15.8.1 41 jemalloc_pprof 0.7.0 outdated 42 ajv-formats ^2.1.1 outdated 43 rabbitmq-stream-client 0.7 outdated 43 unicase 2.7.0 49 ArcSwap 1.7.1 49 nanoid (Rust) 0.4 outdated 50 async-ffi 0.5 50 React Syntax Highlighter ^15.6.1 outdated 50 serde_json_path 0.7 52 axum-server 0.7 outdated 52 xxhash-rust 0.8.12 53 @monaco-editor/react ^4.7.0 53 Formik ^2.4.6 53 pprof 0.15.0 outdated 53 rust-rdkafka 0.39 55 ulid-rs 1.2.1 outdated 56 local-ip-address 0.6 56 tokio-tungstenite 0.24 outdated 58 rumqttc 0.24.0 outdated 59 governor 0.8.0 outdated 59 tracing 0.2 outdated 59 tracing 0.2 outdated 61 async-stream 0.3.5 61 usehooks-ts ^3.1.1 62 refinery 0.8.14 outdated 63 D3.js ^7.9.0 63 downshift ^8.5.0 outdated 63 eslint-plugin-react ^7.37.5 64 Emotion ^11.14.0 64 Emotion ^11.14.0 65 memchr 2 65 react-markdown ^9.1.0 outdated 65 Schemars 1.0.4 66 Ajv ^8.17.1 66 eventsource-client 0.13.0 outdated 66 openapi-typescript ^0.6.2 outdated 66 openapi-typescript ^7 67 fluvio 0.24 outdated 67 url 2.3.1 68 Lodash ^4.17.21 68 rustls-native-certs 0.8 71 Fontsource Inter ^5.2.5 71 Fontsource Inter ^4.5.15 outdated 71 async-compression 0.4.3 71 sha2 0.10 outdated 72 proc-macro2 1.0 73 open 5.3.0 73 ordered-float 3 outdated 74 Dagre ^0.8.5 outdated 75 tempfile 3 76 rust_decimal 1 77 log 0.4.20 77 num-bigint 0.4.6 77 quote 1 77 React Resizable Panels ^0.0.55 outdated 78 Motion ^10.18.0 outdated 78 React Icons ^4.12.0 outdated 78 regress 0.10.0 outdated 80 async-nats 0.38.0 outdated 81 tokio-postgres * 81 tokio-postgres * 81 tokio-rustls 0.25 outdated 83 eslint-plugin-import ^2.31.0 84 SWR 2.3.3 outdated 85 utoipa 7 outdated 90 Clap 4 90 prettier ^2.8.8 outdated 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ^2.2.4 outdated 91 chakra-ui ^2.10.7 outdated 91 chakra-ui ^2.3.1 outdated 91 chakra-ui ^2.12.0 outdated 91 axum 0.9 outdated 91 iceberg 0.6.0 outdated 91 iceberg 0.6.0 outdated 91 Monaco Editor ^0.34.1 outdated 91 PyO3 0.21 outdated 91 React Flow ^11.11.4 outdated 91 time 0.3 92 @vitejs/plugin-react ^6.0.2 92 aws-config 1.2.0 92 aws-sdk-s3 1.95 92 futures 0.3.28 92 kube 0.99 outdated 92 postcss ^8.5.3 92 redis-rs 0.28 outdated 92 Thrift 0.17 outdated 93 rustls 0.22 outdated 93 smallvec 1 outdated 93 Tokio 0.7.10 outdated 93 Vite ^8.0.16 94 @babel/core ^7.26.10 outdated 94 @rjsf/core ^5.24.8 outdated 94 @rjsf/core ^5.24.8 outdated 94 @rjsf/core ^5.24.8 outdated 94 @rjsf/core ^5.24.8 outdated 94 typescript-eslint ^5.62.0 outdated 94 typescript-eslint ^5.62.0 outdated 94 ESLint ^8.57.1 outdated 94 React Router =6.28.1 outdated 95 AG Grid Community ^31.3.4 outdated 95 AG Grid Community ^31.3.4 outdated 96 TypeScript ^5.8 outdated 97 React ^18.3.1 outdated 97 React DOM ^18.3.1 outdated 97 React DOM ^18.3.1 outdated

All 122 Dependencies

Join founders buildingwith open source

Search