All 122 Dependencies

Every package Arroyo depends on, ranked by repo health score.

Arroyo is an open-source distributed stream processing engine written in Rust that lets you write standard SQL to run stateful, real-time computations over both bounded and unbounded data — turning what would otherwise be a batch job into a pipeline that emits results the moment data arrives. It targets the same class of problem as Apache Flink or Kafka Streams, but ships as a single self-contained binary (or Docker image / Helm chart) rather than requiring a JVM cluster, and treats SQL as a first-class interface instead of an afterthought bolted onto a lower-level API.

Under the hood, submitted queries are parsed and optimized by a planner built on Apache DataFusion and Arrow, then compiled into a dataflow graph that Arroyo's controller schedules across a pool of worker processes. Pipelines can maintain windows, joins, and other stateful operators across upstream failures because Arroyo checkpoints operator state directly to object storage (S3-compatible or similar) using a Parquet-based backend, giving pipelines fault tolerance and the ability to rescale without losing progress. For logic that doesn't fit neatly into SQL, Arroyo supports user-defined functions in both Rust and Python, dynamically compiled and loaded by a dedicated compiler service at pipeline build time.

Arroyo ships with a wide range of built-in connectors — Kafka, Confluent, Kinesis, Fluvio, MQTT, NATS, Redis, RabbitMQ, webhooks, WebSockets, and filesystem/Iceberg sinks among them — so pipelines can read from and write to the systems most real-time architectures already use, without writing custom I/O code. A bundled web console (built as a separate TypeScript application) provides a visual pipeline graph, a SQL/Monaco-based query editor, and job monitoring, so operators aren't limited to the CLI for day-to-day use.

The project is dual-licensed under Apache 2.0 and MIT with no enterprise-only fork or license-gated feature set, and it has attracted an active open-source community with regular releases and ongoing commit activity, backed by ArroyoSystems, the company behind it.

18 sasl2-sys 0.1.22 19 aws-msk-iam-sasl-signer 1.0.0 23 clio 0.3.5 28 murmur3 0.5.2 28 tracing-logfmt 0.2.0 outdated 29 integer-encoding 4.0.2 31 mini-moka 0.10.3 32 similar-asserts 1.6.1 outdated 33 tokio-postgres-rustls 0.13 outdated 35 mime_guess 2.0.4 36 rustls-pemfile 2 37 shlex 1.3 outdated 38 jemalloc_pprof 0.7.0 outdated 38 json-subscriber 0.2.6 outdated 40 prop-types ^15.8.1 40 unicase 2.7.0 42 ajv-formats ^2.1.1 outdated 43 nkeys 0.3.0 outdated 43 rabbitmq-stream-client 0.7 outdated 45 ArcSwap 1.7.1 47 nanoid (Rust) 0.4 outdated 48 serde_json_path 0.7 49 async-ffi 0.5 49 figment 0.10 49 rust-rdkafka 0.39 50 React Syntax Highlighter ^15.6.1 outdated 50 axum-server 0.7 outdated 51 xxhash-rust 0.8.12 52 pprof 0.15.0 outdated 53 @monaco-editor/react ^4.7.0 53 Formik ^2.4.6 53 local-ip-address 0.6 53 ulid-rs 1.2.1 outdated 55 tokio-tungstenite 0.24 outdated 56 governor 0.8.0 outdated 57 rumqttc 0.24.0 outdated 58 tracing 0.2 outdated 58 tracing 0.2 outdated 59 async-stream 0.3.5 59 downshift ^8.5.0 outdated 59 refinery 0.8.14 outdated 61 eslint-plugin-react ^7.37.5 61 memchr 2 61 usehooks-ts ^3.1.1 62 D3.js ^7.9.0 62 Emotion ^11.14.0 62 Emotion ^11.14.0 63 Ajv ^8.17.1 63 Schemars 1.0.4 63 eventsource-client 0.13.0 outdated 63 url 2.3.1 64 fluvio 0.24 outdated 65 quote 1 66 react-markdown ^9.1.0 outdated 66 rustls-native-certs 0.8 67 Lodash ^4.17.21 67 proc-macro2 1.0 67 sha2 0.10 outdated 68 tempfile 3 68 tokio-postgres * 68 tokio-postgres * 71 log 0.4.20 71 open 5.3.0 71 ordered-float 3 outdated 72 Dagre ^0.8.5 outdated 72 Fontsource Inter ^5.2.5 72 Fontsource Inter ^4.5.15 outdated 74 async-compression 0.4.3 74 num-bigint 0.4.6 74 rust_decimal 1 76 React Icons ^4.12.0 outdated 76 regress 0.10.0 outdated 78 eslint-plugin-import ^2.31.0 78 openapi-typescript ^0.6.2 outdated 78 openapi-typescript ^7 78 tokio-rustls 0.25 outdated 79 Motion ^10.18.0 outdated 82 async-nats 0.38.0 outdated 83 SWR 2.3.3 outdated 84 React Resizable Panels ^0.0.55 outdated 87 utoipa 7 outdated 89 kube 0.99 outdated 89 time 0.3 90 Clap 4 90 PyO3 0.21 outdated 90 futures 0.3.28 91 React Flow ^11.11.4 outdated 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ^2.2.4 outdated 91 chakra-ui ^2.10.7 outdated 91 chakra-ui ^2.3.1 outdated 91 chakra-ui ^2.12.0 outdated 91 iceberg 0.6.0 outdated 91 iceberg 0.6.0 outdated 91 prettier ^2.8.8 outdated 91 redis-rs 0.28 outdated 92 Monaco Editor ^0.34.1 outdated 92 Thrift 0.17 outdated 92 axum 0.9 outdated 92 postcss ^8.5.3 92 smallvec 1 93 @vitejs/plugin-react ^6.0.2 93 aws-config 1.2.0 93 aws-sdk-s3 1.95 93 rustls 0.22 outdated 94 @babel/core ^7.26.10 outdated 94 Vite ^8.0.16 94 typescript-eslint ^5.62.0 outdated 94 typescript-eslint ^5.62.0 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 AG Grid Community ^31.3.4 outdated 95 AG Grid Community ^31.3.4 outdated 95 ESLint ^8.57.1 outdated 95 React Router =6.28.1 outdated 95 Tokio 0.7.10 outdated 97 TypeScript ^5.8 outdated 98 React ^18.3.1 outdated 98 React DOM ^18.3.1 outdated 98 React DOM ^18.3.1 outdated

All 122 Dependencies

Join founders buildingwith open source