All 122 Dependencies

Every package Arroyo depends on, ranked by repo health score.

Arroyo is an open-source distributed stream processing engine written in Rust that lets you write standard SQL to run stateful, real-time computations over both bounded and unbounded data — turning what would otherwise be a batch job into a pipeline that emits results the moment data arrives. It targets the same class of problem as Apache Flink or Kafka Streams, but ships as a single self-contained binary (or Docker image / Helm chart) rather than requiring a JVM cluster, and treats SQL as a first-class interface instead of an afterthought bolted onto a lower-level API.

Under the hood, submitted queries are parsed and optimized by a planner built on Apache DataFusion and Arrow, then compiled into a dataflow graph that Arroyo's controller schedules across a pool of worker processes. Pipelines can maintain windows, joins, and other stateful operators across upstream failures because Arroyo checkpoints operator state directly to object storage (S3-compatible or similar) using a Parquet-based backend, giving pipelines fault tolerance and the ability to rescale without losing progress. For logic that doesn't fit neatly into SQL, Arroyo supports user-defined functions in both Rust and Python, dynamically compiled and loaded by a dedicated compiler service at pipeline build time.

Arroyo ships with a wide range of built-in connectors — Kafka, Confluent, Kinesis, Fluvio, MQTT, NATS, Redis, RabbitMQ, webhooks, WebSockets, and filesystem/Iceberg sinks among them — so pipelines can read from and write to the systems most real-time architectures already use, without writing custom I/O code. A bundled web console (built as a separate TypeScript application) provides a visual pipeline graph, a SQL/Monaco-based query editor, and job monitoring, so operators aren't limited to the CLI for day-to-day use.

The project is dual-licensed under Apache 2.0 and MIT with no enterprise-only fork or license-gated feature set, and it has attracted an active open-source community with regular releases and ongoing commit activity, backed by ArroyoSystems, the company behind it.

18 sasl2-sys 0.1.22 19 aws-msk-iam-sasl-signer 1.0.0 23 clio 0.3.5 28 murmur3 0.5.2 28 tracing-logfmt 0.2.0 outdated 29 integer-encoding 4.0.2 30 mini-moka 0.10.3 32 similar-asserts 1.6.1 outdated 32 tokio-postgres-rustls 0.13 outdated 35 mime_guess 2.0.4 36 rustls-pemfile 2 36 serde_json_path 0.7 38 shlex 1.3 outdated 38 ulid-rs 1.2.1 outdated 40 nkeys 0.3.0 outdated 40 prop-types ^15.8.1 42 ajv-formats ^2.1.1 outdated 43 async-ffi 0.5 44 rabbitmq-stream-client 0.7 outdated 45 nanoid (Rust) 0.4 outdated 46 json-subscriber 0.2.6 outdated 47 xxhash-rust 0.8.12 48 axum-server 0.7 outdated 48 rust-rdkafka 0.39 48 tokio-tungstenite 0.24 outdated 49 jemalloc_pprof 0.7.0 outdated 49 pprof 0.15.0 outdated 52 @monaco-editor/react ^4.7.0 52 local-ip-address 0.6 53 Formik ^2.4.6 54 governor 0.8.0 outdated 54 memchr 2 55 ArcSwap 1.7.1 56 async-stream 0.3.5 56 downshift ^8.5.0 outdated 56 rumqttc 0.24.0 outdated 57 url 2.3.1 58 unicase 2.7.0 59 quote 1 60 Ajv ^8.17.1 60 proc-macro2 1.0 61 usehooks-ts ^3.1.1 62 eslint-plugin-import ^2.31.0 62 tempfile 3 64 React Syntax Highlighter ^15.6.1 outdated 65 Lodash ^4.17.21 65 react-markdown ^9.1.0 outdated 66 Emotion ^11.14.0 66 Emotion ^11.14.0 66 eventsource-client 0.13.0 outdated 66 fluvio 0.24 outdated 67 figment 0.10 68 num-bigint 0.4.6 68 refinery 0.8.14 outdated 68 rustls-native-certs 0.8 69 Fontsource Inter ^5.2.5 69 Fontsource Inter ^4.5.15 outdated 69 React Icons ^4.12.0 outdated 72 tokio-postgres * 72 tokio-postgres * 73 D3.js ^7.9.0 73 open 5.3.0 74 sha2 0.10 outdated 75 Schemars 1.0.4 75 openapi-typescript ^0.6.2 outdated 75 openapi-typescript ^7 75 ordered-float 3 outdated 75 tokio-rustls 0.25 outdated 76 regress 0.10.0 outdated 77 tracing 0.2 outdated 77 tracing 0.2 outdated 79 Motion ^10.18.0 outdated 79 log 0.4.20 80 async-compression 0.4.3 81 SWR 2.3.3 outdated 81 rust_decimal 1 83 futures 0.3.28 84 Dagre ^0.8.5 outdated 85 async-nats 0.38.0 outdated 87 React Resizable Panels ^0.0.55 outdated 87 eslint-plugin-react ^7.37.5 88 Clap 4 88 kube 0.99 outdated 88 utoipa 7 outdated 89 time 0.3 91 PyO3 0.21 outdated 91 React Flow ^11.11.4 outdated 91 axum 0.9 outdated 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ^2.2.4 outdated 91 chakra-ui ^2.10.7 outdated 91 chakra-ui ^2.3.1 outdated 91 chakra-ui ^2.12.0 outdated 91 iceberg 0.6.0 outdated 91 iceberg 0.6.0 outdated 91 prettier ^2.8.8 outdated 92 @vitejs/plugin-react ^6.0.2 92 Thrift 0.17 outdated 92 aws-sdk-s3 1.95 92 postcss ^8.5.3 92 redis-rs 0.28 outdated 93 Monaco Editor ^0.34.1 outdated 93 Tokio 0.7.10 outdated 93 aws-config 1.2.0 93 smallvec 1 94 Vite ^8.0.16 94 rustls 0.22 outdated 94 typescript-eslint ^5.62.0 outdated 94 typescript-eslint ^5.62.0 outdated 95 @babel/core ^7.26.10 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 @rjsf/core ^5.24.8 outdated 95 AG Grid Community ^31.3.4 outdated 95 AG Grid Community ^31.3.4 outdated 95 ESLint ^8.57.1 outdated 95 React Router =6.28.1 outdated 95 TypeScript ^5.8 outdated 98 React ^18.3.1 outdated 98 React DOM ^18.3.1 outdated 98 React DOM ^18.3.1 outdated

All 122 Dependencies

Join founders buildingwith open source