Message Queues & Background Jobs Packages
Task queues, job schedulers, and background-processing libraries for running work asynchronously and reliably outside the request cycle (BullMQ, Celery).
Packages in Message Queues & Background Jobs
Kind
Sort:Used by Most Apps
cron-validate
A configurable TypeScript/JavaScript validator for cron expressions, with presets for crontab, node-cron, cron-schedule, and AWS CloudWatch.
Supervisor
A battle-tested client/server system for monitoring and auto-restarting UNIX processes.
Apache Beam
A unified programming model for defining batch and streaming data-parallel pipelines
Dramatiq
A fast and reliable distributed task processing library for Python
php-amqplib
The most widely used pure-PHP client for RabbitMQ and the AMQP 0-9-1 messaging protocol.
pyzmq
Python bindings for ZeroMQ, the lightweight messaging library for building distributed, concurrent, and asynchronous applications.
franz-go
A feature-complete, pure Go client for Apache Kafka with full protocol support, transactions, and admin tooling.
workflow
Durable, resilient workflow execution for TypeScript, with automatic retries, persistence, and built-in observability.
Django-RQ
Django integration for RQ (Redis Queue) with settings-based queues, a job decorator, and an admin dashboard.
async-nats
The official async, Tokio-based Rust client for the NATS messaging system
RQ Scheduler
Job scheduling capabilities for RQ, the Redis-based Python task queue.
aio-pika
An asyncio-native Python client for RabbitMQ that wraps aiormq with a high-level, fully type-hinted API and transparent auto-reconnection.
vapor-core
Core service providers and runtime client that run Laravel applications serverlessly on AWS Lambda.
workflow-js
A TypeScript SDK for writing durable, reliable serverless functions with automatic retries, delays, and event waiting, backed by Upstash QStash.
Symfony Scheduler
Cron-style and periodic task scheduling built on Symfony Messenger
dagster-aws
AWS resource library for Dagster pipelines: S3 I/O managers, an ECS run launcher, and Pipes clients for EMR, Glue, and Lambda.
dagster-docker
Dagster's official integration for launching runs and executing steps inside Docker containers.
dagster-slack
Slack integration for Dagster: post pipeline alerts and custom messages via a configurable resource, op/asset hooks, and a run-failure sensor.
agenda
A lightweight, TypeScript-first Node.js job scheduler with pluggable MongoDB, PostgreSQL, and Redis backends.
Hatchet Python SDK
Official Python SDK for Hatchet, a distributed, fault-tolerant task queue and durable workflow engine.
huey
A lightweight Python task queue with decorator-based tasks, scheduling, retries, and pluggable Redis, Postgres, SQLite, and file-system storage backends.
fluvio
The Rust client for Fluvio, a lean distributed data streaming engine.
iggy
The official Rust SDK for Apache Iggy, a hyper-efficient persistent message streaming platform.
Spatie Async
Run PHP code in parallel with an easy pool API built on PCNTL child processes.
