All 403 Dependencies

Every package Apache Airflow depends on, ranked by repo health score.

Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring workflows. Built at Airbnb and donated to the Apache Software Foundation, it treats pipelines as first-class Python code, giving data engineers the full power of the language to express complex task dependencies, parameterize runs, and version-control their pipelines alongside application code.

At the core of Airflow is the Directed Acyclic Graph (DAG) — a declarative representation of tasks and their dependencies. The scheduler continuously evaluates DAGs, queues tasks that are ready to run, and dispatches them to workers via pluggable executors: a local multiprocess executor for single-node deployments, a Celery executor for distributed queues, or a Kubernetes executor that launches each task as its own Pod. As of Airflow 3.0, the architecture has been refactored into a modular multi-package layout with a dedicated Task SDK, a clean FastAPI-based execution API, and first-class support for asset-driven scheduling.

Airflow ships with an extensive provider ecosystem covering over 80 external systems — AWS, GCP, Azure, Snowflake, dbt, Databricks, Spark, and many more — each providing pre-built operators, hooks, and sensors. The web UI offers real-time DAG graph visualization, task-level log streaming, backfill controls, and variable and connection management. Its plugin architecture allows teams to extend virtually every layer of the system without forking core code.

The project is maintained by a large and active Apache community with over 3,000 contributors and is in production at hundreds of organizations including Airbnb, LinkedIn, Twitter, ING, and NASA. It is the de facto standard for Python-native workflow orchestration in data engineering and MLOps.

18 yandex-query-client >=0.1.4 20 chartjs-adapter-dayjs-4 ^1.0.4 20 funcsigs ==1.0.2 22 @lezer/highlight ^1.2.3 22 hmsclient >=0.1.0 22 sphinxcontrib-htmlhelp >=2.0.1 23 sphinxcontrib-qthelp >=1.0.3 23 sphinxcontrib-serializinghtml >=1.1.5 24 sphinxcontrib-applehelp >=1.0.4 24 sphinxcontrib-devhelp >=1.0.2 28 react-innertext ^1.1.5 30 retryhttp >=1.4.0 31 pytest-icdiff >=0.9 33 kgb >=7.2.0 35 a2wsgi >=1.10.8 35 msgraphfs >=0.3.0 36 restructuredtext-lint >=1.4.0 38 anser ^2.3.5 38 azure-data-lake-store-python >=0.0.45 39 aiosqlite >=0.20.0,!=0.22.0 39 eslint-plugin-i18next ^6.1.5 40 SQLAlchemy Spanner >=1.6.2 40 python-tabulate >=0.9.0 40 remark-gfm ^4.0.1 42 akeyless-python >=5.0.0 42 jmespath.py >=0.7.0 43 Colorama ==0.4.0 outdated 43 pydruid >=0.6.6 43 pystatsd >=3.3.0 43 sphinxcontrib-jsmath >=1.0.1 44 HdfsCLI >=2.5.4 44 impyla >=0.22.0,<1.0 44 next-themes ^0.4.6 44 presto-python-client >=0.8.4 44 remark-math ^7.0.1 outdated 44 remark-math ^6.0.0 44 requests-kerberos >=0.14.0 44 sqlalchemy-drill >=1.1.0,!=1.1.6,!=1.1.7 45 Blinker >=1.7.0 45 Microsoft Authentication Extensions for Python >=1.3.0 45 uuid v1.6.0 46 itsdangerous >=2.0 46 msgpack v5.4.1 47 Flask-Limiter >3 47 Viper v1.20.1 outdated 49 Alibaba Cloud Tea OpenAPI >=0.3.7 49 chakra-react-select ^6.1.3 49 python3-saml >=1.16.0 50 Cobra v1.10.1 outdated 50 incremental >=24.7.2 50 python-docx >=1.0.0 50 vertica-python >=1.3.0 50 ydb-dbapi >=0.1.0 51 requests-toolbelt >=1.0.0 51 universal-pathlib >=0.3.8 51 zenpy >=2.0.40 52 PyHive >=0.7.0 52 papermill >=2.6.0 52 pypsrp >=0.8.0 53 Jinja >=3.1.5 53 hvac >=1.1.0 53 use-debounce ^10.1.1 54 @visx/shape ^3.12.0 outdated 54 @visx/shape ^3.12.0 outdated 54 Flask-SQLAlchemy >=3.0.5 54 color v1.18.0 outdated 54 dataclasses-json >=0.6.7 55 Graphviz (Python) >=0.20 55 rich >=13.6.0 55 setproctitle >=1.3.3 55 simple-salesforce >=1.0.0 55 sphinx-copybutton >=0.5.2 55 ts-morph ^27.0.2 outdated 56 eslint-plugin-jsx-a11y ^6.10.2 56 pygtrie >=2.5.0 57 airbyte-api-python-sdk >=1.0.0,<2.0 57 cloudpickle >=2.2.1 57 sphinx-autobuild >=2024.10.2 58 jest-dom ^6.9.1 outdated 59 cast v1.10.0 59 pywinrm >=0.5.0 59 sphinx-design >=0.5.0 60 PyYAML >=6.0.3 60 React Testing Library ^16.3.2 61 React Icons ^5.7.0 61 kubernetes_asyncio >=32.0.0,<37.0.0 62 @monaco-editor/react ^4.7.0 62 Flask-Login >=0.6.2 62 React Syntax Highlighter ^15.6.1 outdated 62 pyspnego >=0.4.0 62 python-lazy-object-proxy >=1.2.0 62 usehooks-ts ^3.1.1 63 HTTPX >=0.25.0 63 httpmock v1.4.0 outdated 63 react-markdown ^9.1.0 outdated 63 stub_uploader >=6.2.0.20251022 63 stub_uploader >=2.9.0.20240316 63 stub_uploader >=2.31.0 64 Emotion ^11.14.0 65 esbuild ^0.28.1 65 tomli >=2.0.1 66 @rolldown/plugin-babel ^0.2.3 66 react-chartjs-2 ^5.3.1 67 eslint-config-prettier ^10.1.8 67 mysql-connector-python >=9.1.0 67 python-xmlsec >=1.3.14 67 sendgrid-python >=6.12.5 67 sphinxcontrib-mermaid >=1.0.0 68 Pygments >=2.0.1,!=2.19.0 68 i18next-browser-languageDetector ^8.2.1 69 aliyun-odps-python-sdk >=0.12.2.2 69 chartjs-plugin-annotation ^3.1.0 70 azure-kusto-python >=4.1.0,!=5.0.0 71 greenlet >=3.1.0 71 jwt v5.3.0 outdated 71 pytz ==2020.1 outdated 71 structlog >=25.4.0 72 PyExasol >=0.26.0,<2 outdated 72 cron-descriptor >=1.2.24 72 psycopg2 >=2.9.9 72 s3fs >=2023.10.0 72 tenacity >=8.3.0 72 termcolor >=3.0.0 72 wheel >=0.42.0 73 SQLAlchemy-Utils >=0.41.2 73 attrs >=22.1.0, !=25.2.0 73 eslint-plugin-jsonc ^3.3.0 73 eslint-plugin-prettier ^5.5.6 74 AlibabaCloud ADB20211201 >=1.0.0 74 asgiref >=2.3.0 74 croniter >=2.0.2 74 globals ^15.15.0 outdated 74 influxdb-client-python >=1.19.0 74 marshmallow >=3 74 nbconvert >=7.16.1 74 pgvector-python >=0.3.1 74 python-dotenv >=0.21.0 74 python-semver >=3.0.4 74 python-slugify >=5.0 74 testify v1.11.1 outdated 74 tqdm >=4.67.1 74 tsx ^4.21.0 75 Microsoft Kiota Abstractions >=1.9.4,<2.0.0 75 Paramiko ==3.4.0 outdated 75 elkjs ^0.11.1 outdated 75 msgraph-sdk-python-core >=1.3.3 75 time-machine >=3.0.0 76 Flask-AppBuilder ==5.2.2 outdated 76 aiomysql >=0.2.0 76 go-plugin v1.7.0 outdated 76 i18next-http-backend ^3.0.5 outdated 76 py-amqp >=5.2.0 76 sphinx-autoapi >=3.8.0 76 sqlparse >=0.5.1 77 Flask-WTF >=1.1.0 77 Requests >=2.32.0,<3 77 cachetools >=6.0.0 77 facebook-python-business-sdk >=22.0.0 77 pendulum >=3.1.0 77 pyparsing ==2.4.7 outdated 78 AsyncSSH >=2.12.0 78 Cohere Python SDK >=5.13.4 78 Deprecated >=1.2.13 78 Flit >=3.12.0 78 Flit >=3.12.0 78 IBM Cloudant Python SDK >=0.10.0 78 aiosmtplib >=0.1.6 78 testcontainers-python >=4.12.0 78 yaml ^2.9.0 79 python-multipart 80 Day.js ^1.11.21 80 InfluxDB 3.0 Python Client >=0.7.0 81 Psycopg >=3.2.9 81 SQLGlot >=30.0.0 81 dill >=0.2.2 81 pluggy >=1.5.0 81 react-i18next ^16.6.5 outdated 81 unplugin-dts ^4.3.0 outdated 82 botocore >=1.41.0 82 datadogpy >=0.50.0 82 fsspec >=2023.10.0 82 gevent >=25.4.1 82 google-ads-python >=26.0.0,!=28.0.0.post2 82 jsonpath-ng >=1.5.3 82 python-ldap >=3.4.4 82 rich-click >=1.9.7 83 asyncpg >=0.30.0 83 duckdb >=1.2.0 83 fastavro >=1.10.0 83 html-to-image ^1.11.13 84 Chart.js ^4.5.1 84 Gunicorn >=23.0.0,!=25.1.0 84 MSW (Mock Service Worker) ^2.14.6 outdated 84 cryptography >=44.0.3 84 gcsfs >=2023.10.0 84 mypy >=1.0.0 84 psutil >=5.8.0 84 pytest-xdist >=3.3.1 84 types-pytz >=2024.1.0.20240417 84 types-toml >=0.10.8.20240310 85 Flask >=2.2.1 85 Gremlin-Python >=3.8.0 85 Hatch >=1.17.1 85 PyGithub >=2.1.1 85 WTForms >=3.0 85 Zustand ^5.0.14 85 docker-py >=7.1.0 85 react-hotkeys-hook ^5.3.3 85 typing_extensions >=4.14.1 86 JPype >=1.4.0,!=1.7.0 86 more-itertools >=9.0.0 86 packaging >=25.0 86 pflag v1.0.10 outdated 86 python-oracledb >=2.3.0 87 Babel >=2.17.0 87 GitPython >=3.1.40 87 PyJWT >=2.11.0 87 PySpark >=4.0.0 87 PySpark >=4.0.0 87 confluent-kafka-python >=2.6.0 87 filelock >=3.13.0 87 pytest-mock >=3.14.0 87 python-dateutil >=2.7.0 88 Alembic >=1.13.1, <2.0 88 React Resizable Panels ^3.0.6 outdated 88 Yandex Cloud Python SDK >=0.383.0 89 Click >=8.3.0 89 i18next ^25.8.16 outdated 90 Black >=26.1.0 90 Databricks SQL Connector for Python >=4.0.0 90 Elasticsearch Python Client >=8.10,<10 90 Pinecone Python SDK >=7.0.0 outdated 90 Uvicorn >=0.37.0 90 astroid >=4 90 dnspython >=1.13.0 90 gcloud-aio-bigquery >=5.2.0 90 gcloud-aio-bigquery >=6.1.2 90 gcloud-aio-bigquery >=9.0.0 outdated 90 jsonschema >=4.19.1 90 lxml 90 msgspec >=0.19.0 90 pipdeptree >=2.13.1 90 weaviate-python-client >=4.4.0,!=4.16.7 91 KaTeX ^0.17.0 outdated 91 Pydantic AI >=2.0.0 91 Ruff ==0.15.21 outdated 91 TanStack Virtual (React) ^3.14.5 91 Typer >=0.22.0 91 boto3 >=1.37.2 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ~3.36.0 outdated 91 coveragepy >=7.4.0 91 eslint-plugin-react ^7.37.5 91 importlib_metadata >=6.5 91 ipykernel >=6.29.4 91 prettier ^3.9.4 92 @vitejs/plugin-react ^6.0.3 92 Celery >=5.5.0,<6 92 Databricks SDK for Python ==0.10.0 outdated 92 FastAPI >=0.129.0,<0.137.0 outdated 92 Google API Python Client >=2.142.0 92 Playwright ^1.61.1 92 Polars >=1.26.0 92 React Flow ^12.11.1 92 React Hook Form ^7.80.0 92 TanStack Query ^5.101.2 92 TanStack Query ^5.101.2 92 TanStack Table ^8.21.3 outdated 92 clickhouse-connect >=1.3.0 92 platformdirs >=4.3.6 92 pytest-asyncio >=1.1.0 92 snowflake-connector-python >=3.17.0 93 Kiota Authentication Azure >=1.9.4,<2.0.0 93 Kiota Authentication Azure >=1.9.4,<2.0.0 93 Kiota Authentication Azure >=1.9.4 93 Kiota Authentication Azure >=1.9.4 93 LangChain >=1.0.0 93 Mermaid ^11.16.0 outdated 93 Monaco Editor ^0.55.1 outdated 93 PyArrow >=16.1.0 93 Pydantic >=2.11.0 93 SQLAlchemy >=2.0.48 93 Starlette >=1.0.1 93 Vitest ^4.1.9 outdated 93 Vitest ^4.1.9 outdated 93 Werkzeug >=2.2 93 llama-index-llms-openai-like >=0.13.0 outdated 93 urllib3 >=2.1.0,!=2.6.0 94 Apache Beam >=2.69.0 94 Authlib >=1.0.0 94 Google Gen AI Python SDK >=2.8.0 94 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 94 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 94 OpenTelemetry Prometheus Exporter >=0.47b0 94 OpenTelemetry Prometheus Exporter <9999,>=1.27.0 outdated 94 Vite ^8.1.3 94 setuptools >=80.0.0,<9999 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 95 Anthropic Python SDK >=0.101.0 95 Axios ^1.18.1 95 ESLint ^10.0.1 95 ESLint ^10.6.0 95 OpenLineage Integration Common >=1.47.0 95 React Router ^7.18.1 outdated 95 TypeScript ^6.0.3 outdated 95 aiohttp >=3.14.0 95 kubernetes >=35.0.0,!=36.0.0,<37.0.0 outdated 95 pypdf >=4.0.0 95 python-telegram-bot >=20.2 95 redis-py >=4.5.2,!=4.5.5,!=5.0.2 96 Apache Airflow >=3.1.3 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow >=1.7.4 96 Apache Airflow >=1.6.3 96 Apache Airflow >=1.28.1 96 Apache Airflow >=2.2.0 96 Apache Airflow 96 Apache Airflow >=2.3.1 96 Apache Airflow >=1.9.0 96 Apache Airflow <1.5.0,>=1.4.0 outdated 96 NumPy >=1.22.4 96 Sphinx >=7 96 pytest >=9.0.0 96 sentry-sdk >=2.30.0 97 OpenAI Python SDK >=2.37.0 97 Slack SDK for Python >=3.36.0 97 google-cloud-aiplatform >=1.155.0 98 Azure Container Service Management (Python) >=8.0.0,<15.0.0 outdated 98 Azure Container Service Management (Python) >=4.6.0 98 Azure Container Service Management (Python) >=4.1.0 98 Azure Container Service Management (Python) >=33.0.0 98 Azure Container Service Management (Python) >=10.1.0 98 Azure Container Service Management (Python) >=8.0.0 98 Azure Container Service Management (Python) >=3.0.0 98 Azure Container Service Management (Python) >=0.5.0 98 Azure Container Service Management (Python) >=2.2.0 98 Azure Container Service Management (Python) >=16.0.0 98 Azure Container Service Management (Python) >=7.12.1 98 Azure Container Service Management (Python) >=12.9.1 98 Azure Container Service Management (Python) >=12.7.0 98 Azure Container Service Management (Python) >=0.17.0 98 Azure Container Service Management (Python) >=0.2.0 98 Azure Data Factory Management Client >=10.0.0 98 Azure Identity (Python) >=1.3.1 98 Azure Storage Blob >=12.26.0 98 React ^1.0.0 outdated 98 React ^7.1.1 outdated 98 React ^19.2.7 98 React DOM ^19.2.7 98 gRPC Python (grpcio) >=1.59.0 98 google-auth >=0.9.0 98 google-auth >=2.30.3 98 google-auth >=2.29.0 98 google-auth >=0.2.0 98 google-auth >=1.2.0 98 google-auth >=0.4.0 98 google-auth >=2.12.0 98 google-auth >=0.13.0 98 google-auth >=3.13.0 outdated 98 google-auth >=2.31.0 98 google-auth >=2.17.0 98 google-auth >=3.31.0 outdated 98 google-auth >=1.10.0 98 google-auth >=2.52.0 98 google-auth >=3.23.0 outdated 98 google-auth >=0.8.6 98 google-auth >=0.5.0 98 google-auth >=2.6.0 98 google-auth >=5.27.0 outdated 98 google-auth >=1.12.0 98 google-auth >=3.12.0 outdated 98 google-auth >=2.15.0 98 google-auth >=2.9.0 98 google-auth >=3.5.0 outdated 98 google-auth >=0.1.6 98 google-auth >=1.7.0 98 google-auth >=2.18.0 98 google-auth >=1.10.0 98 google-auth >=2.9.1 98 google-auth >=2.24.0 98 google-auth >=2.12.0 98 google-auth >=0.10.0 98 google-auth >=2.16.0 98 google-auth >=3.50.0 outdated 98 google-auth >=2.18.0 98 google-auth >=2.9.0 98 google-auth >=1.13.0 98 google-auth >=2.13.0 98 google-auth >=2.14.1 98 google-auth >=3.16.0 outdated 98 google-auth >=2.11.0 98 google-auth >=3.4.0 outdated 98 google-auth >=1.10.0 98 google-auth >=0.7.0 98 google-auth >=1.26.0 98 google-auth >=1.2.1 98 pandas >=2.1.2 98 swagger-ui-react ^5.32.8

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers