All 403 Dependencies

Every package Apache Airflow depends on, ranked by repo health score.

Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring workflows. Built at Airbnb and donated to the Apache Software Foundation, it treats pipelines as first-class Python code, giving data engineers the full power of the language to express complex task dependencies, parameterize runs, and version-control their pipelines alongside application code.

At the core of Airflow is the Directed Acyclic Graph (DAG) — a declarative representation of tasks and their dependencies. The scheduler continuously evaluates DAGs, queues tasks that are ready to run, and dispatches them to workers via pluggable executors: a local multiprocess executor for single-node deployments, a Celery executor for distributed queues, or a Kubernetes executor that launches each task as its own Pod. As of Airflow 3.0, the architecture has been refactored into a modular multi-package layout with a dedicated Task SDK, a clean FastAPI-based execution API, and first-class support for asset-driven scheduling.

Airflow ships with an extensive provider ecosystem covering over 80 external systems — AWS, GCP, Azure, Snowflake, dbt, Databricks, Spark, and many more — each providing pre-built operators, hooks, and sensors. The web UI offers real-time DAG graph visualization, task-level log streaming, backfill controls, and variable and connection management. Its plugin architecture allows teams to extend virtually every layer of the system without forking core code.

The project is maintained by a large and active Apache community with over 3,000 contributors and is in production at hundreds of organizations including Airbnb, LinkedIn, Twitter, ING, and NASA. It is the de facto standard for Python-native workflow orchestration in data engineering and MLOps.

18 sphinxcontrib-jsmath >=1.0.1 18 yandex-query-client >=0.1.4 19 chartjs-adapter-dayjs-4 ^1.0.4 20 funcsigs ==1.0.2 22 sphinxcontrib-htmlhelp >=2.0.1 23 @lezer/highlight ^1.2.3 23 sphinxcontrib-qthelp >=1.0.3 23 sphinxcontrib-serializinghtml >=1.1.5 24 hmsclient >=0.1.0 24 sphinxcontrib-applehelp >=1.0.4 24 sphinxcontrib-devhelp >=1.0.2 28 react-innertext ^1.1.5 30 pytest-icdiff >=0.9 32 retryhttp >=1.4.0 35 a2wsgi >=1.10.8 36 restructuredtext-lint >=1.4.0 36 setproctitle >=1.3.3 37 kgb >=7.2.0 38 anser ^2.3.5 38 azure-data-lake-store-python >=0.0.45 38 python-lazy-object-proxy >=1.2.0 40 SQLAlchemy Spanner >=1.6.2 40 aiosqlite >=0.20.0,!=0.22.0 40 eslint-plugin-i18next ^6.1.5 40 remark-gfm ^4.0.1 41 python-tabulate >=0.9.0 41 requests-toolbelt >=1.0.0 42 akeyless-python >=5.0.0 42 incremental >=24.7.2 43 jmespath.py >=0.7.0 44 Colorama ==0.4.0 outdated 44 HdfsCLI >=2.5.4 44 pydruid >=0.6.6 44 pystatsd >=3.3.0 44 remark-math ^7.0.1 outdated 44 remark-math ^6.0.0 44 requests-kerberos >=0.14.0 44 sphinx-autobuild >=2024.10.2 45 Blinker >=1.7.0 45 Microsoft Authentication Extensions for Python >=1.3.0 45 next-themes ^0.4.6 45 presto-python-client >=0.8.4 45 uuid v1.6.0 46 impyla >=0.22.0,<1.0 46 itsdangerous >=2.0 46 msgpack v5.4.1 46 sphinx-copybutton >=0.5.2 46 ydb-dbapi >=0.1.0 47 Viper v1.20.1 outdated 47 msgraphfs >=0.3.0 47 tomli >=2.0.1 48 Flask-Limiter >3 48 papermill >=2.6.0 48 sqlalchemy-drill >=1.1.0,!=1.1.6,!=1.1.7 49 python3-saml >=1.16.0 50 React Syntax Highlighter ^15.6.1 outdated 50 chakra-react-select ^6.1.3 50 jsonpath-ng >=1.5.3 50 vertica-python >=1.3.0 51 Graphviz (Python) >=0.20 51 mysql-connector-python >=9.1.0 52 Alibaba Cloud Tea OpenAPI >=0.3.7 52 aiomysql >=0.2.0 52 python-docx >=1.0.0 52 universal-pathlib >=0.3.8 53 @monaco-editor/react ^4.7.0 53 Jinja >=3.1.5 53 PyHive >=0.7.0 53 PyYAML >=6.0.3 53 hvac >=1.1.0 54 Cobra v1.10.1 outdated 54 html-to-image ^1.11.13 55 Flask-SQLAlchemy >=3.0.5 55 cron-descriptor >=1.2.24 55 dataclasses-json >=0.6.7 55 kubernetes_asyncio >=32.0.0,<37.0.0 55 pypsrp >=0.8.0 55 python-xmlsec >=1.3.14 55 pywinrm >=0.5.0 56 @visx/shape ^3.12.0 outdated 56 @visx/shape ^3.12.0 outdated 56 HTTPX >=0.25.0 56 WTForms >=3.0 56 eslint-plugin-jsx-a11y ^6.10.2 56 i18next-browser-languageDetector ^8.2.1 56 pyspnego >=0.4.0 57 rich >=13.6.0 57 ts-morph ^27.0.2 outdated 57 use-debounce ^10.1.1 59 airbyte-api-python-sdk >=1.0.0,<2.0 59 httpmock v1.4.0 outdated 60 pygtrie >=2.5.0 60 sendgrid-python >=6.12.5 60 zenpy >=2.0.40 61 eslint-plugin-prettier ^5.5.6 61 eslint-plugin-react ^7.37.5 61 i18next-http-backend ^3.0.5 outdated 61 usehooks-ts ^3.1.1 62 Emotion ^11.14.0 62 Flask-Login >=0.6.2 62 stub_uploader >=6.2.0.20251022 62 stub_uploader >=2.9.0.20240316 62 stub_uploader >=2.31.0 63 cast v1.10.0 63 python-dotenv >=0.21.0 63 simple-salesforce >=1.0.0 64 Flask-WTF >=1.1.0 64 React Testing Library ^16.3.2 64 cloudpickle >=2.2.1 64 sphinx-autoapi >=3.8.0 65 @rolldown/plugin-babel ^0.2.3 65 jest-dom ^6.9.1 outdated 65 jwt v5.3.0 outdated 65 s3fs >=2023.10.0 66 Paramiko ==3.4.0 outdated 66 color v1.18.0 outdated 66 react-markdown ^9.1.0 outdated 66 termcolor >=3.0.0 67 PyExasol >=0.26.0,<2 outdated 67 aliyun-odps-python-sdk >=0.12.2.2 67 pgvector-python >=0.3.1 67 react-chartjs-2 ^5.3.1 68 azure-kusto-python >=4.1.0,!=5.0.0 68 eslint-config-prettier ^10.1.8 68 nbconvert >=7.16.1 69 python-multipart 70 dill >=0.2.2 71 cachetools >=6.0.0 71 python-semver >=3.0.4 71 wheel >=0.42.0 72 Cohere Python SDK >=5.13.4 72 globals ^15.15.0 outdated 72 msgraph-sdk-python-core >=1.3.3 72 psycopg2 >=2.9.9 72 py-amqp >=5.2.0 73 AlibabaCloud ADB20211201 >=1.0.0 73 Flask-AppBuilder ==5.2.2 outdated 73 chartjs-plugin-annotation ^3.1.0 73 marshmallow >=3 73 python-dateutil >=2.7.0 74 Microsoft Kiota Abstractions >=1.9.4,<2.0.0 74 SQLAlchemy-Utils >=0.41.2 74 influxdb-client-python >=1.19.0 74 sphinxcontrib-mermaid >=1.0.0 74 sqlparse >=0.5.1 74 tenacity >=8.3.0 75 asgiref >=2.3.0 75 elkjs ^0.11.1 outdated 75 fastavro >=1.10.0 75 pendulum >=3.1.0 75 python-slugify >=5.0 75 testify v1.11.1 outdated 76 AsyncSSH >=2.12.0 76 IBM Cloudant Python SDK >=0.10.0 76 React Icons ^5.7.0 76 datadogpy >=0.50.0 76 eslint-plugin-jsonc ^3.3.0 76 facebook-python-business-sdk >=22.0.0 76 pytz ==2020.1 outdated 76 structlog >=25.4.0 76 time-machine >=3.0.0 77 Flit >=3.12.0 77 Flit >=3.12.0 77 croniter >=2.0.2 77 react-i18next ^16.6.5 outdated 78 Day.js ^1.11.21 78 Deprecated >=1.2.13 78 InfluxDB 3.0 Python Client >=0.7.0 78 Zustand ^5.0.14 78 aiosmtplib >=0.1.6 78 go-plugin v1.7.0 outdated 78 sphinx-design >=0.5.0 78 unplugin-dts ^4.3.0 outdated 79 MSW (Mock Service Worker) ^2.14.6 79 Sphinx >=7 79 greenlet >=3.1.0 80 attrs >=22.1.0, !=25.2.0 80 typing_extensions >=4.14.1 81 Chart.js ^4.5.1 81 Flask >=2.2.1 81 JPype >=1.4.0,!=1.7.0 81 Psycopg >=3.2.9 81 Requests >=2.32.0,<3 81 SQLGlot >=30.0.0 81 esbuild ^0.28.1 81 pflag v1.0.10 81 pytest-xdist >=3.3.1 82 botocore >=1.41.0 82 duckdb >=1.2.0 82 fsspec >=2023.10.0 82 i18next ^25.8.16 outdated 82 importlib_metadata >=6.5 82 pluggy >=1.5.0 82 python-ldap >=3.4.4 82 react-hotkeys-hook ^5.3.3 82 testcontainers-python >=4.12.0 83 PyGithub >=2.1.1 83 asyncpg >=0.30.0 83 gcsfs >=2023.10.0 83 google-ads-python >=26.0.0,!=28.0.0.post2 83 mypy >=1.0.0 84 Gremlin-Python >=3.8.0 84 React Resizable Panels ^3.0.6 outdated 84 confluent-kafka-python >=2.6.0 84 cryptography >=44.0.3 84 psutil >=5.8.0 84 pytest-mock >=3.14.0 84 types-pytz >=2024.1.0.20240417 84 types-toml >=0.10.8.20240310 85 Babel >=2.17.0 85 packaging >=25.0 85 python-oracledb >=2.3.0 86 PyJWT >=2.11.0 86 pipdeptree >=2.13.1 86 pyparsing ==2.4.7 outdated 86 rich-click >=1.9.7 87 Authlib >=1.0.0 87 PySpark >=4.0.0 87 PySpark >=4.0.0 87 dnspython >=1.13.0 87 more-itertools >=9.0.0 88 Click >=8.3.0 88 GitPython >=3.1.40 88 Gunicorn >=23.0.0,!=25.1.0 88 Hatch >=1.17.1 88 Yandex Cloud Python SDK >=0.383.0 88 gevent >=25.4.1 88 platformdirs >=4.3.6 88 tsx ^4.21.0 88 yaml ^2.9.0 89 Alembic >=1.13.1, <2.0 89 Databricks SQL Connector for Python >=4.0.0 89 Pinecone Python SDK >=7.0.0 outdated 89 Typer >=0.22.0 89 filelock >=3.13.0 89 lxml 89 msgspec >=0.19.0 90 Black >=26.1.0 90 Databricks SDK for Python ==0.10.0 outdated 90 Ruff ==0.15.21 outdated 90 TanStack Virtual (React) ^3.14.5 90 astroid >=4 90 docker-py >=7.1.0 90 gcloud-aio-bigquery >=5.2.0 90 gcloud-aio-bigquery >=6.1.2 90 gcloud-aio-bigquery >=9.0.0 outdated 90 ipykernel >=6.29.4 90 jsonschema >=4.19.1 90 tqdm >=4.67.1 90 weaviate-python-client >=4.4.0,!=4.16.7 91 Celery >=5.5.0,<6 91 FastAPI >=0.129.0,<0.137.0 outdated 91 Google API Python Client >=2.142.0 91 Pydantic AI >=2.0.0 91 Pygments >=2.0.1,!=2.19.0 91 React Flow ^12.11.1 91 TanStack Table ^8.21.3 outdated 91 Uvicorn >=0.37.0 91 boto3 >=1.37.2 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ~3.36.0 outdated 91 prettier ^3.9.4 91 pytest-asyncio >=1.1.0 92 KaTeX ^0.17.0 outdated 92 Kiota Authentication Azure >=1.9.4,<2.0.0 92 Kiota Authentication Azure >=1.9.4,<2.0.0 92 Kiota Authentication Azure >=1.9.4 92 Kiota Authentication Azure >=1.9.4 92 LangChain >=1.0.0 92 Mermaid ^11.16.0 outdated 92 Monaco Editor ^0.55.1 outdated 92 Playwright ^1.61.1 92 Polars >=1.26.0 92 React Hook Form ^7.80.0 92 TanStack Query ^5.101.2 92 TanStack Query ^5.101.2 92 clickhouse-connect >=1.3.0 92 llama-index-llms-openai-like >=0.13.0 outdated 92 snowflake-connector-python >=3.17.0 93 @vitejs/plugin-react ^6.0.3 93 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 93 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 93 OpenTelemetry Prometheus Exporter >=0.47b0 93 OpenTelemetry Prometheus Exporter <9999,>=1.27.0 outdated 93 Pydantic >=2.11.0 93 SQLAlchemy >=2.0.48 93 Vitest ^4.1.9 outdated 93 Vitest ^4.1.9 outdated 93 setuptools >=80.0.0,<9999 93 urllib3 >=2.1.0,!=2.6.0 94 Apache Beam >=2.69.0 94 Axios ^1.18.1 94 Elasticsearch Python Client >=8.10,<10 94 Google Gen AI Python SDK >=2.8.0 94 Starlette >=1.0.1 94 Vite ^8.1.3 94 Werkzeug >=2.2 94 kubernetes >=35.0.0,!=36.0.0,<37.0.0 94 pypdf >=4.0.0 94 redis-py >=4.5.2,!=4.5.5,!=5.0.2 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 95 Anthropic Python SDK >=0.101.0 95 ESLint ^10.0.1 95 ESLint ^10.6.0 95 NumPy >=1.22.4 95 OpenLineage Integration Common >=1.47.0 95 PyArrow >=16.1.0 95 React Router ^7.18.1 outdated 95 aiohttp >=3.14.0 95 coveragepy >=7.4.0 96 Apache Airflow >=3.1.3 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow >=1.7.4 96 Apache Airflow >=1.6.3 96 Apache Airflow >=1.28.1 96 Apache Airflow >=2.2.0 96 Apache Airflow 96 Apache Airflow >=2.3.1 96 Apache Airflow >=1.9.0 96 Apache Airflow <1.5.0,>=1.4.0 outdated 96 Slack SDK for Python >=3.36.0 96 pytest >=9.0.0 96 python-telegram-bot >=20.2 96 sentry-sdk >=2.30.0 97 OpenAI Python SDK >=2.37.0 97 TypeScript ^6.0.3 outdated 97 gRPC Python (grpcio) >=1.59.0 97 google-cloud-aiplatform >=1.155.0 97 swagger-ui-react ^5.32.8 98 Azure Container Service Management (Python) >=8.0.0,<15.0.0 outdated 98 Azure Container Service Management (Python) >=4.6.0 98 Azure Container Service Management (Python) >=4.1.0 98 Azure Container Service Management (Python) >=33.0.0 98 Azure Container Service Management (Python) >=10.1.0 98 Azure Container Service Management (Python) >=8.0.0 98 Azure Container Service Management (Python) >=3.0.0 98 Azure Container Service Management (Python) >=0.5.0 98 Azure Container Service Management (Python) >=2.2.0 98 Azure Container Service Management (Python) >=16.0.0 98 Azure Container Service Management (Python) >=7.12.1 98 Azure Container Service Management (Python) >=12.9.1 98 Azure Container Service Management (Python) >=12.7.0 98 Azure Container Service Management (Python) >=0.17.0 98 Azure Container Service Management (Python) >=0.2.0 98 Azure Data Factory Management Client >=10.0.0 98 Azure Identity (Python) >=1.3.1 98 Azure Storage Blob >=12.26.0 98 React ^1.0.0 outdated 98 React ^7.1.1 outdated 98 React ^19.2.7 98 React DOM ^19.2.7 98 google-auth >=0.9.0 98 google-auth >=2.30.3 98 google-auth >=2.29.0 98 google-auth >=0.2.0 98 google-auth >=1.2.0 98 google-auth >=0.4.0 98 google-auth >=2.12.0 98 google-auth >=0.13.0 98 google-auth >=3.13.0 outdated 98 google-auth >=2.31.0 98 google-auth >=2.17.0 98 google-auth >=3.31.0 outdated 98 google-auth >=1.10.0 98 google-auth >=2.52.0 98 google-auth >=3.23.0 outdated 98 google-auth >=0.8.6 98 google-auth >=0.5.0 98 google-auth >=2.6.0 98 google-auth >=5.27.0 outdated 98 google-auth >=1.12.0 98 google-auth >=3.12.0 outdated 98 google-auth >=2.15.0 98 google-auth >=2.9.0 98 google-auth >=3.5.0 outdated 98 google-auth >=0.1.6 98 google-auth >=1.7.0 98 google-auth >=2.18.0 98 google-auth >=1.10.0 98 google-auth >=2.9.1 98 google-auth >=2.24.0 98 google-auth >=2.12.0 98 google-auth >=0.10.0 98 google-auth >=2.16.0 98 google-auth >=3.50.0 outdated 98 google-auth >=2.18.0 98 google-auth >=2.9.0 98 google-auth >=1.13.0 98 google-auth >=2.13.0 98 google-auth >=2.14.1 98 google-auth >=3.16.0 outdated 98 google-auth >=2.11.0 98 google-auth >=3.4.0 outdated 98 google-auth >=1.10.0 98 google-auth >=0.7.0 98 google-auth >=1.26.0 98 google-auth >=1.2.1 98 pandas >=2.1.2

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers