All 403 Dependencies

Every package Apache Airflow depends on, ranked by repo health score.

Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring workflows. Built at Airbnb and donated to the Apache Software Foundation, it treats pipelines as first-class Python code, giving data engineers the full power of the language to express complex task dependencies, parameterize runs, and version-control their pipelines alongside application code.

At the core of Airflow is the Directed Acyclic Graph (DAG) — a declarative representation of tasks and their dependencies. The scheduler continuously evaluates DAGs, queues tasks that are ready to run, and dispatches them to workers via pluggable executors: a local multiprocess executor for single-node deployments, a Celery executor for distributed queues, or a Kubernetes executor that launches each task as its own Pod. As of Airflow 3.0, the architecture has been refactored into a modular multi-package layout with a dedicated Task SDK, a clean FastAPI-based execution API, and first-class support for asset-driven scheduling.

Airflow ships with an extensive provider ecosystem covering over 80 external systems — AWS, GCP, Azure, Snowflake, dbt, Databricks, Spark, and many more — each providing pre-built operators, hooks, and sensors. The web UI offers real-time DAG graph visualization, task-level log streaming, backfill controls, and variable and connection management. Its plugin architecture allows teams to extend virtually every layer of the system without forking core code.

The project is maintained by a large and active Apache community with over 3,000 contributors and is in production at hundreds of organizations including Airbnb, LinkedIn, Twitter, ING, and NASA. It is the de facto standard for Python-native workflow orchestration in data engineering and MLOps.

18 yandex-query-client >=0.1.4 19 chartjs-adapter-dayjs-4 ^1.0.4 20 funcsigs ==1.0.2 22 @lezer/highlight ^1.2.3 22 sphinxcontrib-htmlhelp >=2.0.1 23 hmsclient >=0.1.0 23 sphinxcontrib-qthelp >=1.0.3 23 sphinxcontrib-serializinghtml >=1.1.5 24 sphinxcontrib-applehelp >=1.0.4 24 sphinxcontrib-devhelp >=1.0.2 28 react-innertext ^1.1.5 30 pytest-icdiff >=0.9 31 retryhttp >=1.4.0 33 kgb >=7.2.0 35 a2wsgi >=1.10.8 35 msgraphfs >=0.3.0 36 restructuredtext-lint >=1.4.0 38 anser ^2.3.5 38 azure-data-lake-store-python >=0.0.45 39 aiosqlite >=0.20.0,!=0.22.0 39 akeyless-python >=5.0.0 39 eslint-plugin-i18next ^6.1.5 40 SQLAlchemy Spanner >=1.6.2 40 remark-gfm ^4.0.1 41 incremental >=24.7.2 41 python-tabulate >=0.9.0 42 Microsoft Authentication Extensions for Python >=1.3.0 42 jmespath.py >=0.7.0 43 pydruid >=0.6.6 43 pystatsd >=3.3.0 43 ydb-dbapi >=0.1.0 44 Colorama ==0.4.0 outdated 44 HdfsCLI >=2.5.4 44 next-themes ^0.4.6 44 remark-math ^7.0.1 outdated 44 remark-math ^6.0.0 44 requests-kerberos >=0.14.0 44 sphinxcontrib-jsmath >=1.0.1 45 Alibaba Cloud Tea OpenAPI >=0.3.7 45 Blinker >=1.7.0 45 impyla >=0.22.0,<1.0 45 presto-python-client >=0.8.4 45 sqlalchemy-drill >=1.1.0,!=1.1.6,!=1.1.7 45 uuid v1.6.0 46 Graphviz (Python) >=0.20 46 itsdangerous >=2.0 46 msgpack v5.4.1 47 Viper v1.20.1 outdated 48 Flask-Limiter >3 49 chakra-react-select ^6.1.3 49 python3-saml >=1.16.0 50 vertica-python >=1.3.0 51 python-docx >=1.0.0 51 universal-pathlib >=0.3.8 52 @monaco-editor/react ^4.7.0 52 PyHive >=0.7.0 53 Cobra v1.10.1 outdated 53 Jinja >=3.1.5 53 hvac >=1.1.0 53 papermill >=2.6.0 53 pypsrp >=0.8.0 53 pywinrm >=0.5.0 53 requests-toolbelt >=1.0.0 54 dataclasses-json >=0.6.7 54 sphinx-copybutton >=0.5.2 55 @visx/shape ^3.12.0 outdated 55 @visx/shape ^3.12.0 outdated 55 Flask-SQLAlchemy >=3.0.5 55 airbyte-api-python-sdk >=1.0.0,<2.0 55 simple-salesforce >=1.0.0 55 use-debounce ^10.1.1 56 color v1.18.0 outdated 56 eslint-plugin-jsx-a11y ^6.10.2 56 rich >=13.6.0 56 ts-morph ^27.0.2 outdated 56 zenpy >=2.0.40 57 pygtrie >=2.5.0 57 setproctitle >=1.3.3 59 jest-dom ^6.9.1 outdated 59 sendgrid-python >=6.12.5 59 sphinx-autobuild >=2024.10.2 59 sphinx-design >=0.5.0 60 cast v1.10.0 60 sphinx-autoapi >=3.8.0 61 PyYAML >=6.0.3 61 React Testing Library ^16.3.2 61 cloudpickle >=2.2.1 61 httpmock v1.4.0 outdated 61 sphinxcontrib-mermaid >=1.0.0 61 usehooks-ts ^3.1.1 62 aiomysql >=0.2.0 62 python-xmlsec >=1.3.14 63 i18next-browser-languageDetector ^8.2.1 63 kubernetes_asyncio >=32.0.0,<37.0.0 63 pyspnego >=0.4.0 63 stub_uploader >=6.2.0.20251022 63 stub_uploader >=2.9.0.20240316 63 stub_uploader >=2.31.0 64 Flask-Login >=0.6.2 64 React Syntax Highlighter ^15.6.1 outdated 64 python-lazy-object-proxy >=1.2.0 65 @rolldown/plugin-babel ^0.2.3 65 aliyun-odps-python-sdk >=0.12.2.2 65 react-markdown ^9.1.0 outdated 65 tomli >=2.0.1 66 Emotion ^11.14.0 66 HTTPX >=0.25.0 66 html-to-image ^1.11.13 67 termcolor >=3.0.0 68 jwt v5.3.0 outdated 68 mysql-connector-python >=9.1.0 68 python-multipart 68 pytz ==2020.1 outdated 68 react-chartjs-2 ^5.3.1 68 sqlparse >=0.5.1 69 React Icons ^5.7.0 69 eslint-config-prettier ^10.1.8 70 azure-kusto-python >=4.1.0,!=5.0.0 70 pgvector-python >=0.3.1 70 psycopg2 >=2.9.9 71 chartjs-plugin-annotation ^3.1.0 71 greenlet >=3.1.0 72 Flit >=3.12.0 72 Flit >=3.12.0 72 PyExasol >=0.26.0,<2 outdated 72 facebook-python-business-sdk >=22.0.0 72 globals ^15.15.0 outdated 72 i18next-http-backend ^3.0.5 outdated 72 python-dotenv >=0.21.0 72 wheel >=0.42.0 73 Pygments >=2.0.1,!=2.19.0 73 SQLAlchemy-Utils >=0.41.2 73 eslint-plugin-prettier ^5.5.6 73 msgraph-sdk-python-core >=1.3.3 73 nbconvert >=7.16.1 74 AlibabaCloud ADB20211201 >=1.0.0 74 Microsoft Kiota Abstractions >=1.9.4,<2.0.0 74 asgiref >=2.3.0 74 cron-descriptor >=1.2.24 74 croniter >=2.0.2 74 python-semver >=3.0.4 74 s3fs >=2023.10.0 74 testify v1.11.1 outdated 75 go-plugin v1.7.0 outdated 75 influxdb-client-python >=1.19.0 75 marshmallow >=3 75 py-amqp >=5.2.0 76 Cohere Python SDK >=5.13.4 76 Day.js ^1.11.21 76 Deprecated >=1.2.13 76 Flask-AppBuilder ==5.2.2 outdated 76 Requests >=2.32.0,<3 76 cachetools >=6.0.0 76 elkjs ^0.11.1 outdated 76 eslint-plugin-jsonc ^3.3.0 76 python-slugify >=5.0 77 AsyncSSH >=2.12.0 77 Paramiko ==3.4.0 outdated 77 aiosmtplib >=0.1.6 77 pendulum >=3.1.0 77 structlog >=25.4.0 77 time-machine >=3.0.0 78 Flask-WTF >=1.1.0 78 IBM Cloudant Python SDK >=0.10.0 78 datadogpy >=0.50.0 78 tenacity >=8.3.0 78 unplugin-dts ^4.3.0 outdated 79 esbuild ^0.28.1 80 Psycopg >=3.2.9 80 dill >=0.2.2 80 yaml ^2.9.0 81 InfluxDB 3.0 Python Client >=0.7.0 81 SQLGlot >=30.0.0 81 Zustand ^5.0.14 81 pluggy >=1.5.0 81 testcontainers-python >=4.12.0 82 WTForms >=3.0 82 attrs >=22.1.0, !=25.2.0 82 botocore >=1.41.0 82 gevent >=25.4.1 82 react-i18next ^16.6.5 outdated 83 Flask >=2.2.1 83 MSW (Mock Service Worker) ^2.14.6 outdated 83 docker-py >=7.1.0 83 duckdb >=1.2.0 83 fastavro >=1.10.0 83 fsspec >=2023.10.0 83 jsonpath-ng >=1.5.3 83 pflag v1.0.10 83 psutil >=5.8.0 83 pyparsing ==2.4.7 outdated 83 python-ldap >=3.4.4 83 react-hotkeys-hook ^5.3.3 84 PyGithub >=2.1.1 84 cryptography >=44.0.3 84 gcsfs >=2023.10.0 84 google-ads-python >=26.0.0,!=28.0.0.post2 84 mypy >=1.0.0 84 pytest-xdist >=3.3.1 84 rich-click >=1.9.7 84 types-pytz >=2024.1.0.20240417 84 types-toml >=0.10.8.20240310 84 typing_extensions >=4.14.1 85 Babel >=2.17.0 85 Gremlin-Python >=3.8.0 85 Gunicorn >=23.0.0,!=25.1.0 85 JPype >=1.4.0,!=1.7.0 85 asyncpg >=0.30.0 85 more-itertools >=9.0.0 85 packaging >=25.0 85 tqdm >=4.67.1 85 tsx ^4.21.0 86 Chart.js ^4.5.1 86 python-oracledb >=2.3.0 87 Click >=8.3.0 87 PyJWT >=2.11.0 87 PySpark >=4.0.0 87 PySpark >=4.0.0 87 React Resizable Panels ^3.0.6 outdated 87 confluent-kafka-python >=2.6.0 87 eslint-plugin-react ^7.37.5 87 filelock >=3.13.0 87 pytest-mock >=3.14.0 88 GitPython >=3.1.40 88 Hatch >=1.17.1 88 Yandex Cloud Python SDK >=0.383.0 88 python-dateutil >=2.7.0 89 Databricks SQL Connector for Python >=4.0.0 89 Typer >=0.22.0 89 astroid >=4 89 lxml 90 Alembic >=1.13.1, <2.0 90 Uvicorn >=0.37.0 90 boto3 >=1.37.2 90 dnspython >=1.13.0 90 gcloud-aio-bigquery >=5.2.0 90 gcloud-aio-bigquery >=6.1.2 90 gcloud-aio-bigquery >=9.0.0 outdated 90 i18next ^25.8.16 outdated 90 jsonschema >=4.19.1 90 msgspec >=0.19.0 90 pipdeptree >=2.13.1 90 pytest-asyncio >=1.1.0 91 Black >=26.1.0 91 Celery >=5.5.0,<6 91 Google API Python Client >=2.142.0 91 Pinecone Python SDK >=7.0.0 outdated 91 Pydantic AI >=2.0.0 91 React Flow ^12.11.1 91 Ruff ==0.15.21 outdated 91 TanStack Virtual (React) ^3.14.5 91 chakra-ui ^2.3.4 outdated 91 chakra-ui ~3.36.0 outdated 91 clickhouse-connect >=1.3.0 91 importlib_metadata >=6.5 91 platformdirs >=4.3.6 91 prettier ^3.9.4 91 weaviate-python-client >=4.4.0,!=4.16.7 92 @vitejs/plugin-react ^6.0.3 92 Databricks SDK for Python ==0.10.0 outdated 92 Elasticsearch Python Client >=8.10,<10 92 FastAPI >=0.129.0,<0.137.0 outdated 92 Playwright ^1.61.1 92 Polars >=1.26.0 92 React Hook Form ^7.80.0 92 TanStack Query ^5.101.2 92 TanStack Query ^5.101.2 92 TanStack Table ^8.21.3 outdated 92 ipykernel >=6.29.4 93 KaTeX ^0.17.0 outdated 93 Kiota Authentication Azure >=1.9.4,<2.0.0 93 Kiota Authentication Azure >=1.9.4,<2.0.0 93 Kiota Authentication Azure >=1.9.4 93 Kiota Authentication Azure >=1.9.4 93 LangChain >=1.0.0 93 Mermaid ^11.16.0 outdated 93 Monaco Editor ^0.55.1 outdated 93 Pydantic >=2.11.0 93 Vitest ^4.1.9 outdated 93 Vitest ^4.1.9 outdated 93 Werkzeug >=2.2 93 coveragepy >=7.4.0 93 llama-index-llms-openai-like >=0.13.0 outdated 93 snowflake-connector-python >=3.17.0 93 urllib3 >=2.1.0,!=2.6.0 94 Apache Beam >=2.69.0 94 Authlib >=1.0.0 94 Google Gen AI Python SDK >=2.8.0 94 OpenLineage Integration Common >=1.47.0 94 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 94 OpenTelemetry Prometheus Exporter >=1.27.0 outdated 94 OpenTelemetry Prometheus Exporter >=0.47b0 94 OpenTelemetry Prometheus Exporter <9999,>=1.27.0 outdated 94 SQLAlchemy >=2.0.48 94 Starlette >=1.0.1 94 Vite ^8.1.3 94 kubernetes >=35.0.0,!=36.0.0,<37.0.0 outdated 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 94 typescript-eslint ^8.62.1 95 Axios ^1.18.1 95 ESLint ^10.0.1 95 ESLint ^10.6.0 95 PyArrow >=16.1.0 95 React Router ^7.18.1 outdated 95 TypeScript ^6.0.3 outdated 95 aiohttp >=3.14.0 95 pypdf >=4.0.0 95 redis-py >=4.5.2,!=4.5.5,!=5.0.2 95 setuptools >=80.0.0,<9999 96 Anthropic Python SDK >=0.101.0 96 Apache Airflow >=3.1.3 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow 96 Apache Airflow >=1.7.4 96 Apache Airflow >=1.6.3 96 Apache Airflow >=1.28.1 96 Apache Airflow >=2.2.0 96 Apache Airflow 96 Apache Airflow >=2.3.1 96 Apache Airflow >=1.9.0 96 Apache Airflow <1.5.0,>=1.4.0 outdated 96 NumPy >=1.22.4 96 pytest >=9.0.0 96 python-telegram-bot >=20.2 96 sentry-sdk >=2.30.0 97 OpenAI Python SDK >=2.37.0 97 Slack SDK for Python >=3.36.0 97 Sphinx >=7 97 google-cloud-aiplatform >=1.155.0 98 Azure Container Service Management (Python) >=8.0.0,<15.0.0 outdated 98 Azure Container Service Management (Python) >=4.6.0 98 Azure Container Service Management (Python) >=4.1.0 98 Azure Container Service Management (Python) >=33.0.0 98 Azure Container Service Management (Python) >=10.1.0 98 Azure Container Service Management (Python) >=8.0.0 98 Azure Container Service Management (Python) >=3.0.0 98 Azure Container Service Management (Python) >=0.5.0 98 Azure Container Service Management (Python) >=2.2.0 98 Azure Container Service Management (Python) >=16.0.0 98 Azure Container Service Management (Python) >=7.12.1 98 Azure Container Service Management (Python) >=12.9.1 98 Azure Container Service Management (Python) >=12.7.0 98 Azure Container Service Management (Python) >=0.17.0 98 Azure Container Service Management (Python) >=0.2.0 98 Azure Data Factory Management Client >=10.0.0 98 Azure Identity (Python) >=1.3.1 98 Azure Storage Blob >=12.26.0 98 React ^1.0.0 outdated 98 React ^7.1.1 outdated 98 React ^19.2.7 98 React DOM ^19.2.7 98 gRPC Python (grpcio) >=1.59.0 98 google-auth >=0.9.0 98 google-auth >=2.30.3 98 google-auth >=2.29.0 98 google-auth >=0.2.0 98 google-auth >=1.2.0 98 google-auth >=0.4.0 98 google-auth >=2.12.0 98 google-auth >=0.13.0 98 google-auth >=3.13.0 outdated 98 google-auth >=2.31.0 98 google-auth >=2.17.0 98 google-auth >=3.31.0 outdated 98 google-auth >=1.10.0 98 google-auth >=2.52.0 98 google-auth >=3.23.0 outdated 98 google-auth >=0.8.6 98 google-auth >=0.5.0 98 google-auth >=2.6.0 98 google-auth >=5.27.0 outdated 98 google-auth >=1.12.0 98 google-auth >=3.12.0 outdated 98 google-auth >=2.15.0 98 google-auth >=2.9.0 98 google-auth >=3.5.0 outdated 98 google-auth >=0.1.6 98 google-auth >=1.7.0 98 google-auth >=2.18.0 98 google-auth >=1.10.0 98 google-auth >=2.9.1 98 google-auth >=2.24.0 98 google-auth >=2.12.0 98 google-auth >=0.10.0 98 google-auth >=2.16.0 98 google-auth >=3.50.0 outdated 98 google-auth >=2.18.0 98 google-auth >=2.9.0 98 google-auth >=1.13.0 98 google-auth >=2.13.0 98 google-auth >=2.14.1 98 google-auth >=3.16.0 outdated 98 google-auth >=2.11.0 98 google-auth >=3.4.0 outdated 98 google-auth >=1.10.0 98 google-auth >=0.7.0 98 google-auth >=1.26.0 98 google-auth >=1.2.1 98 pandas >=2.1.2 98 swagger-ui-react ^5.32.8

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers