Description
airflow-dag-patterns is an agent skill from the wshobson/agents collection for building production Apache Airflow DAGs. It gives an agent the patterns used in real data pipelines: DAG design principles, choosing and writing operators, using sensors to wait on external conditions, testing DAGs locally before they run in production, and setting Airflow up for production deployment. The skill is aimed at the common situations where pipelines go wrong, such as tangled dependencies, custom operators that are hard to reuse, and failed runs that are hard to debug. Its guidance applies when you are creating data pipeline orchestration with Airflow, designing DAG structures and dependencies, implementing custom operators and sensors, testing DAGs on a local machine, or debugging a failed DAG run. The skill is installed with the skills CLI from the wshobson/agents repository. Its skills.sh page showed about 10.7K installs and passing results from three security audits at the time of the scan. It is a reference for an agent to follow, so the code it produces should still be reviewed and tested against your own Airflow version and infrastructure.…
Highlights
- DAG design principles and dependency structure
- Operator and sensor patterns
- Custom operators and sensors
- Local testing of DAGs
- Production deployment guidance
- Installs with the skills CLI
Ratings & Reviews
No ratings yet
Be the first to rate airflow-dag-patterns.
People also visit
ml-pipeline-workflow
Build end-to-end MLOps pipelines from data preparation through model training
airflow-dag-patterns FAQ
What does this skill help with?
Building and debugging Apache Airflow DAGs, including design, operators, sensors, testing and deployment.
Can it write custom operators?
Yes. The skill covers implementing custom operators and sensors alongside the standard ones.
How do I test a DAG?
The skill covers testing Airflow DAGs locally before they are deployed.
Who is it for?
Engineers building data pipelines with Airflow, whether they are setting it up for production or fixing failing runs.
How do I install it?
Run npx skills add https://github.com/wshobson/agents --skill airflow-dag-patterns.
What security audits does it have?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best airflow-dag-patterns alternatives?
Popular alternatives to airflow-dag-patterns include async-python-patterns, backtesting-frameworks and ml-pipeline-workflow. See all airflow-dag-patterns alternatives