senior-data-engineer
World-class data engineering skill for building scalable data pipelines
by davila7Free
Description
senior-data-engineer is an agent skill from the davila7 claude-code-templates collection, listed on skills.sh. It is a data engineering toolkit for building scalable data pipelines, ETL and ELT systems and data infrastructure. The description names expertise in Python, SQL, Spark and Airflow. The skill works through three scripts. The pipeline orchestrator, run as python scripts/pipeline_orchestrator.py with an input folder and an output folder, coordinates the steps of a data pipeline. The data quality validator, run as python scripts/data_quality_validator.py against a project, checks the quality of the data. The ETL performance optimiser, run as python scripts/etl_performance_optimizer.py with a configuration file, looks for ways to make the pipeline faster before it is deployed. The skill describes itself as production-grade and includes a quick start and a list of main capabilities. It is for data engineers who build and maintain pipelines and want a consistent way to validate and tune them.…
Highlights
- Pipeline orchestrator script
- Data quality validator script
- ETL performance optimiser script
- Python, SQL, Spark and Airflow
Ratings & Reviews
No ratings yet
Be the first to rate senior-data-engineer.
People also visit
canvas-design
Create beautiful visual art in .png and .pdf documents using design philosophy
senior-data-engineer FAQ
What does the senior-data-engineer skill do?
It provides scripts for orchestrating data pipelines, checking data quality and optimising ETL performance.
How do I install it?
Run: npx skills add https://github.com/davila7/claude-code-templates --skill senior-data-engineer
Which scripts are included?
pipeline_orchestrator.py, data_quality_validator.py and etl_performance_optimizer.py.
Which technologies does it name?
Python, SQL, Spark and Airflow, according to the description.
Has it been checked for security?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best senior-data-engineer alternatives?
Popular alternatives to senior-data-engineer include implement, brand-guidelines and canvas-design. See all senior-data-engineer alternatives