
bigquery-pipeline-audit
Audits Python + BigQuery pipelines for cost safety, idempotency
by githubFree
Description
bigquery-pipeline-audit is an agent skill from the github/awesome-copilot collection that audits a Python and BigQuery data pipeline for cost safety, idempotency and production readiness. The agent acts as a senior data engineer reviewing the script. It locates every BigQuery job trigger, such as client.query, load_table_from_*, extract_table and copy_table, along with DDL and DML statements, and every external call to APIs, LLM services or storage, to show what will actually be billed. It then checks for loop-driven query multiplication, where a query runs once per item in a loop and the cost grows with the data, and for missing maximum_bytes_billed limits that would let a query scan more data than intended. The audit also checks whether a rerun would corrupt data, and whether failures are visible rather than silently swallowed. The response follows a fixed structure, sections A to F and a final summary, and it references exact function names and line locations with minimal suggested fixes rather than rewrites. This makes the audit practical to act on in a code review. The findings should be verified against the pipeline's real workload, since the cost exposure depends on data volumes that the code alone does not show. The skill is installed with the skills CLI from the github/awesome-copilot repository. Its skills.sh page showed about 8.8K installs and passing results from three security audits at the time of the scan.…
Highlights
- Finds every BigQuery job trigger and external call
- Cost exposure and loop query multiplication checks
- Missing maximum_bytes_billed limits
- Rerun and idempotency checks
- Exact function and line references with minimal fixes
- Installs with the skills CLI
Ratings & Reviews
No ratings yet
Be the first to rate bigquery-pipeline-audit.
People also visit

code-review-excellence
Systematic code review practices for constructive feedback, bug detection

multi-reviewer-patterns
Coordinate parallel code reviews across multiple quality dimensions

review-agent-setup
Configure human-in-the-loop gating for AI agent review actions in Claude Code
bigquery-pipeline-audit FAQ
What does the audit cover?
Cost exposure, rerun safety and idempotency, and whether failures are visible, for Python and BigQuery pipelines.
What is maximum_bytes_billed?
A limit on how much data a BigQuery query may bill for. The audit flags queries that have none.
What is loop-driven query multiplication?
A query run once per item in a loop, so the cost grows with the number of items.
Does the audit give exact costs?
No. It identifies exposure from the code, and the real cost depends on the data volumes.
How do I install it?
Run npx skills add https://github.com/github/awesome-copilot --skill bigquery-pipeline-audit.
What security audits does it have?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best bigquery-pipeline-audit alternatives?
Popular alternatives to bigquery-pipeline-audit include ai-debt-detector, airflow-dag-patterns and code-review-excellence. See all bigquery-pipeline-audit alternatives




