bigquery-observability
Provides data-retrieval best practices, tool selection guidance
by googleFree
Description
BigQuery observability is an agent skill for retrieving telemetry about BigQuery work: which jobs ran, how long they took, what they cost and where capacity went. It gives data-retrieval best practices, guidance on choosing the right tool for each question, and performant SQL for querying BigQuery telemetry. The skill compares three routes. INFORMATION_SCHEMA is the SQL route, for historical analysis, comparing cohorts of queries, finding fast and slow periods, tracking reservations and projects over time, aggregating across many jobs, and tracing cost and billing. The skill warns against using it for high-frequency polling or for looking up a single job, because it can consume slots and take seconds to run. The REST API and the bq command-line tool are the route for looking up one job, diagnosing a stage bottleneck in real time, checking pipeline status, and inspecting reservation and capacity configuration. Cloud Monitoring is the route for alerting, fleet-wide dashboards, slot utilization and service-level monitoring, but not for debugging SQL or individual query text. The skill also covers the Google Cloud environment and project setup needed before any telemetry is retrieved. It is published by Google on skills.sh under the google skills repository, and the listing shows Gen Agent Trust Hub and Socket passing, with Snyk showing Warn.…
Highlights
- Chooses between INFORMATION_SCHEMA, REST API and Cloud Monitoring
- Historical and cross-job cost analysis in SQL
- Single-job lookups through the API and bq CLI
- Dashboards and alerting through Cloud Monitoring
- Environment setup before retrieving telemetry
Ratings & Reviews
No ratings yet
Be the first to rate bigquery-observability.
People also visit
azure-observability
Query metrics, logs, and traces across Azure Monitor, Application Insights
bigquery-slot-cost-optimizer
Analyzes Google Cloud BigQuery slot consumption, query costs
netdata/netdata#Netdata
Discovery, exploration, reporting and root cause analysis over Netdata metrics
bigquery-observability FAQ
What does the skill cover?
Retrieving BigQuery telemetry on jobs, timing, cost and reservations, with guidance on which tool fits each question.
When should I use INFORMATION_SCHEMA?
For historical analysis, comparisons, cost tracing and aggregates across many jobs. The skill advises against high-frequency polling with it.
When should I use the REST API or bq?
For a single job, a real-time look at a stage bottleneck, or checking reservation configuration.
When is Cloud Monitoring the right tool?
For alerts, fleet-wide dashboards and slot utilization over time, but not for SQL-level debugging.
How do I install it?
Run npx skills add https://github.com/google/skills --skill bigquery-observability.
What are the best bigquery-observability alternatives?
Popular alternatives to bigquery-observability include azure-observability, bigquery-slot-cost-optimizer and dashboard-builder. See all bigquery-observability alternatives