Appearance
Compute Cluster Metrics
This page documents Prometheus metrics emitted by the Compute Cluster component, which manages distributed query execution across compute nodes in a Yellowbrick deployment.
Purpose
These metrics are used to monitor the health, performance, and resource usage of compute clusters. They provide visibility into:
- Query activity and throughput
- Memory and CPU utilization
- Query compilation and execution times
- Cluster degradation or compute node loss
They are critical for performance tuning, detecting resource contention, and ensuring cluster reliability at scale.
Metrics
| Name | Type | Freq | Labels | Version Introduced | Version Deprecated | Description |
|---|---|---|---|---|---|---|
yb_lime_active_queries | gauge | 10s | cluster, cluster_name, pool | 7.4.0 | - | Number of active queries |
yb_lime_cluster_degraded_status | gauge | 10s | cluster, cluster_name, status, reason | 7.4.0 | - | Cluster degraded status |
yb_lime_cluster_missing_workers | gauge | 10s | cluster, cluster_name | 7.4.0 | - | Number of missing workers in each cluster |
yb_lime_cluster_state | gauge | 10s | cluster, state, reason | 7.4.0 | - | Cluster state |
yb_lime_queries_completed_backend_total | counter | 10s | cluster, cluster_name, pool, state | 7.4.0 | - | Total number of queries completed via backend |
yb_lime_queries_completed_total | counter | 10s | cluster, cluster_name, state | 7.4.0 | - | Total number of queries completed |
yb_lime_queries_submitted_total | counter | 10s | cluster, cluster_name | 7.4.0 | - | Total number of queries submitted |
yb_lime_query_bytes_network | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Bytes network |
yb_lime_query_bytes_read | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Bytes read |
yb_lime_query_bytes_read_spill | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Bytes read spill |
yb_lime_query_bytes_written | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Bytes written |
yb_lime_query_bytes_written_spill | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Bytes written spill |
yb_lime_query_cache_efficiency | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query cache efficiency |
yb_lime_query_compile_time | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query compile time in seconds |
yb_lime_query_cpu_usage | gauge | 10s | cluster, cluster_name, pool | 7.4.0 | - | Duration weighted average of longest worker CPU query usage as percentage of allocated CPU |
yb_lime_query_lock_time | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query lock time in seconds |
yb_lime_query_memory_granted | gauge | 10s | cluster, cluster_name, pool | 7.4.0 | - | Total memory granted to queries in bytes |
yb_lime_query_memory_used | gauge | 10s | cluster, cluster_name, pool | 7.4.0 | - | Total memory used by queries in bytes |
yb_lime_query_run_time | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query run time in seconds |
yb_lime_query_total_time | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query total time in seconds |
yb_lime_query_wait_time | histogram | 10s | cluster, cluster_name | 7.4.0 | - | Query wait time in seconds |