Skip to main content
GET
Get system and model inference metrics

Response

200 - application/json

Success

Unified snapshot of system resource metrics and per-model inference metrics.

system
System Metrics · object
required

Live system resource utilization.

models
object
required

Map of model ID to its moving-average inference metrics. Empty object if no requests have been processed yet.