Live model performance metrics accessible via AI Gateway

AI Gateway now displays throughput and latency metrics across hundreds of models, helping you choose the right model based on live performance data. Metrics appear in three places and are updated every hour: model list The AI Gatewaynow includes sortable columns for latency and throughput. Each row…

Sources