Sort providers by cost, latency, or throughput on AI Gateway

T1Covered by 1 source · first reported by Vercel (blog + changelog) at 15 May, 00:00 UTC

AI Gateway You can now sort the providers behind a model by cost, time to first token (TTFT), or throughput (TPS) in. sort The default provider order blends provider reliability, quality of model output, cost, and speed of response. You can now usefor explicit control over ranking criteria. sort…