Vercel BlogMay 15, 2026 2

Sort providers by cost, latency, or throughput on AI Gateway

Sort providers by cost, latency, or throughput on AI Gateway
Summary
The AI Gateway now allows users to sort providers by cost, time to first token (TTFT), or throughput (TPS), enabling better control over ranking criteria for model requests. This feature automatically adapts to changes in provider availability and performance metrics without requiring code modifications. The sorting options enhance the ability to optimize for specific needs, such as cost-effectiveness or latency sensitivity.

Related Articles

Frontend Observability in Vue Apps with OpenTelemetry

Frontend Observability in Vue Apps with OpenTelemetry

Jakub Andrzejewski

Rolldown and Vite 8: What Changed

Rolldown and Vite 8: What Changed

Certificates.dev

Avoid Unnecessary Re-renders in Vue with `v-memo`

Avoid Unnecessary Re-renders in Vue with `v-memo`

Jakub Andrzejewski