header-langage
简体中文
繁體中文
English
Tiếng Việt
한국어
日本語
ภาษาไทย
Türkçe
Scan to Download the APP
Partnered With:

OpenRouter upgrades inference routing: pay 6% more for about 17% faster response times

Beating AI News Flash: OpenRouter announces an upgrade to its default inference routing algorithm. Previously, inference providers were primarily selected based on price; now it comprehensively considers speed, stability, and actual invocation costs, no longer blindly choosing the cheapest provider.


Officially, over 24 million requests were tested. Results show that time to first token was reduced by 16.9%, total request latency was reduced by 19%, and the proportion of requests encountering rate-limiting errors dropped from 7.1% to 3.8%. The trade-off is an approximately 6% increase in cost per thousand requests.


The new algorithm is now live, and users do not need to adjust their configurations. This optimization targets the selection of inference providers behind the same model, rather than the model's own capabilities.

举报 Correction/Report
RelatedRecommended
Stripe buys OpenRouter for $7.5 billion, betting it can evolve from an AI traffic channel into a control point for the agent economy.
As the model becomes more like interchangeable electricity, whoever can turn the enterprise's knob to the most cost-effective and stable setting may end up at AI's tollgate.
Citigroup and Bank of America Securities believe that while the Kimi K3 reduces inference costs, it may paradoxically stimulate more invocations, longer contexts, and agent-based tasks through the "Jevons Paradox," thereby driving up demand for GPU, HBM, DDR5, eSSD, and network infrastructure.
Correction/Report
Submit
Add Library
Visible to myself only
Public
Save
Choose Library
Add Library
Cancel
Finish