# arXiv cs.AI: When LLM Routers Overpay: The Cost of Strong-Model Preference [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-when-llm-routers-overpay-the-cost-of-strong-model-e6a1e593) Authors Guannan Lai, Long Chen, and Han-Jia Ye argue that LLM routers can spend more as their cost budgets loosen, selecting the strongest, most expensive model even when a cheaper option offers comparable or identical utility. They call this “strong-model over-selection under loose budgets.” The authors say ambiguity alone does not explain the behavior: a persistent preference for costly models can lead to overpayment when budget relaxation makes premium candidates feasible. They propose EquiRouter, which learns query-dependent model rankings and explicitly favors lower-cost models among equivalent candidates. The abstract reports experiments across text, multimodal, continuous-utility, and large-model-pool settings, claiming improved cost efficiency while maintaining competitive peak and whole-curve performance. It does not give the measurements or experimental conditions needed to assess the size or scope of those reported gains. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Feb 3, 2026 (2026-02-03). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-08T19:25:05.093Z. First observed: 2026-11-06T05:00:54.250Z. Retrieved: 2026-11-08T19:17:43.933Z. - [When LLM Routers Overpay: The Cost of Strong-Model Preference](https://arxiv.org/abs/2602.03478) ## Limits The supplied evidence is the arXiv abstract, which reports experimental results but gives no measurements, baselines, or experimental details for assessing the size and scope of the reported gains. ## Open question Under what experimental conditions, and by how much, does EquiRouter improve cost efficiency while maintaining competitive peak and whole-curve performance? ## Source-stated The authors argue that existing routers may increasingly select the strongest and most expensive model as cost budgets increase, even when cheaper feasible candidates offer comparable or identical utility. > as the budget increases, they increasingly select the strongest and most expensive model even when less expensive feasible candidates provide comparable or identical utility. - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The authors say ambiguity alone does not explain the behavior; persistent model-level preference for costly models can cause overpayment when budget relaxation makes premium candidates feasible. > Substantial overpayment can arise when differently priced models offer equivalent or near-equivalent utility and the router retains a persistent model-level preference for costly models - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The authors propose EquiRouter, which learns query-dependent model rankings and explicitly prefers lower-cost models among equivalent candidates. > we propose EquiRouter, a decision-aligned router that learns query-dependent model rankings, preserves meaningful utility differences, and explicitly prefers lower-cost models among equivalent candidates - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The abstract reports that experiments show improved cost efficiency while maintaining competitive peak and whole-curve performance; it does not provide measurements or conditions in the supplied text. > Experiments across diverse text, multimodal, continuous-utility, and large-model-pool settings show that EquiRouter consistently improves cost efficiency while maintaining competitive peak and whole-curve performance. - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source and contributor context Lai, Guannan, Chen, Long, Ye, Han-Jia · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 0d324916-7025-4125-80b2-01ad4f2cd1bd. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T19:25:05.093Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 1966c7e294772e7638c6fe03102e918a21637ed3b2f5cea6a51ce20995747da8. Source text hash: e921202ffa70c97e55ac87c7e28995592a943457ff0979e7fb80dec9fab70992. ## Revision and source-check history ### Version 1 — 2026-11-08T19:25:05.093Z Authors Guannan Lai, Long Chen, and Han-Jia Ye argue that LLM routers can spend more as their cost budgets loosen, selecting the strongest, most expensive model even when a cheaper option offers comparable or identical utility. They call this “strong-model over-selection under loose budgets.” The authors say ambiguity alone does not explain the behavior: a persistent preference for costly models can lead to overpayment when budget relaxation makes premium candidates feasible. They propose EquiRouter, which learns query-dependent model rankings and explicitly favors lower-cost models among equivalent candidates. The abstract reports experiments across text, multimodal, continuous-utility, and large-model-pool settings, claiming improved cost efficiency while maintaining competitive peak and whole-curve performance. It does not give the measurements or experimental conditions needed to assess the size or scope of those reported gains. ## Original source arXiv cs.AI · Article Original source date: Feb 3, 2026 (2026-02-03). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-08T19:25:05.093Z. First observed: 2026-11-06T05:00:54.250Z. Retrieved: 2026-11-08T19:17:43.933Z. - [When LLM Routers Overpay: The Cost of Strong-Model Preference](https://arxiv.org/abs/2602.03478) ## Limits The supplied evidence is the arXiv abstract, which reports experimental results but gives no measurements, baselines, or experimental details for assessing the size and scope of the reported gains. ## Open question Under what experimental conditions, and by how much, does EquiRouter improve cost efficiency while maintaining competitive peak and whole-curve performance? ## Source-stated The authors argue that existing routers may increasingly select the strongest and most expensive model as cost budgets increase, even when cheaper feasible candidates offer comparable or identical utility. > as the budget increases, they increasingly select the strongest and most expensive model even when less expensive feasible candidates provide comparable or identical utility. - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The authors say ambiguity alone does not explain the behavior; persistent model-level preference for costly models can cause overpayment when budget relaxation makes premium candidates feasible. > Substantial overpayment can arise when differently priced models offer equivalent or near-equivalent utility and the router retains a persistent model-level preference for costly models - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The authors propose EquiRouter, which learns query-dependent model rankings and explicitly prefers lower-cost models among equivalent candidates. > we propose EquiRouter, a decision-aligned router that learns query-dependent model rankings, preserves meaningful utility differences, and explicitly prefers lower-cost models among equivalent candidates - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source-stated The abstract reports that experiments show improved cost efficiency while maintaining competitive peak and whole-curve performance; it does not provide measurements or conditions in the supplied text. > Experiments across diverse text, multimodal, continuous-utility, and large-model-pool settings show that EquiRouter consistently improves cost efficiency while maintaining competitive peak and whole-curve performance. - [Supporting source](https://arxiv.org/abs/2602.03478) ## Source and contributor context Lai, Guannan, Chen, Long, Ye, Han-Jia · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 0d324916-7025-4125-80b2-01ad4f2cd1bd. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T19:25:05.093Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 1966c7e294772e7638c6fe03102e918a21637ed3b2f5cea6a51ce20995747da8. Source text hash: e921202ffa70c97e55ac87c7e28995592a943457ff0979e7fb80dec9fab70992. ### uncertain — 2026-11-08T19:25:05.093Z — anthropic/claude-opus-5.5 Publication: 0d324916-7025-4125-80b2-01ad4f2cd1bd attribution — pass: The reading correctly credits the paper to Guannan Lai, Long Chen and Han-Jia Ye. It keeps the diagnosis, the EquiRouter proposal and the experimental results attributed to the authors and the abstract. > Authors:Guannan Lai, Long Chen, Han-Jia Ye summary — uncertain: The summary is faithful, but it never says what an LLM router is, and that is the central term. The abstract defines it as a system that sends easy queries to cheaper models and saves stronger models for cases that need them. Without this, a general reader cannot see why picking the expensive model is overpayment. Smallest repair: add a plain-language definition near the start. Also, 'can spend more' softens the abstract's 'often violate'. 'Utility' and 'whole-curve performance' would benefit from term-library tooltips. > LLM routing aims to reduce inference costs by assigning easy queries to less expensive models and reserving stronger models for cases in which they are needed. date — pass: The original publication date of 2026-02-03 matches the v1 submission date. The later v2 revision (5 Nov 2026) and the feed date are correctly not used. > \[Submitted on 3 Feb 2026 (v1), last revised 5 Nov 2026 (this version, v2)\] support — pass: Each claim matches the abstract's wording and keeps it as a source assertion. The limitation correctly notes that the abstract gives no measurements or experimental details. The question follows from that gap and does not presume an answer. Saying 'may' where the source says 'often' slightly softens the claim but introduces no unsupported content. > Experiments across diverse text, multimodal, continuous-utility, and large-model-pool settings show that EquiRouter consistently improves cost efficiency while maintaining competitive peak and whole-curve performance. media — pass: The selected media is the verified arXiv abstract page, which is the direct original source. That is the most relevant access point available. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/e6a1e5935b271343d6a9f38de3fad03626cf8717a6598017378c3c2647d92708/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-when-llm-routers-overpay-the-cost-of-strong-model-e6a1e593.json)