{"id":"f7e5b02d6f3d1b87cf38de64d2a7f626d9cc679127323e938617138d91f0527e","title":"AI21 argues agent costs require more than routing","argument":"AI21’s page, published June 25, 2026, argues that teams need more than routing to control token spend as they run agents at scale. AI21 says manually tuned routing can backfire: a cheaper model produced longer trajectories and raised costs in one company’s experience, while model changes can make carefully tuned rules stale. It describes routing—sending each call to the cheapest model that can handle it—as a common response, but says the difficult part is automating decisions for each agent and domain while accounting for provider differences, KV caching and queries.\n\nAI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates. It reports that routing one code-review agent cut cost per PR by 68% against public baselines, equivalent to about $560K a year on production traffic. The post does not provide the evaluation details behind that result. AI21’s broader point is that teams need to cut costs without breaking what works, and keep learning, to answer whether they can afford to run agents at scale.","topicIds":["investment-booms-and-busts"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 25, 2026; originally published June 25, 2026. The post does not give the evaluation details behind the reported code-review-agent cost reduction. The reported field observations come from private conversations described by AI21; the post gives no further methodology for them. AI21 presents its own product and performance claims; the post does not provide independent assessment.","speaker":{"name":"AI21","roleAtSource":"Publisher"},"source":{"title":"Token spend isn’t going down. You need more than naive routing to manage it","publisher":"AI21","format":"Article","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","publishedAt":"2026-06-25T09:44:56Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"AI21 says teams need automated systems to reduce wasted tokens without harming agent quality as models, prices and workflows change.","excerpt":"Teams need automated systems that cut wasted tokens without hurting agent quality – and keep improving those cuts as models, prices, and workflows change.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 reports that routing to a weaker model raised costs in one company’s experience because it produced longer trajectories.","excerpt":"their routing rules that shift traffic to cheaper models eventually drove cost up because the weaker model produced dramatically longer trajectories.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 says model changes can make agent optimization and routing rules stale.","excerpt":"Same thing for adding a new model, tools, or adjusting the harness: The ground shifts, and carefully tuned agents or routing rules go stale.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 describes routing as sending each call to the cheapest model that can handle it.","excerpt":"send each call to the cheapest model that can handle it.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates.","excerpt":"Above that, it makes advanced routing decisions that keep improving over time, as traffic accumulates.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 reports that routing one code-review agent reduced cost per PR by 68% against public baselines, or about $560K annually on production traffic.","excerpt":"Routing a popular code-review agent this way cut cost per PR by 68% against public baselines. That’s about $560K a year on production traffic, from a single agent.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 concludes that teams need to cut costs without breaking what works and keep learning to address whether they can afford to run agents at scale.","excerpt":"cut costs, don’t break what works, and keep learning. By automating that loop, we’re helping more teams confidently answer that question: Can we afford to run it at scale?","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evaluation details support AI21’s reported cost reduction for the code-review agent?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"AI21 argues agent costs require more than routing","summary":"AI21’s page, published June 25, 2026, argues that teams need more than routing to control token spend as they run agents at scale. AI21 says manually tuned routing can backfire: a cheaper model produced longer trajectories and raised costs in one company’s experience, while model changes can make carefully tuned rules stale. It describes routing—sending each call to the cheapest model that can handle it—as a common response, but says the difficult part is automating decisions for each agent and domain while accounting for provider differences, KV caching and queries.\n\nAI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates. It reports that routing one code-review agent cut cost per PR by 68% against public baselines, equivalent to about $560K a year on production traffic. The post does not provide the evaluation details behind that result. AI21’s broader point is that teams need to cut costs without breaking what works, and keep learning, to answer whether they can afford to run agents at scale.","question":"What evaluation details support AI21’s reported cost reduction for the code-review agent?","claims":[{"text":"AI21 says teams need automated systems to reduce wasted tokens without harming agent quality as models, prices and workflows change.","excerpt":"Teams need automated systems that cut wasted tokens without hurting agent quality – and keep improving those cuts as models, prices, and workflows change.","support":"source-stated"},{"text":"AI21 reports that routing to a weaker model raised costs in one company’s experience because it produced longer trajectories.","excerpt":"their routing rules that shift traffic to cheaper models eventually drove cost up because the weaker model produced dramatically longer trajectories.","support":"source-stated"},{"text":"AI21 says model changes can make agent optimization and routing rules stale.","excerpt":"Same thing for adding a new model, tools, or adjusting the harness: The ground shifts, and carefully tuned agents or routing rules go stale.","support":"source-stated"},{"text":"AI21 describes routing as sending each call to the cheapest model that can handle it.","excerpt":"send each call to the cheapest model that can handle it.","support":"source-stated"},{"text":"AI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates.","excerpt":"Above that, it makes advanced routing decisions that keep improving over time, as traffic accumulates.","support":"source-stated"},{"text":"AI21 reports that routing one code-review agent reduced cost per PR by 68% against public baselines, or about $560K annually on production traffic.","excerpt":"Routing a popular code-review agent this way cut cost per PR by 68% against public baselines. That’s about $560K a year on production traffic, from a single agent.","support":"source-stated"},{"text":"AI21 concludes that teams need to cut costs without breaking what works and keep learning to address whether they can afford to run agents at scale.","excerpt":"cut costs, don’t break what works, and keep learning. By automating that loop, we’re helping more teams confidently answer that question: Can we afford to run it at scale?","support":"source-stated"}],"limitations":["Text as retrieved on October 25, 2026; originally published June 25, 2026.","The post does not give the evaluation details behind the reported code-review-agent cost reduction.","The reported field observations come from private conversations described by AI21; the post gives no further methodology for them.","AI21 presents its own product and performance claims; the post does not provide independent assessment."],"mediaId":null,"correctionReason":null,"id":"f7e5b02d6f3d1b87cf38de64d2a7f626d9cc679127323e938617138d91f0527e","publicationId":"d372428c-9d7e-1ea3-ecba-fe8e8046fce1","version":1,"sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","sourceTitle":"Token spend isn’t going down. You need more than naive routing to manage it","publisher":"AI21","publishedAt":"2026-06-25T09:44:56Z","originalPublished":{"value":"2026-06-25T09:44:56Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-10-20T23:43:36.709Z","createdAt":"2026-11-06T11:43:23.228Z","historical":true,"entityIds":["ai21"],"topicIds":["investment-booms-and-busts"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"965ee852ba85d7975ceca28b69c4e45a842aaa97d3172d4d908cbae2434ebdaa","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-25T15:02:07.403Z"},"provenance":{"textHash":"0495c5597fb000d3fa0ea19bb33a429c720020741765a57b447f5aa85dd8ac2e","observationId":"c676abc2a351584146d8d17170121f60b4660a092ac453f66a92b8aedb628f02","retrievedAt":"2026-10-25T15:03:42.595Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"80650610-3c0d-c9ec-ec2b-1e881a0951e5"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"e6e1c364-b77e-160d-2269-8f58ed8464b2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-06T11:39:12.944Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/ai21-argues-agent-costs-require-more-than-routing-f7e5b02d","formats":{"html":"/readings/ai21-argues-agent-costs-require-more-than-routing-f7e5b02d","markdown":"/readings/ai21-argues-agent-costs-require-more-than-routing-f7e5b02d.md","json":"/readings/ai21-argues-agent-costs-require-more-than-routing-f7e5b02d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"ai21","name":"AI21","kind":"organization","context":"AI21 publishes technical research and product announcements about its language models and AI systems.","referenceUrls":["https://www.ai21.com/blog/"],"path":"/entities/ai21","json":"/entities/ai21.json","markdown":"/entities/ai21.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"f7e5b02d6f3d1b87cf38de64d2a7f626d9cc679127323e938617138d91f0527e","revision":"d372428c-9d7e-1ea3-ecba-fe8e8046fce1","revisionKind":"publication-id","title":"AI21 argues agent costs require more than routing","url":"https://escapemeridian.com/readings/ai21-argues-agent-costs-require-more-than-routing-f7e5b02d"},"source":{"type":"source","id":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","revision":"0495c5597fb000d3fa0ea19bb33a429c720020741765a57b447f5aa85dd8ac2e","revisionKind":"sha256-source-text","title":"Token spend isn’t going down. You need more than naive routing to manage it","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"f7e5b02d6f3d1b87cf38de64d2a7f626d9cc679127323e938617138d91f0527e","title":"AI21 argues agent costs require more than routing","argument":"AI21’s page, published June 25, 2026, argues that teams need more than routing to control token spend as they run agents at scale. AI21 says manually tuned routing can backfire: a cheaper model produced longer trajectories and raised costs in one company’s experience, while model changes can make carefully tuned rules stale. It describes routing—sending each call to the cheapest model that can handle it—as a common response, but says the difficult part is automating decisions for each agent and domain while accounting for provider differences, KV caching and queries.\n\nAI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates. It reports that routing one code-review agent cut cost per PR by 68% against public baselines, equivalent to about $560K a year on production traffic. The post does not provide the evaluation details behind that result. AI21’s broader point is that teams need to cut costs without breaking what works, and keep learning, to answer whether they can afford to run agents at scale.","topicIds":["investment-booms-and-busts"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 25, 2026; originally published June 25, 2026. The post does not give the evaluation details behind the reported code-review-agent cost reduction. The reported field observations come from private conversations described by AI21; the post gives no further methodology for them. AI21 presents its own product and performance claims; the post does not provide independent assessment.","speaker":{"name":"AI21","roleAtSource":"Publisher"},"source":{"title":"Token spend isn’t going down. You need more than naive routing to manage it","publisher":"AI21","format":"Article","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","publishedAt":"2026-06-25T09:44:56Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"AI21 says teams need automated systems to reduce wasted tokens without harming agent quality as models, prices and workflows change.","excerpt":"Teams need automated systems that cut wasted tokens without hurting agent quality – and keep improving those cuts as models, prices, and workflows change.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 reports that routing to a weaker model raised costs in one company’s experience because it produced longer trajectories.","excerpt":"their routing rules that shift traffic to cheaper models eventually drove cost up because the weaker model produced dramatically longer trajectories.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 says model changes can make agent optimization and routing rules stale.","excerpt":"Same thing for adding a new model, tools, or adjusting the harness: The ground shifts, and carefully tuned agents or routing rules go stale.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 describes routing as sending each call to the cheapest model that can handle it.","excerpt":"send each call to the cheapest model that can handle it.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates.","excerpt":"Above that, it makes advanced routing decisions that keep improving over time, as traffic accumulates.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 reports that routing one code-review agent reduced cost per PR by 68% against public baselines, or about $560K annually on production traffic.","excerpt":"Routing a popular code-review agent this way cut cost per PR by 68% against public baselines. That’s about $560K a year on production traffic, from a single agent.","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"},{"text":"AI21 concludes that teams need to cut costs without breaking what works and keep learning to address whether they can afford to run agents at scale.","excerpt":"cut costs, don’t break what works, and keep learning. By automating that loop, we’re helping more teams confidently answer that question: Can we afford to run it at scale?","url":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evaluation details support AI21’s reported cost reduction for the code-review agent?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"AI21 argues agent costs require more than routing","summary":"AI21’s page, published June 25, 2026, argues that teams need more than routing to control token spend as they run agents at scale. AI21 says manually tuned routing can backfire: a cheaper model produced longer trajectories and raised costs in one company’s experience, while model changes can make carefully tuned rules stale. It describes routing—sending each call to the cheapest model that can handle it—as a common response, but says the difficult part is automating decisions for each agent and domain while accounting for provider differences, KV caching and queries.\n\nAI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates. It reports that routing one code-review agent cut cost per PR by 68% against public baselines, equivalent to about $560K a year on production traffic. The post does not provide the evaluation details behind that result. AI21’s broader point is that teams need to cut costs without breaking what works, and keep learning, to answer whether they can afford to run agents at scale.","question":"What evaluation details support AI21’s reported cost reduction for the code-review agent?","claims":[{"text":"AI21 says teams need automated systems to reduce wasted tokens without harming agent quality as models, prices and workflows change.","excerpt":"Teams need automated systems that cut wasted tokens without hurting agent quality – and keep improving those cuts as models, prices, and workflows change.","support":"source-stated"},{"text":"AI21 reports that routing to a weaker model raised costs in one company’s experience because it produced longer trajectories.","excerpt":"their routing rules that shift traffic to cheaper models eventually drove cost up because the weaker model produced dramatically longer trajectories.","support":"source-stated"},{"text":"AI21 says model changes can make agent optimization and routing rules stale.","excerpt":"Same thing for adding a new model, tools, or adjusting the harness: The ground shifts, and carefully tuned agents or routing rules go stale.","support":"source-stated"},{"text":"AI21 describes routing as sending each call to the cheapest model that can handle it.","excerpt":"send each call to the cheapest model that can handle it.","support":"source-stated"},{"text":"AI21 says its intelligent router trims token waste and makes routing decisions that improve as traffic accumulates.","excerpt":"Above that, it makes advanced routing decisions that keep improving over time, as traffic accumulates.","support":"source-stated"},{"text":"AI21 reports that routing one code-review agent reduced cost per PR by 68% against public baselines, or about $560K annually on production traffic.","excerpt":"Routing a popular code-review agent this way cut cost per PR by 68% against public baselines. That’s about $560K a year on production traffic, from a single agent.","support":"source-stated"},{"text":"AI21 concludes that teams need to cut costs without breaking what works and keep learning to address whether they can afford to run agents at scale.","excerpt":"cut costs, don’t break what works, and keep learning. By automating that loop, we’re helping more teams confidently answer that question: Can we afford to run it at scale?","support":"source-stated"}],"limitations":["Text as retrieved on October 25, 2026; originally published June 25, 2026.","The post does not give the evaluation details behind the reported code-review-agent cost reduction.","The reported field observations come from private conversations described by AI21; the post gives no further methodology for them.","AI21 presents its own product and performance claims; the post does not provide independent assessment."],"mediaId":null,"correctionReason":null,"id":"f7e5b02d6f3d1b87cf38de64d2a7f626d9cc679127323e938617138d91f0527e","publicationId":"d372428c-9d7e-1ea3-ecba-fe8e8046fce1","version":1,"sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","sourceTitle":"Token spend isn’t going down. You need more than naive routing to manage it","publisher":"AI21","publishedAt":"2026-06-25T09:44:56Z","originalPublished":{"value":"2026-06-25T09:44:56Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-10-20T23:43:36.709Z","createdAt":"2026-11-06T11:43:23.228Z","historical":true,"entityIds":["ai21"],"topicIds":["investment-booms-and-busts"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.ai21.com/blog/spend-isnt-going-down-what-now/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"965ee852ba85d7975ceca28b69c4e45a842aaa97d3172d4d908cbae2434ebdaa","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-25T15:02:07.403Z"},"provenance":{"textHash":"0495c5597fb000d3fa0ea19bb33a429c720020741765a57b447f5aa85dd8ac2e","observationId":"c676abc2a351584146d8d17170121f60b4660a092ac453f66a92b8aedb628f02","retrievedAt":"2026-10-25T15:03:42.595Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"80650610-3c0d-c9ec-ec2b-1e881a0951e5"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"e6e1c364-b77e-160d-2269-8f58ed8464b2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-06T11:39:12.944Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"d372428c-9d7e-1ea3-ecba-fe8e8046fce1","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"This is a single AI21 blog post that argues in its own voice. The reading attributes its claims, including the field anecdotes and the product results, to AI21.","excerpt":"We help companies reduce token spend without sacrificing quality."},{"dimension":"summary","status":"uncertain","explanation":"The title and lead say AI21 argues teams need 'more than routing.' The source's thesis is narrower: naive, hand-tuned routing falls short, and the fix is automatic, learning routing (plus methods beyond it). Dropping 'naive' could suggest AI21 is moving away from routing when it is selling an intelligent router. Smallest repair: say 'more than naive (manually tuned) routing' in the title and lead. Minor: 'longer trajectories', 'cost per PR' and 'KV caching' are unexplained and no definitions are supplied. Adding plain-language tooltips (for example, more agent steps and tokens; pull request) would help.","excerpt":"The hard part is making routing automatic, with logic that learns the best calls per agent and per domain."},{"dimension":"date","status":"pass","explanation":"The stated date, June 25, 2026, matches the UTC day of originalPublished. The source is a publisher page, not an archive copy, so no archive disclosure is needed. The reading uses no later events and presents no forecasts as outcomes. The relative phrase 'past month' is not repeated.","excerpt":null},{"dimension":"support","status":"pass","explanation":"Each claim matches an exact source passage and is attributed to AI21. The 68% figure and the $560K estimate are presented as AI21's report. The note that evaluation details are missing is consistent with the source deferring them. Grounding these claims in the source does not verify them independently.","excerpt":"Routing a popular code-review agent this way cut cost per PR by 68% against public baselines. That’s about $560K a year on production traffic, from a single agent. (More on that research soon.)"},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified media candidates were supplied, so there is no mismatch.","excerpt":null}],"createdAt":"2026-11-06T11:39:12.944Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}