{"id":"3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690","title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","argument":"The authors of “The FrontierOR Challenge: Agentic Algorithm Design for Operations Research” argue that whether large language model (LLM) agents can design algorithms that scale to realistic operations research problems remains an open question. They cite a one-shot evaluation in which the strongest model matched Gurobi—within 1% of its objective and no slower—on only 39% of large instances. The challenge is designed to test whether agentic workflows can design, test and improve algorithms across many optimization problems. Its first stage releases part of an audited benchmark in weekly rounds; a second stage uses new problems outside that benchmark and unseen instances. The challenge separates a Main track, where submitted algorithms run in a network-isolated sandbox with open-source dependencies, from a Self-hosted track, where teams solve instances on their own machines using any software within a timed window. The abstract describes the challenge design, not results showing how well participants’ algorithms perform.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract; it does not provide challenge results or further detail about the benchmark and evaluation beyond the description quoted here.","speaker":{"name":"Wang, Hai, Hajek, Bretislav, Jiang, Chonghe, Kong, Minwei, Qu, Ao, Gong, Huatian, Dong, Bo, Barnhart, Cynthia, Zhao, Jinhua","roleAtSource":"Article author"},"source":{"title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.26171","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say whether LLM agents can design algorithms that scale to realistic operations research instances is still an open question.","excerpt":"but whether they can design algorithms that scale to realistic instances is open","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"In the cited one-shot evaluation, the strongest model met the stated comparison with Gurobi on 39% of large instances.","excerpt":"the strongest model matches Gurobi, with an objective within 1% of Gurobi's and no slower, on only 39% of the large instances.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"The challenge’s second stage introduces problems outside the benchmark, including unseen instances.","excerpt":"Stage 2 introduces new problems outside the benchmark, with unseen instances.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"The authors describe separate Main and Self-hosted tracks with different execution conditions.","excerpt":"in the Main track we run the submitted algorithms in a network-isolated sandbox with open-source dependencies only; in the Self-hosted track teams solve the instances on their own machines, with any software, within a timed window.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26171","checkedAt":"2026-11-21T01:50:09.605Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How will submitted workflows perform on Stage 2’s new problems and unseen instances?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","summary":"The authors of “The FrontierOR Challenge: Agentic Algorithm Design for Operations Research” argue that whether large language model (LLM) agents can design algorithms that scale to realistic operations research problems remains an open question. They cite a one-shot evaluation in which the strongest model matched Gurobi—within 1% of its objective and no slower—on only 39% of large instances. The challenge is designed to test whether agentic workflows can design, test and improve algorithms across many optimization problems. Its first stage releases part of an audited benchmark in weekly rounds; a second stage uses new problems outside that benchmark and unseen instances. The challenge separates a Main track, where submitted algorithms run in a network-isolated sandbox with open-source dependencies, from a Self-hosted track, where teams solve instances on their own machines using any software within a timed window. The abstract describes the challenge design, not results showing how well participants’ algorithms perform.","question":"How will submitted workflows perform on Stage 2’s new problems and unseen instances?","claims":[{"text":"The authors say whether LLM agents can design algorithms that scale to realistic operations research instances is still an open question.","excerpt":"but whether they can design algorithms that scale to realistic instances is open","support":"source-stated"},{"text":"In the cited one-shot evaluation, the strongest model met the stated comparison with Gurobi on 39% of large instances.","excerpt":"the strongest model matches Gurobi, with an objective within 1% of Gurobi's and no slower, on only 39% of the large instances.","support":"source-stated"},{"text":"The challenge’s second stage introduces problems outside the benchmark, including unseen instances.","excerpt":"Stage 2 introduces new problems outside the benchmark, with unseen instances.","support":"source-stated"},{"text":"The authors describe separate Main and Self-hosted tracks with different execution conditions.","excerpt":"in the Main track we run the submitted algorithms in a network-isolated sandbox with open-source dependencies only; in the Self-hosted track teams solve the instances on their own machines, with any software, within a timed window.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract; it does not provide challenge results or further detail about the benchmark and evaluation beyond the description quoted here."],"mediaId":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","correctionReason":null,"id":"3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690","publicationId":"2d02b4e7-b043-4677-83c9-5023852af69e","version":1,"sourceUrl":"https://arxiv.org/abs/2611.26171","sourceTitle":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:44.268Z","createdAt":"2026-11-20T08:47:27.192Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","kind":"article","url":"https://arxiv.org/abs/2611.26171","sourceUrl":"https://arxiv.org/abs/2611.26171","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:46:16.964Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26171","checkedAt":"2026-11-21T01:50:09.605Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","confidence":0.59,"provider":"typesafe","model":"jev-1.13.0","inputHash":"dc7ddcc5baf18a2c4433c732b1e0715d1249303a3fbc7f95691c45cb5a5fae45","decidedAt":"2026-11-20T08:46:17.705Z"},"provenance":{"textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observationId":"505ff0fe353b3b80fb1eb3e6596f12c311e76d54642ff09e3a7e63c07b6d555f","retrievedAt":"2026-11-20T08:46:16.863Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna; stream-sentence-removal-v1: removed summary 6","runId":"40516ecb-76aa-456a-8873-78fda6b06f78"},"reviewer":{"model":"gpt-6-luna","runId":"d97504ed-45b1-4519-8248-6e77542a41f0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T08:47:27.192Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wang, Hai","url":null,"kind":"unknown"},{"name":"Hajek, Bretislav","url":null,"kind":"unknown"},{"name":"Jiang, Chonghe","url":null,"kind":"unknown"},{"name":"Kong, Minwei","url":null,"kind":"unknown"},{"name":"Qu, Ao","url":null,"kind":"unknown"},{"name":"Gong, Huatian","url":null,"kind":"unknown"},{"name":"Dong, Bo","url":null,"kind":"unknown"},{"name":"Barnhart, Cynthia","url":null,"kind":"unknown"},{"name":"Zhao, Jinhua","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wang, Hai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Hai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Hajek, Bretislav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hajek, Bretislav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Jiang, Chonghe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Chonghe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Kong, Minwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kong, Minwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Qu, Ao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qu, Ao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Gong, Huatian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gong, Huatian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Dong, Bo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dong, Bo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Barnhart, Cynthia","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Barnhart, Cynthia","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Zhao, Jinhua","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Jinhua","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}}],"participationCoverage":{"total":9,"returned":9,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.26171","snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z","basis":"publisher-page-metadata","sourceLinks":49,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690/source"}},"canonicalUrl":"https://escapemeridian.com/readings/the-frontieror-challenge-agentic-algorithm-design-for-3e6ed88e","formats":{"html":"/readings/the-frontieror-challenge-agentic-algorithm-design-for-3e6ed88e","markdown":"/readings/the-frontieror-challenge-agentic-algorithm-design-for-3e6ed88e.md","json":"/readings/the-frontieror-challenge-agentic-algorithm-design-for-3e6ed88e.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-agentic","name":"Agentic AI","explanation":"AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.","referenceUrl":"https://developers.google.com/machine-learning/glossary#agentic"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690","revision":"2d02b4e7-b043-4677-83c9-5023852af69e","revisionKind":"publication-id","title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","url":"https://escapemeridian.com/readings/the-frontieror-challenge-agentic-algorithm-design-for-3e6ed88e"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.26171","revision":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","revisionKind":"sha256-source-text","title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","url":"https://arxiv.org/abs/2611.26171"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690","title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","argument":"The authors of “The FrontierOR Challenge: Agentic Algorithm Design for Operations Research” argue that whether large language model (LLM) agents can design algorithms that scale to realistic operations research problems remains an open question. They cite a one-shot evaluation in which the strongest model matched Gurobi—within 1% of its objective and no slower—on only 39% of large instances. The challenge is designed to test whether agentic workflows can design, test and improve algorithms across many optimization problems. Its first stage releases part of an audited benchmark in weekly rounds; a second stage uses new problems outside that benchmark and unseen instances. The challenge separates a Main track, where submitted algorithms run in a network-isolated sandbox with open-source dependencies, from a Self-hosted track, where teams solve instances on their own machines using any software within a timed window. The abstract describes the challenge design, not results showing how well participants’ algorithms perform.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv abstract; it does not provide challenge results or further detail about the benchmark and evaluation beyond the description quoted here.","speaker":{"name":"Wang, Hai, Hajek, Bretislav, Jiang, Chonghe, Kong, Minwei, Qu, Ao, Gong, Huatian, Dong, Bo, Barnhart, Cynthia, Zhao, Jinhua","roleAtSource":"Article author"},"source":{"title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.26171","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say whether LLM agents can design algorithms that scale to realistic operations research instances is still an open question.","excerpt":"but whether they can design algorithms that scale to realistic instances is open","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"In the cited one-shot evaluation, the strongest model met the stated comparison with Gurobi on 39% of large instances.","excerpt":"the strongest model matches Gurobi, with an objective within 1% of Gurobi's and no slower, on only 39% of the large instances.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"The challenge’s second stage introduces problems outside the benchmark, including unseen instances.","excerpt":"Stage 2 introduces new problems outside the benchmark, with unseen instances.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"},{"text":"The authors describe separate Main and Self-hosted tracks with different execution conditions.","excerpt":"in the Main track we run the submitted algorithms in a network-isolated sandbox with open-source dependencies only; in the Self-hosted track teams solve the instances on their own machines, with any software, within a timed window.","url":"https://arxiv.org/abs/2611.26171","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26171","checkedAt":"2026-11-21T01:50:09.605Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How will submitted workflows perform on Stage 2’s new problems and unseen instances?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","summary":"The authors of “The FrontierOR Challenge: Agentic Algorithm Design for Operations Research” argue that whether large language model (LLM) agents can design algorithms that scale to realistic operations research problems remains an open question. They cite a one-shot evaluation in which the strongest model matched Gurobi—within 1% of its objective and no slower—on only 39% of large instances. The challenge is designed to test whether agentic workflows can design, test and improve algorithms across many optimization problems. Its first stage releases part of an audited benchmark in weekly rounds; a second stage uses new problems outside that benchmark and unseen instances. The challenge separates a Main track, where submitted algorithms run in a network-isolated sandbox with open-source dependencies, from a Self-hosted track, where teams solve instances on their own machines using any software within a timed window. The abstract describes the challenge design, not results showing how well participants’ algorithms perform.","question":"How will submitted workflows perform on Stage 2’s new problems and unseen instances?","claims":[{"text":"The authors say whether LLM agents can design algorithms that scale to realistic operations research instances is still an open question.","excerpt":"but whether they can design algorithms that scale to realistic instances is open","support":"source-stated"},{"text":"In the cited one-shot evaluation, the strongest model met the stated comparison with Gurobi on 39% of large instances.","excerpt":"the strongest model matches Gurobi, with an objective within 1% of Gurobi's and no slower, on only 39% of the large instances.","support":"source-stated"},{"text":"The challenge’s second stage introduces problems outside the benchmark, including unseen instances.","excerpt":"Stage 2 introduces new problems outside the benchmark, with unseen instances.","support":"source-stated"},{"text":"The authors describe separate Main and Self-hosted tracks with different execution conditions.","excerpt":"in the Main track we run the submitted algorithms in a network-isolated sandbox with open-source dependencies only; in the Self-hosted track teams solve the instances on their own machines, with any software, within a timed window.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv abstract; it does not provide challenge results or further detail about the benchmark and evaluation beyond the description quoted here."],"mediaId":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","correctionReason":null,"id":"3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690","publicationId":"2d02b4e7-b043-4677-83c9-5023852af69e","version":1,"sourceUrl":"https://arxiv.org/abs/2611.26171","sourceTitle":"The FrontierOR Challenge: Agentic Algorithm Design for Operations Research","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:44.268Z","createdAt":"2026-11-20T08:47:27.192Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","kind":"article","url":"https://arxiv.org/abs/2611.26171","sourceUrl":"https://arxiv.org/abs/2611.26171","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:46:16.964Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26171","checkedAt":"2026-11-21T01:50:09.605Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"1f890f65a7923275677b548f1bc791fa75903222a71a40930f116273f4d1f908","confidence":0.59,"provider":"typesafe","model":"jev-1.13.0","inputHash":"dc7ddcc5baf18a2c4433c732b1e0715d1249303a3fbc7f95691c45cb5a5fae45","decidedAt":"2026-11-20T08:46:17.705Z"},"provenance":{"textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observationId":"505ff0fe353b3b80fb1eb3e6596f12c311e76d54642ff09e3a7e63c07b6d555f","retrievedAt":"2026-11-20T08:46:16.863Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna; stream-sentence-removal-v1: removed summary 6","runId":"40516ecb-76aa-456a-8873-78fda6b06f78"},"reviewer":{"model":"gpt-6-luna","runId":"d97504ed-45b1-4519-8248-6e77542a41f0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T08:47:27.192Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wang, Hai","url":null,"kind":"unknown"},{"name":"Hajek, Bretislav","url":null,"kind":"unknown"},{"name":"Jiang, Chonghe","url":null,"kind":"unknown"},{"name":"Kong, Minwei","url":null,"kind":"unknown"},{"name":"Qu, Ao","url":null,"kind":"unknown"},{"name":"Gong, Huatian","url":null,"kind":"unknown"},{"name":"Dong, Bo","url":null,"kind":"unknown"},{"name":"Barnhart, Cynthia","url":null,"kind":"unknown"},{"name":"Zhao, Jinhua","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wang, Hai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Hai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Hajek, Bretislav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hajek, Bretislav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Jiang, Chonghe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Chonghe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Kong, Minwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kong, Minwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Qu, Ao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qu, Ao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Gong, Huatian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gong, Huatian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Dong, Bo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Dong, Bo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Barnhart, Cynthia","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Barnhart, Cynthia","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}},{"actor":{"name":"Zhao, Jinhua","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Jinhua","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26171","locator":"head/meta[name=author|citation_author]"},"assertionId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:50:09.605Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","sourceUrl":"https://arxiv.org/abs/2611.26171","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z"}}],"participationCoverage":{"total":9,"returned":9,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.26171","snapshotId":"429742e042d066c8c1f52c75a2abe605749cc31b9f869f279b8b0bbb141aab02","contentSha256":"f39d85a4de628b40e176ae0747490e55d692f69a9679fae7cd20f5453a410a33","textHash":"c97a92ec4bc9fc5c5bec8565aa76cdd2b8fe4d8fde1fbdd1f849ceec7fa84fde","observedAt":"2026-11-21T01:50:09.605Z","basis":"publisher-page-metadata","sourceLinks":49,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3e6ed88e764ac620ffeab5802f08c35f16be0645a4bf950e4b68ddb342ff6690/source"}}}],"audits":[{"publicationId":"2d02b4e7-b043-4677-83c9-5023852af69e","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the argument and challenge description to the paper's authors. It presents the 39% figure as the authors' cited one-shot evaluation, not as an independent fact.","excerpt":"Authors:Hai Wang, Bretislav Hajek, Chonghe Jiang, Minwei Kong, Ao Qu, Huatian Gong, Bo Dong, Cynthia Barnhart, Jinhua Zhao"},{"dimension":"summary","status":"uncertain","explanation":"Gurobi is central to the key statistic but is never explained; a general reader cannot tell that it is the comparison reference. Smallest repair: add a tooltip or term-library entry for Gurobi. The reading also drops the source's human stake: OR algorithms are expert-tailored, and a new problem can take weeks of specialist work. Without that, readers lose why agentic algorithm design matters. Restore it in one sentence. Also restore the scoring rule: feasibility is checked, then a feasible solution scores its objective ratio to a frozen reference.","excerpt":"a new routing, scheduling or network design problem can take weeks of specialist work before it is solved well at scale"},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-19 matches the v1 submission date. The feed date of Nov 20 is correctly not used.","excerpt":"[Submitted on 19 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim is supported by a verbatim excerpt. The note that the abstract gives design rather than results is accurate. The question about Stage 2 performance follows from the evidence without assuming an outcome.","excerpt":"Stage 2 introduces new problems outside the benchmark, with unseen instances."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper.","excerpt":null}],"createdAt":"2026-11-20T08:47:27.192Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}