{"id":"6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08","title":"Claude Haiku 4.5 with an FSM improves procedural decisions in the authors’ test","argument":"The authors argue that language-model agents can drift from a procedure during long unattended runs, and that repeating instructions or restarting an agent may simply shift the drift. They study an executable finite-state machine (FSM): workflow state is kept outside the model’s context, and the runtime checks tool calls, state transitions and the end of each turn. In a pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts handled correctly and by the procedure, compared with 48 for the strongest baseline. The authors say the FSM maintained this rate to the end, and that gains across three models tracked how much the plain agent drifted. They also report that Haiku 4.5 with the FSM averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost. The authors’ central implication is that control of execution, not only a more capable model, may support reliable procedural automation. The abstract also points to analyses on SWE-bench Verified, $\\tau^2$-bench, and staged and cross-context workflows, but the reported account counts concern the SOP-Bench experiment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported account counts are from the described SOP-Bench experiment; the abstract names other analyses but gives no corresponding results for them. The evidence is the paper’s abstract and does not provide the experimental procedures or further detail about the evaluated workflows.","speaker":{"name":"Sun, Yutao, Li, Haokun, Chen, Mingshuai, Li, Guanyan, Wang, Zhongyi, Qin, Shengchao, Yin, Jianwei","roleAtSource":"Article author"},"source":{"title":"Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.10884","publishedAt":"2026-11-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say language-model agents drift from procedures during long unattended runs, and that restating instructions or resuming a stopped agent shifts rather than removes the drift.","excerpt":"agents drift from such procedures over long runs, and that restating the instructions or resuming a stopped agent only moves the drift to another shortcut.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The studied executable finite-state machine keeps workflow state outside the model’s context and enforces it at tool calls, state transitions and the end of the agent’s turn.","excerpt":"keeps the workflow state outside the model's context and enforces it at three points: tool calls, state transitions and the end of the agent's turn.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"In the pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts decided correctly and by the procedure, versus 48 for the strongest baseline.","excerpt":"Claude Haiku 4.5 with the FSM decided on average 139 accounts correctly and by the procedure, against 48 for the strongest baseline","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The authors report that Haiku 4.5 with the FSM averaged more procedural decisions than plain Claude Sonnet 4.6 at 38% of the cost.","excerpt":"Haiku 4.5 with it averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The authors suggest that reliable long-horizon automation may come from stronger execution control, not only stronger models.","excerpt":"reliable long-horizon automation can come from stronger execution control, not only stronger models.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10884","checkedAt":"2026-11-12T05:48:07.461Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the FSM’s results on SOP-Bench and the other named workflows vary across models and workflows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Claude Haiku 4.5 with an FSM improves procedural decisions in the authors’ test","summary":"The authors argue that language-model agents can drift from a procedure during long unattended runs, and that repeating instructions or restarting an agent may simply shift the drift. They study an executable finite-state machine (FSM): workflow state is kept outside the model’s context, and the runtime checks tool calls, state transitions and the end of each turn. In a pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts handled correctly and by the procedure, compared with 48 for the strongest baseline. The authors say the FSM maintained this rate to the end, and that gains across three models tracked how much the plain agent drifted. They also report that Haiku 4.5 with the FSM averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost. The authors’ central implication is that control of execution, not only a more capable model, may support reliable procedural automation. The abstract also points to analyses on SWE-bench Verified, $\\tau^2$-bench, and staged and cross-context workflows, but the reported account counts concern the SOP-Bench experiment.","question":"How do the FSM’s results on SOP-Bench and the other named workflows vary across models and workflows?","claims":[{"text":"The authors say language-model agents drift from procedures during long unattended runs, and that restating instructions or resuming a stopped agent shifts rather than removes the drift.","excerpt":"agents drift from such procedures over long runs, and that restating the instructions or resuming a stopped agent only moves the drift to another shortcut.","support":"source-stated"},{"text":"The studied executable finite-state machine keeps workflow state outside the model’s context and enforces it at tool calls, state transitions and the end of the agent’s turn.","excerpt":"keeps the workflow state outside the model's context and enforces it at three points: tool calls, state transitions and the end of the agent's turn.","support":"source-stated"},{"text":"In the pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts decided correctly and by the procedure, versus 48 for the strongest baseline.","excerpt":"Claude Haiku 4.5 with the FSM decided on average 139 accounts correctly and by the procedure, against 48 for the strongest baseline","support":"source-stated"},{"text":"The authors report that Haiku 4.5 with the FSM averaged more procedural decisions than plain Claude Sonnet 4.6 at 38% of the cost.","excerpt":"Haiku 4.5 with it averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost.","support":"source-stated"},{"text":"The authors suggest that reliable long-horizon automation may come from stronger execution control, not only stronger models.","excerpt":"reliable long-horizon automation can come from stronger execution control, not only stronger models.","support":"source-stated"}],"limitations":["The reported account counts are from the described SOP-Bench experiment; the abstract names other analyses but gives no corresponding results for them.","The evidence is the paper’s abstract and does not provide the experimental procedures or further detail about the evaluated workflows."],"mediaId":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","correctionReason":null,"id":"6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08","publicationId":"18263b2c-55ff-4094-8cf3-4c30f889cc5d","version":1,"sourceUrl":"https://arxiv.org/abs/2611.10884","sourceTitle":"Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:36:47.900Z","createdAt":"2026-11-12T05:33:57.057Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","kind":"article","url":"https://arxiv.org/abs/2611.10884","sourceUrl":"https://arxiv.org/abs/2611.10884","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T05:32:57.379Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10884","checkedAt":"2026-11-12T05:48:07.461Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9b7727782fbb6eee62082c34253f0fcb55d052b6529dddf89275a5a6946b9f86","decidedAt":"2026-11-12T05:32:59.423Z"},"provenance":{"textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observationId":"63ac384d3ab2159bb58ce516b31f86026324e31f5284b3649832dfec99eb33d8","retrievedAt":"2026-11-12T05:32:57.104Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"8249f228-3bc8-4e4d-8060-bab6e7246459"},"reviewer":{"model":"gpt-6-luna","runId":"a8ef9e25-9911-4c66-8ae7-fd9ea658d501"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T05:33:57.057Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sun, Yutao","url":null,"kind":"unknown"},{"name":"Li, Haokun","url":null,"kind":"unknown"},{"name":"Chen, Mingshuai","url":null,"kind":"unknown"},{"name":"Li, Guanyan","url":null,"kind":"unknown"},{"name":"Wang, Zhongyi","url":null,"kind":"unknown"},{"name":"Qin, Shengchao","url":null,"kind":"unknown"},{"name":"Yin, Jianwei","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sun, Yutao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Yutao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Li, Haokun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Haokun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Chen, Mingshuai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Mingshuai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Li, Guanyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Guanyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Wang, Zhongyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Zhongyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Qin, Shengchao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qin, Shengchao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Yin, Jianwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yin, Jianwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.10884","snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08/source"}},"canonicalUrl":"https://escapemeridian.com/readings/claude-haiku-4-5-with-an-fsm-improves-procedural-decisions-in-6af4295a","formats":{"html":"/readings/claude-haiku-4-5-with-an-fsm-improves-procedural-decisions-in-6af4295a","markdown":"/readings/claude-haiku-4-5-with-an-fsm-improves-procedural-decisions-in-6af4295a.md","json":"/readings/claude-haiku-4-5-with-an-fsm-improves-procedural-decisions-in-6af4295a.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"},{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08","revision":"18263b2c-55ff-4094-8cf3-4c30f889cc5d","revisionKind":"publication-id","title":"Claude Haiku 4.5 with an FSM improves procedural decisions in the authors’ test","url":"https://escapemeridian.com/readings/claude-haiku-4-5-with-an-fsm-improves-procedural-decisions-in-6af4295a"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.10884","revision":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","revisionKind":"sha256-source-text","title":"Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity","url":"https://arxiv.org/abs/2611.10884"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08","title":"Claude Haiku 4.5 with an FSM improves procedural decisions in the authors’ test","argument":"The authors argue that language-model agents can drift from a procedure during long unattended runs, and that repeating instructions or restarting an agent may simply shift the drift. They study an executable finite-state machine (FSM): workflow state is kept outside the model’s context, and the runtime checks tool calls, state transitions and the end of each turn. In a pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts handled correctly and by the procedure, compared with 48 for the strongest baseline. The authors say the FSM maintained this rate to the end, and that gains across three models tracked how much the plain agent drifted. They also report that Haiku 4.5 with the FSM averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost. The authors’ central implication is that control of execution, not only a more capable model, may support reliable procedural automation. The abstract also points to analyses on SWE-bench Verified, $\\tau^2$-bench, and staged and cross-context workflows, but the reported account counts concern the SOP-Bench experiment.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported account counts are from the described SOP-Bench experiment; the abstract names other analyses but gives no corresponding results for them. The evidence is the paper’s abstract and does not provide the experimental procedures or further detail about the evaluated workflows.","speaker":{"name":"Sun, Yutao, Li, Haokun, Chen, Mingshuai, Li, Guanyan, Wang, Zhongyi, Qin, Shengchao, Yin, Jianwei","roleAtSource":"Article author"},"source":{"title":"Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.10884","publishedAt":"2026-11-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say language-model agents drift from procedures during long unattended runs, and that restating instructions or resuming a stopped agent shifts rather than removes the drift.","excerpt":"agents drift from such procedures over long runs, and that restating the instructions or resuming a stopped agent only moves the drift to another shortcut.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The studied executable finite-state machine keeps workflow state outside the model’s context and enforces it at tool calls, state transitions and the end of the agent’s turn.","excerpt":"keeps the workflow state outside the model's context and enforces it at three points: tool calls, state transitions and the end of the agent's turn.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"In the pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts decided correctly and by the procedure, versus 48 for the strongest baseline.","excerpt":"Claude Haiku 4.5 with the FSM decided on average 139 accounts correctly and by the procedure, against 48 for the strongest baseline","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The authors report that Haiku 4.5 with the FSM averaged more procedural decisions than plain Claude Sonnet 4.6 at 38% of the cost.","excerpt":"Haiku 4.5 with it averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"},{"text":"The authors suggest that reliable long-horizon automation may come from stronger execution control, not only stronger models.","excerpt":"reliable long-horizon automation can come from stronger execution control, not only stronger models.","url":"https://arxiv.org/abs/2611.10884","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10884","checkedAt":"2026-11-12T05:48:07.461Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the FSM’s results on SOP-Bench and the other named workflows vary across models and workflows?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Claude Haiku 4.5 with an FSM improves procedural decisions in the authors’ test","summary":"The authors argue that language-model agents can drift from a procedure during long unattended runs, and that repeating instructions or restarting an agent may simply shift the drift. They study an executable finite-state machine (FSM): workflow state is kept outside the model’s context, and the runtime checks tool calls, state transitions and the end of each turn. In a pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts handled correctly and by the procedure, compared with 48 for the strongest baseline. The authors say the FSM maintained this rate to the end, and that gains across three models tracked how much the plain agent drifted. They also report that Haiku 4.5 with the FSM averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost. The authors’ central implication is that control of execution, not only a more capable model, may support reliable procedural automation. The abstract also points to analyses on SWE-bench Verified, $\\tau^2$-bench, and staged and cross-context workflows, but the reported account counts concern the SOP-Bench experiment.","question":"How do the FSM’s results on SOP-Bench and the other named workflows vary across models and workflows?","claims":[{"text":"The authors say language-model agents drift from procedures during long unattended runs, and that restating instructions or resuming a stopped agent shifts rather than removes the drift.","excerpt":"agents drift from such procedures over long runs, and that restating the instructions or resuming a stopped agent only moves the drift to another shortcut.","support":"source-stated"},{"text":"The studied executable finite-state machine keeps workflow state outside the model’s context and enforces it at tool calls, state transitions and the end of the agent’s turn.","excerpt":"keeps the workflow state outside the model's context and enforces it at three points: tool calls, state transitions and the end of the agent's turn.","support":"source-stated"},{"text":"In the pre-registered experiment on 200-account SOP-Bench batches, Claude Haiku 4.5 with the FSM averaged 139 accounts decided correctly and by the procedure, versus 48 for the strongest baseline.","excerpt":"Claude Haiku 4.5 with the FSM decided on average 139 accounts correctly and by the procedure, against 48 for the strongest baseline","support":"source-stated"},{"text":"The authors report that Haiku 4.5 with the FSM averaged more procedural decisions than plain Claude Sonnet 4.6 at 38% of the cost.","excerpt":"Haiku 4.5 with it averaged more such decisions than plain Claude Sonnet 4.6 at 38% of the cost.","support":"source-stated"},{"text":"The authors suggest that reliable long-horizon automation may come from stronger execution control, not only stronger models.","excerpt":"reliable long-horizon automation can come from stronger execution control, not only stronger models.","support":"source-stated"}],"limitations":["The reported account counts are from the described SOP-Bench experiment; the abstract names other analyses but gives no corresponding results for them.","The evidence is the paper’s abstract and does not provide the experimental procedures or further detail about the evaluated workflows."],"mediaId":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","correctionReason":null,"id":"6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08","publicationId":"18263b2c-55ff-4094-8cf3-4c30f889cc5d","version":1,"sourceUrl":"https://arxiv.org/abs/2611.10884","sourceTitle":"Keeping LLM Agents on Procedure: Executable Finite-State Control for Long-Horizon Instruction Fidelity","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:36:47.900Z","createdAt":"2026-11-12T05:33:57.057Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","kind":"article","url":"https://arxiv.org/abs/2611.10884","sourceUrl":"https://arxiv.org/abs/2611.10884","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T05:32:57.379Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10884","checkedAt":"2026-11-12T05:48:07.461Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"e693b965ad6f0e983539baef46f9ed90d7ee3d97b54fd35a91f0e8843e47ed69","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9b7727782fbb6eee62082c34253f0fcb55d052b6529dddf89275a5a6946b9f86","decidedAt":"2026-11-12T05:32:59.423Z"},"provenance":{"textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observationId":"63ac384d3ab2159bb58ce516b31f86026324e31f5284b3649832dfec99eb33d8","retrievedAt":"2026-11-12T05:32:57.104Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"8249f228-3bc8-4e4d-8060-bab6e7246459"},"reviewer":{"model":"gpt-6-luna","runId":"a8ef9e25-9911-4c66-8ae7-fd9ea658d501"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T05:33:57.057Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sun, Yutao","url":null,"kind":"unknown"},{"name":"Li, Haokun","url":null,"kind":"unknown"},{"name":"Chen, Mingshuai","url":null,"kind":"unknown"},{"name":"Li, Guanyan","url":null,"kind":"unknown"},{"name":"Wang, Zhongyi","url":null,"kind":"unknown"},{"name":"Qin, Shengchao","url":null,"kind":"unknown"},{"name":"Yin, Jianwei","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sun, Yutao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Yutao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Li, Haokun","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Haokun","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Chen, Mingshuai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Mingshuai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Li, Guanyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Li, Guanyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Wang, Zhongyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Zhongyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Qin, Shengchao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Qin, Shengchao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}},{"actor":{"name":"Yin, Jianwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yin, Jianwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10884","locator":"head/meta[name=author|citation_author]"},"assertionId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T05:48:07.461Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","sourceUrl":"https://arxiv.org/abs/2611.10884","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.10884","snapshotId":"5c91c2396dd68f1f2e8f3d8ed563a23ac244c04d51baf13f57ffe4d1e271a47d","contentSha256":"ae1c6bb29c0750b8eb4eb9d8ad658840940d8ea44e2222135fcbc98d2d41a04d","textHash":"404871ccfc432aaa0204f8250528f0c0347b57bb910e45a7a5a8d4a47b2448ba","observedAt":"2026-11-12T05:48:07.461Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6af4295a861b4da9694eb134e9c0c6a1229b2412c61c5fa3bb67ca6f2e90ac08/source"}}}],"audits":[{"publicationId":"18263b2c-55ff-4094-8cf3-4c30f889cc5d","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the findings and implications to the paper's authors, using phrases like 'the authors argue' and 'the authors report'. It does not present SOP-Bench results or cost claims as established fact or as Escape Meridian's view.","excerpt":"Authors:Yutao Sun, Haokun Li, Mingshuai Chen, Guanyan Li, Zhongyi Wang, Shengchao Qin, Jianwei Yin"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful overall, but readers without specialist background are left with two gaps. First, 'SOP' and 'SOP-Bench' are never explained; the reading never says that an SOP is a standard operating procedure or that SOP-Bench is a benchmark of such procedures. Second, it drops the abstract's 95% CI for the difference, [46, 130]. That wide interval is the source's own signal of uncertainty about the size of the gain. It also omits the framing that each step 'needs little intelligence'. Smallest repair: add a plain gloss of SOP/SOP-Bench and the confidence interval.","excerpt":"against 48 for the strongest baseline (95% CI of the difference [46, 130])"},{"dimension":"date","status":"pass","explanation":"The originalPublished value, 2026-11-07, matches the v1 submission date on arXiv. The feed date of 2026-11-10 is correctly not used.","excerpt":"[Submitted on 7 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim is backed by an exact quotation from the abstract. The implication is kept conditional ('may support'), and the limitations correctly say the account counts come only from SOP-Bench. The softening 'may simply shift' is weaker than the source's 'only moves', but it does not misstate the claim. The question does not presuppose any result. No unsupported beneficiaries or costs are introduced.","excerpt":"Because the runtime, not the model, supplies this long-horizon reliability, the FSM can let small models carry procedural work"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page for this paper, which is the most direct way to reach the source.","excerpt":null}],"createdAt":"2026-11-12T05:33:57.057Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}