{"id":"fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63","title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","argument":"Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh and Wesley Assunção argue that stale repository instruction files can impose documentation debt: repeated costs to coding-agent sessions that may be missed when evaluation checks only whether a task succeeds. An instruction file can, for example, direct an agent to a test folder that has moved. The authors studied three stale instructions from active open-source repositories, covering a test command, a code location and a procedure for adding a component. They compared agents working on the same 22 maintenance tasks with each instruction left stale, corrected or removed, analyzing 732 trajectories from two models. Agents followed stale guidance when it was relevant, sometimes despite correct information elsewhere. For one stale test command, Claude Sonnet 5.5 used about two more tool calls per run than with the corrected command; the authors detected no difference in the other cases. Agents generally recovered from immediate failures, but none repaired the instruction file itself. The authors say task success alone can therefore conceal costs in agent behavior. Their results point to a distinction between completing a task and avoiding unnecessary operations along the way, within the study’s tested cases.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study covers three stale instructions from active open-source repositories and 22 maintenance tasks; the reported findings do not establish how often the same effects occur in other settings. The extra tool-call result is reported for the stale test command and Claude Sonnet 5.5; the authors say they could not detect a difference in the other cases.","speaker":{"name":"Mehtiyev, Tural, Tadesse, Biruk, Arkoh, Lawrence, Assunção, Wesley","roleAtSource":"Article author"},"source":{"title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.09802","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors frame stale repository instructions as documentation debt whose costs can recur across later coding-agent sessions and escape evaluations focused only on task success.","excerpt":"such a stale instruction is documentation debt, and its interest is the cost it adds to every later agent session.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"In the study, agents followed stale guidance when it was relevant, sometimes even when correct information was available elsewhere.","excerpt":"agents follow stale guidance when it is relevant to their tasks, sometimes even when correct information is available elsewhere.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"For the stale test command, Claude Sonnet 5.5 used about two extra tool calls per run compared with the corrected command; the authors detected no difference in the other cases.","excerpt":"Claude Sonnet 5.5 needed about two extra tool calls per run, a third more than with the corrected command; in the other cases, we could not detect a difference.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"Agents generally recovered from immediate failures, but none repaired the underlying instruction file.","excerpt":"Although agents generally recovered from the immediate failures, none repaired the underlying instruction file.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"The authors studied three real-world stale instructions from active open-source repositories, 22 maintenance tasks and 732 trajectories from two models.","excerpt":"We study three real-world stale instructions from active open-source repositories in depth","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09802","checkedAt":"2026-11-10T19:52:10.762Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would studies of other stale instructions, repositories and models find the same added tool-call cost, or is it limited to the test-command case reported here?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","summary":"Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh and Wesley Assunção argue that stale repository instruction files can impose documentation debt: repeated costs to coding-agent sessions that may be missed when evaluation checks only whether a task succeeds. An instruction file can, for example, direct an agent to a test folder that has moved. The authors studied three stale instructions from active open-source repositories, covering a test command, a code location and a procedure for adding a component. They compared agents working on the same 22 maintenance tasks with each instruction left stale, corrected or removed, analyzing 732 trajectories from two models. Agents followed stale guidance when it was relevant, sometimes despite correct information elsewhere. For one stale test command, Claude Sonnet 5.5 used about two more tool calls per run than with the corrected command; the authors detected no difference in the other cases. Agents generally recovered from immediate failures, but none repaired the instruction file itself. The authors say task success alone can therefore conceal costs in agent behavior. Their results point to a distinction between completing a task and avoiding unnecessary operations along the way, within the study’s tested cases.","question":"Would studies of other stale instructions, repositories and models find the same added tool-call cost, or is it limited to the test-command case reported here?","claims":[{"text":"The authors frame stale repository instructions as documentation debt whose costs can recur across later coding-agent sessions and escape evaluations focused only on task success.","excerpt":"such a stale instruction is documentation debt, and its interest is the cost it adds to every later agent session.","support":"source-stated"},{"text":"In the study, agents followed stale guidance when it was relevant, sometimes even when correct information was available elsewhere.","excerpt":"agents follow stale guidance when it is relevant to their tasks, sometimes even when correct information is available elsewhere.","support":"source-stated"},{"text":"For the stale test command, Claude Sonnet 5.5 used about two extra tool calls per run compared with the corrected command; the authors detected no difference in the other cases.","excerpt":"Claude Sonnet 5.5 needed about two extra tool calls per run, a third more than with the corrected command; in the other cases, we could not detect a difference.","support":"source-stated"},{"text":"Agents generally recovered from immediate failures, but none repaired the underlying instruction file.","excerpt":"Although agents generally recovered from the immediate failures, none repaired the underlying instruction file.","support":"source-stated"},{"text":"The authors studied three real-world stale instructions from active open-source repositories, 22 maintenance tasks and 732 trajectories from two models.","excerpt":"We study three real-world stale instructions from active open-source repositories in depth","support":"source-stated"}],"limitations":["The study covers three stale instructions from active open-source repositories and 22 maintenance tasks; the reported findings do not establish how often the same effects occur in other settings.","The extra tool-call result is reported for the stale test command and Claude Sonnet 5.5; the authors say they could not detect a difference in the other cases."],"mediaId":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","correctionReason":null,"id":"fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63","publicationId":"30c0ac86-132e-4d31-8feb-0445b37a9db8","version":1,"sourceUrl":"https://arxiv.org/abs/2611.09802","sourceTitle":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:00:45.204Z","createdAt":"2026-11-10T18:49:39.988Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","kind":"article","url":"https://arxiv.org/abs/2611.09802","sourceUrl":"https://arxiv.org/abs/2611.09802","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T05:16:29.266Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09802","checkedAt":"2026-11-10T19:52:10.762Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","confidence":0.8500000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"b8241ddd63e5e289857dfb6fe52a824135b7381b90df60a58a71ad951eaf5484","decidedAt":"2026-11-10T05:16:30.074Z"},"provenance":{"textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observationId":"1f7b29a020462ad80fda1e1320f6ef4695dc408352882d07715e0f4fb3fa2c65","retrievedAt":"2026-11-10T05:16:29.153Z","kind":"publisher-page","preparer":{"model":"server-excerpt-repair/stream-excerpt-repair-v1 (original draft: gpt-6-luna)","runId":"82aeadea-4120-4fa9-8a0d-8a2a3ce638cb"},"reviewer":{"model":"gpt-6-luna","runId":"deeee2fd-fd7c-4fad-87ae-c72293901c98"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T18:49:39.988Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Mehtiyev, Tural","url":null,"kind":"unknown"},{"name":"Tadesse, Biruk","url":null,"kind":"unknown"},{"name":"Arkoh, Lawrence","url":null,"kind":"unknown"},{"name":"Assunção, Wesley","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Mehtiyev, Tural","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mehtiyev, Tural","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Tadesse, Biruk","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tadesse, Biruk","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Arkoh, Lawrence","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arkoh, Lawrence","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Assunção, Wesley","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Assunção, Wesley","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.09802","snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63/source"}},"canonicalUrl":"https://escapemeridian.com/readings/when-instruction-files-go-stale-documentation-debt-and-hidden-fc826f10","formats":{"html":"/readings/when-instruction-files-go-stale-documentation-debt-and-hidden-fc826f10","markdown":"/readings/when-instruction-files-go-stale-documentation-debt-and-hidden-fc826f10.md","json":"/readings/when-instruction-files-go-stale-documentation-debt-and-hidden-fc826f10.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63","revision":"30c0ac86-132e-4d31-8feb-0445b37a9db8","revisionKind":"publication-id","title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","url":"https://escapemeridian.com/readings/when-instruction-files-go-stale-documentation-debt-and-hidden-fc826f10"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.09802","revision":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","revisionKind":"sha256-source-text","title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","url":"https://arxiv.org/abs/2611.09802"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63","title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","argument":"Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh and Wesley Assunção argue that stale repository instruction files can impose documentation debt: repeated costs to coding-agent sessions that may be missed when evaluation checks only whether a task succeeds. An instruction file can, for example, direct an agent to a test folder that has moved. The authors studied three stale instructions from active open-source repositories, covering a test command, a code location and a procedure for adding a component. They compared agents working on the same 22 maintenance tasks with each instruction left stale, corrected or removed, analyzing 732 trajectories from two models. Agents followed stale guidance when it was relevant, sometimes despite correct information elsewhere. For one stale test command, Claude Sonnet 5.5 used about two more tool calls per run than with the corrected command; the authors detected no difference in the other cases. Agents generally recovered from immediate failures, but none repaired the instruction file itself. The authors say task success alone can therefore conceal costs in agent behavior. Their results point to a distinction between completing a task and avoiding unnecessary operations along the way, within the study’s tested cases.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study covers three stale instructions from active open-source repositories and 22 maintenance tasks; the reported findings do not establish how often the same effects occur in other settings. The extra tool-call result is reported for the stale test command and Claude Sonnet 5.5; the authors say they could not detect a difference in the other cases.","speaker":{"name":"Mehtiyev, Tural, Tadesse, Biruk, Arkoh, Lawrence, Assunção, Wesley","roleAtSource":"Article author"},"source":{"title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.09802","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors frame stale repository instructions as documentation debt whose costs can recur across later coding-agent sessions and escape evaluations focused only on task success.","excerpt":"such a stale instruction is documentation debt, and its interest is the cost it adds to every later agent session.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"In the study, agents followed stale guidance when it was relevant, sometimes even when correct information was available elsewhere.","excerpt":"agents follow stale guidance when it is relevant to their tasks, sometimes even when correct information is available elsewhere.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"For the stale test command, Claude Sonnet 5.5 used about two extra tool calls per run compared with the corrected command; the authors detected no difference in the other cases.","excerpt":"Claude Sonnet 5.5 needed about two extra tool calls per run, a third more than with the corrected command; in the other cases, we could not detect a difference.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"Agents generally recovered from immediate failures, but none repaired the underlying instruction file.","excerpt":"Although agents generally recovered from the immediate failures, none repaired the underlying instruction file.","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"},{"text":"The authors studied three real-world stale instructions from active open-source repositories, 22 maintenance tasks and 732 trajectories from two models.","excerpt":"We study three real-world stale instructions from active open-source repositories in depth","url":"https://arxiv.org/abs/2611.09802","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09802","checkedAt":"2026-11-10T19:52:10.762Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would studies of other stale instructions, repositories and models find the same added tool-call cost, or is it limited to the test-command case reported here?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","summary":"Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh and Wesley Assunção argue that stale repository instruction files can impose documentation debt: repeated costs to coding-agent sessions that may be missed when evaluation checks only whether a task succeeds. An instruction file can, for example, direct an agent to a test folder that has moved. The authors studied three stale instructions from active open-source repositories, covering a test command, a code location and a procedure for adding a component. They compared agents working on the same 22 maintenance tasks with each instruction left stale, corrected or removed, analyzing 732 trajectories from two models. Agents followed stale guidance when it was relevant, sometimes despite correct information elsewhere. For one stale test command, Claude Sonnet 5.5 used about two more tool calls per run than with the corrected command; the authors detected no difference in the other cases. Agents generally recovered from immediate failures, but none repaired the instruction file itself. The authors say task success alone can therefore conceal costs in agent behavior. Their results point to a distinction between completing a task and avoiding unnecessary operations along the way, within the study’s tested cases.","question":"Would studies of other stale instructions, repositories and models find the same added tool-call cost, or is it limited to the test-command case reported here?","claims":[{"text":"The authors frame stale repository instructions as documentation debt whose costs can recur across later coding-agent sessions and escape evaluations focused only on task success.","excerpt":"such a stale instruction is documentation debt, and its interest is the cost it adds to every later agent session.","support":"source-stated"},{"text":"In the study, agents followed stale guidance when it was relevant, sometimes even when correct information was available elsewhere.","excerpt":"agents follow stale guidance when it is relevant to their tasks, sometimes even when correct information is available elsewhere.","support":"source-stated"},{"text":"For the stale test command, Claude Sonnet 5.5 used about two extra tool calls per run compared with the corrected command; the authors detected no difference in the other cases.","excerpt":"Claude Sonnet 5.5 needed about two extra tool calls per run, a third more than with the corrected command; in the other cases, we could not detect a difference.","support":"source-stated"},{"text":"Agents generally recovered from immediate failures, but none repaired the underlying instruction file.","excerpt":"Although agents generally recovered from the immediate failures, none repaired the underlying instruction file.","support":"source-stated"},{"text":"The authors studied three real-world stale instructions from active open-source repositories, 22 maintenance tasks and 732 trajectories from two models.","excerpt":"We study three real-world stale instructions from active open-source repositories in depth","support":"source-stated"}],"limitations":["The study covers three stale instructions from active open-source repositories and 22 maintenance tasks; the reported findings do not establish how often the same effects occur in other settings.","The extra tool-call result is reported for the stale test command and Claude Sonnet 5.5; the authors say they could not detect a difference in the other cases."],"mediaId":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","correctionReason":null,"id":"fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63","publicationId":"30c0ac86-132e-4d31-8feb-0445b37a9db8","version":1,"sourceUrl":"https://arxiv.org/abs/2611.09802","sourceTitle":"When Instruction Files Go Stale: Documentation Debt and Hidden Cost in Coding Agents","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:00:45.204Z","createdAt":"2026-11-10T18:49:39.988Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","kind":"article","url":"https://arxiv.org/abs/2611.09802","sourceUrl":"https://arxiv.org/abs/2611.09802","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T05:16:29.266Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.09802","checkedAt":"2026-11-10T19:52:10.762Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"faec5ace286ba7b69d55144ae5bce6135508824b9c18d3b20c5766b8c49072fa","confidence":0.8500000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"b8241ddd63e5e289857dfb6fe52a824135b7381b90df60a58a71ad951eaf5484","decidedAt":"2026-11-10T05:16:30.074Z"},"provenance":{"textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observationId":"1f7b29a020462ad80fda1e1320f6ef4695dc408352882d07715e0f4fb3fa2c65","retrievedAt":"2026-11-10T05:16:29.153Z","kind":"publisher-page","preparer":{"model":"server-excerpt-repair/stream-excerpt-repair-v1 (original draft: gpt-6-luna)","runId":"82aeadea-4120-4fa9-8a0d-8a2a3ce638cb"},"reviewer":{"model":"gpt-6-luna","runId":"deeee2fd-fd7c-4fad-87ae-c72293901c98"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T18:49:39.988Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Mehtiyev, Tural","url":null,"kind":"unknown"},{"name":"Tadesse, Biruk","url":null,"kind":"unknown"},{"name":"Arkoh, Lawrence","url":null,"kind":"unknown"},{"name":"Assunção, Wesley","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Mehtiyev, Tural","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mehtiyev, Tural","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Tadesse, Biruk","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tadesse, Biruk","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Arkoh, Lawrence","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arkoh, Lawrence","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}},{"actor":{"name":"Assunção, Wesley","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Assunção, Wesley","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.09802","locator":"head/meta[name=author|citation_author]"},"assertionId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T19:52:10.762Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","sourceUrl":"https://arxiv.org/abs/2611.09802","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.09802","snapshotId":"f4f65467cca934cc7861a6222893801c07c1d8ede5b5c37cc5cfbda3b8ef7e71","contentSha256":"8042a62fd50bf99eb2c95e6d5f714b050042d13c50ff4be8edda1b6a4cdd32aa","textHash":"e024f23fe382b9b39ed14b94dea1a14c7a0d4d2dcca81ac93dc1546f1906772a","observedAt":"2026-11-10T19:52:10.762Z","basis":"publisher-page-metadata","sourceLinks":45,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/fc826f10a4a7b505daea7c6ae75bb675aef72e8770f7fa49bfd70d9d53f11f63/source"}}}],"audits":[{"publicationId":"30c0ac86-132e-4d31-8feb-0445b37a9db8","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the study and its framing to Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh and Wesley Assunção. It presents the findings as the authors' results, not as established fact.","excerpt":"Authors:Tural Mehtiyev, Biruk Tadesse, Lawrence Arkoh, Wesley Assunção"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful but omits a central comparison result. Correcting the instruction eliminated operations on obsolete paths, while removing it prevented most of them. That stale/corrected/removed contrast is the core of the design. Smallest repair: add one sentence with this result. Two terms are also unexplained for general readers: 'tool calls' (actions such as running commands or opening files) and 'trajectories' (recorded agent runs). Term-library tooltips would fix this. The closing 'distinction' sentence is mild interpretation and is acceptably scoped.","excerpt":"Correcting the instructions eliminated operations on obsolete paths, while removing them prevented most."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-06 matches the v1 submission date. It is not the later feed date of 2026-11-09.","excerpt":"[Submitted on 6 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"The source text supports every claim, limitation and the question. 'Detected no difference' fairly renders 'could not detect a difference.' The claim 5 excerpt covers only the three instructions, but the abstract also states the 22 tasks and 732 trajectories from two models. The question follows from the reported scope.","excerpt":"Agents fix 22 maintenance tasks under three versions of each instruction (left stale, corrected to the current path, and removed)"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page. That page is the source itself.","excerpt":null}],"createdAt":"2026-11-10T18:49:39.988Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}