{"id":"78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab","title":"Rahman, Begoug and Shihab: Revisiting the Survival of Agent-Attributed Code","argument":"Authors Musfiqur Rahman, Mahi Begoug and Emad Shihab revisit whether code from AI coding agents remains in software after it is merged. They analyze 854,139 lines added by 2,802 merged pull requests across 215 AIDev repositories, varying nine measurement choices in 88 survival analyses. Their results differ by agent type: for human-supervised agents, mostly GitHub Copilot, choices change the effect’s size but not its direction; for Devin, they can change the verdict. Treating lines as independent, 15 of 22 specifications report Devin’s code modified sooner; clustering standard errors by repository reduces that count to 3, no more than permuted labels produce. Within repositories, no specification detects a difference. The authors also report that humans make most modifications to agent code under every unit and observation window. Their central argument is that conclusions about whether agent code survives longer than human code depend substantially on measurement choices, and they derive an operationalization checklist for post-merge studies.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence provided is the paper’s abstract; it does not include the full methods, data, or operationalization checklist. The findings described concern the AIDev dataset and the specifications reported in the abstract; they do not establish how results would compare in other datasets.","speaker":{"name":"Rahman, Musfiqur, Begoug, Mahi, Shihab, Emad","roleAtSource":"Article author"},"source":{"title":"Revisiting the Survival of Agent-Attributed Code: How Measurement Choices Decide the Verdict","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21784","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors revisit code survival using 854,139 lines from merged pull requests in 215 repositories, and vary measurement choices across 88 survival analyses.","excerpt":"854,139 lines that 2,802 merged pull requests (PRs) added to 215 repositories of the AIDev dataset. We vary nine measurement choices","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"For code from human-supervised agents, mostly GitHub Copilot, measurement choices alter effect size but not direction; for Devin, choices decide the verdict.","excerpt":"For code from human-supervised agents, mostly GitHub Copilot, the choices change the size of the effect but not its direction. For code from the fully-autonomous agent Devin, they decide the verdict.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The count of specifications reporting Devin code modified sooner falls when standard errors are clustered by repository, and within-repository analyses detect no difference.","excerpt":"15 of 22 specifications report it modified sooner when lines are treated as independent, but only 3 when standard errors are clustered by repository, no more than permuted labels produce. Within repositories, no specification detects a difference.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The authors argue that measurement choices substantially determine conclusions about whether agent-attributed code survives longer than human code.","excerpt":"Whether agent code survives longer than human code is therefore decided as much by the measurement as by the code.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The authors report that humans make most modifications to agent code across the units and observation windows they examined.","excerpt":"Humans make most modifications to agent code under every unit and window.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21784","checkedAt":"2026-11-18T13:48:09.902Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the reported difference for Devin persist under other measurement choices or datasets beyond the AIDev repositories studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Rahman, Begoug and Shihab: Revisiting the Survival of Agent-Attributed Code","summary":"Authors Musfiqur Rahman, Mahi Begoug and Emad Shihab revisit whether code from AI coding agents remains in software after it is merged. They analyze 854,139 lines added by 2,802 merged pull requests across 215 AIDev repositories, varying nine measurement choices in 88 survival analyses. Their results differ by agent type: for human-supervised agents, mostly GitHub Copilot, choices change the effect’s size but not its direction; for Devin, they can change the verdict. Treating lines as independent, 15 of 22 specifications report Devin’s code modified sooner; clustering standard errors by repository reduces that count to 3, no more than permuted labels produce. Within repositories, no specification detects a difference. The authors also report that humans make most modifications to agent code under every unit and observation window. Their central argument is that conclusions about whether agent code survives longer than human code depend substantially on measurement choices, and they derive an operationalization checklist for post-merge studies.","question":"Would the reported difference for Devin persist under other measurement choices or datasets beyond the AIDev repositories studied?","claims":[{"text":"The authors revisit code survival using 854,139 lines from merged pull requests in 215 repositories, and vary measurement choices across 88 survival analyses.","excerpt":"854,139 lines that 2,802 merged pull requests (PRs) added to 215 repositories of the AIDev dataset. We vary nine measurement choices","support":"source-stated"},{"text":"For code from human-supervised agents, mostly GitHub Copilot, measurement choices alter effect size but not direction; for Devin, choices decide the verdict.","excerpt":"For code from human-supervised agents, mostly GitHub Copilot, the choices change the size of the effect but not its direction. For code from the fully-autonomous agent Devin, they decide the verdict.","support":"source-stated"},{"text":"The count of specifications reporting Devin code modified sooner falls when standard errors are clustered by repository, and within-repository analyses detect no difference.","excerpt":"15 of 22 specifications report it modified sooner when lines are treated as independent, but only 3 when standard errors are clustered by repository, no more than permuted labels produce. Within repositories, no specification detects a difference.","support":"source-stated"},{"text":"The authors argue that measurement choices substantially determine conclusions about whether agent-attributed code survives longer than human code.","excerpt":"Whether agent code survives longer than human code is therefore decided as much by the measurement as by the code.","support":"source-stated"},{"text":"The authors report that humans make most modifications to agent code across the units and observation windows they examined.","excerpt":"Humans make most modifications to agent code under every unit and window.","support":"source-stated"}],"limitations":["The evidence provided is the paper’s abstract; it does not include the full methods, data, or operationalization checklist.","The findings described concern the AIDev dataset and the specifications reported in the abstract; they do not establish how results would compare in other datasets."],"mediaId":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","correctionReason":null,"id":"78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab","publicationId":"ee6591d0-6add-46b7-85d7-164bbc80a166","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21784","sourceTitle":"Revisiting the Survival of Agent-Attributed Code: How Measurement Choices Decide the Verdict","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:22:21.067Z","createdAt":"2026-11-18T13:17:44.623Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","kind":"article","url":"https://arxiv.org/abs/2611.21784","sourceUrl":"https://arxiv.org/abs/2611.21784","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:16:53.102Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21784","checkedAt":"2026-11-18T13:48:09.902Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"7782aa1f7525a6f0ef3bb160a691e007cc087860cc5b114b23c27a61f8aea872","decidedAt":"2026-11-18T13:16:54.508Z"},"provenance":{"textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observationId":"f32b30678a63c256f422695cda791c6871a74813b813aeba2c497ba99719809b","retrievedAt":"2026-11-18T13:16:52.931Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"1a5d4bab-c1e7-457c-8af2-ed5691dc2298"},"reviewer":{"model":"gpt-6-luna","runId":"99c724f3-aa77-4626-8243-d65e451bb0b3"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:17:44.623Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Rahman, Musfiqur","url":null,"kind":"unknown"},{"name":"Begoug, Mahi","url":null,"kind":"unknown"},{"name":"Shihab, Emad","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Rahman, Musfiqur","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Rahman, Musfiqur","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}},{"actor":{"name":"Begoug, Mahi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Begoug, Mahi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}},{"actor":{"name":"Shihab, Emad","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shihab, Emad","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21784","snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab/source"}},"canonicalUrl":"https://escapemeridian.com/readings/rahman-begoug-and-shihab-revisiting-the-survival-of-agent-78803c0d","formats":{"html":"/readings/rahman-begoug-and-shihab-revisiting-the-survival-of-agent-78803c0d","markdown":"/readings/rahman-begoug-and-shihab-revisiting-the-survival-of-agent-78803c0d.md","json":"/readings/rahman-begoug-and-shihab-revisiting-the-survival-of-agent-78803c0d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab","revision":"ee6591d0-6add-46b7-85d7-164bbc80a166","revisionKind":"publication-id","title":"Rahman, Begoug and Shihab: Revisiting the Survival of Agent-Attributed Code","url":"https://escapemeridian.com/readings/rahman-begoug-and-shihab-revisiting-the-survival-of-agent-78803c0d"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.21784","revision":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","revisionKind":"sha256-source-text","title":"Revisiting the Survival of Agent-Attributed Code: How Measurement Choices Decide the Verdict","url":"https://arxiv.org/abs/2611.21784"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab","title":"Rahman, Begoug and Shihab: Revisiting the Survival of Agent-Attributed Code","argument":"Authors Musfiqur Rahman, Mahi Begoug and Emad Shihab revisit whether code from AI coding agents remains in software after it is merged. They analyze 854,139 lines added by 2,802 merged pull requests across 215 AIDev repositories, varying nine measurement choices in 88 survival analyses. Their results differ by agent type: for human-supervised agents, mostly GitHub Copilot, choices change the effect’s size but not its direction; for Devin, they can change the verdict. Treating lines as independent, 15 of 22 specifications report Devin’s code modified sooner; clustering standard errors by repository reduces that count to 3, no more than permuted labels produce. Within repositories, no specification detects a difference. The authors also report that humans make most modifications to agent code under every unit and observation window. Their central argument is that conclusions about whether agent code survives longer than human code depend substantially on measurement choices, and they derive an operationalization checklist for post-merge studies.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence provided is the paper’s abstract; it does not include the full methods, data, or operationalization checklist. The findings described concern the AIDev dataset and the specifications reported in the abstract; they do not establish how results would compare in other datasets.","speaker":{"name":"Rahman, Musfiqur, Begoug, Mahi, Shihab, Emad","roleAtSource":"Article author"},"source":{"title":"Revisiting the Survival of Agent-Attributed Code: How Measurement Choices Decide the Verdict","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21784","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors revisit code survival using 854,139 lines from merged pull requests in 215 repositories, and vary measurement choices across 88 survival analyses.","excerpt":"854,139 lines that 2,802 merged pull requests (PRs) added to 215 repositories of the AIDev dataset. We vary nine measurement choices","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"For code from human-supervised agents, mostly GitHub Copilot, measurement choices alter effect size but not direction; for Devin, choices decide the verdict.","excerpt":"For code from human-supervised agents, mostly GitHub Copilot, the choices change the size of the effect but not its direction. For code from the fully-autonomous agent Devin, they decide the verdict.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The count of specifications reporting Devin code modified sooner falls when standard errors are clustered by repository, and within-repository analyses detect no difference.","excerpt":"15 of 22 specifications report it modified sooner when lines are treated as independent, but only 3 when standard errors are clustered by repository, no more than permuted labels produce. Within repositories, no specification detects a difference.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The authors argue that measurement choices substantially determine conclusions about whether agent-attributed code survives longer than human code.","excerpt":"Whether agent code survives longer than human code is therefore decided as much by the measurement as by the code.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"},{"text":"The authors report that humans make most modifications to agent code across the units and observation windows they examined.","excerpt":"Humans make most modifications to agent code under every unit and window.","url":"https://arxiv.org/abs/2611.21784","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21784","checkedAt":"2026-11-18T13:48:09.902Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the reported difference for Devin persist under other measurement choices or datasets beyond the AIDev repositories studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Rahman, Begoug and Shihab: Revisiting the Survival of Agent-Attributed Code","summary":"Authors Musfiqur Rahman, Mahi Begoug and Emad Shihab revisit whether code from AI coding agents remains in software after it is merged. They analyze 854,139 lines added by 2,802 merged pull requests across 215 AIDev repositories, varying nine measurement choices in 88 survival analyses. Their results differ by agent type: for human-supervised agents, mostly GitHub Copilot, choices change the effect’s size but not its direction; for Devin, they can change the verdict. Treating lines as independent, 15 of 22 specifications report Devin’s code modified sooner; clustering standard errors by repository reduces that count to 3, no more than permuted labels produce. Within repositories, no specification detects a difference. The authors also report that humans make most modifications to agent code under every unit and observation window. Their central argument is that conclusions about whether agent code survives longer than human code depend substantially on measurement choices, and they derive an operationalization checklist for post-merge studies.","question":"Would the reported difference for Devin persist under other measurement choices or datasets beyond the AIDev repositories studied?","claims":[{"text":"The authors revisit code survival using 854,139 lines from merged pull requests in 215 repositories, and vary measurement choices across 88 survival analyses.","excerpt":"854,139 lines that 2,802 merged pull requests (PRs) added to 215 repositories of the AIDev dataset. We vary nine measurement choices","support":"source-stated"},{"text":"For code from human-supervised agents, mostly GitHub Copilot, measurement choices alter effect size but not direction; for Devin, choices decide the verdict.","excerpt":"For code from human-supervised agents, mostly GitHub Copilot, the choices change the size of the effect but not its direction. For code from the fully-autonomous agent Devin, they decide the verdict.","support":"source-stated"},{"text":"The count of specifications reporting Devin code modified sooner falls when standard errors are clustered by repository, and within-repository analyses detect no difference.","excerpt":"15 of 22 specifications report it modified sooner when lines are treated as independent, but only 3 when standard errors are clustered by repository, no more than permuted labels produce. Within repositories, no specification detects a difference.","support":"source-stated"},{"text":"The authors argue that measurement choices substantially determine conclusions about whether agent-attributed code survives longer than human code.","excerpt":"Whether agent code survives longer than human code is therefore decided as much by the measurement as by the code.","support":"source-stated"},{"text":"The authors report that humans make most modifications to agent code across the units and observation windows they examined.","excerpt":"Humans make most modifications to agent code under every unit and window.","support":"source-stated"}],"limitations":["The evidence provided is the paper’s abstract; it does not include the full methods, data, or operationalization checklist.","The findings described concern the AIDev dataset and the specifications reported in the abstract; they do not establish how results would compare in other datasets."],"mediaId":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","correctionReason":null,"id":"78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab","publicationId":"ee6591d0-6add-46b7-85d7-164bbc80a166","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21784","sourceTitle":"Revisiting the Survival of Agent-Attributed Code: How Measurement Choices Decide the Verdict","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:22:21.067Z","createdAt":"2026-11-18T13:17:44.623Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","kind":"article","url":"https://arxiv.org/abs/2611.21784","sourceUrl":"https://arxiv.org/abs/2611.21784","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:16:53.102Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21784","checkedAt":"2026-11-18T13:48:09.902Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"60c77550730c56982283546501ffad43d0e4d58de7101ae6bf66f32fd7331e8e","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"7782aa1f7525a6f0ef3bb160a691e007cc087860cc5b114b23c27a61f8aea872","decidedAt":"2026-11-18T13:16:54.508Z"},"provenance":{"textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observationId":"f32b30678a63c256f422695cda791c6871a74813b813aeba2c497ba99719809b","retrievedAt":"2026-11-18T13:16:52.931Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"1a5d4bab-c1e7-457c-8af2-ed5691dc2298"},"reviewer":{"model":"gpt-6-luna","runId":"99c724f3-aa77-4626-8243-d65e451bb0b3"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:17:44.623Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Rahman, Musfiqur","url":null,"kind":"unknown"},{"name":"Begoug, Mahi","url":null,"kind":"unknown"},{"name":"Shihab, Emad","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Rahman, Musfiqur","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Rahman, Musfiqur","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}},{"actor":{"name":"Begoug, Mahi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Begoug, Mahi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}},{"actor":{"name":"Shihab, Emad","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shihab, Emad","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21784","locator":"head/meta[name=author|citation_author]"},"assertionId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:09.902Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","sourceUrl":"https://arxiv.org/abs/2611.21784","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21784","snapshotId":"40f1b0a47d4a337bfbc39374f67e5c7e25d68b203bf59ba9a72a4edd3b197bf6","contentSha256":"e0ff8bdc57278a6eb5dee2ce9160a1ef47a15740d0dc669a00a800d931e859af","textHash":"e84391b95190ab44ca1a07ae3c5a2fc9ffa4cd895525f0bfc98d49ce3bfb0de9","observedAt":"2026-11-18T13:48:09.902Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/78803c0dc0b8255e3efb7136864a5e6fe1e4c4185ba9cc4a4dc239ee5c8f33ab/source"}}}],"audits":[{"publicationId":"ee6591d0-6add-46b7-85d7-164bbc80a166","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the work to Musfiqur Rahman, Mahi Begoug and Emad Shihab and keeps the findings framed as the authors' reported results and argument.","excerpt":"Authors:Musfiqur Rahman, Mahi Begoug, Emad Shihab"},{"dimension":"summary","status":"uncertain","explanation":"The facts are faithful, but the central Devin result is hard for a non-specialist to follow. 'Clustering standard errors by repository', 'permuted labels' and 'specifications' are not explained, so readers cannot see why 15 falls to 3. Devin is not identified as the source's 'fully-autonomous agent', which is the contrast with human-supervised Copilot. The reading also omits the forceful finding that five published designs each flip with one choice. The question's 'reported difference for Devin' implies a robust difference, though the source says the choices decide that verdict. Smallest repair: briefly gloss these terms, add those two points and reframe the question.","excerpt":"For code from the fully-autonomous agent Devin, they decide the verdict."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-16 matches the arXiv v1 submission date. The feed date of 2026-11-18 is correctly not used.","excerpt":"[Submitted on 16 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim is directly supported by its excerpt from the abstract. The limitations correctly note that only the abstract is available and that the study's scope is the AIDev dataset. The reading adds no unsupported benefits or costs.","excerpt":"Whether agent code survives longer than human code is therefore decided as much by the measurement as by the code."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this exact paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-18T13:17:44.623Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}