{"id":"51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5","title":"arXiv cs.AI: Do Verifier Judgments Survive Abstraction?","argument":"Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an LLM-based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page and abstract; it does not identify which benchmarks or abstraction boundaries account for the reported peak transport failure. The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery.","speaker":{"name":"Sheshanarayana, Disha, Goli, Sai Linisha Reddy","roleAtSource":"Article author"},"source":{"title":"Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.18471","publishedAt":"2026-11-13","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.","excerpt":"We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.","excerpt":"Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.","excerpt":"direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.","excerpt":"Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.","excerpt":"These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18471","checkedAt":"2026-11-16T06:46:07.027Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Do Verifier Judgments Survive Abstraction?","summary":"Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an LLM-based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.","question":"When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?","claims":[{"text":"The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.","excerpt":"We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.","support":"source-stated"},{"text":"Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.","excerpt":"Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.","support":"source-stated"},{"text":"The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.","excerpt":"direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.","support":"source-stated"},{"text":"The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.","excerpt":"Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.","support":"source-stated"},{"text":"The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.","excerpt":"These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page and abstract; it does not identify which benchmarks or abstraction boundaries account for the reported peak transport failure.","The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery."],"mediaId":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","correctionReason":null,"id":"51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5","publicationId":"d7aebbe3-7c09-45ea-8f57-7a1a8b881b98","version":1,"sourceUrl":"https://arxiv.org/abs/2611.18471","sourceTitle":"Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-13","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-16T05:06:35.557Z","createdAt":"2026-11-16T06:31:55.348Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","kind":"article","url":"https://arxiv.org/abs/2611.18471","sourceUrl":"https://arxiv.org/abs/2611.18471","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-16T06:31:01.544Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18471","checkedAt":"2026-11-16T06:46:07.027Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4ab1966d24244ba9edfcc6764c554bd3fd4717c76085d09cb2678b95cfff2c65","decidedAt":"2026-11-16T06:31:02.687Z"},"provenance":{"textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observationId":"f4aa7226aa85396d51556bec4b557792b1da4abbcb3ca0fc54bd6250cb0ee27b","retrievedAt":"2026-11-16T06:31:01.376Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5d37cf9e-d8c0-4da6-8cce-4b8680fcc8da"},"reviewer":{"model":"gpt-6-luna","runId":"ab25b2e5-b414-4751-8a44-01eab96b0efa"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-16T06:31:55.348Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sheshanarayana, Disha","url":null,"kind":"unknown"},{"name":"Goli, Sai Linisha Reddy","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sheshanarayana, Disha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sheshanarayana, Disha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18471","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-16T06:46:07.027Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","sourceUrl":"https://arxiv.org/abs/2611.18471","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z"}},{"actor":{"name":"Goli, Sai Linisha Reddy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Goli, Sai Linisha Reddy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18471","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-16T06:46:07.027Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","sourceUrl":"https://arxiv.org/abs/2611.18471","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.18471","snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-do-verifier-judgments-survive-abstraction-51568ee7","formats":{"html":"/readings/arxiv-cs-ai-do-verifier-judgments-survive-abstraction-51568ee7","markdown":"/readings/arxiv-cs-ai-do-verifier-judgments-survive-abstraction-51568ee7.md","json":"/readings/arxiv-cs-ai-do-verifier-judgments-survive-abstraction-51568ee7.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5","revision":"d7aebbe3-7c09-45ea-8f57-7a1a8b881b98","revisionKind":"publication-id","title":"arXiv cs.AI: Do Verifier Judgments Survive Abstraction?","url":"https://escapemeridian.com/readings/arxiv-cs-ai-do-verifier-judgments-survive-abstraction-51568ee7"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.18471","revision":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","revisionKind":"sha256-source-text","title":"Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation","url":"https://arxiv.org/abs/2611.18471"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5","title":"arXiv cs.AI: Do Verifier Judgments Survive Abstraction?","argument":"Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an LLM-based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the arXiv page and abstract; it does not identify which benchmarks or abstraction boundaries account for the reported peak transport failure. The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery.","speaker":{"name":"Sheshanarayana, Disha, Goli, Sai Linisha Reddy","roleAtSource":"Article author"},"source":{"title":"Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.18471","publishedAt":"2026-11-13","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.","excerpt":"We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.","excerpt":"Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.","excerpt":"direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.","excerpt":"Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"},{"text":"The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.","excerpt":"These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.","url":"https://arxiv.org/abs/2611.18471","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18471","checkedAt":"2026-11-16T06:46:07.027Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Do Verifier Judgments Survive Abstraction?","summary":"Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an LLM-based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.","question":"When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?","claims":[{"text":"The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.","excerpt":"We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.","support":"source-stated"},{"text":"Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.","excerpt":"Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.","support":"source-stated"},{"text":"The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.","excerpt":"direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.","support":"source-stated"},{"text":"The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.","excerpt":"Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.","support":"source-stated"},{"text":"The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.","excerpt":"These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.","support":"source-stated"}],"limitations":["The supplied evidence is the arXiv page and abstract; it does not identify which benchmarks or abstraction boundaries account for the reported peak transport failure.","The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery."],"mediaId":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","correctionReason":null,"id":"51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5","publicationId":"d7aebbe3-7c09-45ea-8f57-7a1a8b881b98","version":1,"sourceUrl":"https://arxiv.org/abs/2611.18471","sourceTitle":"Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-13","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-16T05:06:35.557Z","createdAt":"2026-11-16T06:31:55.348Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","kind":"article","url":"https://arxiv.org/abs/2611.18471","sourceUrl":"https://arxiv.org/abs/2611.18471","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-16T06:31:01.544Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18471","checkedAt":"2026-11-16T06:46:07.027Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"4423f2de09f617ccd067c58714622f20be58fa539c251eb6d0f75c094dd8a4a7","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4ab1966d24244ba9edfcc6764c554bd3fd4717c76085d09cb2678b95cfff2c65","decidedAt":"2026-11-16T06:31:02.687Z"},"provenance":{"textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observationId":"f4aa7226aa85396d51556bec4b557792b1da4abbcb3ca0fc54bd6250cb0ee27b","retrievedAt":"2026-11-16T06:31:01.376Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5d37cf9e-d8c0-4da6-8cce-4b8680fcc8da"},"reviewer":{"model":"gpt-6-luna","runId":"ab25b2e5-b414-4751-8a44-01eab96b0efa"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-16T06:31:55.348Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Sheshanarayana, Disha","url":null,"kind":"unknown"},{"name":"Goli, Sai Linisha Reddy","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Sheshanarayana, Disha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sheshanarayana, Disha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18471","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-16T06:46:07.027Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","sourceUrl":"https://arxiv.org/abs/2611.18471","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z"}},{"actor":{"name":"Goli, Sai Linisha Reddy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Goli, Sai Linisha Reddy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18471","locator":"head/meta[name=author|citation_author]"},"assertionId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-16T06:46:07.027Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","sourceUrl":"https://arxiv.org/abs/2611.18471","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.18471","snapshotId":"b7f6df2d5198b0f811cf285424bcb4616ba0089d7844b99a50af719cfc602070","contentSha256":"08487c2432ea9f084ad92924ef7b531f6461587553471c9b25a9b11a731ae80a","textHash":"15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929","observedAt":"2026-11-16T06:46:07.027Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/51568ee7493ec4c55d2116153282e617c0a41a4c19a33d9b32a3372ba9cda7f5/source"}}}],"audits":[{"publicationId":"d7aebbe3-7c09-45ea-8f57-7a1a8b881b98","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly names Disha Sheshanarayana and Sai Linisha Reddy Goli as authors and keeps the findings attributed to them with phrasing such as 'they report' and 'the authors caution.' The title prefix 'arXiv cs.AI' matches the publisher field. The paper is primarily cs.CL and cross-listed to cs.AI, which is not a misattribution.","excerpt":"Authors:Disha Sheshanarayana, Sai Linisha Reddy Goli"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful but hard for a non-specialist to follow. Central terms are not explained in plain language: LLM-based verifier (an AI model that judges whether an agent's run succeeded), agent execution/trajectory, verifier backbones, macro abstraction, provenance (the record of what actually happened) and native-view accuracy. It also never says why this matters for the evaluations people rely on. Smallest repair: briefly gloss verifier, abstraction and provenance in the opening sentences, or confirm that term-library tooltips cover them. The question is narrow but legitimate.","excerpt":"In deployed agent systems, the same execution may be exposed through composed tools, delegation boundaries, or compacted histories, changing what execution evidence is directly observable to the verifier."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-13, which matches the arXiv v1 submission date. The later feed date of 2026-11-16 was correctly not used.","excerpt":"[Submitted on 13 Nov 2026]"},{"dimension":"support","status":"uncertain","explanation":"All five claims and their figures (about 31%, 85.5%) match the abstract verbatim, with scope preserved. 'Caution' slightly firms up the source's 'This suggests,' but this is acceptable. One limitation is partly inaccurate: it says the abstract does not identify which abstraction boundaries account for the peak failure. The abstract names macro abstraction and delegation; only the benchmarks and verifiers involved are unspecified. Smallest repair: limit that limitation to benchmarks and verifier backbones.","excerpt":"we find substantial transport failure, reaching about 31% under macro abstraction and delegation."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source. No better media was found.","excerpt":null}],"createdAt":"2026-11-16T06:31:55.348Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}