Escape Meridian

Sheshanarayana, Disha, Goli, Sai Linisha Reddy · Nov 13, 2026

arXiv cs.AI: Do Verifier Judgments Survive Abstraction?

Markdown · JSON · Original source

Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an -based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation , seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 13, 2026 (2026-11-13).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-16T06:31:55.348Z. First observed: 2026-11-16T05:06:35.557Z. Retrieved: 2026-11-16T06:31:01.376Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The supplied evidence is the page and abstract; it does not identify which or abstraction boundaries account for the reported peak transport failure. The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery.

Open question

When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?

Source-stated

The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.

We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.

Source-stated

Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.

Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.

Source-stated

The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.

direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.

Source-stated

The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.

Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.

Source-stated

The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.

These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.

Source and contributor context

Sheshanarayana, Disha, Goli, Sai Linisha Reddy · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: d7aebbe3-7c09-45ea-8f57-7a1a8b881b98.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T06:31:55.348Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f4aa7226aa85396d51556bec4b557792b1da4abbcb3ca0fc54bd6250cb0ee27b. Source text hash: 15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929.

Revision and source-check history

Version 1 · 2026-11-16T06:31:55.348Z

arXiv cs.AI: Do Verifier Judgments Survive Abstraction?

Authors Disha Sheshanarayana and Sai Linisha Reddy Goli argue that measuring an -based verifier on one view of an agent execution can miss failures when the same execution is presented through composed tools, delegation boundaries or compacted histories. They introduce Verification Transport, a test of whether judgments remain stable when abstraction changes what execution evidence the verifier can observe. Across four agent-evaluation , seven verifier backbones, four verification protocols and three abstraction boundaries, they report transport failure reaching about 31% under macro abstraction and delegation. Direct verification more often gives incorrect verdicts; evidence-grounded and deliberative protocols more often abstain when observability is limited. The authors caution that lower transport-failure rates do not necessarily imply greater reliability. They report that restoring corresponding execution provenance recovers 85.5% of transport failures, with lower recovery when provenance is lossy or unavailable. Their results challenge native-view accuracy as a sufficient measure of verifier reliability when execution evidence crosses abstraction boundaries.

Original source

cs.AI · Article

Source details

Original source date: Nov 13, 2026 (2026-11-13).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-16T06:31:55.348Z. First observed: 2026-11-16T05:06:35.557Z. Retrieved: 2026-11-16T06:31:01.376Z.

Limits

The supplied evidence is the page and abstract; it does not identify which or abstraction boundaries account for the reported peak transport failure. The abstract reports lower recovery when provenance is lossy or unavailable but does not quantify that recovery.

Open question

When provenance is lossy or unavailable, how much lower is recovery than the reported recovery with corresponding execution provenance?

Source-stated

The authors propose testing whether verifier judgments remain stable when abstraction changes which execution evidence is observable.

We introduce Verification Transport, a reliability test that measures judgment stability under abstraction-induced changes in execution observability.

Source-stated

Across the evaluated settings, the authors report transport failure reaching about 31% under macro abstraction and delegation.

Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, we find substantial transport failure, reaching about 31% under macro abstraction and delegation.

Source-stated

The authors report different failure patterns: direct verification more often gives incorrect verdicts, while evidence-grounded and deliberative protocols more often abstain when observability is limited.

direct verification more often produces incorrect verdicts, whereas evidence-grounded and deliberative protocols tend to abstain under limited observability.

Source-stated

The authors report that restoring corresponding execution provenance recovers many transport failures, but recovery is lower when provenance is lossy or unavailable.

Restoring the corresponding execution provenance recovers 85.5% of transport failures, while recovery is lower when provenance is lossy or unavailable.

Source-stated

The authors argue that native-view accuracy alone does not characterize verifier reliability when execution evidence crosses abstraction boundaries.

These results show that native-view accuracy alone is insufficient to characterize verifier reliability when execution evidence crosses abstraction boundaries.

Source and contributor context

Sheshanarayana, Disha, Goli, Sai Linisha Reddy · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: d7aebbe3-7c09-45ea-8f57-7a1a8b881b98.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T06:31:55.348Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f4aa7226aa85396d51556bec4b557792b1da4abbcb3ca0fc54bd6250cb0ee27b. Source text hash: 15036d29e38cadf0ba7e0a4d8a2936dd4165699147aa896b40d51eff0ab79929.

uncertain · 2026-11-16T06:31:55.348Z · anthropic/claude-opus-5.5

Publication: d7aebbe3-7c09-45ea-8f57-7a1a8b881b98

attribution — pass: The draft correctly names Disha Sheshanarayana and Sai Linisha Reddy Goli as authors and keeps the findings attributed to them with phrasing such as 'they report' and 'the authors caution.' The title prefix 'arXiv cs.AI' matches the publisher field. The paper is primarily cs.CL and cross-listed to cs.AI, which is not a misattribution.

Authors:Disha Sheshanarayana, Sai Linisha Reddy Goli

summary — uncertain: The summary is faithful but hard for a non-specialist to follow. Central terms are not explained in plain language: LLM-based verifier (an AI model that judges whether an agent's run succeeded), agent execution/trajectory, verifier backbones, macro abstraction, provenance (the record of what actually happened) and native-view accuracy. It also never says why this matters for the evaluations people rely on. Smallest repair: briefly gloss verifier, abstraction and provenance in the opening sentences, or confirm that term-library tooltips cover them. The question is narrow but legitimate.

In deployed agent systems, the same execution may be exposed through composed tools, delegation boundaries, or compacted histories, changing what execution evidence is directly observable to the verifier.

date — pass: originalPublished is 2026-11-13, which matches the arXiv v1 submission date. The later feed date of 2026-11-16 was correctly not used.

[Submitted on 13 Nov 2026]

support — uncertain: All five claims and their figures (about 31%, 85.5%) match the abstract verbatim, with scope preserved. 'Caution' slightly firms up the source's 'This suggests,' but this is acceptable. One limitation is partly inaccurate: it says the abstract does not identify which abstraction boundaries account for the peak failure. The abstract names macro abstraction and delegation; only the benchmarks and verifiers involved are unspecified. Smallest repair: limit that limitation to benchmarks and verifier backbones.

we find substantial transport failure, reaching about 31% under macro abstraction and delegation.

media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source. No better media was found.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.