Wang, Xiaobo, Wang, Zimu, Ye, Siyu, Li, Jiaqi, Tang, Min, Bai, Jun, Shi, Yuling, Wang, Ruobing, Zhang, Jingjing, Wang, Chaofan, Wu, Kai, Qi, Mengnan, Cai, Kai, Gu, Xiaodong, Liu, Qi, Zheng, Zilong · Nov 5, 2026
arXiv cs.AI authors argue agent evolution can improve scores while losing useful capabilities
Markdown · JSON · Original source
In “Beneath the Surface: What We Overlook When We Talk About Agent Evolution,” Xiaobo Wang and coauthors examine evolution: changes to an agent’s harness that enable (RSI) without updating . Across four methods, they find that higher scores do not necessarily mean reliable, efficient or transferable improvement. All sixteen evolved agents gained tasks they had not previously covered, but also lost tasks they had covered. In one general-task case, reliability rose by 5.2 points even as ten previously covered tasks were lost. Most reliability gains also increased deployment cost. The authors report that specific changes usually outperform generic reminders, though combinations can alter their benefits. The highest-scoring agent did not produce the largest mean improvement in any of the four pools, and stricter admission could discard useful alternatives. Transfer depended on the target and harness: coverage usually fell on the general-task target, but rose on the coding target with the outer-layer-only harness. The authors use these findings to motivate preservation-aware evaluation, tested decision rules and explicit applicability conditions. They also report that EvoAudit, which revises select, analyze, mutate and gate, achieved the best performance.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T22:31:57.015Z. First observed: 2026-11-06T05:01:04.879Z. Retrieved: 2026-11-08T22:31:11.379Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the abstract; it does not provide the and task details, evaluation procedures, or numerical results beyond those stated here. The abstract does not specify the decision rules or applicability conditions the authors recommend testing.
Open question
Which decision rules and applicability conditions best preserve useful alternatives while screening changes that lose previously covered tasks?
Source-stated
The authors say agent harness evolution enables recursive self-improvement without updating model weights.
Agent harness evolution enables recursive self-improvement (RSI) without updating model weights.
Source-stated
Across the evaluated agents, gaining newly covered tasks did not prevent losses on tasks they had covered before.
All sixteen evolved agents gain previously uncovered tasks while losing previously covered ones.
Source-stated
In one general-task case, reliability increased even though the agent lost previously covered tasks.
In one general-task case, reliability rises by 5.2 points despite losing ten previously covered tasks.
Source-stated
The authors report that most reliability gains also increased deployment cost.
Most reliability gains also increase deployment cost.
Source-stated
The highest-scoring agent did not have the largest mean improvement in any evaluated pool, and stricter admission could discard useful alternatives.
The highest-scoring agent does not yield the largest mean improvement in any of our four pools, and stricter admission can discard useful alternatives.
Source-stated
Transfer results differed by target and harness: coverage usually fell for the general-task target but rose for the coding target with the outer-layer-only harness.
coverage usually falls on the general-task target across both harness types and paradigms, but rises on the coding target with the outer-layer-only harness.
Source-stated
The authors report that EvoAudit revises select, analyze, mutate and gate, and achieved the best performance.
EvoAudit turns these diagnostics into revisions of select, analyze, mutate, and gate, achieving the best performance.
Source and contributor context
Wang, Xiaobo, Wang, Zimu, Ye, Siyu, Li, Jiaqi, Tang, Min, Bai, Jun, Shi, Yuling, Wang, Ruobing, Zhang, Jingjing, Wang, Chaofan, Wu, Kai, Qi, Mengnan, Cai, Kai, Gu, Xiaodong, Liu, Qi, Zheng, Zilong · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Agent harness
An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.
Recursive self-improvement
An AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: af7fa63c-4bc7-4a52-8192-50dc23a56eda.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T22:31:57.015Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 23e5856ae770b55dc41974936ac30e812a6a3ee98f084787ecd807cb488cf829. Source text hash: be7a67562a4b36ade5ab983b7db804104415d9f913d4f5f349894a187e5c5189.
Revision and source-check history
Version 1 · 2026-11-08T22:31:57.015Z
arXiv cs.AI authors argue agent evolution can improve scores while losing useful capabilities
In “Beneath the Surface: What We Overlook When We Talk About Agent Evolution,” Xiaobo Wang and coauthors examine evolution: changes to an agent’s harness that enable (RSI) without updating . Across four methods, they find that higher scores do not necessarily mean reliable, efficient or transferable improvement. All sixteen evolved agents gained tasks they had not previously covered, but also lost tasks they had covered. In one general-task case, reliability rose by 5.2 points even as ten previously covered tasks were lost. Most reliability gains also increased deployment cost. The authors report that specific changes usually outperform generic reminders, though combinations can alter their benefits. The highest-scoring agent did not produce the largest mean improvement in any of the four pools, and stricter admission could discard useful alternatives. Transfer depended on the target and harness: coverage usually fell on the general-task target, but rose on the coding target with the outer-layer-only harness. The authors use these findings to motivate preservation-aware evaluation, tested decision rules and explicit applicability conditions. They also report that EvoAudit, which revises select, analyze, mutate and gate, achieved the best performance.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T22:31:57.015Z. First observed: 2026-11-06T05:01:04.879Z. Retrieved: 2026-11-08T22:31:11.379Z.
Limits
The supplied evidence is the abstract; it does not provide the and task details, evaluation procedures, or numerical results beyond those stated here. The abstract does not specify the decision rules or applicability conditions the authors recommend testing.
Open question
Which decision rules and applicability conditions best preserve useful alternatives while screening changes that lose previously covered tasks?
Source-stated
The authors say agent harness evolution enables recursive self-improvement without updating model weights.
Agent harness evolution enables recursive self-improvement (RSI) without updating model weights.
Source-stated
Across the evaluated agents, gaining newly covered tasks did not prevent losses on tasks they had covered before.
All sixteen evolved agents gain previously uncovered tasks while losing previously covered ones.
Source-stated
In one general-task case, reliability increased even though the agent lost previously covered tasks.
In one general-task case, reliability rises by 5.2 points despite losing ten previously covered tasks.
Source-stated
The authors report that most reliability gains also increased deployment cost.
Most reliability gains also increase deployment cost.
Source-stated
The highest-scoring agent did not have the largest mean improvement in any evaluated pool, and stricter admission could discard useful alternatives.
The highest-scoring agent does not yield the largest mean improvement in any of our four pools, and stricter admission can discard useful alternatives.
Source-stated
Transfer results differed by target and harness: coverage usually fell for the general-task target but rose for the coding target with the outer-layer-only harness.
coverage usually falls on the general-task target across both harness types and paradigms, but rises on the coding target with the outer-layer-only harness.
Source-stated
The authors report that EvoAudit revises select, analyze, mutate and gate, and achieved the best performance.
EvoAudit turns these diagnostics into revisions of select, analyze, mutate, and gate, achieving the best performance.
Source and contributor context
Wang, Xiaobo, Wang, Zimu, Ye, Siyu, Li, Jiaqi, Tang, Min, Bai, Jun, Shi, Yuling, Wang, Ruobing, Zhang, Jingjing, Wang, Chaofan, Wu, Kai, Qi, Mengnan, Cai, Kai, Gu, Xiaodong, Liu, Qi, Zheng, Zilong · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Agent harness
An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.
Recursive self-improvement
An AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: af7fa63c-4bc7-4a52-8192-50dc23a56eda.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T22:31:57.015Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 23e5856ae770b55dc41974936ac30e812a6a3ee98f084787ecd807cb488cf829. Source text hash: be7a67562a4b36ade5ab983b7db804104415d9f913d4f5f349894a187e5c5189.
uncertain · 2026-11-08T22:31:57.015Z · anthropic/claude-opus-5.5
Publication: af7fa63c-4bc7-4a52-8192-50dc23a56eda
attribution — pass: The draft correctly attributes the paper to Xiaobo Wang and coauthors, matching the arXiv listing title and author list. Findings are framed as the authors' reports rather than established facts.
Authors:Xiaobo Wang, Zimu Wang, Siyu Ye, Jiaqi Li
summary — uncertain: The summary is faithful to the abstract, but central jargon is left unexplained for a non-specialist reader. 'Harness' is never defined; the draft only calls it 'changes to an agent's harness.' 'Model weights,' 'coverage,' 'admission,' 'pools,' 'outer-layer-only harness' and 'select, analyze, mutate and gate' are also unexplained. Without these terms, a general reader cannot follow the core argument. Smallest repair: add plain-language tooltips or brief glosses for harness, admission and coverage, and note that the abstract does not say what EvoAudit's 'best performance' is compared against.
Agent harness evolution enables recursive self-improvement (RSI) without updating model weights.
date — pass: originalPublished 2026-11-05 matches the arXiv v1 submission date, not the later feed date.
[Submitted on 5 Nov 2026]
support — pass: Each claim matches a verbatim excerpt from the abstract. The question follows from the authors' call for tested decision rules and applicability conditions without asserting an answer. The limitations accurately note that only the abstract was supplied.
These findings motivate preservation-aware evaluation, tested decision rules, and explicit applicability conditions.
media — pass: The selected media is the verified arXiv abstract page for this paper, which is the direct original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.
Definition referenceAn AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system.
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceAn agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.
Definition referenceAn AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system.
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference