Yuan, Boqin, Su, Yue, Song, Renchu, Yang, Sen, Qin, Jing · Apr 26, 2026
arXiv cs.AI: ClawTrace: Cost-Aware Tracing for LLM Agent Skill Distillation
Markdown · JSON · Original source
The authors of ClawTrace argue that reusable instructions for agents should be evaluated by rule type, not as a single package. Their method records how much each step in an agent’s work costs, then uses those traces to write patches that preserve, prune, or repair rules. The distinction matters in their reported results: on 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled quality regressions without lowering median cost. Across the 84-task SkillsBench transfer, CostCraft saved no aggregate cost; the authors attribute all three quality regressions to preserve patches and both quality wins to prune patches. They argue that aggregate results can conceal which rules help or harm performance. Escape Meridian interpretation: these results suggest that looking only at a skill’s overall cost and quality may miss important differences between its components. The evidence is limited to the task sets and seeds reported in the abstract and does not establish how these patterns generalize to other tasks. The authors release ClawTrace, the TraceCard schema, and the typed skills.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Apr 26, 2026 (2026-04-26).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T15:48:40.543Z. First observed: 2026-11-09T05:06:52.894Z. Retrieved: 2026-11-12T14:34:50.616Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract reports results on SpreadsheetBench and SkillsBench only; it does not establish whether the reported rule-type patterns generalize to other tasks. The reported SpreadsheetBench result covers two seeds; the abstract does not give further experimental details.
Open question
Do the reported rule-type patterns persist on tasks beyond SpreadsheetBench and SkillsBench?
Source-stated
The authors argue that reusable agent skills should be evaluated by rule type rather than as monolithic instruction packages.
We argue that reusable agent skills should be evaluated at the rule-type level, not as monolithic instruction packages.
Source-stated
ClawTrace records agent traces with cost attribution and compiles sessions into TraceCards; CostCraft uses those cards to create preserve, prune, and repair patches.
ClawTrace records cost-attributed agent traces and compiles each session into a TraceCard; CostCraft reads TraceCards and writes three kinds of skill patches: preserve, prune, and repair.
Source-stated
On 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled the quality-regression count without lowering median cost.
On 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled the quality-regression count without lowering median cost.
Source-stated
Across the 84-task SkillsBench transfer, CostCraft saved no aggregate cost; the authors attribute all quality regressions to preserve patches and both quality wins to prune patches.
Across the full 84-task SkillsBench transfer, CostCraft saves no aggregate cost. All three quality regressions trace to the preserve lane, and both quality wins trace to the prune lane
Escape Meridian interpretation
The authors report results from two named task sets and a stated number of seeds; whether the patterns extend beyond those settings remains unestablished in the abstract.
On 30 held-out SpreadsheetBench tasks across two seeds
Source and contributor context
Yuan, Boqin, Su, Yue, Song, Renchu, Yang, Sen, Qin, Jing · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 1c9d1fb7-15c9-4339-8851-a27f39a33964.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T15:48:40.543Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: b7abd18634aa52b7cc47545cd57f43c6d4aef2668c1add4f102242cd512682c4. Source text hash: b24ff8b6cdf2a0ca70fd192e77e7f83ef8ec1e7b03a29c9f082b2e77a3c8d38a.
Revision and source-check history
Version 1 · 2026-11-12T15:48:40.543Z
arXiv cs.AI: ClawTrace: Cost-Aware Tracing for LLM Agent Skill Distillation
The authors of ClawTrace argue that reusable instructions for agents should be evaluated by rule type, not as a single package. Their method records how much each step in an agent’s work costs, then uses those traces to write patches that preserve, prune, or repair rules. The distinction matters in their reported results: on 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled quality regressions without lowering median cost. Across the 84-task SkillsBench transfer, CostCraft saved no aggregate cost; the authors attribute all three quality regressions to preserve patches and both quality wins to prune patches. They argue that aggregate results can conceal which rules help or harm performance. Escape Meridian interpretation: these results suggest that looking only at a skill’s overall cost and quality may miss important differences between its components. The evidence is limited to the task sets and seeds reported in the abstract and does not establish how these patterns generalize to other tasks. The authors release ClawTrace, the TraceCard schema, and the typed skills.
Original source
cs.AI · Article
Source details
Original source date: Apr 26, 2026 (2026-04-26).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T15:48:40.543Z. First observed: 2026-11-09T05:06:52.894Z. Retrieved: 2026-11-12T14:34:50.616Z.
Limits
The abstract reports results on SpreadsheetBench and SkillsBench only; it does not establish whether the reported rule-type patterns generalize to other tasks. The reported SpreadsheetBench result covers two seeds; the abstract does not give further experimental details.
Open question
Do the reported rule-type patterns persist on tasks beyond SpreadsheetBench and SkillsBench?
Source-stated
The authors argue that reusable agent skills should be evaluated by rule type rather than as monolithic instruction packages.
We argue that reusable agent skills should be evaluated at the rule-type level, not as monolithic instruction packages.
Source-stated
ClawTrace records agent traces with cost attribution and compiles sessions into TraceCards; CostCraft uses those cards to create preserve, prune, and repair patches.
ClawTrace records cost-attributed agent traces and compiles each session into a TraceCard; CostCraft reads TraceCards and writes three kinds of skill patches: preserve, prune, and repair.
Source-stated
On 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled the quality-regression count without lowering median cost.
On 30 held-out SpreadsheetBench tasks across two seeds, removing prune patches roughly tripled the quality-regression count without lowering median cost.
Source-stated
Across the 84-task SkillsBench transfer, CostCraft saved no aggregate cost; the authors attribute all quality regressions to preserve patches and both quality wins to prune patches.
Across the full 84-task SkillsBench transfer, CostCraft saves no aggregate cost. All three quality regressions trace to the preserve lane, and both quality wins trace to the prune lane
Escape Meridian interpretation
The authors report results from two named task sets and a stated number of seeds; whether the patterns extend beyond those settings remains unestablished in the abstract.
On 30 held-out SpreadsheetBench tasks across two seeds
Source and contributor context
Yuan, Boqin, Su, Yue, Song, Renchu, Yang, Sen, Qin, Jing · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 1c9d1fb7-15c9-4339-8851-a27f39a33964.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T15:48:40.543Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: b7abd18634aa52b7cc47545cd57f43c6d4aef2668c1add4f102242cd512682c4. Source text hash: b24ff8b6cdf2a0ca70fd192e77e7f83ef8ec1e7b03a29c9f082b2e77a3c8d38a.
passed · 2026-11-12T15:48:40.543Z · anthropic/claude-opus-5.5
Publication: 1c9d1fb7-15c9-4339-8851-a27f39a33964
attribution — pass: The reading attributes the method, results and argument to the paper's authors. Source assertions stay attributed, and the inference is labeled as Escape Meridian interpretation. The title correctly names the arXiv cs.AI paper.
Authors:Boqin Yuan, Yue Su, Renchu Song, Sen Yang, Jing Qin
summary — pass: The reading leads with the authors' thesis, explains the core mechanism (per-step cost traces feeding preserve/prune/repair patches) and conveys the counterintuitive finding that pruning acts as a guardrail. Minor clarity gaps do not block understanding. CostCraft appears without being named as the patch-writing tool. 'Seeds' and 'held-out' are not explained. A small repair would name CostCraft when the patches are introduced. The question follows from the evidence.
prune patches act as quality guardrails while preserve patches drive regressions
date — pass: originalPublished 2026-04-26 matches the v1 submission date. The later v3 revision on 5 Nov 2026 and the November feed date are correctly not used.
[Submitted on 26 Apr 2026 (v1), last revised 5 Nov 2026 (this version, v3)]
support — pass: Each claim matches the abstract closely. The labeled interpretation that aggregate cost and quality may miss component differences is grounded in the authors' statement that aggregate metrics hide a pattern. The limitations and the question about generalization are framed as unknowns rather than as conclusions. No benefits or costs are invented.
We find a pattern aggregate metrics hide.
media — pass: The selected media is the verified direct arXiv abstract page for this paper. That is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv