{"id":"343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea","title":"arXiv: Researchers question whether skill optimizers improve agentic tasks","argument":"Jiawei Zhou and coauthors argue that skill optimizers—systems that rewrite an agent’s natural-language procedures—may select edits that look useful on a small development set without improving performance on new tasks. Across three optimizers, three benchmarks and two models, learned skills succeeded about as often as their hand-written starting versions, while reading about 16% more input tokens. The authors report that selecting the best of several candidates on at most 30 tasks can produce similar apparent gains even when no candidate changed. They recommend accounting for selection effects and for the extra turns an edit adds, rather than judging a skill by success scores or length alone. The abstract does not establish whether these recommendations improve performance in other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports results across three optimizers, three agentic benchmarks and two models; it does not establish how well the findings generalize to other settings. The abstract does not report whether the four proposed principles improve results when implemented.","speaker":{"name":"Zhou, Jiawei, Peng, Bo, Huang, Yuxuan, Zhang, Ming, Sun, Youbang, Wang, Xiang, Lu, Chaochao","roleAtSource":"Article author"},"source":{"title":"Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.37201","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors describe skill optimizers as systems that adapt agents by rewriting natural-language procedures and keeping edits that raise success on a small development set.","excerpt":"rewriting its skill, a natural-language procedure in its context, and keeping the edits that raise success on a small dev set","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"Across three optimizers, three agentic benchmarks and two models, learned skills succeeded about as often as their hand-written seed, averaging 0.1 points higher.","excerpt":"Across three optimizers, three agentic benchmarks and two models, the learned skills succeed about as often as their hand-written seed, 0.1 points higher on average.","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors report that selection of the best candidate on at most 30 tasks can produce gains of this size even when candidates are unchanged.","excerpt":"keeping the best of several candidates on at most 30 tasks reports gains this large even when none changed.","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors report that learned skills read about 16% more input tokens and often add rules that prompt extra turns.","excerpt":"They read about 16% more input tokens: the optimizers almost always add rules","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors recommend testing whether an edit's gain exceeds what selection alone reports, and accounting for added turns.","excerpt":"accept an edit only if its gain exceeds what selection alone reports; charge it for the turns it adds, not for its length","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37201","checkedAt":"2026-10-30T00:26:35.449Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would accounting for selection effects and added turns improve skill optimization on tasks beyond the benchmarks studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Researchers question whether skill optimizers improve agentic tasks","summary":"Jiawei Zhou and coauthors argue that skill optimizers—systems that rewrite an agent’s natural-language procedures—may select edits that look useful on a small development set without improving performance on new tasks. Across three optimizers, three benchmarks and two models, learned skills succeeded about as often as their hand-written starting versions, while reading about 16% more input tokens. The authors report that selecting the best of several candidates on at most 30 tasks can produce similar apparent gains even when no candidate changed. They recommend accounting for selection effects and for the extra turns an edit adds, rather than judging a skill by success scores or length alone. The abstract does not establish whether these recommendations improve performance in other settings.","question":"Would accounting for selection effects and added turns improve skill optimization on tasks beyond the benchmarks studied?","claims":[{"text":"The authors describe skill optimizers as systems that adapt agents by rewriting natural-language procedures and keeping edits that raise success on a small development set.","excerpt":"rewriting its skill, a natural-language procedure in its context, and keeping the edits that raise success on a small dev set","support":"source-stated"},{"text":"Across three optimizers, three agentic benchmarks and two models, learned skills succeeded about as often as their hand-written seed, averaging 0.1 points higher.","excerpt":"Across three optimizers, three agentic benchmarks and two models, the learned skills succeed about as often as their hand-written seed, 0.1 points higher on average.","support":"source-stated"},{"text":"The authors report that selection of the best candidate on at most 30 tasks can produce gains of this size even when candidates are unchanged.","excerpt":"keeping the best of several candidates on at most 30 tasks reports gains this large even when none changed.","support":"source-stated"},{"text":"The authors report that learned skills read about 16% more input tokens and often add rules that prompt extra turns.","excerpt":"They read about 16% more input tokens: the optimizers almost always add rules","support":"source-stated"},{"text":"The authors recommend testing whether an edit's gain exceeds what selection alone reports, and accounting for added turns.","excerpt":"accept an edit only if its gain exceeds what selection alone reports; charge it for the turns it adds, not for its length","support":"source-stated"}],"limitations":["The abstract reports results across three optimizers, three agentic benchmarks and two models; it does not establish how well the findings generalize to other settings.","The abstract does not report whether the four proposed principles improve results when implemented."],"mediaId":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","correctionReason":null,"id":"343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea","publicationId":"a03e5104-bb25-46bb-8e98-38527932b6d0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.37201","sourceTitle":"Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:38:37.797Z","createdAt":"2026-10-29T22:18:14.142Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","kind":"article","url":"https://arxiv.org/abs/2610.37201","sourceUrl":"https://arxiv.org/abs/2610.37201","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-29T22:17:20.735Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37201","checkedAt":"2026-10-30T00:26:35.449Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4003b088455ac8ff20359082d5ce4f2a95b010eb1032e72146c7eb28e381d094","decidedAt":"2026-10-29T22:17:22.797Z"},"provenance":{"textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observationId":"601b64da073d9bd683411045fa28e8ffe7c5d780ecbc051102488e960e8528ec","retrievedAt":"2026-10-29T22:17:20.461Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c941a7f3-169b-479b-8f5a-ae749050775d"},"reviewer":{"model":"gpt-6-luna","runId":"1c61f62f-c2ff-4ba3-89b9-5eba2e8ec1c3"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T22:18:14.142Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhou, Jiawei","url":null,"kind":"unknown"},{"name":"Peng, Bo","url":null,"kind":"unknown"},{"name":"Huang, Yuxuan","url":null,"kind":"unknown"},{"name":"Zhang, Ming","url":null,"kind":"unknown"},{"name":"Sun, Youbang","url":null,"kind":"unknown"},{"name":"Wang, Xiang","url":null,"kind":"unknown"},{"name":"Lu, Chaochao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhou, Jiawei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Jiawei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Peng, Bo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Peng, Bo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Huang, Yuxuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yuxuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Zhang, Ming","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Ming","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Sun, Youbang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Youbang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Wang, Xiang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Xiang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Lu, Chaochao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lu, Chaochao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.37201","snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-researchers-question-whether-skill-optimizers-improve-343476a3","formats":{"html":"/readings/arxiv-researchers-question-whether-skill-optimizers-improve-343476a3","markdown":"/readings/arxiv-researchers-question-whether-skill-optimizers-improve-343476a3.md","json":"/readings/arxiv-researchers-question-whether-skill-optimizers-improve-343476a3.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-agentic","name":"Agentic AI","explanation":"AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.","referenceUrl":"https://developers.google.com/machine-learning/glossary#agentic"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-tokens","name":"Model tokens","explanation":"Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens.","referenceUrl":"https://developers.google.com/machine-learning/glossary#token"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea","revision":"a03e5104-bb25-46bb-8e98-38527932b6d0","revisionKind":"publication-id","title":"arXiv: Researchers question whether skill optimizers improve agentic tasks","url":"https://escapemeridian.com/readings/arxiv-researchers-question-whether-skill-optimizers-improve-343476a3"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.37201","revision":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","revisionKind":"sha256-source-text","title":"Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution","url":"https://arxiv.org/abs/2610.37201"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea","title":"arXiv: Researchers question whether skill optimizers improve agentic tasks","argument":"Jiawei Zhou and coauthors argue that skill optimizers—systems that rewrite an agent’s natural-language procedures—may select edits that look useful on a small development set without improving performance on new tasks. Across three optimizers, three benchmarks and two models, learned skills succeeded about as often as their hand-written starting versions, while reading about 16% more input tokens. The authors report that selecting the best of several candidates on at most 30 tasks can produce similar apparent gains even when no candidate changed. They recommend accounting for selection effects and for the extra turns an edit adds, rather than judging a skill by success scores or length alone. The abstract does not establish whether these recommendations improve performance in other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports results across three optimizers, three agentic benchmarks and two models; it does not establish how well the findings generalize to other settings. The abstract does not report whether the four proposed principles improve results when implemented.","speaker":{"name":"Zhou, Jiawei, Peng, Bo, Huang, Yuxuan, Zhang, Ming, Sun, Youbang, Wang, Xiang, Lu, Chaochao","roleAtSource":"Article author"},"source":{"title":"Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.37201","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors describe skill optimizers as systems that adapt agents by rewriting natural-language procedures and keeping edits that raise success on a small development set.","excerpt":"rewriting its skill, a natural-language procedure in its context, and keeping the edits that raise success on a small dev set","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"Across three optimizers, three agentic benchmarks and two models, learned skills succeeded about as often as their hand-written seed, averaging 0.1 points higher.","excerpt":"Across three optimizers, three agentic benchmarks and two models, the learned skills succeed about as often as their hand-written seed, 0.1 points higher on average.","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors report that selection of the best candidate on at most 30 tasks can produce gains of this size even when candidates are unchanged.","excerpt":"keeping the best of several candidates on at most 30 tasks reports gains this large even when none changed.","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors report that learned skills read about 16% more input tokens and often add rules that prompt extra turns.","excerpt":"They read about 16% more input tokens: the optimizers almost always add rules","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"},{"text":"The authors recommend testing whether an edit's gain exceeds what selection alone reports, and accounting for added turns.","excerpt":"accept an edit only if its gain exceeds what selection alone reports; charge it for the turns it adds, not for its length","url":"https://arxiv.org/abs/2610.37201","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37201","checkedAt":"2026-10-30T00:26:35.449Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would accounting for selection effects and added turns improve skill optimization on tasks beyond the benchmarks studied?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Researchers question whether skill optimizers improve agentic tasks","summary":"Jiawei Zhou and coauthors argue that skill optimizers—systems that rewrite an agent’s natural-language procedures—may select edits that look useful on a small development set without improving performance on new tasks. Across three optimizers, three benchmarks and two models, learned skills succeeded about as often as their hand-written starting versions, while reading about 16% more input tokens. The authors report that selecting the best of several candidates on at most 30 tasks can produce similar apparent gains even when no candidate changed. They recommend accounting for selection effects and for the extra turns an edit adds, rather than judging a skill by success scores or length alone. The abstract does not establish whether these recommendations improve performance in other settings.","question":"Would accounting for selection effects and added turns improve skill optimization on tasks beyond the benchmarks studied?","claims":[{"text":"The authors describe skill optimizers as systems that adapt agents by rewriting natural-language procedures and keeping edits that raise success on a small development set.","excerpt":"rewriting its skill, a natural-language procedure in its context, and keeping the edits that raise success on a small dev set","support":"source-stated"},{"text":"Across three optimizers, three agentic benchmarks and two models, learned skills succeeded about as often as their hand-written seed, averaging 0.1 points higher.","excerpt":"Across three optimizers, three agentic benchmarks and two models, the learned skills succeed about as often as their hand-written seed, 0.1 points higher on average.","support":"source-stated"},{"text":"The authors report that selection of the best candidate on at most 30 tasks can produce gains of this size even when candidates are unchanged.","excerpt":"keeping the best of several candidates on at most 30 tasks reports gains this large even when none changed.","support":"source-stated"},{"text":"The authors report that learned skills read about 16% more input tokens and often add rules that prompt extra turns.","excerpt":"They read about 16% more input tokens: the optimizers almost always add rules","support":"source-stated"},{"text":"The authors recommend testing whether an edit's gain exceeds what selection alone reports, and accounting for added turns.","excerpt":"accept an edit only if its gain exceeds what selection alone reports; charge it for the turns it adds, not for its length","support":"source-stated"}],"limitations":["The abstract reports results across three optimizers, three agentic benchmarks and two models; it does not establish how well the findings generalize to other settings.","The abstract does not report whether the four proposed principles improve results when implemented."],"mediaId":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","correctionReason":null,"id":"343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea","publicationId":"a03e5104-bb25-46bb-8e98-38527932b6d0","version":1,"sourceUrl":"https://arxiv.org/abs/2610.37201","sourceTitle":"Does Your Generalist Skill Optimizer Really Incentivize Agentic Tasks? Rethinking Skill Optimization via Bipartite Attribution","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:38:37.797Z","createdAt":"2026-10-29T22:18:14.142Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","kind":"article","url":"https://arxiv.org/abs/2610.37201","sourceUrl":"https://arxiv.org/abs/2610.37201","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-29T22:17:20.735Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.37201","checkedAt":"2026-10-30T00:26:35.449Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"d62ec00a3db6685821b2ab1583eee0db5ee46d44c3bd09c17fc65f7708d0401d","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4003b088455ac8ff20359082d5ce4f2a95b010eb1032e72146c7eb28e381d094","decidedAt":"2026-10-29T22:17:22.797Z"},"provenance":{"textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observationId":"601b64da073d9bd683411045fa28e8ffe7c5d780ecbc051102488e960e8528ec","retrievedAt":"2026-10-29T22:17:20.461Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c941a7f3-169b-479b-8f5a-ae749050775d"},"reviewer":{"model":"gpt-6-luna","runId":"1c61f62f-c2ff-4ba3-89b9-5eba2e8ec1c3"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T22:18:14.142Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zhou, Jiawei","url":null,"kind":"unknown"},{"name":"Peng, Bo","url":null,"kind":"unknown"},{"name":"Huang, Yuxuan","url":null,"kind":"unknown"},{"name":"Zhang, Ming","url":null,"kind":"unknown"},{"name":"Sun, Youbang","url":null,"kind":"unknown"},{"name":"Wang, Xiang","url":null,"kind":"unknown"},{"name":"Lu, Chaochao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zhou, Jiawei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Jiawei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Peng, Bo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Peng, Bo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Huang, Yuxuan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huang, Yuxuan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Zhang, Ming","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Ming","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Sun, Youbang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sun, Youbang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Wang, Xiang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Xiang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}},{"actor":{"name":"Lu, Chaochao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lu, Chaochao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.37201","locator":"head/meta[name=author|citation_author]"},"assertionId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-30T00:26:35.449Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","sourceUrl":"https://arxiv.org/abs/2610.37201","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.37201","snapshotId":"265527d5a31ab779ea08bb83c30030dfaf4089dbbba0b67dfff219637fd73fc4","contentSha256":"45f172eab70a881a7ce540e188fdbe14e7566365c2a29d4d84f0bf22effb217f","textHash":"5cf4c65b7ad2722e6d2f67f0e9f42b58b5b037e5e3fee95eb43a339b49f7defb","observedAt":"2026-10-30T00:26:35.449Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/343476a3f7923b455090bfb99e811e92497279cdeb3dca07aaba7677a3c1ffea/source"}}}],"audits":[{"publicationId":"a03e5104-bb25-46bb-8e98-38527932b6d0","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the paper to Jiawei Zhou and coauthors on arXiv. It frames the findings and recommendations as the authors' reports and arguments.","excerpt":"Authors:Jiawei Zhou, Bo Peng, Yuxuan Huang, Ming Zhang, Youbang Sun, Xiang Wang, Chaochao Lu"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question match the abstract. Skill optimizers are explained in plain language, and the central finding is clear: dev-set gains vanish on test and costs rise. The draft notes the limits on generalization, and the question is open rather than leading. Terms such as tokens and turns are only lightly explained, but they do not block understanding.","excerpt":"Their dev gains vanish on test: keeping the best of several candidates on at most 30 tasks reports gains this large even when none changed."},{"dimension":"date","status":"pass","explanation":"The original publication date, 2026-10-27, matches the v1 submission date. The feed date of 2026-10-29 is a later announcement.","excerpt":"[Submitted on 27 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract: the 0.1-point average gain, the 30-task selection effect, the roughly 16% extra input tokens, rules that lead to extra turns, and the recommended principles. The draft states that real-world benefit of the recommendations is unestablished, and it adds no unsupported impacts.","excerpt":"They read about 16% more input tokens: the optimizers almost always add rules, half to re-check work and some to act one call at a time, and the agent follows them as extra turns"},{"dimension":"media","status":"pass","explanation":"The selected media item is the verified link to the arXiv abstract page itself, which is the direct original source.","excerpt":null}],"createdAt":"2026-10-29T22:18:14.142Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}