{"id":"1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891","title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","argument":"Authors Daniel Lenton, Yusha Arif and Haris Mahmood propose Continual-ARC, a benchmark for studying continual learning: whether a system can acquire skills as tasks recur over time. Its stream combines tasks from three ARC-AGI editions. Tasks return after gaps with fresh instances, while new tasks arrive; learners can pay for demonstrations, submit answers or act inside an agent harness, with paid retries for wrong answers. The benchmark scores how much feedback budget each instance uses, then tests learners on familiar tasks and unseen ones. The authors say this lets memory-based and weight-based systems be compared on the same scale. In their experiments, persistence in an agent harness generally did not improve memorization without explicit expert guidance. Most harness-based methods learned less than a baseline that simply cached task demonstrations, and gained little or nothing on unseen tasks. By contrast, weight-based learning showed substantial gains on unseen tasks. The authors therefore point toward future weight-based continual learning that could teach models to use harnesses in new domains. But the reported comparison covers the models and methods tested in this paper; it does not establish how the pattern will hold in other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported findings concern the evaluated setup: the abstract names Qwen3.5-9B and GLM-5.3 Flash and does not establish whether the same pattern holds for other models or settings. The abstract describes results on benchmark tasks; it does not establish performance in real-world applications.","speaker":{"name":"Lenton, Daniel, Arif, Yusha, Mahmood, Haris","roleAtSource":"Article author"},"source":{"title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.14505","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose Continual-ARC, a lifelong stream of tasks from three ARC-AGI editions, designed to compare memory-based and weight-based systems on the same scale.","excerpt":"We propose Continual-ARC, a lifelong stream built from the three ARC-AGI editions","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"In the benchmark, tasks recur after dormant gaps with fresh instances, and the learner has a feedback budget for demonstrations, answers and harness actions.","excerpt":"The same tasks return after dormant gaps with fresh instances, while new tasks keep arriving.","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"The authors report that harness persistence generally did not improve memorization without explicit expert guidance; most harness methods performed below a demonstration-caching floor.","excerpt":"Persistence in the harness generally does not improve memorization unless provided with explicit expert guidance. Most harness-based methods still learn less than a floor that simply caches each task's demonstrations","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"The authors report little or no harness-based gain on unseen tasks, while weight-based learning showed substantial gains; they suggest future work could teach models to drive harnesses in new domains.","excerpt":"Harness-based methods gain little or nothing on unseen tasks, whereas weight-based learning shows substantial gains.","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14505","checkedAt":"2026-11-18T13:48:10.828Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would show that weight-based continual learning can teach models to drive harnesses in new domains?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","summary":"Authors Daniel Lenton, Yusha Arif and Haris Mahmood propose Continual-ARC, a benchmark for studying continual learning: whether a system can acquire skills as tasks recur over time. Its stream combines tasks from three ARC-AGI editions. Tasks return after gaps with fresh instances, while new tasks arrive; learners can pay for demonstrations, submit answers or act inside an agent harness, with paid retries for wrong answers. The benchmark scores how much feedback budget each instance uses, then tests learners on familiar tasks and unseen ones. The authors say this lets memory-based and weight-based systems be compared on the same scale. In their experiments, persistence in an agent harness generally did not improve memorization without explicit expert guidance. Most harness-based methods learned less than a baseline that simply cached task demonstrations, and gained little or nothing on unseen tasks. By contrast, weight-based learning showed substantial gains on unseen tasks. The authors therefore point toward future weight-based continual learning that could teach models to use harnesses in new domains. But the reported comparison covers the models and methods tested in this paper; it does not establish how the pattern will hold in other settings.","question":"What evidence would show that weight-based continual learning can teach models to drive harnesses in new domains?","claims":[{"text":"The authors propose Continual-ARC, a lifelong stream of tasks from three ARC-AGI editions, designed to compare memory-based and weight-based systems on the same scale.","excerpt":"We propose Continual-ARC, a lifelong stream built from the three ARC-AGI editions","support":"source-stated"},{"text":"In the benchmark, tasks recur after dormant gaps with fresh instances, and the learner has a feedback budget for demonstrations, answers and harness actions.","excerpt":"The same tasks return after dormant gaps with fresh instances, while new tasks keep arriving.","support":"source-stated"},{"text":"The authors report that harness persistence generally did not improve memorization without explicit expert guidance; most harness methods performed below a demonstration-caching floor.","excerpt":"Persistence in the harness generally does not improve memorization unless provided with explicit expert guidance. Most harness-based methods still learn less than a floor that simply caches each task's demonstrations","support":"source-stated"},{"text":"The authors report little or no harness-based gain on unseen tasks, while weight-based learning showed substantial gains; they suggest future work could teach models to drive harnesses in new domains.","excerpt":"Harness-based methods gain little or nothing on unseen tasks, whereas weight-based learning shows substantial gains.","support":"source-stated"}],"limitations":["The reported findings concern the evaluated setup: the abstract names Qwen3.5-9B and GLM-5.3 Flash and does not establish whether the same pattern holds for other models or settings.","The abstract describes results on benchmark tasks; it does not establish performance in real-world applications."],"mediaId":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","correctionReason":null,"id":"1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891","publicationId":"2572ac9d-9e66-4da4-803f-3262116804a0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14505","sourceTitle":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:19:19.236Z","createdAt":"2026-11-18T13:32:44.496Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","kind":"article","url":"https://arxiv.org/abs/2611.14505","sourceUrl":"https://arxiv.org/abs/2611.14505","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:04:28.161Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14505","checkedAt":"2026-11-18T13:48:10.828Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","confidence":0.63,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5c9b24262da3538feb13ac6cf9539a5b326b5f2df1904b04cf7b93aeb8b8932d","decidedAt":"2026-11-18T13:04:29.286Z"},"provenance":{"textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observationId":"dce89cd9a294e91fbcde3d7b45d9bb6f0a947e39582bdad6efbefcba814a77f0","retrievedAt":"2026-11-18T13:04:28.018Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"da88f019-93b6-4852-8f68-1f12b6fad69a"},"reviewer":{"model":"gpt-6-luna","runId":"5642a60b-a0fa-47ba-8016-9604b214bd99"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:32:44.496Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Lenton, Daniel","url":null,"kind":"unknown"},{"name":"Arif, Yusha","url":null,"kind":"unknown"},{"name":"Mahmood, Haris","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Lenton, Daniel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lenton, Daniel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}},{"actor":{"name":"Arif, Yusha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arif, Yusha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}},{"actor":{"name":"Mahmood, Haris","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mahmood, Haris","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14505","snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891/source"}},"canonicalUrl":"https://escapemeridian.com/readings/continual-arc-measuring-skill-acquisition-over-a-working-1245e9bf","formats":{"html":"/readings/continual-arc-measuring-skill-acquisition-over-a-working-1245e9bf","markdown":"/readings/continual-arc-measuring-skill-acquisition-over-a-working-1245e9bf.md","json":"/readings/continual-arc-measuring-skill-acquisition-over-a-working-1245e9bf.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-continual-learning","name":"Continual learning","explanation":"A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.","referenceUrl":"https://en.wikipedia.org/wiki/Incremental_learning"},{"id":"term-agent-harness","name":"Agent harness","explanation":"An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.","referenceUrl":"https://www.anthropic.com/research/demystifying-evals-for-ai-agents"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891","revision":"2572ac9d-9e66-4da4-803f-3262116804a0","revisionKind":"publication-id","title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","url":"https://escapemeridian.com/readings/continual-arc-measuring-skill-acquisition-over-a-working-1245e9bf"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.14505","revision":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","revisionKind":"sha256-source-text","title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","url":"https://arxiv.org/abs/2611.14505"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891","title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","argument":"Authors Daniel Lenton, Yusha Arif and Haris Mahmood propose Continual-ARC, a benchmark for studying continual learning: whether a system can acquire skills as tasks recur over time. Its stream combines tasks from three ARC-AGI editions. Tasks return after gaps with fresh instances, while new tasks arrive; learners can pay for demonstrations, submit answers or act inside an agent harness, with paid retries for wrong answers. The benchmark scores how much feedback budget each instance uses, then tests learners on familiar tasks and unseen ones. The authors say this lets memory-based and weight-based systems be compared on the same scale. In their experiments, persistence in an agent harness generally did not improve memorization without explicit expert guidance. Most harness-based methods learned less than a baseline that simply cached task demonstrations, and gained little or nothing on unseen tasks. By contrast, weight-based learning showed substantial gains on unseen tasks. The authors therefore point toward future weight-based continual learning that could teach models to use harnesses in new domains. But the reported comparison covers the models and methods tested in this paper; it does not establish how the pattern will hold in other settings.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported findings concern the evaluated setup: the abstract names Qwen3.5-9B and GLM-5.3 Flash and does not establish whether the same pattern holds for other models or settings. The abstract describes results on benchmark tasks; it does not establish performance in real-world applications.","speaker":{"name":"Lenton, Daniel, Arif, Yusha, Mahmood, Haris","roleAtSource":"Article author"},"source":{"title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.14505","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose Continual-ARC, a lifelong stream of tasks from three ARC-AGI editions, designed to compare memory-based and weight-based systems on the same scale.","excerpt":"We propose Continual-ARC, a lifelong stream built from the three ARC-AGI editions","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"In the benchmark, tasks recur after dormant gaps with fresh instances, and the learner has a feedback budget for demonstrations, answers and harness actions.","excerpt":"The same tasks return after dormant gaps with fresh instances, while new tasks keep arriving.","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"The authors report that harness persistence generally did not improve memorization without explicit expert guidance; most harness methods performed below a demonstration-caching floor.","excerpt":"Persistence in the harness generally does not improve memorization unless provided with explicit expert guidance. Most harness-based methods still learn less than a floor that simply caches each task's demonstrations","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"},{"text":"The authors report little or no harness-based gain on unseen tasks, while weight-based learning showed substantial gains; they suggest future work could teach models to drive harnesses in new domains.","excerpt":"Harness-based methods gain little or nothing on unseen tasks, whereas weight-based learning shows substantial gains.","url":"https://arxiv.org/abs/2611.14505","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14505","checkedAt":"2026-11-18T13:48:10.828Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would show that weight-based continual learning can teach models to drive harnesses in new domains?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","summary":"Authors Daniel Lenton, Yusha Arif and Haris Mahmood propose Continual-ARC, a benchmark for studying continual learning: whether a system can acquire skills as tasks recur over time. Its stream combines tasks from three ARC-AGI editions. Tasks return after gaps with fresh instances, while new tasks arrive; learners can pay for demonstrations, submit answers or act inside an agent harness, with paid retries for wrong answers. The benchmark scores how much feedback budget each instance uses, then tests learners on familiar tasks and unseen ones. The authors say this lets memory-based and weight-based systems be compared on the same scale. In their experiments, persistence in an agent harness generally did not improve memorization without explicit expert guidance. Most harness-based methods learned less than a baseline that simply cached task demonstrations, and gained little or nothing on unseen tasks. By contrast, weight-based learning showed substantial gains on unseen tasks. The authors therefore point toward future weight-based continual learning that could teach models to use harnesses in new domains. But the reported comparison covers the models and methods tested in this paper; it does not establish how the pattern will hold in other settings.","question":"What evidence would show that weight-based continual learning can teach models to drive harnesses in new domains?","claims":[{"text":"The authors propose Continual-ARC, a lifelong stream of tasks from three ARC-AGI editions, designed to compare memory-based and weight-based systems on the same scale.","excerpt":"We propose Continual-ARC, a lifelong stream built from the three ARC-AGI editions","support":"source-stated"},{"text":"In the benchmark, tasks recur after dormant gaps with fresh instances, and the learner has a feedback budget for demonstrations, answers and harness actions.","excerpt":"The same tasks return after dormant gaps with fresh instances, while new tasks keep arriving.","support":"source-stated"},{"text":"The authors report that harness persistence generally did not improve memorization without explicit expert guidance; most harness methods performed below a demonstration-caching floor.","excerpt":"Persistence in the harness generally does not improve memorization unless provided with explicit expert guidance. Most harness-based methods still learn less than a floor that simply caches each task's demonstrations","support":"source-stated"},{"text":"The authors report little or no harness-based gain on unseen tasks, while weight-based learning showed substantial gains; they suggest future work could teach models to drive harnesses in new domains.","excerpt":"Harness-based methods gain little or nothing on unseen tasks, whereas weight-based learning shows substantial gains.","support":"source-stated"}],"limitations":["The reported findings concern the evaluated setup: the abstract names Qwen3.5-9B and GLM-5.3 Flash and does not establish whether the same pattern holds for other models or settings.","The abstract describes results on benchmark tasks; it does not establish performance in real-world applications."],"mediaId":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","correctionReason":null,"id":"1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891","publicationId":"2572ac9d-9e66-4da4-803f-3262116804a0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14505","sourceTitle":"Continual-ARC: Measuring Skill Acquisition over a Working Lifetime","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:19:19.236Z","createdAt":"2026-11-18T13:32:44.496Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","kind":"article","url":"https://arxiv.org/abs/2611.14505","sourceUrl":"https://arxiv.org/abs/2611.14505","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T13:04:28.161Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14505","checkedAt":"2026-11-18T13:48:10.828Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"241bb53e2eb133a9c44561b597fc18c9b3018a10b84c15b4bbbf95ce2f9fc5ae","confidence":0.63,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5c9b24262da3538feb13ac6cf9539a5b326b5f2df1904b04cf7b93aeb8b8932d","decidedAt":"2026-11-18T13:04:29.286Z"},"provenance":{"textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observationId":"dce89cd9a294e91fbcde3d7b45d9bb6f0a947e39582bdad6efbefcba814a77f0","retrievedAt":"2026-11-18T13:04:28.018Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"da88f019-93b6-4852-8f68-1f12b6fad69a"},"reviewer":{"model":"gpt-6-luna","runId":"5642a60b-a0fa-47ba-8016-9604b214bd99"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T13:32:44.496Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Lenton, Daniel","url":null,"kind":"unknown"},{"name":"Arif, Yusha","url":null,"kind":"unknown"},{"name":"Mahmood, Haris","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Lenton, Daniel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lenton, Daniel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}},{"actor":{"name":"Arif, Yusha","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Arif, Yusha","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}},{"actor":{"name":"Mahmood, Haris","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mahmood, Haris","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14505","locator":"head/meta[name=author|citation_author]"},"assertionId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T13:48:10.828Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","sourceUrl":"https://arxiv.org/abs/2611.14505","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14505","snapshotId":"663ce4cec73df792c9690485c9fea4b0b070f935159812350649f775b97aad63","contentSha256":"e69a86650e319ef5e9ddba212d2233ce88064d204deea773d4dc3af02f679855","textHash":"fbfcaac6912feb0b257a3c84da86f33512308aa3fc11b3d3c3fb041f48c6e2b4","observedAt":"2026-11-18T13:48:10.828Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/1245e9bf7ba3a97cab48d9f3d9004f9139d6444fea8565e7f2c23037cd480891/source"}}}],"audits":[{"publicationId":"2572ac9d-9e66-4da4-803f-3262116804a0","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly credits Daniel Lenton, Yusha Arif and Haris Mahmood with the paper. It keeps the benchmark design and results attributed to the authors ('the authors say', 'in their experiments').","excerpt":"Authors:Daniel Lenton, Yusha Arif, Haris Mahmood"},{"dimension":"summary","status":"uncertain","explanation":"The reading tracks the abstract faithfully but leaves central terms unexplained for a non-specialist. The terms are 'agent harness' (the main object being tested), 'memory-based' versus 'weight-based' systems, and ARC-AGI. A general reader cannot follow the core finding without knowing what a harness is or what learning in weights means. It also omits two details: the harness ran with frozen weights, and the weight-based method was Qwen3.5-9B trained to imitate GLM-5.3 Flash. That bears on how 'substantial gains' should be read. Smallest repair: add one plain-language gloss or tooltip for each of the three terms, and name the specific weight-based method.","excerpt":"We run an agent harness with frozen weights, with and without persistence, on Qwen3.5-9B and GLM-5.3 Flash, comparing them with two prompting floors, a program-induction method and Qwen3.5-9B's weights trained to imitate GLM-5.3 Flash."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-10, which matches the v1 submission date. Later revisions on Nov 11 and Nov 15 and the Nov 18 feed entry do not change the original date.","excerpt":"Submitted on 10 Nov 2026 (v1)"},{"dimension":"support","status":"pass","explanation":"Each claim is directly supported by the abstract. The forward-looking statement is attributed to the authors as a possibility, not stated as fact. The limitations correctly scope the results to the tested models and benchmark. The question follows from the authors' stated direction without presupposing the answer.","excerpt":"Harness-based methods gain little or nothing on unseen tasks, whereas weight-based learning shows substantial gains."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page for this paper, which is the direct original source.","excerpt":null}],"createdAt":"2026-11-18T13:32:44.496Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}