{"id":"6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4","title":"What Does a Harness Buy? Tokens, Mostly","argument":"Yangze Liu and Zhongyi Han argue that a coding agent’s harness—the system prompt, tools and context management around a language model—does not have a universally best configuration. Their study compares three production harnesses across seven models and three benchmarks, and reruns each setup unchanged to measure how much results vary without changing the harness. The authors report that no harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 pass-rate points, and swapping harnesses changes about as many task outcomes as rerunning the same setup. But averages can hide consequential pairings: OpenCode trails by 8 to 9 points on one model and leads by 14 on another. Costs also depend on the model, ranging from under 10% to 3 to 4 times across harnesses. The authors’ practical point is that a harness comparison needs a rerun alongside it: otherwise, a measured difference may be mistaken for a harness effect when reruns themselves change outcomes. Their results make “which harness is better?” a model-dependent question, not a general ranking. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports tests of seven models, three production harnesses and three benchmarks; it does not establish that the findings generalize to other models, harnesses or tasks. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","speaker":{"name":"Liu, Yangze, Han, Zhongyi","roleAtSource":"Article author"},"source":{"title":"What Does a Harness Buy? Tokens, Mostly","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.04433","publishedAt":"2026-10-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors define a coding agent’s harness as the system prompt, tools and context management surrounding a language model.","excerpt":"A coding agent is a language model inside a harness: the system prompt, the tools, and the context management","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"Across their tested models and benchmarks, the authors report no harness consistently leads, and bounded differences between harnesses are 2 to 5 points.","excerpt":"No harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 points","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"The authors report that changing the harness alters about as many task outcomes as rerunning the same harness, with some model-specific reversals.","excerpt":"a harness swap changes about as many task outcomes as a rerun. The exceptions are harness effects in particular pairings of model and harness, whose direction changes with the model","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"The authors report that cost differences across harnesses depend on the model, ranging from under 10% to 3 to 4 times.","excerpt":"Cost differences between harnesses also depend on the model, from under 10% to 3 to 4 times.","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.04433","checkedAt":"2026-11-19T08:50:09.729Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Across the tested model-harness pairings, how often do harness differences exceed the variation seen in reruns?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"What Does a Harness Buy? Tokens, Mostly","summary":"Yangze Liu and Zhongyi Han argue that a coding agent’s harness—the system prompt, tools and context management around a language model—does not have a universally best configuration. Their study compares three production harnesses across seven models and three benchmarks, and reruns each setup unchanged to measure how much results vary without changing the harness. The authors report that no harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 pass-rate points, and swapping harnesses changes about as many task outcomes as rerunning the same setup. But averages can hide consequential pairings: OpenCode trails by 8 to 9 points on one model and leads by 14 on another. Costs also depend on the model, ranging from under 10% to 3 to 4 times across harnesses. The authors’ practical point is that a harness comparison needs a rerun alongside it: otherwise, a measured difference may be mistaken for a harness effect when reruns themselves change outcomes. Their results make “which harness is better?” a model-dependent question, not a general ranking. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","question":"Across the tested model-harness pairings, how often do harness differences exceed the variation seen in reruns?","claims":[{"text":"The authors define a coding agent’s harness as the system prompt, tools and context management surrounding a language model.","excerpt":"A coding agent is a language model inside a harness: the system prompt, the tools, and the context management","support":"source-stated"},{"text":"Across their tested models and benchmarks, the authors report no harness consistently leads, and bounded differences between harnesses are 2 to 5 points.","excerpt":"No harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 points","support":"source-stated"},{"text":"The authors report that changing the harness alters about as many task outcomes as rerunning the same harness, with some model-specific reversals.","excerpt":"a harness swap changes about as many task outcomes as a rerun. The exceptions are harness effects in particular pairings of model and harness, whose direction changes with the model","support":"source-stated"},{"text":"The authors report that cost differences across harnesses depend on the model, ranging from under 10% to 3 to 4 times.","excerpt":"Cost differences between harnesses also depend on the model, from under 10% to 3 to 4 times.","support":"source-stated"}],"limitations":["The abstract reports tests of seven models, three production harnesses and three benchmarks; it does not establish that the findings generalize to other models, harnesses or tasks.","The abstract does not identify which model-harness pairings produce the reported score and cost differences."],"mediaId":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","correctionReason":null,"id":"6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4","publicationId":"31975bf2-91f5-475b-8f10-4b080414f245","version":1,"sourceUrl":"https://arxiv.org/abs/2610.04433","sourceTitle":"What Does a Harness Buy? Tokens, Mostly","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-06T08:47:13.776Z","createdAt":"2026-11-19T08:18:26.903Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","kind":"article","url":"https://arxiv.org/abs/2610.04433","sourceUrl":"https://arxiv.org/abs/2610.04433","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T08:16:59.331Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.04433","checkedAt":"2026-11-19T08:50:09.729Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","confidence":0.87,"provider":"typesafe","model":"jev-1.13.0","inputHash":"35017377f04bb59c6403e16eadcfe2e85f724dbabb32acd77e3f1234683690a7","decidedAt":"2026-11-19T08:16:59.709Z"},"provenance":{"textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observationId":"e0d321ea118b6ea45b020f4c7e4e7358c7478fe1b95b9ad818cd436e26dcb50b","retrievedAt":"2026-11-19T08:16:59.280Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"db12333f-511a-4e28-84b7-82109a6404e2"},"reviewer":{"model":"gpt-6-luna","runId":"6a249076-dd6f-4f0f-80bd-b4365ca32617"}},"audit":{"status":"passed","reviewedAt":"2026-11-19T08:18:26.903Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liu, Yangze","url":null,"kind":"unknown"},{"name":"Han, Zhongyi","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liu, Yangze","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yangze","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.04433","locator":"head/meta[name=author|citation_author]"},"assertionId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T08:50:09.729Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","sourceUrl":"https://arxiv.org/abs/2610.04433","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z"}},{"actor":{"name":"Han, Zhongyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Han, Zhongyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.04433","locator":"head/meta[name=author|citation_author]"},"assertionId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T08:50:09.729Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","sourceUrl":"https://arxiv.org/abs/2610.04433","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.04433","snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4/source"}},"canonicalUrl":"https://escapemeridian.com/readings/what-does-a-harness-buy-tokens-mostly-6d621d61","formats":{"html":"/readings/what-does-a-harness-buy-tokens-mostly-6d621d61","markdown":"/readings/what-does-a-harness-buy-tokens-mostly-6d621d61.md","json":"/readings/what-does-a-harness-buy-tokens-mostly-6d621d61.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4","revision":"31975bf2-91f5-475b-8f10-4b080414f245","revisionKind":"publication-id","title":"What Does a Harness Buy? Tokens, Mostly","url":"https://escapemeridian.com/readings/what-does-a-harness-buy-tokens-mostly-6d621d61"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.04433","revision":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","revisionKind":"sha256-source-text","title":"What Does a Harness Buy? Tokens, Mostly","url":"https://arxiv.org/abs/2610.04433"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4","title":"What Does a Harness Buy? Tokens, Mostly","argument":"Yangze Liu and Zhongyi Han argue that a coding agent’s harness—the system prompt, tools and context management around a language model—does not have a universally best configuration. Their study compares three production harnesses across seven models and three benchmarks, and reruns each setup unchanged to measure how much results vary without changing the harness. The authors report that no harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 pass-rate points, and swapping harnesses changes about as many task outcomes as rerunning the same setup. But averages can hide consequential pairings: OpenCode trails by 8 to 9 points on one model and leads by 14 on another. Costs also depend on the model, ranging from under 10% to 3 to 4 times across harnesses. The authors’ practical point is that a harness comparison needs a rerun alongside it: otherwise, a measured difference may be mistaken for a harness effect when reruns themselves change outcomes. Their results make “which harness is better?” a model-dependent question, not a general ranking. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports tests of seven models, three production harnesses and three benchmarks; it does not establish that the findings generalize to other models, harnesses or tasks. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","speaker":{"name":"Liu, Yangze, Han, Zhongyi","roleAtSource":"Article author"},"source":{"title":"What Does a Harness Buy? Tokens, Mostly","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.04433","publishedAt":"2026-10-03","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors define a coding agent’s harness as the system prompt, tools and context management surrounding a language model.","excerpt":"A coding agent is a language model inside a harness: the system prompt, the tools, and the context management","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"Across their tested models and benchmarks, the authors report no harness consistently leads, and bounded differences between harnesses are 2 to 5 points.","excerpt":"No harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 points","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"The authors report that changing the harness alters about as many task outcomes as rerunning the same harness, with some model-specific reversals.","excerpt":"a harness swap changes about as many task outcomes as a rerun. The exceptions are harness effects in particular pairings of model and harness, whose direction changes with the model","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"},{"text":"The authors report that cost differences across harnesses depend on the model, ranging from under 10% to 3 to 4 times.","excerpt":"Cost differences between harnesses also depend on the model, from under 10% to 3 to 4 times.","url":"https://arxiv.org/abs/2610.04433","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.04433","checkedAt":"2026-11-19T08:50:09.729Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Across the tested model-harness pairings, how often do harness differences exceed the variation seen in reruns?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"What Does a Harness Buy? Tokens, Mostly","summary":"Yangze Liu and Zhongyi Han argue that a coding agent’s harness—the system prompt, tools and context management around a language model—does not have a universally best configuration. Their study compares three production harnesses across seven models and three benchmarks, and reruns each setup unchanged to measure how much results vary without changing the harness. The authors report that no harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 pass-rate points, and swapping harnesses changes about as many task outcomes as rerunning the same setup. But averages can hide consequential pairings: OpenCode trails by 8 to 9 points on one model and leads by 14 on another. Costs also depend on the model, ranging from under 10% to 3 to 4 times across harnesses. The authors’ practical point is that a harness comparison needs a rerun alongside it: otherwise, a measured difference may be mistaken for a harness effect when reruns themselves change outcomes. Their results make “which harness is better?” a model-dependent question, not a general ranking. The abstract does not identify which model-harness pairings produce the reported score and cost differences.","question":"Across the tested model-harness pairings, how often do harness differences exceed the variation seen in reruns?","claims":[{"text":"The authors define a coding agent’s harness as the system prompt, tools and context management surrounding a language model.","excerpt":"A coding agent is a language model inside a harness: the system prompt, the tools, and the context management","support":"source-stated"},{"text":"Across their tested models and benchmarks, the authors report no harness consistently leads, and bounded differences between harnesses are 2 to 5 points.","excerpt":"No harness leads consistently across models. Where the data can bound the difference between two harnesses, the bound is 2 to 5 points","support":"source-stated"},{"text":"The authors report that changing the harness alters about as many task outcomes as rerunning the same harness, with some model-specific reversals.","excerpt":"a harness swap changes about as many task outcomes as a rerun. The exceptions are harness effects in particular pairings of model and harness, whose direction changes with the model","support":"source-stated"},{"text":"The authors report that cost differences across harnesses depend on the model, ranging from under 10% to 3 to 4 times.","excerpt":"Cost differences between harnesses also depend on the model, from under 10% to 3 to 4 times.","support":"source-stated"}],"limitations":["The abstract reports tests of seven models, three production harnesses and three benchmarks; it does not establish that the findings generalize to other models, harnesses or tasks.","The abstract does not identify which model-harness pairings produce the reported score and cost differences."],"mediaId":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","correctionReason":null,"id":"6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4","publicationId":"31975bf2-91f5-475b-8f10-4b080414f245","version":1,"sourceUrl":"https://arxiv.org/abs/2610.04433","sourceTitle":"What Does a Harness Buy? Tokens, Mostly","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-03","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-06T08:47:13.776Z","createdAt":"2026-11-19T08:18:26.903Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","kind":"article","url":"https://arxiv.org/abs/2610.04433","sourceUrl":"https://arxiv.org/abs/2610.04433","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T08:16:59.331Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.04433","checkedAt":"2026-11-19T08:50:09.729Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"da56a135b102688b3da0263ff9c8e58691b0d34cc00f9ea1b383584bae1a98ed","confidence":0.87,"provider":"typesafe","model":"jev-1.13.0","inputHash":"35017377f04bb59c6403e16eadcfe2e85f724dbabb32acd77e3f1234683690a7","decidedAt":"2026-11-19T08:16:59.709Z"},"provenance":{"textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observationId":"e0d321ea118b6ea45b020f4c7e4e7358c7478fe1b95b9ad818cd436e26dcb50b","retrievedAt":"2026-11-19T08:16:59.280Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"db12333f-511a-4e28-84b7-82109a6404e2"},"reviewer":{"model":"gpt-6-luna","runId":"6a249076-dd6f-4f0f-80bd-b4365ca32617"}},"audit":{"status":"passed","reviewedAt":"2026-11-19T08:18:26.903Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liu, Yangze","url":null,"kind":"unknown"},{"name":"Han, Zhongyi","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liu, Yangze","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yangze","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.04433","locator":"head/meta[name=author|citation_author]"},"assertionId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T08:50:09.729Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","sourceUrl":"https://arxiv.org/abs/2610.04433","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z"}},{"actor":{"name":"Han, Zhongyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Han, Zhongyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.04433","locator":"head/meta[name=author|citation_author]"},"assertionId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T08:50:09.729Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","sourceUrl":"https://arxiv.org/abs/2610.04433","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.04433","snapshotId":"0bf1faa2fc9075fe5bd4e23b452c398bf28d52c83a3314cb14f4afec1879d240","contentSha256":"d542545f1fce82a4346c787f27b44ad56db0162a25b3cbb338b6b9b62afd9314","textHash":"4e16fae4c939559b7bc6f3d7046c48f8af0205c8b04f7f1bdcd0e6dc9b1fffae","observedAt":"2026-11-19T08:50:09.729Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6d621d61ee5a890844f2d0583daddb27cfa89448fd63577b5ea4b3c0d103b2f4/source"}}}],"audits":[{"publicationId":"31975bf2-91f5-475b-8f10-4b080414f245","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly credits the paper to Yangze Liu and Zhongyi Han. It frames the findings as the authors' reports and arguments, not as established fact.","excerpt":"Authors:Yangze Liu, Zhongyi Han"},{"dimension":"summary","status":"pass","explanation":"The summary defines harness in plain terms and covers the design: seven models, three production harnesses, three benchmarks and unchanged reruns. It also covers the main findings, the OpenCode reversal, the cost spread and the reporting recommendation. The rerun rationale fairly reflects the source's stated gap. Optional repair: name all three harnesses and note that vendors and leaderboards credit harnesses with score gains. That claim is the stake the paper challenges. Neither omission blocks understanding. The question about how often harness differences exceed rerun variation follows from the evidence.","excerpt":"have not measured whether the swap changes the pass rate more than running the same harness again"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-03 matches the v1 submission date. The source was later revised on 18 Nov 2026, but the first submission correctly governs.","excerpt":"Submitted on 3 Oct 2026 (v1)"},{"dimension":"support","status":"pass","explanation":"Each claim is an exact or faithful paraphrase of the abstract: the harness definition, the 2 to 5 point bound, a swap matching a rerun, the model-specific reversals and the cost range. The limitations are accurate and appropriately scoped. The reading does not overstate generality or turn benchmark results into real-world reliability.","excerpt":"Which harness is better therefore has no answer apart from the model, and a harness difference should be reported next to a rerun."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which gives the easiest access to the actual source.","excerpt":null}],"createdAt":"2026-11-19T08:18:26.903Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}