{"id":"d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10","title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","argument":"George Juraj Salapa introduces kw-bench, a benchmark for investigative knowledge work: recovering answers hidden in incomplete, inconsistent records rather than generating a document from a brief. Its first task asks a model working inside a harness—a loop with tools such as a shell and filesystem—to reconstruct VAT across three generations of SAP from raw system extracts. The paper says grading is deterministic, with no LLM judge.\n\nIn the reported two-hour runs, four harnesses used the same model. OpenCode and micro-cc scored 0.542 and 0.528; the two lab harnesses each scored 0.00. Salapa says “inertia”—keeping weak signals alive across a long session—defeated those harnesses. With Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes. Salapa argues that below the frontier, the harness affects how far a model gets, while a frontier model makes this task much easier. He says a weeks-long engagement now costs minutes and a few dollars; the abstract does not establish that result across other engagements. How well would these results hold across other investigative tasks and records?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes only the first task family, a VAT reconstruction, and does not report how results generalize to other investigative tasks. The abstract states that a weeks-long engagement costs minutes and a few dollars but does not specify the basis for that comparison or establish it across engagements. The reported results are for the listed harnesses, models, task, and run durations; the abstract alone does not show how performance changes under other conditions.","speaker":{"name":"Salapa, George Juraj","roleAtSource":"Article author"},"source":{"title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36405","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"Salapa presents kw-bench as a benchmark for investigative work, where answers must be recovered from incomplete and inconsistent evidence.","excerpt":"the answer already exists -- hidden in incomplete and inconsistent evidence spread across systems -- and has to be recovered and defended to the cent.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The first task reconstructs five years of VAT across three generations of SAP, using raw system extracts.","excerpt":"Its first task family is a five-year VAT reconstruction across three generations of SAP","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The benchmark uses deterministic grading without an LLM judge.","excerpt":"Grading is deterministic, with no LLM judge.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"In a two-hour run using DeepSeek v4.1 Flash, OpenCode scored 0.542 and micro-cc 0.528, while Claude Code and Codex each scored 0.00.","excerpt":"OpenCode 0.542, micro-cc 0.528); the two lab harnesses, away from their home model, delivered nothing (0.00 each).","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The author attributes the weaker results to harnesses failing to keep weak signals active across a long session.","excerpt":"What defeated them was inertia: keeping many weak signals alive across a long session.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"On Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes.","excerpt":"micro-cc and Claude Code on Claude Opus 5.5 scored 0.9986 and 1.000, in 22 and 25 minutes.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"Salapa argues that below the frontier, the harness affects how far a model gets, and says a weeks-long engagement could take minutes and a few dollars.","excerpt":"A weeks-long engagement now costs minutes and a few dollars; below the frontier, the harness decides how far a model gets.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36405","checkedAt":"2026-11-14T00:32:10.845Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would these results hold across other investigative tasks and records?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","summary":"George Juraj Salapa introduces kw-bench, a benchmark for investigative knowledge work: recovering answers hidden in incomplete, inconsistent records rather than generating a document from a brief. Its first task asks a model working inside a harness—a loop with tools such as a shell and filesystem—to reconstruct VAT across three generations of SAP from raw system extracts. The paper says grading is deterministic, with no LLM judge.\n\nIn the reported two-hour runs, four harnesses used the same model. OpenCode and micro-cc scored 0.542 and 0.528; the two lab harnesses each scored 0.00. Salapa says “inertia”—keeping weak signals alive across a long session—defeated those harnesses. With Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes. Salapa argues that below the frontier, the harness affects how far a model gets, while a frontier model makes this task much easier. He says a weeks-long engagement now costs minutes and a few dollars; the abstract does not establish that result across other engagements. How well would these results hold across other investigative tasks and records?","question":"How well would these results hold across other investigative tasks and records?","claims":[{"text":"Salapa presents kw-bench as a benchmark for investigative work, where answers must be recovered from incomplete and inconsistent evidence.","excerpt":"the answer already exists -- hidden in incomplete and inconsistent evidence spread across systems -- and has to be recovered and defended to the cent.","support":"source-stated"},{"text":"The first task reconstructs five years of VAT across three generations of SAP, using raw system extracts.","excerpt":"Its first task family is a five-year VAT reconstruction across three generations of SAP","support":"source-stated"},{"text":"The benchmark uses deterministic grading without an LLM judge.","excerpt":"Grading is deterministic, with no LLM judge.","support":"source-stated"},{"text":"In a two-hour run using DeepSeek v4.1 Flash, OpenCode scored 0.542 and micro-cc 0.528, while Claude Code and Codex each scored 0.00.","excerpt":"OpenCode 0.542, micro-cc 0.528); the two lab harnesses, away from their home model, delivered nothing (0.00 each).","support":"source-stated"},{"text":"The author attributes the weaker results to harnesses failing to keep weak signals active across a long session.","excerpt":"What defeated them was inertia: keeping many weak signals alive across a long session.","support":"source-stated"},{"text":"On Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes.","excerpt":"micro-cc and Claude Code on Claude Opus 5.5 scored 0.9986 and 1.000, in 22 and 25 minutes.","support":"source-stated"},{"text":"Salapa argues that below the frontier, the harness affects how far a model gets, and says a weeks-long engagement could take minutes and a few dollars.","excerpt":"A weeks-long engagement now costs minutes and a few dollars; below the frontier, the harness decides how far a model gets.","support":"source-stated"}],"limitations":["The abstract describes only the first task family, a VAT reconstruction, and does not report how results generalize to other investigative tasks.","The abstract states that a weeks-long engagement costs minutes and a few dollars but does not specify the basis for that comparison or establish it across engagements.","The reported results are for the listed harnesses, models, task, and run durations; the abstract alone does not show how performance changes under other conditions."],"mediaId":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","correctionReason":null,"id":"d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10","publicationId":"2cb147b2-d1d0-4fcf-8fcc-beb6d0d2c66e","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36405","sourceTitle":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:24:36.660Z","createdAt":"2026-11-14T00:01:16.312Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","kind":"article","url":"https://arxiv.org/abs/2610.36405","sourceUrl":"https://arxiv.org/abs/2610.36405","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T21:20:34.129Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36405","checkedAt":"2026-11-14T00:32:10.845Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","confidence":0.9199999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"97e556ecac98fa4476bcf31d37c6000f42177658981ac1647f2655f016c2aa17","decidedAt":"2026-10-30T21:20:46.141Z"},"provenance":{"textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observationId":"d589aeafcc1c0effa6ef79ec1fb4bb9e007970e7d6d4a958a643e3adf1ad6ddd","retrievedAt":"2026-10-30T21:20:33.758Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"800d7e57-fd86-44e1-8dbd-9edc8dc7d40e"},"reviewer":{"model":"gpt-6-luna","runId":"5ccee3d3-d7e1-44fc-86ec-3416f74ca4d9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T00:01:16.312Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Salapa, George Juraj","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Salapa, George Juraj","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Salapa, George Juraj","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36405","locator":"head/meta[name=author|citation_author]"},"assertionId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T00:32:10.845Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea","sourceUrl":"https://arxiv.org/abs/2610.36405","contentSha256":"d78f40578bc55912003e3826d100d820d0f9d2a46908397cf387bbfc2ea48df2","textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observedAt":"2026-11-14T00:32:10.845Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36405","snapshotId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea","contentSha256":"d78f40578bc55912003e3826d100d820d0f9d2a46908397cf387bbfc2ea48df2","textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observedAt":"2026-11-14T00:32:10.845Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10/source"}},"canonicalUrl":"https://escapemeridian.com/readings/kw-bench-breaking-frontier-harnesses-on-real-world-tasks-d0b77c13","formats":{"html":"/readings/kw-bench-breaking-frontier-harnesses-on-real-world-tasks-d0b77c13","markdown":"/readings/kw-bench-breaking-frontier-harnesses-on-real-world-tasks-d0b77c13.md","json":"/readings/kw-bench-breaking-frontier-harnesses-on-real-world-tasks-d0b77c13.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10","revision":"2cb147b2-d1d0-4fcf-8fcc-beb6d0d2c66e","revisionKind":"publication-id","title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","url":"https://escapemeridian.com/readings/kw-bench-breaking-frontier-harnesses-on-real-world-tasks-d0b77c13"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.36405","revision":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","revisionKind":"sha256-source-text","title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","url":"https://arxiv.org/abs/2610.36405"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10","title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","argument":"George Juraj Salapa introduces kw-bench, a benchmark for investigative knowledge work: recovering answers hidden in incomplete, inconsistent records rather than generating a document from a brief. Its first task asks a model working inside a harness—a loop with tools such as a shell and filesystem—to reconstruct VAT across three generations of SAP from raw system extracts. The paper says grading is deterministic, with no LLM judge.\n\nIn the reported two-hour runs, four harnesses used the same model. OpenCode and micro-cc scored 0.542 and 0.528; the two lab harnesses each scored 0.00. Salapa says “inertia”—keeping weak signals alive across a long session—defeated those harnesses. With Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes. Salapa argues that below the frontier, the harness affects how far a model gets, while a frontier model makes this task much easier. He says a weeks-long engagement now costs minutes and a few dollars; the abstract does not establish that result across other engagements. How well would these results hold across other investigative tasks and records?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract describes only the first task family, a VAT reconstruction, and does not report how results generalize to other investigative tasks. The abstract states that a weeks-long engagement costs minutes and a few dollars but does not specify the basis for that comparison or establish it across engagements. The reported results are for the listed harnesses, models, task, and run durations; the abstract alone does not show how performance changes under other conditions.","speaker":{"name":"Salapa, George Juraj","roleAtSource":"Article author"},"source":{"title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36405","publishedAt":"2026-10-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"Salapa presents kw-bench as a benchmark for investigative work, where answers must be recovered from incomplete and inconsistent evidence.","excerpt":"the answer already exists -- hidden in incomplete and inconsistent evidence spread across systems -- and has to be recovered and defended to the cent.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The first task reconstructs five years of VAT across three generations of SAP, using raw system extracts.","excerpt":"Its first task family is a five-year VAT reconstruction across three generations of SAP","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The benchmark uses deterministic grading without an LLM judge.","excerpt":"Grading is deterministic, with no LLM judge.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"In a two-hour run using DeepSeek v4.1 Flash, OpenCode scored 0.542 and micro-cc 0.528, while Claude Code and Codex each scored 0.00.","excerpt":"OpenCode 0.542, micro-cc 0.528); the two lab harnesses, away from their home model, delivered nothing (0.00 each).","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"The author attributes the weaker results to harnesses failing to keep weak signals active across a long session.","excerpt":"What defeated them was inertia: keeping many weak signals alive across a long session.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"On Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes.","excerpt":"micro-cc and Claude Code on Claude Opus 5.5 scored 0.9986 and 1.000, in 22 and 25 minutes.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"},{"text":"Salapa argues that below the frontier, the harness affects how far a model gets, and says a weeks-long engagement could take minutes and a few dollars.","excerpt":"A weeks-long engagement now costs minutes and a few dollars; below the frontier, the harness decides how far a model gets.","url":"https://arxiv.org/abs/2610.36405","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36405","checkedAt":"2026-11-14T00:32:10.845Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would these results hold across other investigative tasks and records?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","summary":"George Juraj Salapa introduces kw-bench, a benchmark for investigative knowledge work: recovering answers hidden in incomplete, inconsistent records rather than generating a document from a brief. Its first task asks a model working inside a harness—a loop with tools such as a shell and filesystem—to reconstruct VAT across three generations of SAP from raw system extracts. The paper says grading is deterministic, with no LLM judge.\n\nIn the reported two-hour runs, four harnesses used the same model. OpenCode and micro-cc scored 0.542 and 0.528; the two lab harnesses each scored 0.00. Salapa says “inertia”—keeping weak signals alive across a long session—defeated those harnesses. With Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes. Salapa argues that below the frontier, the harness affects how far a model gets, while a frontier model makes this task much easier. He says a weeks-long engagement now costs minutes and a few dollars; the abstract does not establish that result across other engagements. How well would these results hold across other investigative tasks and records?","question":"How well would these results hold across other investigative tasks and records?","claims":[{"text":"Salapa presents kw-bench as a benchmark for investigative work, where answers must be recovered from incomplete and inconsistent evidence.","excerpt":"the answer already exists -- hidden in incomplete and inconsistent evidence spread across systems -- and has to be recovered and defended to the cent.","support":"source-stated"},{"text":"The first task reconstructs five years of VAT across three generations of SAP, using raw system extracts.","excerpt":"Its first task family is a five-year VAT reconstruction across three generations of SAP","support":"source-stated"},{"text":"The benchmark uses deterministic grading without an LLM judge.","excerpt":"Grading is deterministic, with no LLM judge.","support":"source-stated"},{"text":"In a two-hour run using DeepSeek v4.1 Flash, OpenCode scored 0.542 and micro-cc 0.528, while Claude Code and Codex each scored 0.00.","excerpt":"OpenCode 0.542, micro-cc 0.528); the two lab harnesses, away from their home model, delivered nothing (0.00 each).","support":"source-stated"},{"text":"The author attributes the weaker results to harnesses failing to keep weak signals active across a long session.","excerpt":"What defeated them was inertia: keeping many weak signals alive across a long session.","support":"source-stated"},{"text":"On Claude Opus 5.5, micro-cc and Claude Code scored 0.9986 and 1.000 in 22 and 25 minutes.","excerpt":"micro-cc and Claude Code on Claude Opus 5.5 scored 0.9986 and 1.000, in 22 and 25 minutes.","support":"source-stated"},{"text":"Salapa argues that below the frontier, the harness affects how far a model gets, and says a weeks-long engagement could take minutes and a few dollars.","excerpt":"A weeks-long engagement now costs minutes and a few dollars; below the frontier, the harness decides how far a model gets.","support":"source-stated"}],"limitations":["The abstract describes only the first task family, a VAT reconstruction, and does not report how results generalize to other investigative tasks.","The abstract states that a weeks-long engagement costs minutes and a few dollars but does not specify the basis for that comparison or establish it across engagements.","The reported results are for the listed harnesses, models, task, and run durations; the abstract alone does not show how performance changes under other conditions."],"mediaId":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","correctionReason":null,"id":"d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10","publicationId":"2cb147b2-d1d0-4fcf-8fcc-beb6d0d2c66e","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36405","sourceTitle":"kw-bench: Breaking Frontier Harnesses on Real-World Tasks","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T08:24:36.660Z","createdAt":"2026-11-14T00:01:16.312Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","kind":"article","url":"https://arxiv.org/abs/2610.36405","sourceUrl":"https://arxiv.org/abs/2610.36405","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T21:20:34.129Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36405","checkedAt":"2026-11-14T00:32:10.845Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8046d94113f2842475de49dc8b5dd6f88eb8119f7651e7906ca0b4f839b0e9ae","confidence":0.9199999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"97e556ecac98fa4476bcf31d37c6000f42177658981ac1647f2655f016c2aa17","decidedAt":"2026-10-30T21:20:46.141Z"},"provenance":{"textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observationId":"d589aeafcc1c0effa6ef79ec1fb4bb9e007970e7d6d4a958a643e3adf1ad6ddd","retrievedAt":"2026-10-30T21:20:33.758Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"800d7e57-fd86-44e1-8dbd-9edc8dc7d40e"},"reviewer":{"model":"gpt-6-luna","runId":"5ccee3d3-d7e1-44fc-86ec-3416f74ca4d9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-14T00:01:16.312Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Salapa, George Juraj","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Salapa, George Juraj","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Salapa, George Juraj","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36405","locator":"head/meta[name=author|citation_author]"},"assertionId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-14T00:32:10.845Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea","sourceUrl":"https://arxiv.org/abs/2610.36405","contentSha256":"d78f40578bc55912003e3826d100d820d0f9d2a46908397cf387bbfc2ea48df2","textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observedAt":"2026-11-14T00:32:10.845Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36405","snapshotId":"edf3a9f7976cd137abce4d951cb71ead235928578d094640a5f6b2f69270e9ea","contentSha256":"d78f40578bc55912003e3826d100d820d0f9d2a46908397cf387bbfc2ea48df2","textHash":"ac5f4ce184531093625e38898c84bdeca15b5e668f3af2d4ae2620b35cb8e9f5","observedAt":"2026-11-14T00:32:10.845Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/d0b77c13d4c3948af2f61f36740f37060bf9c7f008589baa8775c8d60baaab10/source"}}}],"audits":[{"publicationId":"2cb147b2-d1d0-4fcf-8fcc-beb6d0d2c66e","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper is correctly attributed to George Juraj Salapa. The benchmark, the scores and the inertia diagnosis are kept as the author's reported results and claims.","excerpt":"Authors:George Juraj Salapa"},{"dimension":"summary","status":"uncertain","explanation":"The summary softens the author's force and drops a key condition. The source says the harness 'decides' how far a model gets; the draft says it 'affects'. The source says the task 'collapses' on a frontier model; the draft says 'much easier'. The summary never names DeepSeek v4.1 Flash. It also does not say that the zero-scoring lab harnesses were Claude Code and Codex running 'away from their home model'. Without that, a lay reader cannot see that Claude Code scored 0.00 on DeepSeek but 1.000 on Opus. Smallest repair: restore 'decides' and 'collapses', name the model and the two lab harnesses, and add the home-model condition. VAT, SAP and LLM judge may need term tooltips.","excerpt":"the two lab harnesses, away from their home model, delivered nothing (0.00 each)"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-10-26 matches the v1 submission date. The later feed date was correctly not used.","excerpt":"[Submitted on 26 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated with a matching excerpt. The cost claim is attributed to the author and flagged as not established across engagements. The limitations and the question follow from the abstract's single task family and do not invent benefits or costs.","excerpt":"A weeks-long engagement now costs minutes and a few dollars; below the frontier, the harness decides how far a model gets."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page, which is the source itself.","excerpt":null}],"createdAt":"2026-11-14T00:01:16.312Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}