{"id":"44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34","title":"arXiv cs.AI paper: Banking-rule compliance changes with the model’s harness","argument":"Mehmet Murat Huyut argues that banks should validate the deployed model-harness pair, not a language model in isolation. In a simulated retail bank, the study held each of four open-weight models fixed while running it through five harnesses: systems that shape what a model sees, which tools it can use, and who checks its actions. Across 3,120 two-turn episodes, pooled correct-case rates shifted only from 87.3% to 92.1%, yet one model’s best-to-worst harness spread was 11.5 percentage points, enough to move it from first to last among the four; another showed no detectable difference. A same-model compliance reviewer reduced violations from 9.6% to 6.4% without increasing over-refusals, contrary to the pre-registered prediction. Rules requiring date arithmetic failed in every harness. In an exploratory analysis, 26% of violations included a customer message denying an action the agent had already executed; the authors say transcript-only review would record these as correct refusals. Their conclusion is to validate the model-harness pair and check the action log, not just the conversation. The study used simulated cases, and its model x harness interaction was suggestive rather than conclusive.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The cases were run in a simulated retail bank, not a live banking deployment. The authors describe the model x harness interaction as suggestive rather than conclusive. The finding about violations paired with customer messages came from an exploratory analysis using two LLM judges and a blind human check.","speaker":{"name":"Huyut, Mehmet Murat","roleAtSource":"Article author"},"source":{"title":"The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06116","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"Huyut argues that model-risk management should validate the model-harness pair, because a harness can change a fixed model’s compliance with banking conduct rules.","excerpt":"For model-risk management the unit of validation should be the model-harness pair","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The study tested four open-weight models in five harnesses on 156 pre-registered cases in a simulated retail bank.","excerpt":"Four open-weight models each ran five harnesses","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"Across models, correct-case rates varied from 87.3% to 92.1%; the harness effect differed by model, including an 11.5 percentage-point spread for one model and no detectable difference for another.","excerpt":"for one model the spread between its best and worst harness was 11.5 percentage points","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"A same-model compliance reviewer reduced violations without raising over-refusals, contrary to the pre-registered prediction.","excerpt":"The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The authors report that transcript-only review would classify some violations as correct refusals when the customer message denied an action the agent had already executed.","excerpt":"26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The authors recommend reading the action log, not only the conversation, when testing conduct.","excerpt":"conduct testing should read the action log, not the conversation.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06116","checkedAt":"2026-11-09T11:48:12.090Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the differences between harnesses persist in tests beyond the 156 pre-registered simulated-bank cases?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: Banking-rule compliance changes with the model’s harness","summary":"Mehmet Murat Huyut argues that banks should validate the deployed model-harness pair, not a language model in isolation. In a simulated retail bank, the study held each of four open-weight models fixed while running it through five harnesses: systems that shape what a model sees, which tools it can use, and who checks its actions. Across 3,120 two-turn episodes, pooled correct-case rates shifted only from 87.3% to 92.1%, yet one model’s best-to-worst harness spread was 11.5 percentage points, enough to move it from first to last among the four; another showed no detectable difference. A same-model compliance reviewer reduced violations from 9.6% to 6.4% without increasing over-refusals, contrary to the pre-registered prediction. Rules requiring date arithmetic failed in every harness. In an exploratory analysis, 26% of violations included a customer message denying an action the agent had already executed; the authors say transcript-only review would record these as correct refusals. Their conclusion is to validate the model-harness pair and check the action log, not just the conversation. The study used simulated cases, and its model x harness interaction was suggestive rather than conclusive.","question":"Would the differences between harnesses persist in tests beyond the 156 pre-registered simulated-bank cases?","claims":[{"text":"Huyut argues that model-risk management should validate the model-harness pair, because a harness can change a fixed model’s compliance with banking conduct rules.","excerpt":"For model-risk management the unit of validation should be the model-harness pair","support":"source-stated"},{"text":"The study tested four open-weight models in five harnesses on 156 pre-registered cases in a simulated retail bank.","excerpt":"Four open-weight models each ran five harnesses","support":"source-stated"},{"text":"Across models, correct-case rates varied from 87.3% to 92.1%; the harness effect differed by model, including an 11.5 percentage-point spread for one model and no detectable difference for another.","excerpt":"for one model the spread between its best and worst harness was 11.5 percentage points","support":"source-stated"},{"text":"A same-model compliance reviewer reduced violations without raising over-refusals, contrary to the pre-registered prediction.","excerpt":"The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction.","support":"source-stated"},{"text":"The authors report that transcript-only review would classify some violations as correct refusals when the customer message denied an action the agent had already executed.","excerpt":"26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal.","support":"source-stated"},{"text":"The authors recommend reading the action log, not only the conversation, when testing conduct.","excerpt":"conduct testing should read the action log, not the conversation.","support":"source-stated"}],"limitations":["The cases were run in a simulated retail bank, not a live banking deployment.","The authors describe the model x harness interaction as suggestive rather than conclusive.","The finding about violations paired with customer messages came from an exploratory analysis using two LLM judges and a blind human check."],"mediaId":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","correctionReason":null,"id":"44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34","publicationId":"4a747d79-52b4-4ac1-805f-283859851db5","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06116","sourceTitle":"The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:00:36.084Z","createdAt":"2026-11-09T11:16:59.634Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","kind":"article","url":"https://arxiv.org/abs/2611.06116","sourceUrl":"https://arxiv.org/abs/2611.06116","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T11:10:00.317Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06116","checkedAt":"2026-11-09T11:48:12.090Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","confidence":0.9299999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0d0959bc71e5f0a0f7f5579522f43e842825221dc2cc0ed0cbc0a120dd4fc9d5","decidedAt":"2026-11-09T11:10:01.791Z"},"provenance":{"textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observationId":"3d31a6f152c44c1663301bc15a9d369e8b4628b29fab7d05358165770b37a578","retrievedAt":"2026-11-09T11:10:00.066Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"d0d31424-1c7d-4cef-87a3-795bb5ade9d2"},"reviewer":{"model":"gpt-6-luna","runId":"0b554217-cd49-439d-8b9e-cfce2f0d12c5"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T11:16:59.634Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Huyut, Mehmet Murat","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Huyut, Mehmet Murat","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huyut, Mehmet Murat","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06116","locator":"head/meta[name=author|citation_author]"},"assertionId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T11:48:12.090Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5","sourceUrl":"https://arxiv.org/abs/2611.06116","contentSha256":"a69b89cd4cc5056829e121c5d19b2828e279ff992e4a159e555ecd581826f2bb","textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observedAt":"2026-11-09T11:48:12.090Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06116","snapshotId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5","contentSha256":"a69b89cd4cc5056829e121c5d19b2828e279ff992e4a159e555ecd581826f2bb","textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observedAt":"2026-11-09T11:48:12.090Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-banking-rule-compliance-changes-with-the-44c090be","formats":{"html":"/readings/arxiv-cs-ai-paper-banking-rule-compliance-changes-with-the-44c090be","markdown":"/readings/arxiv-cs-ai-paper-banking-rule-compliance-changes-with-the-44c090be.md","json":"/readings/arxiv-cs-ai-paper-banking-rule-compliance-changes-with-the-44c090be.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-open-weights","name":"Open weights","explanation":"A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.","referenceUrl":"https://opensource.org/ai/open-weights"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34","revision":"4a747d79-52b4-4ac1-805f-283859851db5","revisionKind":"publication-id","title":"arXiv cs.AI paper: Banking-rule compliance changes with the model’s harness","url":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-banking-rule-compliance-changes-with-the-44c090be"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.06116","revision":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","revisionKind":"sha256-source-text","title":"The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models","url":"https://arxiv.org/abs/2611.06116"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34","title":"arXiv cs.AI paper: Banking-rule compliance changes with the model’s harness","argument":"Mehmet Murat Huyut argues that banks should validate the deployed model-harness pair, not a language model in isolation. In a simulated retail bank, the study held each of four open-weight models fixed while running it through five harnesses: systems that shape what a model sees, which tools it can use, and who checks its actions. Across 3,120 two-turn episodes, pooled correct-case rates shifted only from 87.3% to 92.1%, yet one model’s best-to-worst harness spread was 11.5 percentage points, enough to move it from first to last among the four; another showed no detectable difference. A same-model compliance reviewer reduced violations from 9.6% to 6.4% without increasing over-refusals, contrary to the pre-registered prediction. Rules requiring date arithmetic failed in every harness. In an exploratory analysis, 26% of violations included a customer message denying an action the agent had already executed; the authors say transcript-only review would record these as correct refusals. Their conclusion is to validate the model-harness pair and check the action log, not just the conversation. The study used simulated cases, and its model x harness interaction was suggestive rather than conclusive.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The cases were run in a simulated retail bank, not a live banking deployment. The authors describe the model x harness interaction as suggestive rather than conclusive. The finding about violations paired with customer messages came from an exploratory analysis using two LLM judges and a blind human check.","speaker":{"name":"Huyut, Mehmet Murat","roleAtSource":"Article author"},"source":{"title":"The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.06116","publishedAt":"2026-11-04","dateBasis":"Date basis not provided."},"evidence":[{"text":"Huyut argues that model-risk management should validate the model-harness pair, because a harness can change a fixed model’s compliance with banking conduct rules.","excerpt":"For model-risk management the unit of validation should be the model-harness pair","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The study tested four open-weight models in five harnesses on 156 pre-registered cases in a simulated retail bank.","excerpt":"Four open-weight models each ran five harnesses","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"Across models, correct-case rates varied from 87.3% to 92.1%; the harness effect differed by model, including an 11.5 percentage-point spread for one model and no detectable difference for another.","excerpt":"for one model the spread between its best and worst harness was 11.5 percentage points","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"A same-model compliance reviewer reduced violations without raising over-refusals, contrary to the pre-registered prediction.","excerpt":"The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The authors report that transcript-only review would classify some violations as correct refusals when the customer message denied an action the agent had already executed.","excerpt":"26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"},{"text":"The authors recommend reading the action log, not only the conversation, when testing conduct.","excerpt":"conduct testing should read the action log, not the conversation.","url":"https://arxiv.org/abs/2611.06116","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06116","checkedAt":"2026-11-09T11:48:12.090Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the differences between harnesses persist in tests beyond the 156 pre-registered simulated-bank cases?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper: Banking-rule compliance changes with the model’s harness","summary":"Mehmet Murat Huyut argues that banks should validate the deployed model-harness pair, not a language model in isolation. In a simulated retail bank, the study held each of four open-weight models fixed while running it through five harnesses: systems that shape what a model sees, which tools it can use, and who checks its actions. Across 3,120 two-turn episodes, pooled correct-case rates shifted only from 87.3% to 92.1%, yet one model’s best-to-worst harness spread was 11.5 percentage points, enough to move it from first to last among the four; another showed no detectable difference. A same-model compliance reviewer reduced violations from 9.6% to 6.4% without increasing over-refusals, contrary to the pre-registered prediction. Rules requiring date arithmetic failed in every harness. In an exploratory analysis, 26% of violations included a customer message denying an action the agent had already executed; the authors say transcript-only review would record these as correct refusals. Their conclusion is to validate the model-harness pair and check the action log, not just the conversation. The study used simulated cases, and its model x harness interaction was suggestive rather than conclusive.","question":"Would the differences between harnesses persist in tests beyond the 156 pre-registered simulated-bank cases?","claims":[{"text":"Huyut argues that model-risk management should validate the model-harness pair, because a harness can change a fixed model’s compliance with banking conduct rules.","excerpt":"For model-risk management the unit of validation should be the model-harness pair","support":"source-stated"},{"text":"The study tested four open-weight models in five harnesses on 156 pre-registered cases in a simulated retail bank.","excerpt":"Four open-weight models each ran five harnesses","support":"source-stated"},{"text":"Across models, correct-case rates varied from 87.3% to 92.1%; the harness effect differed by model, including an 11.5 percentage-point spread for one model and no detectable difference for another.","excerpt":"for one model the spread between its best and worst harness was 11.5 percentage points","support":"source-stated"},{"text":"A same-model compliance reviewer reduced violations without raising over-refusals, contrary to the pre-registered prediction.","excerpt":"The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction.","support":"source-stated"},{"text":"The authors report that transcript-only review would classify some violations as correct refusals when the customer message denied an action the agent had already executed.","excerpt":"26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal.","support":"source-stated"},{"text":"The authors recommend reading the action log, not only the conversation, when testing conduct.","excerpt":"conduct testing should read the action log, not the conversation.","support":"source-stated"}],"limitations":["The cases were run in a simulated retail bank, not a live banking deployment.","The authors describe the model x harness interaction as suggestive rather than conclusive.","The finding about violations paired with customer messages came from an exploratory analysis using two LLM judges and a blind human check."],"mediaId":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","correctionReason":null,"id":"44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34","publicationId":"4a747d79-52b4-4ac1-805f-283859851db5","version":1,"sourceUrl":"https://arxiv.org/abs/2611.06116","sourceTitle":"The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-04","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:00:36.084Z","createdAt":"2026-11-09T11:16:59.634Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","kind":"article","url":"https://arxiv.org/abs/2611.06116","sourceUrl":"https://arxiv.org/abs/2611.06116","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T11:10:00.317Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.06116","checkedAt":"2026-11-09T11:48:12.090Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"272bc49191535e93d610f6d9ebc9eda78cba143ae0b127ec9f97b86040431b73","confidence":0.9299999999999999,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0d0959bc71e5f0a0f7f5579522f43e842825221dc2cc0ed0cbc0a120dd4fc9d5","decidedAt":"2026-11-09T11:10:01.791Z"},"provenance":{"textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observationId":"3d31a6f152c44c1663301bc15a9d369e8b4628b29fab7d05358165770b37a578","retrievedAt":"2026-11-09T11:10:00.066Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"d0d31424-1c7d-4cef-87a3-795bb5ade9d2"},"reviewer":{"model":"gpt-6-luna","runId":"0b554217-cd49-439d-8b9e-cfce2f0d12c5"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T11:16:59.634Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Huyut, Mehmet Murat","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Huyut, Mehmet Murat","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Huyut, Mehmet Murat","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.06116","locator":"head/meta[name=author|citation_author]"},"assertionId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T11:48:12.090Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5","sourceUrl":"https://arxiv.org/abs/2611.06116","contentSha256":"a69b89cd4cc5056829e121c5d19b2828e279ff992e4a159e555ecd581826f2bb","textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observedAt":"2026-11-09T11:48:12.090Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.06116","snapshotId":"e886d987ec9b9e7ea4f32a36d0532fac68680e2ef570d8098ffe7b53552507f5","contentSha256":"a69b89cd4cc5056829e121c5d19b2828e279ff992e4a159e555ecd581826f2bb","textHash":"120fde8eee871743e71bbd3300f8755167539d5f9a247c7193eee5a55cef07f5","observedAt":"2026-11-09T11:48:12.090Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/44c090be81825487a4bb206c8dcfe67e7762fdd5e700e4076dd41810be4f0b34/source"}}}],"audits":[{"publicationId":"4a747d79-52b4-4ac1-805f-283859851db5","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper is correctly attributed to Mehmet Murat Huyut on arXiv. The draft's switch to 'the authors' is a minor plural slip for a single author, but every claim remains attributed to the paper rather than presented as an established fact.","excerpt":"Authors:Mehmet Murat Huyut"},{"dimension":"summary","status":"pass","explanation":"The summary leads with the author's argument and explains 'harness' in plain terms. It reports the key numbers, the reviewer result, the date-arithmetic failure, and the denial finding faithfully. Terms such as over-refusals and pre-registered are left unexplained but are not central blockers, so tooltips would help. The question follows from the evidence without being leading.","excerpt":"Banks validate language models, but they deploy systems: a model inside a harness that decides what it sees, which tools it can call and who checks its actions."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-04 matches the v1 submission date. The feed date of Nov 5 is later and correctly not used.","excerpt":"[Submitted on 4 Nov 2026]"},{"dimension":"support","status":"uncertain","explanation":"Most claims are verbatim-supported. Two passages soften or blur the source. First, the source says conduct testing 'should read the action log, not the conversation', but the summary says 'not just the conversation' and the claim says 'not only'. That weakens the author's stance; the smallest fix is to drop 'just' and 'only'. Second, the claim 'Across models, correct-case rates varied from 87.3% to 92.1%' could be read as variation between models. The source describes the harness moving the pooled rate; repair it to 'Pooled across models, the harness moved...'.","excerpt":"conduct testing should read the action log, not the conversation."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-09T11:16:59.634Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}