{"id":"3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0","title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","argument":"Liang Yue and Eric A. Vance report that in 814 RL runs teaching 7-8B models to answer closed-book questions or abstain, an LLM judge’s influence depended on what its verdicts expressed. A rewarded wrong answer could be memorised for that question, but the judge’s knowledge of individual answers did not improve the model’s choices on new questions over a baseline that sampled 32 answers and abstained when they disagreed. By contrast, a judge’s pattern of rejecting correct answers about a category could travel: the authors say rejecting eleven of twelve correct training answers about capitals of former states led the model to refuse 98% of such new questions. They report that changing those twelve verdicts by hand shifted refusal from 5% to 90%, even when the judge accepted as many answers as the answer key. The model still answered 94% correctly when abstention was blocked, which the authors take to indicate the capitals were not forgotten. Their proposed alternative needs neither labels nor a judge: reward answers that most of the model’s own untrained samples agree on. The abstract says this earns the answer key’s reward and keeps the category, highlighting a distinction between transferring answer knowledge and transferring a tendency to refuse a kind of question.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract, not its full methods or results; it does not provide enough detail here to assess the experimental setup or the breadth of the findings.","speaker":{"name":"Yue, Liang, Vance, Eric A.","roleAtSource":"Article author"},"source":{"title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25191","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors report 814 RL runs teaching 7-8B models to answer closed-book questions or abstain.","excerpt":"In 814 RL runs that teach 7-8B models to answer closed-book questions or abstain, we ask what passes.","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"The authors say knowledge about single answers did not improve choices on new questions over sampling 32 answers and abstaining when they disagreed.","excerpt":"A model trained with the answer key, or with a far stronger judge, chooses which new questions to answer no better than the untrained model does by sampling 32 answers and abstaining where they disagree","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"They report that rejecting eleven of twelve correct training answers about former-state capitals led to refusals on 98% of new questions of that kind.","excerpt":"A judge that rejects eleven of the twelve correct training answers about capitals of former states teaches the model to refuse 98% of such capitals on new questions","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"The authors propose rewarding answers that most of the model’s own untrained samples agree on, without labels or a judge.","excerpt":"rewarding the model for giving the answer that most of its own untrained samples agree on, with no labels and no judge, earns the answer key's reward and keeps the category.","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25191","checkedAt":"2026-11-20T22:20:10.460Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How broadly do the reported results hold beyond 7-8B models trained on closed-book questions or abstention?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","summary":"Liang Yue and Eric A. Vance report that in 814 RL runs teaching 7-8B models to answer closed-book questions or abstain, an LLM judge’s influence depended on what its verdicts expressed. A rewarded wrong answer could be memorised for that question, but the judge’s knowledge of individual answers did not improve the model’s choices on new questions over a baseline that sampled 32 answers and abstained when they disagreed. By contrast, a judge’s pattern of rejecting correct answers about a category could travel: the authors say rejecting eleven of twelve correct training answers about capitals of former states led the model to refuse 98% of such new questions. They report that changing those twelve verdicts by hand shifted refusal from 5% to 90%, even when the judge accepted as many answers as the answer key. The model still answered 94% correctly when abstention was blocked, which the authors take to indicate the capitals were not forgotten. Their proposed alternative needs neither labels nor a judge: reward answers that most of the model’s own untrained samples agree on. The abstract says this earns the answer key’s reward and keeps the category, highlighting a distinction between transferring answer knowledge and transferring a tendency to refuse a kind of question.","question":"How broadly do the reported results hold beyond 7-8B models trained on closed-book questions or abstention?","claims":[{"text":"The authors report 814 RL runs teaching 7-8B models to answer closed-book questions or abstain.","excerpt":"In 814 RL runs that teach 7-8B models to answer closed-book questions or abstain, we ask what passes.","support":"source-stated"},{"text":"The authors say knowledge about single answers did not improve choices on new questions over sampling 32 answers and abstaining when they disagreed.","excerpt":"A model trained with the answer key, or with a far stronger judge, chooses which new questions to answer no better than the untrained model does by sampling 32 answers and abstaining where they disagree","support":"source-stated"},{"text":"They report that rejecting eleven of twelve correct training answers about former-state capitals led to refusals on 98% of new questions of that kind.","excerpt":"A judge that rejects eleven of the twelve correct training answers about capitals of former states teaches the model to refuse 98% of such capitals on new questions","support":"source-stated"},{"text":"The authors propose rewarding answers that most of the model’s own untrained samples agree on, without labels or a judge.","excerpt":"rewarding the model for giving the answer that most of its own untrained samples agree on, with no labels and no judge, earns the answer key's reward and keeps the category.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract, not its full methods or results; it does not provide enough detail here to assess the experimental setup or the breadth of the findings."],"mediaId":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","correctionReason":null,"id":"3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0","publicationId":"bcd15748-cfad-4ce2-8f72-b3486442212a","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25191","sourceTitle":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:34.695Z","createdAt":"2026-11-20T05:16:34.052Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","kind":"article","url":"https://arxiv.org/abs/2611.25191","sourceUrl":"https://arxiv.org/abs/2611.25191","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T05:02:30.493Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25191","checkedAt":"2026-11-20T22:20:10.460Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"18bafcb29fdeb15a97ea32faebcd30cf038c9cc4c7c231f804f067c946d94b26","decidedAt":"2026-11-20T05:02:31.394Z"},"provenance":{"textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observationId":"3f673eef44f9c5320e7a30fc0a252c71868d79ded43cffe0a17ef07bcdb13e0e","retrievedAt":"2026-11-20T05:02:30.364Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fcd6a831-0cdb-4874-8908-f3dbd6f69e05"},"reviewer":{"model":"gpt-6-luna","runId":"af8ca911-ad66-4e8f-87ec-4afb180fba2d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:16:34.052Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yue, Liang","url":null,"kind":"unknown"},{"name":"Vance, Eric A.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yue, Liang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yue, Liang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25191","locator":"head/meta[name=author|citation_author]"},"assertionId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:20:10.460Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","sourceUrl":"https://arxiv.org/abs/2611.25191","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z"}},{"actor":{"name":"Vance, Eric A.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Vance, Eric A.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25191","locator":"head/meta[name=author|citation_author]"},"assertionId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:20:10.460Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","sourceUrl":"https://arxiv.org/abs/2611.25191","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25191","snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0/source"}},"canonicalUrl":"https://escapemeridian.com/readings/blind-spots-travel-knowledge-stays-home-what-rl-inherits-from-3f4d12d5","formats":{"html":"/readings/blind-spots-travel-knowledge-stays-home-what-rl-inherits-from-3f4d12d5","markdown":"/readings/blind-spots-travel-knowledge-stays-home-what-rl-inherits-from-3f4d12d5.md","json":"/readings/blind-spots-travel-knowledge-stays-home-what-rl-inherits-from-3f4d12d5.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0","revision":"bcd15748-cfad-4ce2-8f72-b3486442212a","revisionKind":"publication-id","title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","url":"https://escapemeridian.com/readings/blind-spots-travel-knowledge-stays-home-what-rl-inherits-from-3f4d12d5"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.25191","revision":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","revisionKind":"sha256-source-text","title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","url":"https://arxiv.org/abs/2611.25191"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0","title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","argument":"Liang Yue and Eric A. Vance report that in 814 RL runs teaching 7-8B models to answer closed-book questions or abstain, an LLM judge’s influence depended on what its verdicts expressed. A rewarded wrong answer could be memorised for that question, but the judge’s knowledge of individual answers did not improve the model’s choices on new questions over a baseline that sampled 32 answers and abstained when they disagreed. By contrast, a judge’s pattern of rejecting correct answers about a category could travel: the authors say rejecting eleven of twelve correct training answers about capitals of former states led the model to refuse 98% of such new questions. They report that changing those twelve verdicts by hand shifted refusal from 5% to 90%, even when the judge accepted as many answers as the answer key. The model still answered 94% correctly when abstention was blocked, which the authors take to indicate the capitals were not forgotten. Their proposed alternative needs neither labels nor a judge: reward answers that most of the model’s own untrained samples agree on. The abstract says this earns the answer key’s reward and keeps the category, highlighting a distinction between transferring answer knowledge and transferring a tendency to refuse a kind of question.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract, not its full methods or results; it does not provide enough detail here to assess the experimental setup or the breadth of the findings.","speaker":{"name":"Yue, Liang, Vance, Eric A.","roleAtSource":"Article author"},"source":{"title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25191","publishedAt":"2026-11-18","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors report 814 RL runs teaching 7-8B models to answer closed-book questions or abstain.","excerpt":"In 814 RL runs that teach 7-8B models to answer closed-book questions or abstain, we ask what passes.","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"The authors say knowledge about single answers did not improve choices on new questions over sampling 32 answers and abstaining when they disagreed.","excerpt":"A model trained with the answer key, or with a far stronger judge, chooses which new questions to answer no better than the untrained model does by sampling 32 answers and abstaining where they disagree","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"They report that rejecting eleven of twelve correct training answers about former-state capitals led to refusals on 98% of new questions of that kind.","excerpt":"A judge that rejects eleven of the twelve correct training answers about capitals of former states teaches the model to refuse 98% of such capitals on new questions","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"},{"text":"The authors propose rewarding answers that most of the model’s own untrained samples agree on, without labels or a judge.","excerpt":"rewarding the model for giving the answer that most of its own untrained samples agree on, with no labels and no judge, earns the answer key's reward and keeps the category.","url":"https://arxiv.org/abs/2611.25191","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25191","checkedAt":"2026-11-20T22:20:10.460Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How broadly do the reported results hold beyond 7-8B models trained on closed-book questions or abstention?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","summary":"Liang Yue and Eric A. Vance report that in 814 RL runs teaching 7-8B models to answer closed-book questions or abstain, an LLM judge’s influence depended on what its verdicts expressed. A rewarded wrong answer could be memorised for that question, but the judge’s knowledge of individual answers did not improve the model’s choices on new questions over a baseline that sampled 32 answers and abstained when they disagreed. By contrast, a judge’s pattern of rejecting correct answers about a category could travel: the authors say rejecting eleven of twelve correct training answers about capitals of former states led the model to refuse 98% of such new questions. They report that changing those twelve verdicts by hand shifted refusal from 5% to 90%, even when the judge accepted as many answers as the answer key. The model still answered 94% correctly when abstention was blocked, which the authors take to indicate the capitals were not forgotten. Their proposed alternative needs neither labels nor a judge: reward answers that most of the model’s own untrained samples agree on. The abstract says this earns the answer key’s reward and keeps the category, highlighting a distinction between transferring answer knowledge and transferring a tendency to refuse a kind of question.","question":"How broadly do the reported results hold beyond 7-8B models trained on closed-book questions or abstention?","claims":[{"text":"The authors report 814 RL runs teaching 7-8B models to answer closed-book questions or abstain.","excerpt":"In 814 RL runs that teach 7-8B models to answer closed-book questions or abstain, we ask what passes.","support":"source-stated"},{"text":"The authors say knowledge about single answers did not improve choices on new questions over sampling 32 answers and abstaining when they disagreed.","excerpt":"A model trained with the answer key, or with a far stronger judge, chooses which new questions to answer no better than the untrained model does by sampling 32 answers and abstaining where they disagree","support":"source-stated"},{"text":"They report that rejecting eleven of twelve correct training answers about former-state capitals led to refusals on 98% of new questions of that kind.","excerpt":"A judge that rejects eleven of the twelve correct training answers about capitals of former states teaches the model to refuse 98% of such capitals on new questions","support":"source-stated"},{"text":"The authors propose rewarding answers that most of the model’s own untrained samples agree on, without labels or a judge.","excerpt":"rewarding the model for giving the answer that most of its own untrained samples agree on, with no labels and no judge, earns the answer key's reward and keeps the category.","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract, not its full methods or results; it does not provide enough detail here to assess the experimental setup or the breadth of the findings."],"mediaId":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","correctionReason":null,"id":"3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0","publicationId":"bcd15748-cfad-4ce2-8f72-b3486442212a","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25191","sourceTitle":"Blind Spots Travel, Knowledge Stays Home: What RL Inherits from an LLM Judge","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-18","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:34.695Z","createdAt":"2026-11-20T05:16:34.052Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","kind":"article","url":"https://arxiv.org/abs/2611.25191","sourceUrl":"https://arxiv.org/abs/2611.25191","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T05:02:30.493Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25191","checkedAt":"2026-11-20T22:20:10.460Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d40cd77e12b3daaa96fb59a366d413e8cf7974ff806e075c89bbb2bb99a0887a","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"18bafcb29fdeb15a97ea32faebcd30cf038c9cc4c7c231f804f067c946d94b26","decidedAt":"2026-11-20T05:02:31.394Z"},"provenance":{"textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observationId":"3f673eef44f9c5320e7a30fc0a252c71868d79ded43cffe0a17ef07bcdb13e0e","retrievedAt":"2026-11-20T05:02:30.364Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fcd6a831-0cdb-4874-8908-f3dbd6f69e05"},"reviewer":{"model":"gpt-6-luna","runId":"af8ca911-ad66-4e8f-87ec-4afb180fba2d"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:16:34.052Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yue, Liang","url":null,"kind":"unknown"},{"name":"Vance, Eric A.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yue, Liang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yue, Liang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25191","locator":"head/meta[name=author|citation_author]"},"assertionId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:20:10.460Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","sourceUrl":"https://arxiv.org/abs/2611.25191","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z"}},{"actor":{"name":"Vance, Eric A.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Vance, Eric A.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25191","locator":"head/meta[name=author|citation_author]"},"assertionId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-20T22:20:10.460Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","sourceUrl":"https://arxiv.org/abs/2611.25191","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25191","snapshotId":"7121d3cbb8ccdecffd9a47f19b955f70b206071680d26ccd70460b94a3e545a0","contentSha256":"7664ed571fb9713f30ee308a2ba8f5565394f38d08d20bd0dfc4a567ad36b75f","textHash":"dbb0938c6e1ebd63d328a443c4c8a014a138fc5c2103aba3662d81123364ecf2","observedAt":"2026-11-20T22:20:10.460Z","basis":"publisher-page-metadata","sourceLinks":42,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3f4d12d5b5f30c952a69921b31676c4264ce176cf30548e99d003ad8e838b4d0/source"}}}],"audits":[{"publicationId":"bcd15748-cfad-4ce2-8f72-b3486442212a","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the work to the paper's listed authors, Liang Yue and Eric A. Vance, and keeps the findings framed as their report ('report', 'the authors say', 'the abstract says').","excerpt":"Authors:Liang Yue, Eric A. Vance"},{"dimension":"summary","status":"uncertain","explanation":"Central terms are not explained for a general reader: 'RL', '7-8B models' and 'LLM judge' appear without plain-language glosses. The draft also omits the abstract's premise that an LLM judge is an AI grader used as the reward when no answer key exists. It drops the authors' key stake that this category loss is one 'accuracy and abstention rates do not reveal'. It also omits that two of four judges at answer-key leniency already cost 38-42% of these capitals. Smallest repair: add the premise sentence, gloss the terms (or add term tooltips), and restore the hidden-loss point.","excerpt":"LLM judges serve as rewards where no answer key exists, in the hope that their knowledge passes to the trained model."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-18 matches the arXiv v1 submission date. The feed date of 2026-11-20 is correctly not used.","excerpt":"[Submitted on 18 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract and is attributed. One wording is slightly firmer than the source. 'did not improve the model's choices' could note the abstract's figure that grader knowledge adds about one corrected answer per hundred questions, but this does not contradict the 'no better' finding. Hedging 'could be memorised' is softer than the source but not misleading. The question and limitation follow from the evidence without unsupported impacts.","excerpt":"the grader's knowledge adds about one corrected answer per hundred questions"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-20T05:16:34.052Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}