{"id":"72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c","title":"arXiv: Ordinal Credit Assignment: Learning from comparisons, with a judge’s limits","argument":"Hao Yu’s paper studies multi-step reinforcement learning using comparisons between outcomes rather than a reward function or reward model. It proposes crediting each action by how its reward-to-go compares with other trajectories still running at the same time step. In deterministic environments, the expected update ranks actions by true value; with stochastic outcomes, it favors actions that win more often, not necessarily those with higher mean. In a pre-registered study, comparisons cost no detectable performance relative to scalar returns at the same granularity, and learning a reward model from those comparisons did not do better. With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores. But when training with an LLM judge on a requirement omitted by a hand-written reward, policies satisfied the requirement in all five seeds while landing far less often than with oracle comparisons. The paper attributes that gap to the judge being near chance on near-tied failures that dominate early training. The abstract also reports that comparisons do not close the gap to PPO with scalar rewards on HalfCheetah. These results make the judge’s ability to distinguish close outcomes central to whether comparison-based training works in the reported setting.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract, so it does not provide the full experimental setup or detail behind the reported results. The reported study covers six environments with ten seeds per claim; the LLM-judge training result covers five seeds. The abstract reports that the judge is near chance on near-tied failures, but does not establish whether improving that accuracy would reduce the performance gap.","speaker":{"name":"Yu, Hao","roleAtSource":"Article author"},"source":{"title":"Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2605.06375","publishedAt":"2026-05-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The paper studies multi-step reinforcement learning from comparisons, without a reward function or reward model.","excerpt":"We study reinforcement learning that receives only such comparisons - no reward function, no reward model - in multi-step tasks.","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"Its proposed update credits actions by comparing reward-to-go against other trajectories still running at that time step.","excerpt":"each action is credited by how its reward-to-go compares with those of other trajectories at the same time step","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"The paper says the update ranks actions by true value in deterministic environments, but in stochastic outcomes favors actions that win more often over those with higher mean.","excerpt":"under stochastic outcomes it prefers actions that win more often rather than those with higher mean","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"In the reported study, comparisons had no detectable performance cost relative to scalar returns at the same granularity, and learning a reward model from those comparisons was not better.","excerpt":"comparisons cost no detectable performance relative to scalar returns at the same granularity, learning a reward model from the same comparisons is not better","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores.","excerpt":"With real LLM judges, comparisons are 7-10 points more accurate than pointwise scores","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"In training on a requirement omitted by the hand-written reward, policies satisfied it in all five seeds but landed far less often than with oracle comparisons; the paper attributes the gap to the judge’s poor performance on near-tied failures.","excerpt":"policies satisfy it in all five seeds but land far less often than with oracle comparisons, because the judge is near chance on the near-tied failures dominating early training","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"The paper says comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","excerpt":"Comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.06375","checkedAt":"2026-11-09T12:50:08.032Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would a judge that is more accurate on near-tied failures reduce the gap between LLM-judge and oracle-comparison training?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Ordinal Credit Assignment: Learning from comparisons, with a judge’s limits","summary":"Hao Yu’s paper studies multi-step reinforcement learning using comparisons between outcomes rather than a reward function or reward model. It proposes crediting each action by how its reward-to-go compares with other trajectories still running at the same time step. In deterministic environments, the expected update ranks actions by true value; with stochastic outcomes, it favors actions that win more often, not necessarily those with higher mean. In a pre-registered study, comparisons cost no detectable performance relative to scalar returns at the same granularity, and learning a reward model from those comparisons did not do better. With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores. But when training with an LLM judge on a requirement omitted by a hand-written reward, policies satisfied the requirement in all five seeds while landing far less often than with oracle comparisons. The paper attributes that gap to the judge being near chance on near-tied failures that dominate early training. The abstract also reports that comparisons do not close the gap to PPO with scalar rewards on HalfCheetah. These results make the judge’s ability to distinguish close outcomes central to whether comparison-based training works in the reported setting.","question":"Would a judge that is more accurate on near-tied failures reduce the gap between LLM-judge and oracle-comparison training?","claims":[{"text":"The paper studies multi-step reinforcement learning from comparisons, without a reward function or reward model.","excerpt":"We study reinforcement learning that receives only such comparisons - no reward function, no reward model - in multi-step tasks.","support":"source-stated"},{"text":"Its proposed update credits actions by comparing reward-to-go against other trajectories still running at that time step.","excerpt":"each action is credited by how its reward-to-go compares with those of other trajectories at the same time step","support":"source-stated"},{"text":"The paper says the update ranks actions by true value in deterministic environments, but in stochastic outcomes favors actions that win more often over those with higher mean.","excerpt":"under stochastic outcomes it prefers actions that win more often rather than those with higher mean","support":"source-stated"},{"text":"In the reported study, comparisons had no detectable performance cost relative to scalar returns at the same granularity, and learning a reward model from those comparisons was not better.","excerpt":"comparisons cost no detectable performance relative to scalar returns at the same granularity, learning a reward model from the same comparisons is not better","support":"source-stated"},{"text":"With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores.","excerpt":"With real LLM judges, comparisons are 7-10 points more accurate than pointwise scores","support":"source-stated"},{"text":"In training on a requirement omitted by the hand-written reward, policies satisfied it in all five seeds but landed far less often than with oracle comparisons; the paper attributes the gap to the judge’s poor performance on near-tied failures.","excerpt":"policies satisfy it in all five seeds but land far less often than with oracle comparisons, because the judge is near chance on the near-tied failures dominating early training","support":"source-stated"},{"text":"The paper says comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","excerpt":"Comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract, so it does not provide the full experimental setup or detail behind the reported results.","The reported study covers six environments with ten seeds per claim; the LLM-judge training result covers five seeds.","The abstract reports that the judge is near chance on near-tied failures, but does not establish whether improving that accuracy would reduce the performance gap."],"mediaId":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","correctionReason":null,"id":"72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c","publicationId":"9d6c1dd0-b1ee-4672-8135-06bd48c4ef53","version":1,"sourceUrl":"https://arxiv.org/abs/2605.06375","sourceTitle":"Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-05-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:00:23.346Z","createdAt":"2026-11-09T12:34:10.445Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","kind":"article","url":"https://arxiv.org/abs/2605.06375","sourceUrl":"https://arxiv.org/abs/2605.06375","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T12:33:02.269Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.06375","checkedAt":"2026-11-09T12:50:08.032Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"d566029c0e13d0f12cd15206ec5544261c13b8aa2c25deff3c36ce60687155a4","decidedAt":"2026-11-09T12:33:05.134Z"},"provenance":{"textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observationId":"07910f652aded99fd0146609d228998832041b852d7c89e6496d890bd7911bf0","retrievedAt":"2026-11-09T12:33:01.777Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"cc4888f2-41de-4cab-8a9a-478b5475e0c8"},"reviewer":{"model":"gpt-6-luna","runId":"4f08a70d-f92c-41a2-8734-d5d0e265708a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T12:34:10.445Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yu, Hao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yu, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yu, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.06375","locator":"head/meta[name=author|citation_author]"},"assertionId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:50:08.032Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c","sourceUrl":"https://arxiv.org/abs/2605.06375","contentSha256":"a13fc70a118bbe6ca606913ab73a91ce11f8cfbe69b9917414df5c633e88c367","textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observedAt":"2026-11-09T12:50:08.032Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2605.06375","snapshotId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c","contentSha256":"a13fc70a118bbe6ca606913ab73a91ce11f8cfbe69b9917414df5c633e88c367","textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observedAt":"2026-11-09T12:50:08.032Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-ordinal-credit-assignment-learning-from-comparisons-with-72f879f2","formats":{"html":"/readings/arxiv-ordinal-credit-assignment-learning-from-comparisons-with-72f879f2","markdown":"/readings/arxiv-ordinal-credit-assignment-learning-from-comparisons-with-72f879f2.md","json":"/readings/arxiv-ordinal-credit-assignment-learning-from-comparisons-with-72f879f2.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c","revision":"9d6c1dd0-b1ee-4672-8135-06bd48c4ef53","revisionKind":"publication-id","title":"arXiv: Ordinal Credit Assignment: Learning from comparisons, with a judge’s limits","url":"https://escapemeridian.com/readings/arxiv-ordinal-credit-assignment-learning-from-comparisons-with-72f879f2"},"source":{"type":"source","id":"https://arxiv.org/abs/2605.06375","revision":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","revisionKind":"sha256-source-text","title":"Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone","url":"https://arxiv.org/abs/2605.06375"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c","title":"arXiv: Ordinal Credit Assignment: Learning from comparisons, with a judge’s limits","argument":"Hao Yu’s paper studies multi-step reinforcement learning using comparisons between outcomes rather than a reward function or reward model. It proposes crediting each action by how its reward-to-go compares with other trajectories still running at the same time step. In deterministic environments, the expected update ranks actions by true value; with stochastic outcomes, it favors actions that win more often, not necessarily those with higher mean. In a pre-registered study, comparisons cost no detectable performance relative to scalar returns at the same granularity, and learning a reward model from those comparisons did not do better. With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores. But when training with an LLM judge on a requirement omitted by a hand-written reward, policies satisfied the requirement in all five seeds while landing far less often than with oracle comparisons. The paper attributes that gap to the judge being near chance on near-tied failures that dominate early training. The abstract also reports that comparisons do not close the gap to PPO with scalar rewards on HalfCheetah. These results make the judge’s ability to distinguish close outcomes central to whether comparison-based training works in the reported setting.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract, so it does not provide the full experimental setup or detail behind the reported results. The reported study covers six environments with ten seeds per claim; the LLM-judge training result covers five seeds. The abstract reports that the judge is near chance on near-tied failures, but does not establish whether improving that accuracy would reduce the performance gap.","speaker":{"name":"Yu, Hao","roleAtSource":"Article author"},"source":{"title":"Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2605.06375","publishedAt":"2026-05-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The paper studies multi-step reinforcement learning from comparisons, without a reward function or reward model.","excerpt":"We study reinforcement learning that receives only such comparisons - no reward function, no reward model - in multi-step tasks.","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"Its proposed update credits actions by comparing reward-to-go against other trajectories still running at that time step.","excerpt":"each action is credited by how its reward-to-go compares with those of other trajectories at the same time step","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"The paper says the update ranks actions by true value in deterministic environments, but in stochastic outcomes favors actions that win more often over those with higher mean.","excerpt":"under stochastic outcomes it prefers actions that win more often rather than those with higher mean","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"In the reported study, comparisons had no detectable performance cost relative to scalar returns at the same granularity, and learning a reward model from those comparisons was not better.","excerpt":"comparisons cost no detectable performance relative to scalar returns at the same granularity, learning a reward model from the same comparisons is not better","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores.","excerpt":"With real LLM judges, comparisons are 7-10 points more accurate than pointwise scores","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"In training on a requirement omitted by the hand-written reward, policies satisfied it in all five seeds but landed far less often than with oracle comparisons; the paper attributes the gap to the judge’s poor performance on near-tied failures.","excerpt":"policies satisfy it in all five seeds but land far less often than with oracle comparisons, because the judge is near chance on the near-tied failures dominating early training","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"},{"text":"The paper says comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","excerpt":"Comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","url":"https://arxiv.org/abs/2605.06375","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.06375","checkedAt":"2026-11-09T12:50:08.032Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would a judge that is more accurate on near-tied failures reduce the gap between LLM-judge and oracle-comparison training?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Ordinal Credit Assignment: Learning from comparisons, with a judge’s limits","summary":"Hao Yu’s paper studies multi-step reinforcement learning using comparisons between outcomes rather than a reward function or reward model. It proposes crediting each action by how its reward-to-go compares with other trajectories still running at the same time step. In deterministic environments, the expected update ranks actions by true value; with stochastic outcomes, it favors actions that win more often, not necessarily those with higher mean. In a pre-registered study, comparisons cost no detectable performance relative to scalar returns at the same granularity, and learning a reward model from those comparisons did not do better. With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores. But when training with an LLM judge on a requirement omitted by a hand-written reward, policies satisfied the requirement in all five seeds while landing far less often than with oracle comparisons. The paper attributes that gap to the judge being near chance on near-tied failures that dominate early training. The abstract also reports that comparisons do not close the gap to PPO with scalar rewards on HalfCheetah. These results make the judge’s ability to distinguish close outcomes central to whether comparison-based training works in the reported setting.","question":"Would a judge that is more accurate on near-tied failures reduce the gap between LLM-judge and oracle-comparison training?","claims":[{"text":"The paper studies multi-step reinforcement learning from comparisons, without a reward function or reward model.","excerpt":"We study reinforcement learning that receives only such comparisons - no reward function, no reward model - in multi-step tasks.","support":"source-stated"},{"text":"Its proposed update credits actions by comparing reward-to-go against other trajectories still running at that time step.","excerpt":"each action is credited by how its reward-to-go compares with those of other trajectories at the same time step","support":"source-stated"},{"text":"The paper says the update ranks actions by true value in deterministic environments, but in stochastic outcomes favors actions that win more often over those with higher mean.","excerpt":"under stochastic outcomes it prefers actions that win more often rather than those with higher mean","support":"source-stated"},{"text":"In the reported study, comparisons had no detectable performance cost relative to scalar returns at the same granularity, and learning a reward model from those comparisons was not better.","excerpt":"comparisons cost no detectable performance relative to scalar returns at the same granularity, learning a reward model from the same comparisons is not better","support":"source-stated"},{"text":"With real LLM judges, comparisons were 7–10 points more accurate than pointwise scores.","excerpt":"With real LLM judges, comparisons are 7-10 points more accurate than pointwise scores","support":"source-stated"},{"text":"In training on a requirement omitted by the hand-written reward, policies satisfied it in all five seeds but landed far less often than with oracle comparisons; the paper attributes the gap to the judge’s poor performance on near-tied failures.","excerpt":"policies satisfy it in all five seeds but land far less often than with oracle comparisons, because the judge is near chance on the near-tied failures dominating early training","support":"source-stated"},{"text":"The paper says comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","excerpt":"Comparisons do not close the gap to PPO with scalar rewards on HalfCheetah.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract, so it does not provide the full experimental setup or detail behind the reported results.","The reported study covers six environments with ten seeds per claim; the LLM-judge training result covers five seeds.","The abstract reports that the judge is near chance on near-tied failures, but does not establish whether improving that accuracy would reduce the performance gap."],"mediaId":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","correctionReason":null,"id":"72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c","publicationId":"9d6c1dd0-b1ee-4672-8135-06bd48c4ef53","version":1,"sourceUrl":"https://arxiv.org/abs/2605.06375","sourceTitle":"Ordinal Credit Assignment: Multi-Step Reinforcement Learning from Comparisons Alone","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-05-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:00:23.346Z","createdAt":"2026-11-09T12:34:10.445Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","kind":"article","url":"https://arxiv.org/abs/2605.06375","sourceUrl":"https://arxiv.org/abs/2605.06375","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T12:33:02.269Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.06375","checkedAt":"2026-11-09T12:50:08.032Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"0768da0d36af9940d50555df795bff7adbeb23b482d28d4587f5f55c01e174af","confidence":0.77,"provider":"typesafe","model":"jev-1.13.0","inputHash":"d566029c0e13d0f12cd15206ec5544261c13b8aa2c25deff3c36ce60687155a4","decidedAt":"2026-11-09T12:33:05.134Z"},"provenance":{"textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observationId":"07910f652aded99fd0146609d228998832041b852d7c89e6496d890bd7911bf0","retrievedAt":"2026-11-09T12:33:01.777Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"cc4888f2-41de-4cab-8a9a-478b5475e0c8"},"reviewer":{"model":"gpt-6-luna","runId":"4f08a70d-f92c-41a2-8734-d5d0e265708a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T12:34:10.445Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yu, Hao","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yu, Hao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yu, Hao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.06375","locator":"head/meta[name=author|citation_author]"},"assertionId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T12:50:08.032Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c","sourceUrl":"https://arxiv.org/abs/2605.06375","contentSha256":"a13fc70a118bbe6ca606913ab73a91ce11f8cfbe69b9917414df5c633e88c367","textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observedAt":"2026-11-09T12:50:08.032Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2605.06375","snapshotId":"5f4ad9f7d8f43d7a77a0aa6d19f0ca0cbdeacf35f33c4b4211ce5b3cbf5f3c8c","contentSha256":"a13fc70a118bbe6ca606913ab73a91ce11f8cfbe69b9917414df5c633e88c367","textHash":"840c9e01a25a716fe5c21509f6625be7b44077aece4ac6d187e31cad24106ea1","observedAt":"2026-11-09T12:50:08.032Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/72f879f2eb1a1b893fc3841611b61228e0222da3cf46674233daab3ad893fa5c/source"}}}],"audits":[{"publicationId":"9d6c1dd0-b1ee-4672-8135-06bd48c4ef53","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the paper to Hao Yu on arXiv. It frames the findings as the paper's own claims, using phrases such as 'the paper says' and 'the abstract reports'.","excerpt":"Authors:Hao Yu"},{"dimension":"summary","status":"uncertain","explanation":"The reading leaves out the author's core motivation: scalar rewards are often impossible to write down, while judging which outcome is better is easy. That is the stake that makes the work matter to a general reader. 'Landing far less often' is not explained, so a reader cannot tell what landing means here. Smallest repair: open with the motivating sentence and say plainly what 'land' measures. Central terms such as reward-to-go, PPO, HalfCheetah and oracle comparisons are kept exactly and should get term-library tooltips. The title and question are otherwise faithful.","excerpt":"for many tasks no formula captures what we want, while judging which of two outcomes is better is easy"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-05-07, which matches the v1 submission date. It is not the 4 Nov 2026 revision date or the feed date.","excerpt":"Submitted on 7 May 2026 (v1), last revised 4 Nov 2026 (this version, v2)"},{"dimension":"support","status":"uncertain","explanation":"All seven claims match their excerpts verbatim. However, the closing sentence says the results make the judge's ability to distinguish close outcomes 'central to whether comparison-based training works'. That is an unlabeled interpretation that goes beyond the abstract: the abstract says policies satisfied the requirement in all five seeds and attributes only the landing gap to the judge. Smallest repair: label the sentence as Escape Meridian interpretation, or narrow it to the landing-rate gap the paper explains.","excerpt":"because the judge is near chance on the near-tied failures dominating early training"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most relevant way to access the source.","excerpt":null}],"createdAt":"2026-11-09T12:34:10.445Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}