{"id":"dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd","title":"arXiv cs.AI: Learning to Act with World Models by Valuing What Comes Next","argument":"The paper’s authors propose WM-PPO, a method that pairs a world model—which predicts how actions change the environment—with a critic that estimates the chance of success. Their central argument is that predicting a next observation is not enough: the agent also needs to judge whether that predicted state moves it closer to success. WM-PPO uses critic values of predicted next states to guide policy learning, including for sampled actions that were not executed. A shared gate adjusts the influence of these signals based on how reliably similar comparisons predicted outcomes earlier in training. The authors say the policy, critic and world model learn from the agent’s own interaction, without a teacher or privileged information; only the policy is used at inference. At a comparable number of real environment steps, they report success rising from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO. They also report matching the strongest PPO refinements they tested on ALFWorld and exceeding the best of them by 6.5 points on ScienceWorld. The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer. Escape Meridian interpretation: these results concern the two named environments; the abstract does not establish how the method performs elsewhere.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported success comparisons concern ALFWorld and ScienceWorld; the supplied abstract does not report results in other environments. The supplied evidence is the paper’s arXiv page and abstract; it does not provide the methodological details needed to assess the reported experiments.","speaker":{"name":"Gao, Chenghao, Zhang, Zhi, Jin, Dian, Pan, Yihe, Zhou, Doudou","roleAtSource":"Article author"},"source":{"title":"Learning to Act with World Models by Valuing What Comes Next","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.12200","publishedAt":"2026-11-09","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose WM-PPO, which uses a world model’s predicted next observations and a critic’s values of those successor states to guide policy learning.","excerpt":"For each action the policy samples, executed or not, the world model predicts the next observation and the critic values the predicted successor.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"WM-PPO uses a shared gate to weight its policy and value channels according to how reliably similar comparisons predicted real outcomes earlier in training.","excerpt":"A shared gate weights both channels according to how reliably comparisons with similar margins predicted real outcomes earlier in training.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors report that, with a comparable number of real environment steps, WM-PPO raised success from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO.","excerpt":"With a comparable number of real environment steps, WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors report that WM-PPO matched the strongest PPO refinements they tested on ALFWorld and exceeded the best of them by 6.5 points on ScienceWorld.","excerpt":"It matches the strongest PPO refinements we tested on ALFWorld and exceeds the best of them by 6.5 points on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer.","excerpt":"The trained policy more often completes prerequisite steps before placing an object or committing to an answer.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The reported results cover ALFWorld and ScienceWorld; whether the gains extend to other environments remains an open question.","excerpt":"WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12200","checkedAt":"2026-11-10T16:50:11.560Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do WM-PPO’s reported gains hold in environments beyond ALFWorld and ScienceWorld?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Learning to Act with World Models by Valuing What Comes Next","summary":"The paper’s authors propose WM-PPO, a method that pairs a world model—which predicts how actions change the environment—with a critic that estimates the chance of success. Their central argument is that predicting a next observation is not enough: the agent also needs to judge whether that predicted state moves it closer to success. WM-PPO uses critic values of predicted next states to guide policy learning, including for sampled actions that were not executed. A shared gate adjusts the influence of these signals based on how reliably similar comparisons predicted outcomes earlier in training. The authors say the policy, critic and world model learn from the agent’s own interaction, without a teacher or privileged information; only the policy is used at inference. At a comparable number of real environment steps, they report success rising from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO. They also report matching the strongest PPO refinements they tested on ALFWorld and exceeding the best of them by 6.5 points on ScienceWorld. The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer. Escape Meridian interpretation: these results concern the two named environments; the abstract does not establish how the method performs elsewhere.","question":"Do WM-PPO’s reported gains hold in environments beyond ALFWorld and ScienceWorld?","claims":[{"text":"The authors propose WM-PPO, which uses a world model’s predicted next observations and a critic’s values of those successor states to guide policy learning.","excerpt":"For each action the policy samples, executed or not, the world model predicts the next observation and the critic values the predicted successor.","support":"source-stated"},{"text":"WM-PPO uses a shared gate to weight its policy and value channels according to how reliably similar comparisons predicted real outcomes earlier in training.","excerpt":"A shared gate weights both channels according to how reliably comparisons with similar margins predicted real outcomes earlier in training.","support":"source-stated"},{"text":"The authors report that, with a comparable number of real environment steps, WM-PPO raised success from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO.","excerpt":"With a comparable number of real environment steps, WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","support":"source-stated"},{"text":"The authors report that WM-PPO matched the strongest PPO refinements they tested on ALFWorld and exceeded the best of them by 6.5 points on ScienceWorld.","excerpt":"It matches the strongest PPO refinements we tested on ALFWorld and exceeds the best of them by 6.5 points on ScienceWorld.","support":"source-stated"},{"text":"The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer.","excerpt":"The trained policy more often completes prerequisite steps before placing an object or committing to an answer.","support":"source-stated"},{"text":"The reported results cover ALFWorld and ScienceWorld; whether the gains extend to other environments remains an open question.","excerpt":"WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","support":"interpretation"}],"limitations":["The reported success comparisons concern ALFWorld and ScienceWorld; the supplied abstract does not report results in other environments.","The supplied evidence is the paper’s arXiv page and abstract; it does not provide the methodological details needed to assess the reported experiments."],"mediaId":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","correctionReason":null,"id":"dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd","publicationId":"c22e47f4-a62d-443f-8cd9-ff1ecc032e24","version":1,"sourceUrl":"https://arxiv.org/abs/2611.12200","sourceTitle":"Learning to Act with World Models by Valuing What Comes Next","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-09","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:42:26.267Z","createdAt":"2026-11-10T15:46:44.138Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","kind":"article","url":"https://arxiv.org/abs/2611.12200","sourceUrl":"https://arxiv.org/abs/2611.12200","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T15:32:59.549Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12200","checkedAt":"2026-11-10T16:50:11.560Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","confidence":0.83,"provider":"typesafe","model":"jev-1.13.0","inputHash":"2ce7541256ad411a11f55acdf7aa1709236f2505d4397322dc9df373be9bb4e6","decidedAt":"2026-11-10T15:33:01.587Z"},"provenance":{"textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observationId":"e7fc681b47a1425b4185bae1833c525fe51d5c764991882486ebe14d60c9a22d","retrievedAt":"2026-11-10T15:32:59.216Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"65ba80ce-3355-4652-8d90-a3ad72b760e6"},"reviewer":{"model":"gpt-6-luna","runId":"6270fd61-a6fe-462b-89b1-a9f6975d3a23"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T15:46:44.138Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gao, Chenghao","url":null,"kind":"unknown"},{"name":"Zhang, Zhi","url":null,"kind":"unknown"},{"name":"Jin, Dian","url":null,"kind":"unknown"},{"name":"Pan, Yihe","url":null,"kind":"unknown"},{"name":"Zhou, Doudou","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gao, Chenghao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gao, Chenghao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Zhang, Zhi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Zhi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Jin, Dian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jin, Dian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Pan, Yihe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pan, Yihe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Zhou, Doudou","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Doudou","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.12200","snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-learning-to-act-with-world-models-by-valuing-what-dd096de3","formats":{"html":"/readings/arxiv-cs-ai-learning-to-act-with-world-models-by-valuing-what-dd096de3","markdown":"/readings/arxiv-cs-ai-learning-to-act-with-world-models-by-valuing-what-dd096de3.md","json":"/readings/arxiv-cs-ai-learning-to-act-with-world-models-by-valuing-what-dd096de3.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-world-model","name":"World model","explanation":"An AI system's internal model of how an environment behaves, used to predict what happens next or to plan.","referenceUrl":"https://arxiv.org/abs/1803.10122"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd","revision":"c22e47f4-a62d-443f-8cd9-ff1ecc032e24","revisionKind":"publication-id","title":"arXiv cs.AI: Learning to Act with World Models by Valuing What Comes Next","url":"https://escapemeridian.com/readings/arxiv-cs-ai-learning-to-act-with-world-models-by-valuing-what-dd096de3"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.12200","revision":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","revisionKind":"sha256-source-text","title":"Learning to Act with World Models by Valuing What Comes Next","url":"https://arxiv.org/abs/2611.12200"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd","title":"arXiv cs.AI: Learning to Act with World Models by Valuing What Comes Next","argument":"The paper’s authors propose WM-PPO, a method that pairs a world model—which predicts how actions change the environment—with a critic that estimates the chance of success. Their central argument is that predicting a next observation is not enough: the agent also needs to judge whether that predicted state moves it closer to success. WM-PPO uses critic values of predicted next states to guide policy learning, including for sampled actions that were not executed. A shared gate adjusts the influence of these signals based on how reliably similar comparisons predicted outcomes earlier in training. The authors say the policy, critic and world model learn from the agent’s own interaction, without a teacher or privileged information; only the policy is used at inference. At a comparable number of real environment steps, they report success rising from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO. They also report matching the strongest PPO refinements they tested on ALFWorld and exceeding the best of them by 6.5 points on ScienceWorld. The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer. Escape Meridian interpretation: these results concern the two named environments; the abstract does not establish how the method performs elsewhere.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported success comparisons concern ALFWorld and ScienceWorld; the supplied abstract does not report results in other environments. The supplied evidence is the paper’s arXiv page and abstract; it does not provide the methodological details needed to assess the reported experiments.","speaker":{"name":"Gao, Chenghao, Zhang, Zhi, Jin, Dian, Pan, Yihe, Zhou, Doudou","roleAtSource":"Article author"},"source":{"title":"Learning to Act with World Models by Valuing What Comes Next","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.12200","publishedAt":"2026-11-09","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose WM-PPO, which uses a world model’s predicted next observations and a critic’s values of those successor states to guide policy learning.","excerpt":"For each action the policy samples, executed or not, the world model predicts the next observation and the critic values the predicted successor.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"WM-PPO uses a shared gate to weight its policy and value channels according to how reliably similar comparisons predicted real outcomes earlier in training.","excerpt":"A shared gate weights both channels according to how reliably comparisons with similar margins predicted real outcomes earlier in training.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors report that, with a comparable number of real environment steps, WM-PPO raised success from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO.","excerpt":"With a comparable number of real environment steps, WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors report that WM-PPO matched the strongest PPO refinements they tested on ALFWorld and exceeded the best of them by 6.5 points on ScienceWorld.","excerpt":"It matches the strongest PPO refinements we tested on ALFWorld and exceeds the best of them by 6.5 points on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer.","excerpt":"The trained policy more often completes prerequisite steps before placing an object or committing to an answer.","url":"https://arxiv.org/abs/2611.12200","relationship":"Source-stated"},{"text":"The reported results cover ALFWorld and ScienceWorld; whether the gains extend to other environments remains an open question.","excerpt":"WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","url":"https://arxiv.org/abs/2611.12200","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12200","checkedAt":"2026-11-10T16:50:11.560Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do WM-PPO’s reported gains hold in environments beyond ALFWorld and ScienceWorld?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Learning to Act with World Models by Valuing What Comes Next","summary":"The paper’s authors propose WM-PPO, a method that pairs a world model—which predicts how actions change the environment—with a critic that estimates the chance of success. Their central argument is that predicting a next observation is not enough: the agent also needs to judge whether that predicted state moves it closer to success. WM-PPO uses critic values of predicted next states to guide policy learning, including for sampled actions that were not executed. A shared gate adjusts the influence of these signals based on how reliably similar comparisons predicted outcomes earlier in training. The authors say the policy, critic and world model learn from the agent’s own interaction, without a teacher or privileged information; only the policy is used at inference. At a comparable number of real environment steps, they report success rising from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO. They also report matching the strongest PPO refinements they tested on ALFWorld and exceeding the best of them by 6.5 points on ScienceWorld. The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer. Escape Meridian interpretation: these results concern the two named environments; the abstract does not establish how the method performs elsewhere.","question":"Do WM-PPO’s reported gains hold in environments beyond ALFWorld and ScienceWorld?","claims":[{"text":"The authors propose WM-PPO, which uses a world model’s predicted next observations and a critic’s values of those successor states to guide policy learning.","excerpt":"For each action the policy samples, executed or not, the world model predicts the next observation and the critic values the predicted successor.","support":"source-stated"},{"text":"WM-PPO uses a shared gate to weight its policy and value channels according to how reliably similar comparisons predicted real outcomes earlier in training.","excerpt":"A shared gate weights both channels according to how reliably comparisons with similar margins predicted real outcomes earlier in training.","support":"source-stated"},{"text":"The authors report that, with a comparable number of real environment steps, WM-PPO raised success from 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld, compared with PPO.","excerpt":"With a comparable number of real environment steps, WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","support":"source-stated"},{"text":"The authors report that WM-PPO matched the strongest PPO refinements they tested on ALFWorld and exceeded the best of them by 6.5 points on ScienceWorld.","excerpt":"It matches the strongest PPO refinements we tested on ALFWorld and exceeds the best of them by 6.5 points on ScienceWorld.","support":"source-stated"},{"text":"The authors say the trained policy more often completes prerequisite steps before placing an object or committing to an answer.","excerpt":"The trained policy more often completes prerequisite steps before placing an object or committing to an answer.","support":"source-stated"},{"text":"The reported results cover ALFWorld and ScienceWorld; whether the gains extend to other environments remains an open question.","excerpt":"WM-PPO raises success from PPO's 63.5% to 87.5% on ALFWorld and from 39.3% to 52.9% on ScienceWorld.","support":"interpretation"}],"limitations":["The reported success comparisons concern ALFWorld and ScienceWorld; the supplied abstract does not report results in other environments.","The supplied evidence is the paper’s arXiv page and abstract; it does not provide the methodological details needed to assess the reported experiments."],"mediaId":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","correctionReason":null,"id":"dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd","publicationId":"c22e47f4-a62d-443f-8cd9-ff1ecc032e24","version":1,"sourceUrl":"https://arxiv.org/abs/2611.12200","sourceTitle":"Learning to Act with World Models by Valuing What Comes Next","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-09","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:42:26.267Z","createdAt":"2026-11-10T15:46:44.138Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","kind":"article","url":"https://arxiv.org/abs/2611.12200","sourceUrl":"https://arxiv.org/abs/2611.12200","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-10T15:32:59.549Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12200","checkedAt":"2026-11-10T16:50:11.560Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"4315d7613d2afdcdb6f9b3822097afdf30231c495b29868843c0a4a989626182","confidence":0.83,"provider":"typesafe","model":"jev-1.13.0","inputHash":"2ce7541256ad411a11f55acdf7aa1709236f2505d4397322dc9df373be9bb4e6","decidedAt":"2026-11-10T15:33:01.587Z"},"provenance":{"textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observationId":"e7fc681b47a1425b4185bae1833c525fe51d5c764991882486ebe14d60c9a22d","retrievedAt":"2026-11-10T15:32:59.216Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"65ba80ce-3355-4652-8d90-a3ad72b760e6"},"reviewer":{"model":"gpt-6-luna","runId":"6270fd61-a6fe-462b-89b1-a9f6975d3a23"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T15:46:44.138Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Gao, Chenghao","url":null,"kind":"unknown"},{"name":"Zhang, Zhi","url":null,"kind":"unknown"},{"name":"Jin, Dian","url":null,"kind":"unknown"},{"name":"Pan, Yihe","url":null,"kind":"unknown"},{"name":"Zhou, Doudou","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Gao, Chenghao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gao, Chenghao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Zhang, Zhi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Zhi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Jin, Dian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jin, Dian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Pan, Yihe","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Pan, Yihe","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}},{"actor":{"name":"Zhou, Doudou","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhou, Doudou","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12200","locator":"head/meta[name=author|citation_author]"},"assertionId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T16:50:11.560Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","sourceUrl":"https://arxiv.org/abs/2611.12200","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.12200","snapshotId":"e2b6bf4bc2b3334f1da85fc61e380eec89350f58b56836af13f07172a839542d","contentSha256":"823c3c19358dfeb72e91769e571698b874762ff78edc4b57d81dbd899d272485","textHash":"51eea328f9e5fe2224e4e1003275200acbdb2b93f4c193111930fc6ef948b7d7","observedAt":"2026-11-10T16:50:11.560Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/dd096de3129efe6e855ce9b7055ba194b6ffb8856f9ed52eb3ab8945e75ddfbd/source"}}}],"audits":[{"publicationId":"c22e47f4-a62d-443f-8cd9-ff1ecc032e24","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the method, results and behavioral claim to the paper's authors (Gao, Zhang, Jin, Pan, Zhou). Reported figures are framed as author reports, not established facts. The closing interpretation is clearly labeled as Escape Meridian's.","excerpt":"Authors:Chenghao Gao, Zhi Zhang, Dian Jin, Yihe Pan, Doudou Zhou"},{"dimension":"summary","status":"uncertain","explanation":"The summary is faithful but may be hard for a general reader. It omits the motivating problem: a sparse terminal reward, meaning success is signaled only at the end, tells the agent little about its individual steps. PPO, the baseline reinforcement-learning algorithm, is never identified. 'Policy' and 'inference' are not explained. ALFWorld and ScienceWorld are not described as text-based task environments. The smallest repair is one sentence on the sparse-reward problem, plus a brief gloss or tooltip for PPO and the two benchmarks.","excerpt":"A sparse terminal reward tells an agent little about its steps."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-09, matches the arXiv v1 submission date of 9 Nov 2026. The feed date of 10 Nov is correctly not used.","excerpt":"[Submitted on 9 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each source-stated claim matches the abstract verbatim in substance, including its conditions: comparable real environment steps, and comparison against PPO refinements 'we tested'. The interpretation claim about other environments is labeled, conditional and supported. The question follows from the evidence without leading. No benefits or real-world reliability are implied beyond the reported benchmark scores.","excerpt":"It matches the strongest PPO refinements we tested on ALFWorld and exceeds the best of them by 6.5 points on ScienceWorld."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the actual source. It is the most direct and relevant link available.","excerpt":null}],"createdAt":"2026-11-10T15:46:44.138Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}