{"id":"76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213","title":"arXiv: Koopman Model-Based Reinforcement Learning","argument":"Authors Wenjian Hao, Paulo C. Heredia and Shaoshuai Mou propose K-MBRL, a method for controlling nonlinear robotic systems with unknown dynamics. It combines a learned model with a critic, which estimates future cost, to improve a control policy. The authors say representing dynamics with linear Koopman dynamics makes policy-gradient computation a constant matrix product, while using a one-step predicted state avoids repeated long-horizon model predictions. The critic retains information about future cost. The resulting policy acts through feedforward evaluation, without online optimization.\n\nThe authors report convergence guarantees under standard stochastic approximation assumptions. They say simulations on HalfCheetah and quadruped locomotion tasks show strong sample efficiency and improved performance against classical reinforcement-learning baselines. They also report testing on a physical quadruped: it rose onto two rounded rear feet, balanced during bipedal walking, and returned to the ground. The physical-robot validation extends beyond simulation, but the abstract describes only this sequence of maneuvers. The authors use a pendulum task to assess policy-gradient approximation accuracy and examine components and hyperparameters.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it reports qualitative comparisons but gives no numerical performance results in the supplied text. The physical quadruped validation described here covers a specific sequence of maneuvers; the supplied abstract does not report performance beyond it. Technical terms to consider for the term library: Koopman model-based reinforcement learning, Koopman operator, critic, policy gradient, feedforward evaluation, and stochastic approximation.","speaker":{"name":"Hao, Wenjian, Heredia, Paulo C., Mou, Shaoshuai","roleAtSource":"Article author"},"source":{"title":"Koopman Model-Based Reinforcement Learning","publisher":"arXiv eess.SY","format":"Article","url":"https://arxiv.org/abs/2611.14186","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose K-MBRL for controlling nonlinear robotic systems with unknown dynamics, using a learned policy objective that combines immediate cost with estimated future cost.","excerpt":"We propose a Koopman model-based reinforcement learning (K-MBRL) algorithm for controlling nonlinear robotic systems with unknown dynamics.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors say linear Koopman dynamics make model-dependent policy-gradient computation a constant matrix product, and one-step prediction limits accumulated prediction errors while the critic retains long-term cost information.","excerpt":"the linear Koopman dynamics simplify the model-dependent policy gradient computation to a constant matrix product","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report that the learned policy enables real-time control through feedforward evaluation without online optimization.","excerpt":"The learned policy enables real-time control through feedforward evaluation without online optimization.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report convergence guarantees under standard stochastic approximation assumptions.","excerpt":"We establish policy learning convergence guarantees under standard stochastic approximation assumptions.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report simulation results on HalfCheetah and quadruped locomotion tasks, and validation on a physical quadruped performing a sequence of maneuvers.","excerpt":"The proposed K-MBRL is further validated on a physical quadruped robot performing a challenging sequence of maneuvers","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The abstract describes the physical robot sequence as rising onto two rounded rear feet, balancing during bipedal walking, and safely returning to the ground.","excerpt":"rising to an upright posture supported by two rounded rear feet, maintaining balance during bipedal walking, and safely returning to the ground","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14186","checkedAt":"2026-11-11T22:48:24.726Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does K-MBRL perform on the physical quadruped beyond the described sequence of maneuvers?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Koopman Model-Based Reinforcement Learning","summary":"Authors Wenjian Hao, Paulo C. Heredia and Shaoshuai Mou propose K-MBRL, a method for controlling nonlinear robotic systems with unknown dynamics. It combines a learned model with a critic, which estimates future cost, to improve a control policy. The authors say representing dynamics with linear Koopman dynamics makes policy-gradient computation a constant matrix product, while using a one-step predicted state avoids repeated long-horizon model predictions. The critic retains information about future cost. The resulting policy acts through feedforward evaluation, without online optimization.\n\nThe authors report convergence guarantees under standard stochastic approximation assumptions. They say simulations on HalfCheetah and quadruped locomotion tasks show strong sample efficiency and improved performance against classical reinforcement-learning baselines. They also report testing on a physical quadruped: it rose onto two rounded rear feet, balanced during bipedal walking, and returned to the ground. The physical-robot validation extends beyond simulation, but the abstract describes only this sequence of maneuvers. The authors use a pendulum task to assess policy-gradient approximation accuracy and examine components and hyperparameters.","question":"How does K-MBRL perform on the physical quadruped beyond the described sequence of maneuvers?","claims":[{"text":"The authors propose K-MBRL for controlling nonlinear robotic systems with unknown dynamics, using a learned policy objective that combines immediate cost with estimated future cost.","excerpt":"We propose a Koopman model-based reinforcement learning (K-MBRL) algorithm for controlling nonlinear robotic systems with unknown dynamics.","support":"source-stated"},{"text":"The authors say linear Koopman dynamics make model-dependent policy-gradient computation a constant matrix product, and one-step prediction limits accumulated prediction errors while the critic retains long-term cost information.","excerpt":"the linear Koopman dynamics simplify the model-dependent policy gradient computation to a constant matrix product","support":"source-stated"},{"text":"The authors report that the learned policy enables real-time control through feedforward evaluation without online optimization.","excerpt":"The learned policy enables real-time control through feedforward evaluation without online optimization.","support":"source-stated"},{"text":"The authors report convergence guarantees under standard stochastic approximation assumptions.","excerpt":"We establish policy learning convergence guarantees under standard stochastic approximation assumptions.","support":"source-stated"},{"text":"The authors report simulation results on HalfCheetah and quadruped locomotion tasks, and validation on a physical quadruped performing a sequence of maneuvers.","excerpt":"The proposed K-MBRL is further validated on a physical quadruped robot performing a challenging sequence of maneuvers","support":"source-stated"},{"text":"The abstract describes the physical robot sequence as rising onto two rounded rear feet, balancing during bipedal walking, and safely returning to the ground.","excerpt":"rising to an upright posture supported by two rounded rear feet, maintaining balance during bipedal walking, and safely returning to the ground","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it reports qualitative comparisons but gives no numerical performance results in the supplied text.","The physical quadruped validation described here covers a specific sequence of maneuvers; the supplied abstract does not report performance beyond it.","Technical terms to consider for the term library: Koopman model-based reinforcement learning, Koopman operator, critic, policy gradient, feedforward evaluation, and stochastic approximation."],"mediaId":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","correctionReason":null,"id":"76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213","publicationId":"2b66d2aa-016c-49d2-8c01-078d8a67832f","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14186","sourceTitle":"Koopman Model-Based Reinforcement Learning","publisher":"arXiv eess.SY","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:05:08.537Z","createdAt":"2026-11-11T22:33:42.728Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","kind":"article","url":"https://arxiv.org/abs/2611.14186","sourceUrl":"https://arxiv.org/abs/2611.14186","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-11T22:32:41.974Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14186","checkedAt":"2026-11-11T22:48:24.726Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bf20dbf87c834d734b778bed66809f2d8aa38137a5a2fb97135305b6eaa2d1a5","decidedAt":"2026-11-11T22:32:43.794Z"},"provenance":{"textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observationId":"c0ff1fba6fc27eaede63e18f1f715b511ee5262308bed630a937620f54ac4c61","retrievedAt":"2026-11-11T22:32:41.713Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"72b6672c-4933-4975-85a7-2a77d7aea75b"},"reviewer":{"model":"gpt-6-luna","runId":"6c9bd3ee-3330-4482-8e13-b0d25bea398a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T22:33:42.728Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Hao, Wenjian","url":null,"kind":"unknown"},{"name":"Heredia, Paulo C.","url":null,"kind":"unknown"},{"name":"Mou, Shaoshuai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Hao, Wenjian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hao, Wenjian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}},{"actor":{"name":"Heredia, Paulo C.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Heredia, Paulo C.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}},{"actor":{"name":"Mou, Shaoshuai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mou, Shaoshuai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14186","snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-koopman-model-based-reinforcement-learning-76fb461a","formats":{"html":"/readings/arxiv-koopman-model-based-reinforcement-learning-76fb461a","markdown":"/readings/arxiv-koopman-model-based-reinforcement-learning-76fb461a.md","json":"/readings/arxiv-koopman-model-based-reinforcement-learning-76fb461a.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213","revision":"2b66d2aa-016c-49d2-8c01-078d8a67832f","revisionKind":"publication-id","title":"arXiv: Koopman Model-Based Reinforcement Learning","url":"https://escapemeridian.com/readings/arxiv-koopman-model-based-reinforcement-learning-76fb461a"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.14186","revision":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","revisionKind":"sha256-source-text","title":"Koopman Model-Based Reinforcement Learning","url":"https://arxiv.org/abs/2611.14186"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213","title":"arXiv: Koopman Model-Based Reinforcement Learning","argument":"Authors Wenjian Hao, Paulo C. Heredia and Shaoshuai Mou propose K-MBRL, a method for controlling nonlinear robotic systems with unknown dynamics. It combines a learned model with a critic, which estimates future cost, to improve a control policy. The authors say representing dynamics with linear Koopman dynamics makes policy-gradient computation a constant matrix product, while using a one-step predicted state avoids repeated long-horizon model predictions. The critic retains information about future cost. The resulting policy acts through feedforward evaluation, without online optimization.\n\nThe authors report convergence guarantees under standard stochastic approximation assumptions. They say simulations on HalfCheetah and quadruped locomotion tasks show strong sample efficiency and improved performance against classical reinforcement-learning baselines. They also report testing on a physical quadruped: it rose onto two rounded rear feet, balanced during bipedal walking, and returned to the ground. The physical-robot validation extends beyond simulation, but the abstract describes only this sequence of maneuvers. The authors use a pendulum task to assess policy-gradient approximation accuracy and examine components and hyperparameters.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the arXiv abstract; it reports qualitative comparisons but gives no numerical performance results in the supplied text. The physical quadruped validation described here covers a specific sequence of maneuvers; the supplied abstract does not report performance beyond it. Technical terms to consider for the term library: Koopman model-based reinforcement learning, Koopman operator, critic, policy gradient, feedforward evaluation, and stochastic approximation.","speaker":{"name":"Hao, Wenjian, Heredia, Paulo C., Mou, Shaoshuai","roleAtSource":"Article author"},"source":{"title":"Koopman Model-Based Reinforcement Learning","publisher":"arXiv eess.SY","format":"Article","url":"https://arxiv.org/abs/2611.14186","publishedAt":"2026-11-10","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose K-MBRL for controlling nonlinear robotic systems with unknown dynamics, using a learned policy objective that combines immediate cost with estimated future cost.","excerpt":"We propose a Koopman model-based reinforcement learning (K-MBRL) algorithm for controlling nonlinear robotic systems with unknown dynamics.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors say linear Koopman dynamics make model-dependent policy-gradient computation a constant matrix product, and one-step prediction limits accumulated prediction errors while the critic retains long-term cost information.","excerpt":"the linear Koopman dynamics simplify the model-dependent policy gradient computation to a constant matrix product","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report that the learned policy enables real-time control through feedforward evaluation without online optimization.","excerpt":"The learned policy enables real-time control through feedforward evaluation without online optimization.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report convergence guarantees under standard stochastic approximation assumptions.","excerpt":"We establish policy learning convergence guarantees under standard stochastic approximation assumptions.","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The authors report simulation results on HalfCheetah and quadruped locomotion tasks, and validation on a physical quadruped performing a sequence of maneuvers.","excerpt":"The proposed K-MBRL is further validated on a physical quadruped robot performing a challenging sequence of maneuvers","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"},{"text":"The abstract describes the physical robot sequence as rising onto two rounded rear feet, balancing during bipedal walking, and safely returning to the ground.","excerpt":"rising to an upright posture supported by two rounded rear feet, maintaining balance during bipedal walking, and safely returning to the ground","url":"https://arxiv.org/abs/2611.14186","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14186","checkedAt":"2026-11-11T22:48:24.726Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How does K-MBRL perform on the physical quadruped beyond the described sequence of maneuvers?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv: Koopman Model-Based Reinforcement Learning","summary":"Authors Wenjian Hao, Paulo C. Heredia and Shaoshuai Mou propose K-MBRL, a method for controlling nonlinear robotic systems with unknown dynamics. It combines a learned model with a critic, which estimates future cost, to improve a control policy. The authors say representing dynamics with linear Koopman dynamics makes policy-gradient computation a constant matrix product, while using a one-step predicted state avoids repeated long-horizon model predictions. The critic retains information about future cost. The resulting policy acts through feedforward evaluation, without online optimization.\n\nThe authors report convergence guarantees under standard stochastic approximation assumptions. They say simulations on HalfCheetah and quadruped locomotion tasks show strong sample efficiency and improved performance against classical reinforcement-learning baselines. They also report testing on a physical quadruped: it rose onto two rounded rear feet, balanced during bipedal walking, and returned to the ground. The physical-robot validation extends beyond simulation, but the abstract describes only this sequence of maneuvers. The authors use a pendulum task to assess policy-gradient approximation accuracy and examine components and hyperparameters.","question":"How does K-MBRL perform on the physical quadruped beyond the described sequence of maneuvers?","claims":[{"text":"The authors propose K-MBRL for controlling nonlinear robotic systems with unknown dynamics, using a learned policy objective that combines immediate cost with estimated future cost.","excerpt":"We propose a Koopman model-based reinforcement learning (K-MBRL) algorithm for controlling nonlinear robotic systems with unknown dynamics.","support":"source-stated"},{"text":"The authors say linear Koopman dynamics make model-dependent policy-gradient computation a constant matrix product, and one-step prediction limits accumulated prediction errors while the critic retains long-term cost information.","excerpt":"the linear Koopman dynamics simplify the model-dependent policy gradient computation to a constant matrix product","support":"source-stated"},{"text":"The authors report that the learned policy enables real-time control through feedforward evaluation without online optimization.","excerpt":"The learned policy enables real-time control through feedforward evaluation without online optimization.","support":"source-stated"},{"text":"The authors report convergence guarantees under standard stochastic approximation assumptions.","excerpt":"We establish policy learning convergence guarantees under standard stochastic approximation assumptions.","support":"source-stated"},{"text":"The authors report simulation results on HalfCheetah and quadruped locomotion tasks, and validation on a physical quadruped performing a sequence of maneuvers.","excerpt":"The proposed K-MBRL is further validated on a physical quadruped robot performing a challenging sequence of maneuvers","support":"source-stated"},{"text":"The abstract describes the physical robot sequence as rising onto two rounded rear feet, balancing during bipedal walking, and safely returning to the ground.","excerpt":"rising to an upright posture supported by two rounded rear feet, maintaining balance during bipedal walking, and safely returning to the ground","support":"source-stated"}],"limitations":["The evidence is the arXiv abstract; it reports qualitative comparisons but gives no numerical performance results in the supplied text.","The physical quadruped validation described here covers a specific sequence of maneuvers; the supplied abstract does not report performance beyond it.","Technical terms to consider for the term library: Koopman model-based reinforcement learning, Koopman operator, critic, policy gradient, feedforward evaluation, and stochastic approximation."],"mediaId":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","correctionReason":null,"id":"76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213","publicationId":"2b66d2aa-016c-49d2-8c01-078d8a67832f","version":1,"sourceUrl":"https://arxiv.org/abs/2611.14186","sourceTitle":"Koopman Model-Based Reinforcement Learning","publisher":"arXiv eess.SY","publishedAt":null,"originalPublished":{"value":"2026-11-10","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:05:08.537Z","createdAt":"2026-11-11T22:33:42.728Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","kind":"article","url":"https://arxiv.org/abs/2611.14186","sourceUrl":"https://arxiv.org/abs/2611.14186","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-11T22:32:41.974Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.14186","checkedAt":"2026-11-11T22:48:24.726Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"cf4120ffcafbd134c57fd9c6705e7a435bc24cda7e7423bb0cd6eb34033bf116","confidence":0.71,"provider":"typesafe","model":"jev-1.13.0","inputHash":"bf20dbf87c834d734b778bed66809f2d8aa38137a5a2fb97135305b6eaa2d1a5","decidedAt":"2026-11-11T22:32:43.794Z"},"provenance":{"textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observationId":"c0ff1fba6fc27eaede63e18f1f715b511ee5262308bed630a937620f54ac4c61","retrievedAt":"2026-11-11T22:32:41.713Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"72b6672c-4933-4975-85a7-2a77d7aea75b"},"reviewer":{"model":"gpt-6-luna","runId":"6c9bd3ee-3330-4482-8e13-b0d25bea398a"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T22:33:42.728Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Hao, Wenjian","url":null,"kind":"unknown"},{"name":"Heredia, Paulo C.","url":null,"kind":"unknown"},{"name":"Mou, Shaoshuai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Hao, Wenjian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hao, Wenjian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}},{"actor":{"name":"Heredia, Paulo C.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Heredia, Paulo C.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}},{"actor":{"name":"Mou, Shaoshuai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mou, Shaoshuai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.14186","locator":"head/meta[name=author|citation_author]"},"assertionId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-11T22:48:24.726Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","sourceUrl":"https://arxiv.org/abs/2611.14186","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z"}}],"participationCoverage":{"total":3,"returned":3,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.14186","snapshotId":"725e33ff799d7a13ebe541e93d2e8682cf8d526dd72ab33a72417c003bc10c49","contentSha256":"5ff74c59b4beb4671933d99ba87d79553a61b872a97076baf719bdc16ed3d2ad","textHash":"30eb1eb5c20f1aabb7bd36aa8e551ccfa1c15288550f8afc434959a846cf8aea","observedAt":"2026-11-11T22:48:24.726Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/76fb461a8d5d04d317780adf3a768d1e64ab2a89c696a2547f750fab67882213/source"}}}],"audits":[{"publicationId":"2b66d2aa-016c-49d2-8c01-078d8a67832f","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly credits Wenjian Hao, Paulo C. Heredia and Shaoshuai Mou. It keeps the method, guarantees and results framed as the authors' proposals and reports.","excerpt":"Authors:Wenjian Hao, Paulo C. Heredia, Shaoshuai Mou"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful but drops the payoff of two mechanisms. It says the gradient becomes a constant matrix product but omits the source's point: this enables computationally efficient policy improvement. It recasts the one-step design as avoiding long-horizon predictions, but the source's stated aim is mitigating accumulated prediction errors. It also omits 'safely' from the return to the ground. Central terms (Koopman, policy gradient, feedforward evaluation) rely on the suggested tooltips, and the reader gets no plain sense of why this matters. Smallest repair: add 'enabling computationally efficient policy improvement' and 'to mitigate accumulated prediction errors'.","excerpt":"simplify the model-dependent policy gradient computation to a constant matrix product, enabling computationally efficient policy improvement"},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-10 matches the v1 submission date. The feed date of Nov 11 is later and correctly not used.","excerpt":"[Submitted on 10 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All claims are stated by the source, with matching excerpts and appropriate hedging. Claim 1 says 'learned policy objective', whereas the source says 'approximate' and the immediate cost is 'analytical'. This is minor imprecision, not a material contradiction. The limitations and the question about performance beyond the described maneuvers follow from the abstract and do not overstate it.","excerpt":"combines the analytical immediate cost with an estimate of the future cost evaluated at the one-step predicted state"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-11T22:33:42.728Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}