# arXiv cs.AI: Perceptive Humanoid Motion from Simulation [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-perceptive-humanoid-motion-from-simulation-aaebca3f) Authors Siyuan Hu and colleagues argue that a data bottleneck constrains generalist humanoid autonomy: mapping pixels and free-form language to low-level joint commands requires paired supervision, and human teleoperation can take at least an hour of human time to produce an hour of data. They present HALO, a system that synthesizes vision-language-motion data across a thousand procedurally generated homes. Its corpus scales with compute rather than human labor. HALO learns physical skills such as navigating to named objects, moving through half-open doors, and pushing boxes, then combines skills to solve composite, long-horizon tasks. The authors report that HALO transfers zero-shot to the physical world despite never seeing a real home during training, achieving a 91% success rate across 360 trials in six unmapped real-world environments. Escape Meridian interpretation: this approach could reduce reliance on human-collected training data, but the reported trials are a bounded evaluation, not evidence of performance across homes generally. The abstract reports an aggregate success rate without breaking it down by environment or task. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T00:05:16.224Z. First observed: 2026-11-05T05:06:31.707Z. Retrieved: 2026-11-09T14:01:47.401Z. - [Perceptive Humanoid Motion from Simulation](https://arxiv.org/abs/2611.06908) ## Limits The evidence is the arXiv abstract; it does not provide a breakdown of success rates by environment, task, or trial conditions. ## Open question How did HALO's success rate vary across the six environments and the different tasks? ## Source-stated The authors say paired supervision for mapping visual and language input to robot joint commands is a data bottleneck for generalist humanoid autonomy. > mapping pixels and free-form language to low-level joint commands requires paired supervision, and no corpus of such data exists at sufficiently large scale. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source-stated HALO synthesizes training data across procedurally generated homes, with a corpus that scales with compute rather than human labor. > a pipeline that synthesizes vision-language-motion data across a thousand procedurally generated homes. The corpus scales with compute rather than human labor. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source-stated The authors report that HALO transfers zero-shot to the physical world and achieved a 91% success rate over 360 trials in six unmapped real-world environments. > HALO transfers zero-shot to the physical world, achieving a 91% success rate across 360 trials in six unmapped real-world environments. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Escape Meridian interpretation The reported evaluation supports a claim about the specified trials, but does not establish performance across homes generally. > achieving a 91% success rate across 360 trials in six unmapped real-world environments. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source and contributor context Hu, Siyuan, Abuduweili, Abulikemu, Meng, Yue, Liu, Shipeng, Leboutet, Quentin, Chen, Chen, Müller, Matthias, Koltun, Vladlen · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Teleoperation A person controlling a robot from a distance. - [Definition reference](https://en.wikipedia.org/wiki/Teleoperation) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: b7320a56-47d0-46aa-8db4-08eed6d048a3. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T00:05:16.224Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 9b6ad9bfa98ab0efa9bc66e5fc1359da254a77f1b0a637f3944b8b5fa330578a. Source text hash: 62da5fcc98d9c618ace43c2d1ec011e0233b0487dc4009041e844ba97f55ba68. ## Revision and source-check history ### Version 1 — 2026-11-10T00:05:16.224Z Authors Siyuan Hu and colleagues argue that a data bottleneck constrains generalist humanoid autonomy: mapping pixels and free-form language to low-level joint commands requires paired supervision, and human teleoperation can take at least an hour of human time to produce an hour of data. They present HALO, a system that synthesizes vision-language-motion data across a thousand procedurally generated homes. Its corpus scales with compute rather than human labor. HALO learns physical skills such as navigating to named objects, moving through half-open doors, and pushing boxes, then combines skills to solve composite, long-horizon tasks. The authors report that HALO transfers zero-shot to the physical world despite never seeing a real home during training, achieving a 91% success rate across 360 trials in six unmapped real-world environments. Escape Meridian interpretation: this approach could reduce reliance on human-collected training data, but the reported trials are a bounded evaluation, not evidence of performance across homes generally. The abstract reports an aggregate success rate without breaking it down by environment or task. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T00:05:16.224Z. First observed: 2026-11-05T05:06:31.707Z. Retrieved: 2026-11-09T14:01:47.401Z. - [Perceptive Humanoid Motion from Simulation](https://arxiv.org/abs/2611.06908) ## Limits The evidence is the arXiv abstract; it does not provide a breakdown of success rates by environment, task, or trial conditions. ## Open question How did HALO's success rate vary across the six environments and the different tasks? ## Source-stated The authors say paired supervision for mapping visual and language input to robot joint commands is a data bottleneck for generalist humanoid autonomy. > mapping pixels and free-form language to low-level joint commands requires paired supervision, and no corpus of such data exists at sufficiently large scale. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source-stated HALO synthesizes training data across procedurally generated homes, with a corpus that scales with compute rather than human labor. > a pipeline that synthesizes vision-language-motion data across a thousand procedurally generated homes. The corpus scales with compute rather than human labor. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source-stated The authors report that HALO transfers zero-shot to the physical world and achieved a 91% success rate over 360 trials in six unmapped real-world environments. > HALO transfers zero-shot to the physical world, achieving a 91% success rate across 360 trials in six unmapped real-world environments. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Escape Meridian interpretation The reported evaluation supports a claim about the specified trials, but does not establish performance across homes generally. > achieving a 91% success rate across 360 trials in six unmapped real-world environments. - [Supporting source](https://arxiv.org/abs/2611.06908) ## Source and contributor context Hu, Siyuan, Abuduweili, Abulikemu, Meng, Yue, Liu, Shipeng, Leboutet, Quentin, Chen, Chen, Müller, Matthias, Koltun, Vladlen · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Teleoperation A person controlling a robot from a distance. - [Definition reference](https://en.wikipedia.org/wiki/Teleoperation) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: b7320a56-47d0-46aa-8db4-08eed6d048a3. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T00:05:16.224Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 9b6ad9bfa98ab0efa9bc66e5fc1359da254a77f1b0a637f3944b8b5fa330578a. Source text hash: 62da5fcc98d9c618ace43c2d1ec011e0233b0487dc4009041e844ba97f55ba68. ### passed — 2026-11-10T00:05:16.224Z — anthropic/claude-opus-5.5 Publication: b7320a56-47d0-46aa-8db4-08eed6d048a3 attribution — pass: The work is correctly attributed to Siyuan Hu and colleagues, matching the listed authors, on arXiv. Claims are framed as what the authors argue, present or report. The interpretive sentence is explicitly labeled as Escape Meridian interpretation. > Authors:Siyuan Hu, Abulikemu Abuduweili, Yue Meng, Shipeng Liu, Quentin Leboutet, Chen Chen, Matthias Müller, Vladlen Koltun summary — pass: The summary follows the abstract: the data bottleneck, the HALO synthetic-data pipeline, skills and composition, and the 91% result across 360 trials in six environments. Saying teleoperation 'can take' at least an hour slightly softens 'require', but meaning is preserved. Terms such as zero-shot, paired supervision and procedurally generated could use term-library tooltips. However, context such as 'never seeing a real home during training' keeps the core development readable. The question follows from the stated gap about the aggregate result. > Without ever seeing a real home during training, HALO transfers zero-shot to the physical world date — pass: originalPublished 2026-11-04 matches the v1 arXiv submission date. The feed date of 2026-11-05 is later and correctly not used. > \[Submitted on 4 Nov 2026\] support — pass: Each claim's excerpt is verbatim from the abstract and supports the claim. The interpretation is conditional ('could reduce reliance') and bounded to the reported trials. It does not convert the success rate into general real-world reliability. The limitation correctly notes the abstract gives no per-environment or per-task breakdown. The reported results remain the authors' claims and are not independently verified. > achieving a 91% success rate across 360 trials in six unmapped real-world environments. media — pass: The selected media is the verified direct link to the original arXiv abstract page, matching the source URL. No better source media was found. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/aaebca3fe646a5a2c74fbed648395d2939985c9b76f03f08418d34534c2f1129/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-perceptive-humanoid-motion-from-simulation-aaebca3f.json)