# What Should a Navigator Remember? Spatiotemporal Memory for Zero-Shot Vision-Language Navigation — arXiv cs.AI [Canonical reading](https://escapemeridian.com/readings/what-should-a-navigator-remember-spatiotemporal-memory-for-zero-166899d7) The authors study what an 8B-scale navigation system should retain when following language instructions without navigation-specific training. Their system organizes information into task, temporal, and spatial memories: instruction progress, observation history anchored to poses, and accumulated geometry. An 8B observer summarizes observations; an 8B reasoner uses the memories to choose waypoint intents or request more views, while a geometric controller executes selected targets. The authors distinguish retaining evidence, making it accessible to the reasoner, and acquiring further observations. On R2R-CE val-unseen, the complete system achieved the highest result among the evaluated Qwen3-based zero-shot baselines. Removing temporal memory reduced SR and sharply increased average path length from 16.9 to 39.1m. Removing the spatial-map and planning component also reduced SR. In real-world corridor and office experiments with a Unitree Go2, the zero-shot method achieved higher success rates than a post-trained baseline. The authors say these results suggest better transfer to the evaluated real-world settings. They also use paired instruction interventions in LAW2 to examine instruction-following behavior beyond endpoint success. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T10:11:06.372Z. First observed: 2026-10-30T06:40:04.841Z. Retrieved: 2026-10-31T04:32:22.231Z. - [What Should a Navigator Remember? Spatiotemporal Memory for Zero-Shot Vision-Language Navigation](https://arxiv.org/abs/2610.38318) ## Limits The supplied evidence is the abstract, not the full paper; it does not provide the detailed evaluation setup or results underlying the reported comparisons. The real-world transfer result is limited in the abstract to the evaluated corridor and office environments. The abstract reports higher success rates than the post-trained baseline but gives no numerical rates. ## Open question What evidence from the evaluated corridor and office experiments underlies the reported higher success rates and transfer claim? ## Source-stated The system combines task, temporal, and spatial memories for later navigation decisions. > Our agent combines instruction progress, hierarchically compressed observation history anchored to poses, and accumulated geometry in complementary task, temporal, and spatial memories. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The system uses an observer to summarize observations and a reasoner to choose targets or request more views, with a controller executing targets. > An 8B observer summarizes observations, and an 8B reasoner uses the memories to select waypoint intents or request additional views, a geometric controller executes the selected targets. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated On R2R-CE val-unseen, the complete system ranked highest among the evaluated Qwen3-based zero-shot baselines. > On R2R-CE val-unseen, the complete system achieves the highest among the evaluated Qwen3-based zero-shot baselines. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated Removing temporal memory reduced SR and increased average path length; removing the spatial-map and planning component also reduced SR. > Removing temporal memory reduces SR and sharply increases average path length from 16.9 to 39.1m, removing the spatial-map and planning component reduces SR as well. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated In evaluated corridor and office experiments, the zero-shot method had higher success rates than the post-trained baseline. > Real-world experiments on a Unitree Go2 show that our zero-shot method achieves higher success rates than the post-trained baseline in both corridor and office environments - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors say their real-world results suggest better transfer to the settings they evaluated. > suggesting better transfer to the evaluated real-world settings. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors use paired instruction interventions to examine behavioral responses beyond endpoint success. > As a complementary evaluation, LAW2 uses paired instruction interventions to examine behavioral responses, instruction following ability beyond endpoint success. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors conclude that structured memory preserving task progress, observation history, and geometry supports zero-shot navigation with smaller open models. > These results support preserving task progress, observation history, and geometry in structured memory for zero-shot navigation with smaller open models. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source and contributor context Peng, Yuhang, Wang, Zhikai, Wang, Ziyi, Zhong, Jiaru, Zheng, Xiaoji, Huang, Jingzhi, Wang, Yi, Gong, Jiangtao · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 7f4a3397-c633-436b-8496-c65393c4cd32. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T10:11:06.372Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: a608345b7327b4e76ee7c2cb0636876ebf842ad1e957fc6b8fb913b8db19845a. Source text hash: e091eb22c08e01ae1a86700997737cd1420e03b19aa17f53f4cc4f2f5d825862. ## Revision and source-check history ### Version 1 — 2026-11-11T10:11:06.372Z The authors study what an 8B-scale navigation system should retain when following language instructions without navigation-specific training. Their system organizes information into task, temporal, and spatial memories: instruction progress, observation history anchored to poses, and accumulated geometry. An 8B observer summarizes observations; an 8B reasoner uses the memories to choose waypoint intents or request more views, while a geometric controller executes selected targets. The authors distinguish retaining evidence, making it accessible to the reasoner, and acquiring further observations. On R2R-CE val-unseen, the complete system achieved the highest result among the evaluated Qwen3-based zero-shot baselines. Removing temporal memory reduced SR and sharply increased average path length from 16.9 to 39.1m. Removing the spatial-map and planning component also reduced SR. In real-world corridor and office experiments with a Unitree Go2, the zero-shot method achieved higher success rates than a post-trained baseline. The authors say these results suggest better transfer to the evaluated real-world settings. They also use paired instruction interventions in LAW2 to examine instruction-following behavior beyond endpoint success. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T10:11:06.372Z. First observed: 2026-10-30T06:40:04.841Z. Retrieved: 2026-10-31T04:32:22.231Z. - [What Should a Navigator Remember? Spatiotemporal Memory for Zero-Shot Vision-Language Navigation](https://arxiv.org/abs/2610.38318) ## Limits The supplied evidence is the abstract, not the full paper; it does not provide the detailed evaluation setup or results underlying the reported comparisons. The real-world transfer result is limited in the abstract to the evaluated corridor and office environments. The abstract reports higher success rates than the post-trained baseline but gives no numerical rates. ## Open question What evidence from the evaluated corridor and office experiments underlies the reported higher success rates and transfer claim? ## Source-stated The system combines task, temporal, and spatial memories for later navigation decisions. > Our agent combines instruction progress, hierarchically compressed observation history anchored to poses, and accumulated geometry in complementary task, temporal, and spatial memories. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The system uses an observer to summarize observations and a reasoner to choose targets or request more views, with a controller executing targets. > An 8B observer summarizes observations, and an 8B reasoner uses the memories to select waypoint intents or request additional views, a geometric controller executes the selected targets. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated On R2R-CE val-unseen, the complete system ranked highest among the evaluated Qwen3-based zero-shot baselines. > On R2R-CE val-unseen, the complete system achieves the highest among the evaluated Qwen3-based zero-shot baselines. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated Removing temporal memory reduced SR and increased average path length; removing the spatial-map and planning component also reduced SR. > Removing temporal memory reduces SR and sharply increases average path length from 16.9 to 39.1m, removing the spatial-map and planning component reduces SR as well. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated In evaluated corridor and office experiments, the zero-shot method had higher success rates than the post-trained baseline. > Real-world experiments on a Unitree Go2 show that our zero-shot method achieves higher success rates than the post-trained baseline in both corridor and office environments - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors say their real-world results suggest better transfer to the settings they evaluated. > suggesting better transfer to the evaluated real-world settings. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors use paired instruction interventions to examine behavioral responses beyond endpoint success. > As a complementary evaluation, LAW2 uses paired instruction interventions to examine behavioral responses, instruction following ability beyond endpoint success. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source-stated The authors conclude that structured memory preserving task progress, observation history, and geometry supports zero-shot navigation with smaller open models. > These results support preserving task progress, observation history, and geometry in structured memory for zero-shot navigation with smaller open models. - [Supporting source](https://arxiv.org/abs/2610.38318) ## Source and contributor context Peng, Yuhang, Wang, Zhikai, Wang, Ziyi, Zhong, Jiaru, Zheng, Xiaoji, Huang, Jingzhi, Wang, Yi, Gong, Jiangtao · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 7f4a3397-c633-436b-8496-c65393c4cd32. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T10:11:06.372Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: a608345b7327b4e76ee7c2cb0636876ebf842ad1e957fc6b8fb913b8db19845a. Source text hash: e091eb22c08e01ae1a86700997737cd1420e03b19aa17f53f4cc4f2f5d825862. ### uncertain — 2026-11-11T10:11:06.372Z — anthropic/claude-opus-5.5 Publication: 7f4a3397-c633-436b-8496-c65393c4cd32 attribution — pass: The work is correctly attributed to the paper's authors on arXiv. Results and the transfer interpretation remain framed as the authors' claims. The title suffix says arXiv cs.AI while the primary listing is cs.RO, but this matches the supplied publisher metadata and does not misattribute the work. > Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI) summary — uncertain: The summary is faithful, but several central terms are unexplained for a non-specialist: SR (success rate) carries the main ablation result, and R2R-CE val-unseen, Qwen3, 8B, waypoint intents, post-trained baseline, Unitree Go2 and LAW2 lack plain context. It also omits the authors' concluding thesis: structured memory helps zero-shot navigation with smaller open models. Smallest repair: gloss SR and the benchmark, note that Go2 is a robot, and add the thesis sentence. > These results support preserving task progress, observation history, and geometry in structured memory for zero-shot navigation with smaller open models. date — pass: The originalPublished date of 2026-10-28 matches the v1 submission date. The feed date is later and is correctly not used. > \[Submitted on 28 Oct 2026\] support — pass: Every claim matches the abstract verbatim, including the 16.9 to 39.1m path length. The transfer claim is kept to the evaluated settings and labeled as the authors' suggestion. The limitations correctly note that the abstract gives no numerical real-world rates. The question follows from that gap and does not lead. > suggesting better transfer to the evaluated real-world settings media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct way to reach the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/166899d74667ced3b5e38c1d51aafb8466b8e310564d1bf8f77d6055212f08f5/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/what-should-a-navigator-remember-spatiotemporal-memory-for-zero-166899d7.json)