# arXiv eess.SY: Authors propose an onboard vision-language navigation stack for aerial robots [Canonical reading](https://escapemeridian.com/readings/arxiv-eess-sy-authors-propose-an-onboard-vision-language-ec525db3) The authors of “VLN on the Fly” propose an onboard stack that separates grounding, planning, and control rather than combining them in one end-to-end policy. Their design uses a quantized VLM to map an instruction to an image cell, depth to turn that target into a 3D goal, a B-spline planner to produce a trajectory, and a pretrained reinforcement learning policy to track it. In 15 onboard flights involving three everyday referents in a controlled indoor volume, the stack reached the target in 13 trials, with 5.72 cm mean goal error and 39.3% average GPU utilization. In six additional cluttered-environment trials, it tracked collision-free trajectories under onboard perception gating. These results describe a limited set of flights; the abstract does not establish performance in other environments or broader operational reliability. The authors argue that keeping stages inspectable preserves observability and safety checks that end-to-end policies give up. As an Escape Meridian reading, the abstract leaves performance beyond the described trials unknown. How would the stack perform in environments beyond the controlled indoor volume and the six cluttered-environment trials described in the abstract? Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv eess.SY · Article Original source date: Aug 7, 2026 (2026-08-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-05T10:18:25.660Z. First observed: 2026-10-27T04:27:08.136Z. Retrieved: 2026-10-30T01:48:53.748Z. - [VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots](https://arxiv.org/abs/2609.20191) ## Limits The abstract reports a limited number of flights and does not establish performance outside the described controlled indoor volume and cluttered-environment trials. The source page provides the abstract, not the full paper's methods or results; this reading is limited to the claims in that abstract. ## Open question How would the stack perform in environments beyond the controlled indoor volume and the six cluttered-environment trials described in the abstract? ## Source-stated The authors propose an onboard aerial-robot navigation stack with grounding, planning, and control as separate stages. > We propose VLN on the Fly, an onboard stack that keeps grounding, planning, and control as separate, inspectable stages. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated The stack uses a quantized VLM, depth, a B-spline planner, and a pretrained reinforcement learning policy in sequence. > A quantized VLM grounds an instruction to a coarse image cell, depth lifts it to a 3D goal, a fast B-spline planner returns a feasible trajectory, and a pretrained reinforcement learning policy tracks it to motor commands across quadrotors. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated Across 15 onboard flights in a controlled indoor volume, the stack reached the target in 13 trials, with 5.72 cm mean goal error and 39.3% average GPU utilization. > Across 15 onboard flights over three everyday referents in a controlled indoor volume, the stack reaches the target in 13 of 15 trials with 5.72 cm mean goal error and 39.3% average GPU utilization. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated In six additional cluttered-environment trials, the stack tracked collision-free trajectories under onboard perception gating. > In 6 additional cluttered-environment trials, the stack tracks collision-free trajectories under onboard perception gating. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Escape Meridian interpretation The abstract reports these results in a controlled indoor volume and a further six cluttered-environment trials; performance beyond those settings is not established there. > Across 15 onboard flights over three everyday referents in a controlled indoor volume - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source and contributor context Tayar, Marco S., Tommaselli, Felipe, Capezzuto, Gianluca, Saraiva, Pedro Antonio Rabelo, de Freitas, Pedro H. V., Kido, Lucas, Sonego, Guilherme, Godoy, Ricardo V., Becker, Marcelo · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Quantization Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy. - [Definition reference](https://developers.google.com/machine-learning/glossary#quantization) ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Reinforcement learning Training by trial and error, in which a system is rewarded for the outcomes its designers want. - [Definition reference](https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl) ## Graphics processing unit A chip that performs many calculations at once; the main hardware used to train and run AI models. - [Definition reference](https://en.wikipedia.org/wiki/Graphics_processing_unit) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6d89c36b-fb16-4b53-8eb3-61c709b06fe1. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T10:18:25.660Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 4ff3d66e9f4f922e6344c244c187ca13dfb467c1284aee0082d755b02d5bcfda. Source text hash: 6866c05de5800017cff735ce5f741ee58ba8eae629f906b31386e08ab4fbbf27. ## Revision and source-check history ### Version 1 — 2026-11-05T10:18:25.660Z The authors of “VLN on the Fly” propose an onboard stack that separates grounding, planning, and control rather than combining them in one end-to-end policy. Their design uses a quantized VLM to map an instruction to an image cell, depth to turn that target into a 3D goal, a B-spline planner to produce a trajectory, and a pretrained reinforcement learning policy to track it. In 15 onboard flights involving three everyday referents in a controlled indoor volume, the stack reached the target in 13 trials, with 5.72 cm mean goal error and 39.3% average GPU utilization. In six additional cluttered-environment trials, it tracked collision-free trajectories under onboard perception gating. These results describe a limited set of flights; the abstract does not establish performance in other environments or broader operational reliability. The authors argue that keeping stages inspectable preserves observability and safety checks that end-to-end policies give up. As an Escape Meridian reading, the abstract leaves performance beyond the described trials unknown. How would the stack perform in environments beyond the controlled indoor volume and the six cluttered-environment trials described in the abstract? ## Original source arXiv eess.SY · Article Original source date: Aug 7, 2026 (2026-08-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-05T10:18:25.660Z. First observed: 2026-10-27T04:27:08.136Z. Retrieved: 2026-10-30T01:48:53.748Z. - [VLN on the Fly: An Onboard Vision-Language Navigation Stack for Aerial Robots](https://arxiv.org/abs/2609.20191) ## Limits The abstract reports a limited number of flights and does not establish performance outside the described controlled indoor volume and cluttered-environment trials. The source page provides the abstract, not the full paper's methods or results; this reading is limited to the claims in that abstract. ## Open question How would the stack perform in environments beyond the controlled indoor volume and the six cluttered-environment trials described in the abstract? ## Source-stated The authors propose an onboard aerial-robot navigation stack with grounding, planning, and control as separate stages. > We propose VLN on the Fly, an onboard stack that keeps grounding, planning, and control as separate, inspectable stages. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated The stack uses a quantized VLM, depth, a B-spline planner, and a pretrained reinforcement learning policy in sequence. > A quantized VLM grounds an instruction to a coarse image cell, depth lifts it to a 3D goal, a fast B-spline planner returns a feasible trajectory, and a pretrained reinforcement learning policy tracks it to motor commands across quadrotors. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated Across 15 onboard flights in a controlled indoor volume, the stack reached the target in 13 trials, with 5.72 cm mean goal error and 39.3% average GPU utilization. > Across 15 onboard flights over three everyday referents in a controlled indoor volume, the stack reaches the target in 13 of 15 trials with 5.72 cm mean goal error and 39.3% average GPU utilization. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source-stated In six additional cluttered-environment trials, the stack tracked collision-free trajectories under onboard perception gating. > In 6 additional cluttered-environment trials, the stack tracks collision-free trajectories under onboard perception gating. - [Supporting source](https://arxiv.org/abs/2609.20191) ## Escape Meridian interpretation The abstract reports these results in a controlled indoor volume and a further six cluttered-environment trials; performance beyond those settings is not established there. > Across 15 onboard flights over three everyday referents in a controlled indoor volume - [Supporting source](https://arxiv.org/abs/2609.20191) ## Source and contributor context Tayar, Marco S., Tommaselli, Felipe, Capezzuto, Gianluca, Saraiva, Pedro Antonio Rabelo, de Freitas, Pedro H. V., Kido, Lucas, Sonego, Guilherme, Godoy, Ricardo V., Becker, Marcelo · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Quantization Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy. - [Definition reference](https://developers.google.com/machine-learning/glossary#quantization) ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Reinforcement learning Training by trial and error, in which a system is rewarded for the outcomes its designers want. - [Definition reference](https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl) ## Graphics processing unit A chip that performs many calculations at once; the main hardware used to train and run AI models. - [Definition reference](https://en.wikipedia.org/wiki/Graphics_processing_unit) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6d89c36b-fb16-4b53-8eb3-61c709b06fe1. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T10:18:25.660Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 4ff3d66e9f4f922e6344c244c187ca13dfb467c1284aee0082d755b02d5bcfda. Source text hash: 6866c05de5800017cff735ce5f741ee58ba8eae629f906b31386e08ab4fbbf27. ### uncertain — 2026-11-05T10:18:25.660Z — anthropic/claude-opus-5.5 Publication: 6d89c36b-fb16-4b53-8eb3-61c709b06fe1 attribution — pass: The design, results and argument are attributed to the authors of the arXiv paper. The title prefix uses the feed label 'arXiv eess.SY', while the page lists cs.RO as the primary category. eess.SY is still a listed subject, so this is not a misattribution. > We propose VLN on the Fly, an onboard stack that keeps grounding, planning, and control as separate, inspectable stages. summary — uncertain: The reading is accurate but hard to follow for non-specialists. It never says plainly that vision-language navigation means a robot flying toward something described in words. It also omits the paper's core motivation: grounding, planning and control must share limited onboard compute, and errors are hard to isolate in flight. Without that, the 39.3% GPU figure has little meaning. Central terms (quantized VLM, grounding, referents, perception gating) go unexplained and need tooltips. The limits caveat repeats three times. Smallest repair: add the compute and error-isolation rationale and a one-line plain description of the task. > Running vision-language navigation fully onboard an aerial robot is hard, since grounding, planning, and control must share limited compute and a single-stage error is difficult to isolate in flight. date — pass: originalPublished 2026-08-07 matches the v1 submission date. It is not the 25 Oct 2026 v2 revision or the 27 Oct feed date. > Submitted on 7 Aug 2026 (v1), last revised 25 Oct 2026 (this version, v2) support — pass: Each claim and figure matches the abstract: 13 of 15 trials, 5.72 cm, 39.3%, and six cluttered-environment trials. The interpretation about unknown performance beyond the tested settings is labeled and conditional. No unsupported benefits or costs are implied. > the stack reaches the target in 13 of 15 trials with 5.72 cm mean goal error and 39.3% average GPU utilization media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the original source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/ec525db3626e03336483c8549fe1aead05ff3cb433b354b911e986905a3b3d59/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-eess-sy-authors-propose-an-onboard-vision-language-ec525db3.json)