Escape Meridian

Nehme, Ghadi, Nam, Dahyun, Srinivasan, Akshay Govind, Ahmed, Faez · Nov 18, 2026

arXiv cs.AI: RoboBuilder: Agentic Robot Co-Design with Real-world Video Feedback in the Loop

Markdown · JSON · Original source

In their abstract, Ghadi Nehme, Dahyun Nam, Akshay Govind Srinivasan and Faez Ahmed introduce RoboBuilder, a where coding agents design a robot’s hardware and program, then test designs that pass simulation on a physical course. The authors report that, with public part data, none of 15 initial designs that passed simulation crossed the real course. Agents instead learn from requested measurements and videos of real runs. Across four coding agents, the authors report that agents solve nearly all easy obstacles and devise mechanisms their search baselines do not reach. They struggle with harder levels, a single robot crossing every obstacle, and transfer from simulation to the real world. The authors report that 66% of simulated passes hold across all levels. In a feedback test, an agent shown video of a real failure redesigns the robot, sometimes correcting its simulator; this removes 72% of level-1 and level-2 failures.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T07:47:30.658Z. First observed: 2026-11-19T05:07:10.829Z. Retrieved: 2026-11-19T07:32:13.667Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The supplied evidence is the abstract; it does not provide the detailed methods or results needed to assess the reported trials beyond the summary given there. The abstract does not quantify how much video feedback helps on harder levels.

Open question

How much does video feedback improve results on the harder levels, where the abstract says the agents falter?

Source-stated

The authors introduce RoboBuilder as a benchmark in which coding agents design robot hardware and programs, and designs that pass simulation are physically tested.

coding agents co-design a robot's hardware and program from standard parts, motors and a custom 3D-printed part, and every design that passes in simulation is built and tested on a physical course

Source-stated

With public part data, none of the 15 initial designs that passed simulation crossed the real course.

under public part data, none of 15 initial passing designs crossed the real course

Source-stated

The authors report that agents solve nearly all easy obstacles and invent mechanisms their search baselines do not reach, but struggle with harder tasks and real-world transfer.

agents solve nearly all easy obstacles and invent mechanisms our search baselines do not reach, but falter at harder levels, when one robot must cross every obstacle, and in the real world

Source-stated

The abstract reports that 66% of simulated passes hold across all levels.

in the real world, where 66% of simulated passes hold across all levels

Source-stated

In trials with video of real failures, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures.

shown a video of its real failure, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures

Source and contributor context

Nehme, Ghadi, Nam, Dahyun, Srinivasan, Akshay Govind, Ahmed, Faez · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Agentic AI

AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 2c855c10-92d1-43ce-83f6-cb29dde298e0.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T07:47:30.658Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f7b47d5fb666e0f46b44960da86838a3285d667ab9ee9482868583a5389b11af. Source text hash: d0766bdcd4ca7aef4935237ce587320438eab8b223ff6a36d6dde22f85bca9e5.

Revision and source-check history

Version 1 · 2026-11-19T07:47:30.658Z

arXiv cs.AI: RoboBuilder: Agentic Robot Co-Design with Real-world Video Feedback in the Loop

In their abstract, Ghadi Nehme, Dahyun Nam, Akshay Govind Srinivasan and Faez Ahmed introduce RoboBuilder, a where coding agents design a robot’s hardware and program, then test designs that pass simulation on a physical course. The authors report that, with public part data, none of 15 initial designs that passed simulation crossed the real course. Agents instead learn from requested measurements and videos of real runs. Across four coding agents, the authors report that agents solve nearly all easy obstacles and devise mechanisms their search baselines do not reach. They struggle with harder levels, a single robot crossing every obstacle, and transfer from simulation to the real world. The authors report that 66% of simulated passes hold across all levels. In a feedback test, an agent shown video of a real failure redesigns the robot, sometimes correcting its simulator; this removes 72% of level-1 and level-2 failures.

Original source

cs.AI · Article

Source details

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T07:47:30.658Z. First observed: 2026-11-19T05:07:10.829Z. Retrieved: 2026-11-19T07:32:13.667Z.

Limits

The supplied evidence is the abstract; it does not provide the detailed methods or results needed to assess the reported trials beyond the summary given there. The abstract does not quantify how much video feedback helps on harder levels.

Open question

How much does video feedback improve results on the harder levels, where the abstract says the agents falter?

Source-stated

The authors introduce RoboBuilder as a benchmark in which coding agents design robot hardware and programs, and designs that pass simulation are physically tested.

coding agents co-design a robot's hardware and program from standard parts, motors and a custom 3D-printed part, and every design that passes in simulation is built and tested on a physical course

Source-stated

With public part data, none of the 15 initial designs that passed simulation crossed the real course.

under public part data, none of 15 initial passing designs crossed the real course

Source-stated

The authors report that agents solve nearly all easy obstacles and invent mechanisms their search baselines do not reach, but struggle with harder tasks and real-world transfer.

agents solve nearly all easy obstacles and invent mechanisms our search baselines do not reach, but falter at harder levels, when one robot must cross every obstacle, and in the real world

Source-stated

The abstract reports that 66% of simulated passes hold across all levels.

in the real world, where 66% of simulated passes hold across all levels

Source-stated

In trials with video of real failures, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures.

shown a video of its real failure, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures

Source and contributor context

Nehme, Ghadi, Nam, Dahyun, Srinivasan, Akshay Govind, Ahmed, Faez · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Agentic AI

AI systems that plan and carry out a series of steps toward a goal, often by using other software, rather than giving one answer.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 2c855c10-92d1-43ce-83f6-cb29dde298e0.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T07:47:30.658Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: f7b47d5fb666e0f46b44960da86838a3285d667ab9ee9482868583a5389b11af. Source text hash: d0766bdcd4ca7aef4935237ce587320438eab8b223ff6a36d6dde22f85bca9e5.

uncertain · 2026-11-19T07:47:30.658Z · anthropic/claude-opus-5.5

Publication: 2c855c10-92d1-43ce-83f6-cb29dde298e0

attribution — pass: The reading correctly attributes RoboBuilder and its results to the four listed authors and frames the findings as the authors' own reports in their arXiv abstract.

Authors:Ghadi Nehme, Dahyun Nam, Akshay Govind Srinivasan, Faez Ahmed

summary — uncertain: The draft says agents 'learn from requested measurements and videos,' but the source says the agent learns the simulator. Dropping that makes 'sometimes correcting its simulator' unclear. Smallest repair: 'an agent learns the simulator from measurements it requests and videos of real runs.' The question refers to 'harder levels,' yet the 72% figure already includes level 2, so it should specify level 3. Central terms such as benchmark, coding agents and search baselines lack plain explanation, and the reading does not say why the work matters. The abstract itself frames that as measuring progress toward agents that engineer real machines.

an agent learns the simulator from measurements it requests and videos of real runs

date — pass: originalPublished 2026-11-18 matches the arXiv v1 submission date.

[Submitted on 18 Nov 2026]

support — pass: Each claim matches its excerpt, and the figures (15 designs, 66%, 72%, four agents) are stated as the source states them. No benefits or costs are invented. The limitation about harder levels is reasonable, although level 2 is partly covered by the 72% figure.

removes 72% of level-1 and level-2 failures

media — pass: The selected media is the verified arXiv abstract page, which is the direct original source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.