Shmuel Berman, Michael Ilie, Jia Deng, and Daniel Freeman argue in Anthropic that robot access matters

Shmuel Berman, Michael Ilie, Jia Deng, and Daniel Freeman argue in Anthropic that robot access matters

Anthropic published this research on July 9, 2026. Shmuel Berman, Michael Ilie, Jia Deng, and Daniel Freeman report tests of language models controlling simulated and physical robots. They find that performance depends heavily on how a model is connected to a robot: models mostly fail when directly controlling the joints, but can complete some real navigation and manipulation tasks when supervising a pretrained controller or using orientation tools. The authors argue that this matters for safety because a model can affect the physical world without controlling a robot’s joints itself; access to a capable controller may be enough. In their tests, pretrained policies raised task performance, but models still struggled with spatial memory, long plans and reliable task completion. In one physical-robot run, a model misjudged a trash can as out of the way; the robot struck and dragged it before the team stopped it. The authors conclude that evaluations and deployments should treat access level as part of the system. They call for clearer limits on physical access, so a system can affect some objects while being blocked from others. Real-world trials were limited, and how well the results carry over to other robots, tasks and access controls remains unknown.

Publication: c5fcfad6-92c4-9ba7-c6dc-167392f0f84e

attribution — pass: The reading correctly attributes the research to Shmuel Berman, Michael Ilie, Jia Deng and Daniel Freeman, published by Anthropic. Findings and safety conclusions are framed as the authors' reports and arguments, not as established fact. The title's phrase 'argue in Anthropic' is awkward but does not misattribute.

Shmuel Berman, Michael Ilie, Jia Deng, and Daniel Freeman

summary — uncertain: The summary accurately conveys the interface-dependence finding and the safety argument. It drops the source's other central thesis: models are improving quickly across generations, and the reliability gap is 'closing with each model generation.' Without it, the summary reads as mostly limitations and loses the authors' force. Smallest repair: add one attributed sentence saying the authors report rapid, uneven generational gains, especially with higher-level control. 'Policy' and 'orientation tools' are also unexplained beyond the pretrained definition. A brief gloss, such as a separate network turning high-level commands into joint movements, would help.

Models are getting better at robotics quickly, but we found that how capable they are depends heavily on how they are connected to the robot

date — pass: The reading states July 9, 2026, which matches the UTC calendar day of evidence.originalPublished, and labels the text as retrieved on October 27, 2026. The page was modified on October 23, 2026, but the reading relies on core body passages that appear integral to the original article. There is no hindsight framing, and the authors' expectations are not presented as outcomes. The evidence is a publisher page, not an archive copy.

support — pass: Each claim matches its quoted source text. That includes the interface dependence, the controller-access safety point, the trash-can incident, the conclusion on access level and the limited real-world trials. The statement that access to a capable controller 'may be enough' stays within the source's wording. The open question about generalization follows from the authors' own stated limits. No benefits or costs are invented.

a model does not need to drive joints itself to act capably in the world, only access to a competent controller.

media — pass: No media was selected, and no verified media candidates were supplied, so nothing is misidentified or invented.