{"id":"3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0","title":"arXiv cs.AI: ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","argument":"The authors of ReactBench-AD argue that common autonomous-driving benchmarks, dominated by routine scenarios, cannot test whether driving models handle rare hazards. Their benchmark inserts a crossing pedestrian, a standing pedestrian or a stationary car into real driving scenes, creating pixel-level counterfactual pairs: each edited scene differs from its original by the inserted object. This lets the authors compare predicted trajectories and isolate the object’s effect. In tests of four VLAs and two WAMs, they report that the models reacted weakly, often barely at all. That finding challenges claims of strong long-tail capability out of the box. The authors also report a more encouraging result: after a short fine-tuning stage on edited scenes, ReCogDrive reacted better, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving. They argue that models may therefore be a strong foundation for acquiring these behaviors with little additional training. They emphasize the value of real or synthetic data demonstrating hazards that nominal datasets rarely contain. The abstract does not give the size of the evaluation or detailed measurements of the reported improvements.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s abstract; it does not provide evaluation size, detailed measurements, or the fine-tuning procedure. The abstract reports generalization to unseen objects and fully real scenes but does not specify their number or range.","speaker":{"name":"Theodoridis, Nikos, Mohandas, Reenu, Sharma, Sushil, Hogan, Ciarán, Sistu, Ganesh, Scanlan, Anthony, Brophy, Tim, Eising, Ciarán","roleAtSource":"Article author"},"source":{"title":"ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.20011","publishedAt":"2026-11-15","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say existing benchmarks dominated by nominal scenarios cannot test the long-tail capability they aim to evaluate.","excerpt":"most existing benchmarks are dominated by nominal scenarios and therefore cannot test this promise.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"ReactBench-AD creates counterfactual scene pairs by inserting hazards across camera views and history frames, allowing comparison of the predicted trajectory with and without an inserted object.","excerpt":"Each edited scene thus forms an exact, pixel-level counterfactual pair with its original, which allows us to isolate the causal effect of the inserted object on the predicted trajectory.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors report weak reactions from the four VLAs and two WAMs they evaluated.","excerpt":"Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors report that short fine-tuning on edited scenes improved ReCogDrive’s reactions and generalized to unseen objects and fully real scenes, with minimal cost to nominal driving.","excerpt":"a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors argue that the results challenge out-of-the-box long-tail capabilities while suggesting these models may acquire them with little additional training.","excerpt":"These results call into question the out-of-the-box long-tail capabilities of these models, but suggest that they can be a strong foundation for acquiring them with little additional training","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.20011","checkedAt":"2026-11-17T09:34:07.456Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How many unseen objects and fully real scenes were used to assess whether ReCogDrive’s learned behavior generalizes?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","summary":"The authors of ReactBench-AD argue that common autonomous-driving benchmarks, dominated by routine scenarios, cannot test whether driving models handle rare hazards. Their benchmark inserts a crossing pedestrian, a standing pedestrian or a stationary car into real driving scenes, creating pixel-level counterfactual pairs: each edited scene differs from its original by the inserted object. This lets the authors compare predicted trajectories and isolate the object’s effect. In tests of four VLAs and two WAMs, they report that the models reacted weakly, often barely at all. That finding challenges claims of strong long-tail capability out of the box. The authors also report a more encouraging result: after a short fine-tuning stage on edited scenes, ReCogDrive reacted better, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving. They argue that models may therefore be a strong foundation for acquiring these behaviors with little additional training. They emphasize the value of real or synthetic data demonstrating hazards that nominal datasets rarely contain. The abstract does not give the size of the evaluation or detailed measurements of the reported improvements.","question":"How many unseen objects and fully real scenes were used to assess whether ReCogDrive’s learned behavior generalizes?","claims":[{"text":"The authors say existing benchmarks dominated by nominal scenarios cannot test the long-tail capability they aim to evaluate.","excerpt":"most existing benchmarks are dominated by nominal scenarios and therefore cannot test this promise.","support":"source-stated"},{"text":"ReactBench-AD creates counterfactual scene pairs by inserting hazards across camera views and history frames, allowing comparison of the predicted trajectory with and without an inserted object.","excerpt":"Each edited scene thus forms an exact, pixel-level counterfactual pair with its original, which allows us to isolate the causal effect of the inserted object on the predicted trajectory.","support":"source-stated"},{"text":"The authors report weak reactions from the four VLAs and two WAMs they evaluated.","excerpt":"Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all.","support":"source-stated"},{"text":"The authors report that short fine-tuning on edited scenes improved ReCogDrive’s reactions and generalized to unseen objects and fully real scenes, with minimal cost to nominal driving.","excerpt":"a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving.","support":"source-stated"},{"text":"The authors argue that the results challenge out-of-the-box long-tail capabilities while suggesting these models may acquire them with little additional training.","excerpt":"These results call into question the out-of-the-box long-tail capabilities of these models, but suggest that they can be a strong foundation for acquiring them with little additional training","support":"source-stated"}],"limitations":["The evidence is the paper’s abstract; it does not provide evaluation size, detailed measurements, or the fine-tuning procedure.","The abstract reports generalization to unseen objects and fully real scenes but does not specify their number or range."],"mediaId":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","correctionReason":null,"id":"3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0","publicationId":"99a11c1a-5f01-488a-8da3-6866fbb62bf2","version":1,"sourceUrl":"https://arxiv.org/abs/2611.20011","sourceTitle":"ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-15","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:31:18.637Z","createdAt":"2026-11-17T09:02:08.743Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","kind":"article","url":"https://arxiv.org/abs/2611.20011","sourceUrl":"https://arxiv.org/abs/2611.20011","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T08:48:45.656Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.20011","checkedAt":"2026-11-17T09:34:07.456Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"efde79e8d2f17481abcf3b9cc8196a5e62ca871fa33c7f250b57026a9e359455","decidedAt":"2026-11-17T08:48:46.567Z"},"provenance":{"textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observationId":"bddc8797d40b42eb2df437501a5f498e85008d02d952277bd6b9e130cebf25b5","retrievedAt":"2026-11-17T08:48:45.540Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"81330922-2f3e-4e5d-8905-889aef492aa2"},"reviewer":{"model":"gpt-6-luna","runId":"fc8b30f8-d089-4856-82aa-ad42f95f1604"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T09:02:08.743Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Theodoridis, Nikos","url":null,"kind":"unknown"},{"name":"Mohandas, Reenu","url":null,"kind":"unknown"},{"name":"Sharma, Sushil","url":null,"kind":"unknown"},{"name":"Hogan, Ciarán","url":null,"kind":"unknown"},{"name":"Sistu, Ganesh","url":null,"kind":"unknown"},{"name":"Scanlan, Anthony","url":null,"kind":"unknown"},{"name":"Brophy, Tim","url":null,"kind":"unknown"},{"name":"Eising, Ciarán","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Theodoridis, Nikos","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Theodoridis, Nikos","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Mohandas, Reenu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mohandas, Reenu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Sharma, Sushil","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sharma, Sushil","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Hogan, Ciarán","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hogan, Ciarán","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Sistu, Ganesh","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sistu, Ganesh","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Scanlan, Anthony","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Scanlan, Anthony","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Brophy, Tim","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Brophy, Tim","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Eising, Ciarán","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eising, Ciarán","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.20011","snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-reactbench-ad-do-driving-vlas-and-world-action-3c1ff8fe","formats":{"html":"/readings/arxiv-cs-ai-reactbench-ad-do-driving-vlas-and-world-action-3c1ff8fe","markdown":"/readings/arxiv-cs-ai-reactbench-ad-do-driving-vlas-and-world-action-3c1ff8fe.md","json":"/readings/arxiv-cs-ai-reactbench-ad-do-driving-vlas-and-world-action-3c1ff8fe.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-counterfactual","name":"Counterfactual","explanation":"An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.","referenceUrl":"https://dictionary.cambridge.org/dictionary/english/counterfactual"},{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"},{"id":"term-synthetic-data","name":"Synthetic data","explanation":"Training or test data generated by software or another model rather than collected from the world.","referenceUrl":"https://en.wikipedia.org/wiki/Synthetic_data"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0","revision":"99a11c1a-5f01-488a-8da3-6866fbb62bf2","revisionKind":"publication-id","title":"arXiv cs.AI: ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","url":"https://escapemeridian.com/readings/arxiv-cs-ai-reactbench-ad-do-driving-vlas-and-world-action-3c1ff8fe"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.20011","revision":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","revisionKind":"sha256-source-text","title":"ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","url":"https://arxiv.org/abs/2611.20011"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0","title":"arXiv cs.AI: ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","argument":"The authors of ReactBench-AD argue that common autonomous-driving benchmarks, dominated by routine scenarios, cannot test whether driving models handle rare hazards. Their benchmark inserts a crossing pedestrian, a standing pedestrian or a stationary car into real driving scenes, creating pixel-level counterfactual pairs: each edited scene differs from its original by the inserted object. This lets the authors compare predicted trajectories and isolate the object’s effect. In tests of four VLAs and two WAMs, they report that the models reacted weakly, often barely at all. That finding challenges claims of strong long-tail capability out of the box. The authors also report a more encouraging result: after a short fine-tuning stage on edited scenes, ReCogDrive reacted better, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving. They argue that models may therefore be a strong foundation for acquiring these behaviors with little additional training. They emphasize the value of real or synthetic data demonstrating hazards that nominal datasets rarely contain. The abstract does not give the size of the evaluation or detailed measurements of the reported improvements.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s abstract; it does not provide evaluation size, detailed measurements, or the fine-tuning procedure. The abstract reports generalization to unseen objects and fully real scenes but does not specify their number or range.","speaker":{"name":"Theodoridis, Nikos, Mohandas, Reenu, Sharma, Sushil, Hogan, Ciarán, Sistu, Ganesh, Scanlan, Anthony, Brophy, Tim, Eising, Ciarán","roleAtSource":"Article author"},"source":{"title":"ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.20011","publishedAt":"2026-11-15","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say existing benchmarks dominated by nominal scenarios cannot test the long-tail capability they aim to evaluate.","excerpt":"most existing benchmarks are dominated by nominal scenarios and therefore cannot test this promise.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"ReactBench-AD creates counterfactual scene pairs by inserting hazards across camera views and history frames, allowing comparison of the predicted trajectory with and without an inserted object.","excerpt":"Each edited scene thus forms an exact, pixel-level counterfactual pair with its original, which allows us to isolate the causal effect of the inserted object on the predicted trajectory.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors report weak reactions from the four VLAs and two WAMs they evaluated.","excerpt":"Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors report that short fine-tuning on edited scenes improved ReCogDrive’s reactions and generalized to unseen objects and fully real scenes, with minimal cost to nominal driving.","excerpt":"a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving.","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"},{"text":"The authors argue that the results challenge out-of-the-box long-tail capabilities while suggesting these models may acquire them with little additional training.","excerpt":"These results call into question the out-of-the-box long-tail capabilities of these models, but suggest that they can be a strong foundation for acquiring them with little additional training","url":"https://arxiv.org/abs/2611.20011","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.20011","checkedAt":"2026-11-17T09:34:07.456Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How many unseen objects and fully real scenes were used to assess whether ReCogDrive’s learned behavior generalizes?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","summary":"The authors of ReactBench-AD argue that common autonomous-driving benchmarks, dominated by routine scenarios, cannot test whether driving models handle rare hazards. Their benchmark inserts a crossing pedestrian, a standing pedestrian or a stationary car into real driving scenes, creating pixel-level counterfactual pairs: each edited scene differs from its original by the inserted object. This lets the authors compare predicted trajectories and isolate the object’s effect. In tests of four VLAs and two WAMs, they report that the models reacted weakly, often barely at all. That finding challenges claims of strong long-tail capability out of the box. The authors also report a more encouraging result: after a short fine-tuning stage on edited scenes, ReCogDrive reacted better, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving. They argue that models may therefore be a strong foundation for acquiring these behaviors with little additional training. They emphasize the value of real or synthetic data demonstrating hazards that nominal datasets rarely contain. The abstract does not give the size of the evaluation or detailed measurements of the reported improvements.","question":"How many unseen objects and fully real scenes were used to assess whether ReCogDrive’s learned behavior generalizes?","claims":[{"text":"The authors say existing benchmarks dominated by nominal scenarios cannot test the long-tail capability they aim to evaluate.","excerpt":"most existing benchmarks are dominated by nominal scenarios and therefore cannot test this promise.","support":"source-stated"},{"text":"ReactBench-AD creates counterfactual scene pairs by inserting hazards across camera views and history frames, allowing comparison of the predicted trajectory with and without an inserted object.","excerpt":"Each edited scene thus forms an exact, pixel-level counterfactual pair with its original, which allows us to isolate the causal effect of the inserted object on the predicted trajectory.","support":"source-stated"},{"text":"The authors report weak reactions from the four VLAs and two WAMs they evaluated.","excerpt":"Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all.","support":"source-stated"},{"text":"The authors report that short fine-tuning on edited scenes improved ReCogDrive’s reactions and generalized to unseen objects and fully real scenes, with minimal cost to nominal driving.","excerpt":"a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving.","support":"source-stated"},{"text":"The authors argue that the results challenge out-of-the-box long-tail capabilities while suggesting these models may acquire them with little additional training.","excerpt":"These results call into question the out-of-the-box long-tail capabilities of these models, but suggest that they can be a strong foundation for acquiring them with little additional training","support":"source-stated"}],"limitations":["The evidence is the paper’s abstract; it does not provide evaluation size, detailed measurements, or the fine-tuning procedure.","The abstract reports generalization to unseen objects and fully real scenes but does not specify their number or range."],"mediaId":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","correctionReason":null,"id":"3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0","publicationId":"99a11c1a-5f01-488a-8da3-6866fbb62bf2","version":1,"sourceUrl":"https://arxiv.org/abs/2611.20011","sourceTitle":"ReactBench-AD: Do Driving VLAs and World-Action Models React to Imminent Hazards in Their Path?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-15","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:31:18.637Z","createdAt":"2026-11-17T09:02:08.743Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","kind":"article","url":"https://arxiv.org/abs/2611.20011","sourceUrl":"https://arxiv.org/abs/2611.20011","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T08:48:45.656Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.20011","checkedAt":"2026-11-17T09:34:07.456Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"59b5b1ce403f01f47f56a7d8fcf58aac9d6b7e43b9cb01a9558a29f425b8ccb7","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"efde79e8d2f17481abcf3b9cc8196a5e62ca871fa33c7f250b57026a9e359455","decidedAt":"2026-11-17T08:48:46.567Z"},"provenance":{"textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observationId":"bddc8797d40b42eb2df437501a5f498e85008d02d952277bd6b9e130cebf25b5","retrievedAt":"2026-11-17T08:48:45.540Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"81330922-2f3e-4e5d-8905-889aef492aa2"},"reviewer":{"model":"gpt-6-luna","runId":"fc8b30f8-d089-4856-82aa-ad42f95f1604"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T09:02:08.743Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Theodoridis, Nikos","url":null,"kind":"unknown"},{"name":"Mohandas, Reenu","url":null,"kind":"unknown"},{"name":"Sharma, Sushil","url":null,"kind":"unknown"},{"name":"Hogan, Ciarán","url":null,"kind":"unknown"},{"name":"Sistu, Ganesh","url":null,"kind":"unknown"},{"name":"Scanlan, Anthony","url":null,"kind":"unknown"},{"name":"Brophy, Tim","url":null,"kind":"unknown"},{"name":"Eising, Ciarán","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Theodoridis, Nikos","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Theodoridis, Nikos","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Mohandas, Reenu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mohandas, Reenu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Sharma, Sushil","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sharma, Sushil","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Hogan, Ciarán","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hogan, Ciarán","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Sistu, Ganesh","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sistu, Ganesh","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Scanlan, Anthony","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Scanlan, Anthony","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Brophy, Tim","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Brophy, Tim","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}},{"actor":{"name":"Eising, Ciarán","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eising, Ciarán","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.20011","locator":"head/meta[name=author|citation_author]"},"assertionId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T09:34:07.456Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","sourceUrl":"https://arxiv.org/abs/2611.20011","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.20011","snapshotId":"fef7d16685ff90bb710ecb905cc5e130842b8c83ad58a8117ec9a00808109f4f","contentSha256":"e729b5188efda7b1a19e129912ab19d977ce574262893976f520847fdb3462cb","textHash":"4d6a6d18657f913f3ff7cc9e8d0806825ffe2660e82da46a3f1acd48f7dd48bc","observedAt":"2026-11-17T09:34:07.456Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3c1ff8fe827239c48a47d17d61ce393ca7d9f3e0d3fd3ed6ce81466487ef3de0/source"}}}],"audits":[{"publicationId":"99a11c1a-5f01-488a-8da3-6866fbb62bf2","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft consistently attributes the benchmark, findings and interpretation to the paper's authors. Words such as 'argue', 'report' and 'suggest' keep the source's claims attributed rather than presenting them as established fact.","excerpt":"Evaluating four VLAs and two WAMs, we find that they react weakly, often barely at all."},{"dimension":"summary","status":"uncertain","explanation":"The content faithfully tracks the abstract, and the question is a fair open issue. But central terms are never explained: 'VLAs' and 'WAMs' appear only as acronyms, not even expanded to Vision-Language-Action models or World-Action Models. 'long-tail', 'nominal', 'fine-tuning' and 'predicted trajectories' also need explanation. ReCogDrive is not identified as one of the evaluated VLAs. Smallest repair: expand the acronyms, add term tooltips, and note that ReCogDrive was one of the tested VLAs.","excerpt":"Vision-Language-Action models (VLAs) and World-Action Models (WAMs) have emerged in autonomous driving"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-15, which matches the v1 arXiv submission date. The feed date of 2026-11-17 is a later announcement.","excerpt":"[Submitted on 15 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract: the benchmark design, counterfactual pairs, weak reactions, the fine-tuning result with generalization at minimal nominal cost, and the authors' conclusion. The draft keeps the fine-tuning result as the authors' report and correctly notes the abstract's missing evaluation size and measurements. It adds no invented beneficiaries or costs.","excerpt":"a short fine-tuning stage on edited scenes substantially improves its reactions, with the learned behavior generalizing to unseen objects and fully real scenes, at minimal cost to nominal driving."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page. It is the original source, and no better source media was found.","excerpt":null}],"createdAt":"2026-11-17T09:02:08.743Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}