{"id":"cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306","title":"arXiv cs.AI: Efficient Multimodal Agents for Auditing 3D Worlds","argument":"The authors describe a system for finding glitches in interactive 3D worlds, such as floating objects or walls that can be walked through. Its small-model explorers navigate to suspicious objects and trigger glitches; a frontier model reviews what they record and report. The authors say this division addresses a trade-off in existing auditors, which they describe as either accurate but slow and expensive or cheap but unreliable. On WorldAuditBench, the system succeeded on 55.9% of 213 tasks and cost less than a quarter as much as the strongest auditor they report. It matched a frontier model exploring on its own at 4.6 times lower cost and about half the latency. Recognition, however, remains a weak point: the authors say the small explorers’ performance on it stays far behind. They also report that the system answers embodied questions about real-world scans without further training, matching the frontier reviewer exploring on its own. These results are reported by the paper’s authors; the abstract does not explain why recognition lags or how the system performs across different kinds of audit tasks.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s abstract, which does not explain why recognition stays far behind or give a breakdown of performance across different kinds of audit tasks. The abstract reports benchmark results but does not provide the evaluation details needed here to assess how the reported tasks were constructed.","speaker":{"name":"Yang, Jingbo, Jiang, Ziyan, An, Li, Ji, Jiabao, Liu, Yujian, Jaakkola, Tommi, Zhang, Yang, Chang, Shiyu","roleAtSource":"Article author"},"source":{"title":"Efficient Multimodal Agents for Auditing 3D Worlds","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25543","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say auditing 3D worlds requires navigating to possible glitches, triggering behavior-dependent glitches, and recognizing what is wrong.","excerpt":"Auditing requires three abilities, namely navigating to the objects that may contain a glitch, triggering glitches that appear only after a specific behavior, and recognizing what is wrong.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"The authors train a 4B vision language model on verified trajectories from a frontier teacher guided by Bayesian search; they say six such explorers together match a frontier model on navigation and triggering, but not recognition.","excerpt":"A 4B vision language model fine-tuned end to end on verified trajectories of a frontier teacher guided by Bayesian search learns to navigate and trigger, and six such explorers together match a frontier model on both, but recognition stays far behind.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"Their auditor combines a swarm of small explorers with a frontier model that reviews the explorers’ records and reports.","excerpt":"We therefore build an auditor in which a swarm of small explorers navigates and triggers, and a frontier model reviews what they record and report.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"On WorldAuditBench, the authors report 55.9% success on 213 tasks, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","excerpt":"On WorldAuditBench, our auditor succeeds on 55.9% of 213 tasks in Unreal Engine 5 and this http URL worlds, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"The authors report that their auditor matches a frontier reviewer exploring on its own at lower cost and latency, and also performs competitively on embodied questions about real-world scans without further training.","excerpt":"It matches the frontier reviewer exploring on its own at 4.6 times lower cost and about half the latency. Without further training, it also answers embodied questions about real-world scans, matching the frontier reviewer exploring on its own","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25543","checkedAt":"2026-11-21T01:20:09.870Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What accounts for the gap between the small explorers’ navigation and triggering abilities and their weaker recognition performance?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Efficient Multimodal Agents for Auditing 3D Worlds","summary":"The authors describe a system for finding glitches in interactive 3D worlds, such as floating objects or walls that can be walked through. Its small-model explorers navigate to suspicious objects and trigger glitches; a frontier model reviews what they record and report. The authors say this division addresses a trade-off in existing auditors, which they describe as either accurate but slow and expensive or cheap but unreliable. On WorldAuditBench, the system succeeded on 55.9% of 213 tasks and cost less than a quarter as much as the strongest auditor they report. It matched a frontier model exploring on its own at 4.6 times lower cost and about half the latency. Recognition, however, remains a weak point: the authors say the small explorers’ performance on it stays far behind. They also report that the system answers embodied questions about real-world scans without further training, matching the frontier reviewer exploring on its own. These results are reported by the paper’s authors; the abstract does not explain why recognition lags or how the system performs across different kinds of audit tasks.","question":"What accounts for the gap between the small explorers’ navigation and triggering abilities and their weaker recognition performance?","claims":[{"text":"The authors say auditing 3D worlds requires navigating to possible glitches, triggering behavior-dependent glitches, and recognizing what is wrong.","excerpt":"Auditing requires three abilities, namely navigating to the objects that may contain a glitch, triggering glitches that appear only after a specific behavior, and recognizing what is wrong.","support":"source-stated"},{"text":"The authors train a 4B vision language model on verified trajectories from a frontier teacher guided by Bayesian search; they say six such explorers together match a frontier model on navigation and triggering, but not recognition.","excerpt":"A 4B vision language model fine-tuned end to end on verified trajectories of a frontier teacher guided by Bayesian search learns to navigate and trigger, and six such explorers together match a frontier model on both, but recognition stays far behind.","support":"source-stated"},{"text":"Their auditor combines a swarm of small explorers with a frontier model that reviews the explorers’ records and reports.","excerpt":"We therefore build an auditor in which a swarm of small explorers navigates and triggers, and a frontier model reviews what they record and report.","support":"source-stated"},{"text":"On WorldAuditBench, the authors report 55.9% success on 213 tasks, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","excerpt":"On WorldAuditBench, our auditor succeeds on 55.9% of 213 tasks in Unreal Engine 5 and this http URL worlds, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","support":"source-stated"},{"text":"The authors report that their auditor matches a frontier reviewer exploring on its own at lower cost and latency, and also performs competitively on embodied questions about real-world scans without further training.","excerpt":"It matches the frontier reviewer exploring on its own at 4.6 times lower cost and about half the latency. Without further training, it also answers embodied questions about real-world scans, matching the frontier reviewer exploring on its own","support":"source-stated"}],"limitations":["The evidence is the paper’s abstract, which does not explain why recognition stays far behind or give a breakdown of performance across different kinds of audit tasks.","The abstract reports benchmark results but does not provide the evaluation details needed here to assess how the reported tasks were constructed."],"mediaId":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","correctionReason":null,"id":"cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306","publicationId":"35e0f91b-f318-4cec-8784-b471c1ecc160","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25543","sourceTitle":"Efficient Multimodal Agents for Auditing 3D Worlds","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:41.595Z","createdAt":"2026-11-20T08:16:46.042Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","kind":"article","url":"https://arxiv.org/abs/2611.25543","sourceUrl":"https://arxiv.org/abs/2611.25543","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:03:57.213Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25543","checkedAt":"2026-11-21T01:20:09.870Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"85d5c25fe5f7d4d0b09a7119000083d35742440060cde6b07ef79537f43237a2","decidedAt":"2026-11-20T08:15:55.121Z"},"provenance":{"textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observationId":"4befe650ee83dd7ca9d375a990fbb8f6f1e00c025161da1b75a22654c057a420","retrievedAt":"2026-11-20T08:03:56.940Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fd8d54ee-8f71-4300-8aee-4fddb3b75a8c"},"reviewer":{"model":"gpt-6-luna","runId":"dc354ad8-f792-49de-8cc5-4e7bcdb9f6ea"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T08:16:46.042Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yang, Jingbo","url":null,"kind":"unknown"},{"name":"Jiang, Ziyan","url":null,"kind":"unknown"},{"name":"An, Li","url":null,"kind":"unknown"},{"name":"Ji, Jiabao","url":null,"kind":"unknown"},{"name":"Liu, Yujian","url":null,"kind":"unknown"},{"name":"Jaakkola, Tommi","url":null,"kind":"unknown"},{"name":"Zhang, Yang","url":null,"kind":"unknown"},{"name":"Chang, Shiyu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yang, Jingbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yang, Jingbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Jiang, Ziyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Ziyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"An, Li","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"An, Li","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Ji, Jiabao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ji, Jiabao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Liu, Yujian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yujian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Jaakkola, Tommi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jaakkola, Tommi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Zhang, Yang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Yang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Chang, Shiyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chang, Shiyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25543","snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-efficient-multimodal-agents-for-auditing-3d-worlds-cc1b80e8","formats":{"html":"/readings/arxiv-cs-ai-efficient-multimodal-agents-for-auditing-3d-worlds-cc1b80e8","markdown":"/readings/arxiv-cs-ai-efficient-multimodal-agents-for-auditing-3d-worlds-cc1b80e8.md","json":"/readings/arxiv-cs-ai-efficient-multimodal-agents-for-auditing-3d-worlds-cc1b80e8.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-multimodal-model","name":"Multimodal model","explanation":"A model that works with more than one kind of input or output, such as text, images and audio.","referenceUrl":"https://developers.google.com/machine-learning/glossary#multimodal-model"},{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"},{"id":"term-latency","name":"Latency","explanation":"The delay between sending a request and receiving the result.","referenceUrl":"https://developers.google.com/machine-learning/glossary#latency"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306","revision":"35e0f91b-f318-4cec-8784-b471c1ecc160","revisionKind":"publication-id","title":"arXiv cs.AI: Efficient Multimodal Agents for Auditing 3D Worlds","url":"https://escapemeridian.com/readings/arxiv-cs-ai-efficient-multimodal-agents-for-auditing-3d-worlds-cc1b80e8"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.25543","revision":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","revisionKind":"sha256-source-text","title":"Efficient Multimodal Agents for Auditing 3D Worlds","url":"https://arxiv.org/abs/2611.25543"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306","title":"arXiv cs.AI: Efficient Multimodal Agents for Auditing 3D Worlds","argument":"The authors describe a system for finding glitches in interactive 3D worlds, such as floating objects or walls that can be walked through. Its small-model explorers navigate to suspicious objects and trigger glitches; a frontier model reviews what they record and report. The authors say this division addresses a trade-off in existing auditors, which they describe as either accurate but slow and expensive or cheap but unreliable. On WorldAuditBench, the system succeeded on 55.9% of 213 tasks and cost less than a quarter as much as the strongest auditor they report. It matched a frontier model exploring on its own at 4.6 times lower cost and about half the latency. Recognition, however, remains a weak point: the authors say the small explorers’ performance on it stays far behind. They also report that the system answers embodied questions about real-world scans without further training, matching the frontier reviewer exploring on its own. These results are reported by the paper’s authors; the abstract does not explain why recognition lags or how the system performs across different kinds of audit tasks.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence is the paper’s abstract, which does not explain why recognition stays far behind or give a breakdown of performance across different kinds of audit tasks. The abstract reports benchmark results but does not provide the evaluation details needed here to assess how the reported tasks were constructed.","speaker":{"name":"Yang, Jingbo, Jiang, Ziyan, An, Li, Ji, Jiabao, Liu, Yujian, Jaakkola, Tommi, Zhang, Yang, Chang, Shiyu","roleAtSource":"Article author"},"source":{"title":"Efficient Multimodal Agents for Auditing 3D Worlds","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.25543","publishedAt":"2026-11-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors say auditing 3D worlds requires navigating to possible glitches, triggering behavior-dependent glitches, and recognizing what is wrong.","excerpt":"Auditing requires three abilities, namely navigating to the objects that may contain a glitch, triggering glitches that appear only after a specific behavior, and recognizing what is wrong.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"The authors train a 4B vision language model on verified trajectories from a frontier teacher guided by Bayesian search; they say six such explorers together match a frontier model on navigation and triggering, but not recognition.","excerpt":"A 4B vision language model fine-tuned end to end on verified trajectories of a frontier teacher guided by Bayesian search learns to navigate and trigger, and six such explorers together match a frontier model on both, but recognition stays far behind.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"Their auditor combines a swarm of small explorers with a frontier model that reviews the explorers’ records and reports.","excerpt":"We therefore build an auditor in which a swarm of small explorers navigates and triggers, and a frontier model reviews what they record and report.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"On WorldAuditBench, the authors report 55.9% success on 213 tasks, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","excerpt":"On WorldAuditBench, our auditor succeeds on 55.9% of 213 tasks in Unreal Engine 5 and this http URL worlds, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"},{"text":"The authors report that their auditor matches a frontier reviewer exploring on its own at lower cost and latency, and also performs competitively on embodied questions about real-world scans without further training.","excerpt":"It matches the frontier reviewer exploring on its own at 4.6 times lower cost and about half the latency. Without further training, it also answers embodied questions about real-world scans, matching the frontier reviewer exploring on its own","url":"https://arxiv.org/abs/2611.25543","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25543","checkedAt":"2026-11-21T01:20:09.870Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What accounts for the gap between the small explorers’ navigation and triggering abilities and their weaker recognition performance?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Efficient Multimodal Agents for Auditing 3D Worlds","summary":"The authors describe a system for finding glitches in interactive 3D worlds, such as floating objects or walls that can be walked through. Its small-model explorers navigate to suspicious objects and trigger glitches; a frontier model reviews what they record and report. The authors say this division addresses a trade-off in existing auditors, which they describe as either accurate but slow and expensive or cheap but unreliable. On WorldAuditBench, the system succeeded on 55.9% of 213 tasks and cost less than a quarter as much as the strongest auditor they report. It matched a frontier model exploring on its own at 4.6 times lower cost and about half the latency. Recognition, however, remains a weak point: the authors say the small explorers’ performance on it stays far behind. They also report that the system answers embodied questions about real-world scans without further training, matching the frontier reviewer exploring on its own. These results are reported by the paper’s authors; the abstract does not explain why recognition lags or how the system performs across different kinds of audit tasks.","question":"What accounts for the gap between the small explorers’ navigation and triggering abilities and their weaker recognition performance?","claims":[{"text":"The authors say auditing 3D worlds requires navigating to possible glitches, triggering behavior-dependent glitches, and recognizing what is wrong.","excerpt":"Auditing requires three abilities, namely navigating to the objects that may contain a glitch, triggering glitches that appear only after a specific behavior, and recognizing what is wrong.","support":"source-stated"},{"text":"The authors train a 4B vision language model on verified trajectories from a frontier teacher guided by Bayesian search; they say six such explorers together match a frontier model on navigation and triggering, but not recognition.","excerpt":"A 4B vision language model fine-tuned end to end on verified trajectories of a frontier teacher guided by Bayesian search learns to navigate and trigger, and six such explorers together match a frontier model on both, but recognition stays far behind.","support":"source-stated"},{"text":"Their auditor combines a swarm of small explorers with a frontier model that reviews the explorers’ records and reports.","excerpt":"We therefore build an auditor in which a swarm of small explorers navigates and triggers, and a frontier model reviews what they record and report.","support":"source-stated"},{"text":"On WorldAuditBench, the authors report 55.9% success on 213 tasks, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","excerpt":"On WorldAuditBench, our auditor succeeds on 55.9% of 213 tasks in Unreal Engine 5 and this http URL worlds, 13.6 points above the strongest auditor reported, at less than a quarter of its cost.","support":"source-stated"},{"text":"The authors report that their auditor matches a frontier reviewer exploring on its own at lower cost and latency, and also performs competitively on embodied questions about real-world scans without further training.","excerpt":"It matches the frontier reviewer exploring on its own at 4.6 times lower cost and about half the latency. Without further training, it also answers embodied questions about real-world scans, matching the frontier reviewer exploring on its own","support":"source-stated"}],"limitations":["The evidence is the paper’s abstract, which does not explain why recognition stays far behind or give a breakdown of performance across different kinds of audit tasks.","The abstract reports benchmark results but does not provide the evaluation details needed here to assess how the reported tasks were constructed."],"mediaId":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","correctionReason":null,"id":"cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306","publicationId":"35e0f91b-f318-4cec-8784-b471c1ecc160","version":1,"sourceUrl":"https://arxiv.org/abs/2611.25543","sourceTitle":"Efficient Multimodal Agents for Auditing 3D Worlds","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:41.595Z","createdAt":"2026-11-20T08:16:46.042Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","kind":"article","url":"https://arxiv.org/abs/2611.25543","sourceUrl":"https://arxiv.org/abs/2611.25543","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:03:57.213Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.25543","checkedAt":"2026-11-21T01:20:09.870Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"55a133996a14a2ca04d63de3c67e10ecf5e614134bed5405846f55f17aca1699","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"85d5c25fe5f7d4d0b09a7119000083d35742440060cde6b07ef79537f43237a2","decidedAt":"2026-11-20T08:15:55.121Z"},"provenance":{"textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observationId":"4befe650ee83dd7ca9d375a990fbb8f6f1e00c025161da1b75a22654c057a420","retrievedAt":"2026-11-20T08:03:56.940Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"fd8d54ee-8f71-4300-8aee-4fddb3b75a8c"},"reviewer":{"model":"gpt-6-luna","runId":"dc354ad8-f792-49de-8cc5-4e7bcdb9f6ea"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T08:16:46.042Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Yang, Jingbo","url":null,"kind":"unknown"},{"name":"Jiang, Ziyan","url":null,"kind":"unknown"},{"name":"An, Li","url":null,"kind":"unknown"},{"name":"Ji, Jiabao","url":null,"kind":"unknown"},{"name":"Liu, Yujian","url":null,"kind":"unknown"},{"name":"Jaakkola, Tommi","url":null,"kind":"unknown"},{"name":"Zhang, Yang","url":null,"kind":"unknown"},{"name":"Chang, Shiyu","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Yang, Jingbo","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Yang, Jingbo","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Jiang, Ziyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiang, Ziyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"An, Li","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"An, Li","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Ji, Jiabao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ji, Jiabao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Liu, Yujian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Yujian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Jaakkola, Tommi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jaakkola, Tommi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Zhang, Yang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Yang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}},{"actor":{"name":"Chang, Shiyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chang, Shiyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.25543","locator":"head/meta[name=author|citation_author]"},"assertionId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T01:20:09.870Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","sourceUrl":"https://arxiv.org/abs/2611.25543","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.25543","snapshotId":"d9d4c008119f52ef6ed7029e86949aa1603a0bbd7dc49441b21a81bc5d5bcdc5","contentSha256":"74f5348867634f72db3acf9ee867becefce1aa53c3968983099cf1138d24df5c","textHash":"0a1da8acd9f54b109fb06eb9a38f4b0803c728ea3ea27b534e091c5a4bb652ad","observedAt":"2026-11-21T01:20:09.870Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/cc1b80e8da4b3790a88fbefdc8d498172b84919685c47d6021afec20b8218306/source"}}}],"audits":[{"publicationId":"35e0f91b-f318-4cec-8784-b471c1ecc160","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the system, benchmark results, cost comparisons and the recognition gap to the paper's authors. Its title correctly identifies the arXiv cs.AI paper. No result is presented as independently verified.","excerpt":"Authors:Jingbo Yang, Ziyan Jiang, Li An, Jiabao Ji, Yujian Liu, Tommi Jaakkola, Yang Zhang, Shiyu Chang"},{"dimension":"summary","status":"uncertain","explanation":"The summary is accurate but leaves out the abstract's stated stake. The authors say an auditor could check AI-built worlds at scale and provide rewards to the agents that build them, but only if it is both accurate and cheap. Without this, a general reader sees the cost results without the reason they matter. Central terms such as frontier model, 4B vision language model and embodied questions about real-world scans are not explained in plain language. Smallest repair: add one sentence on the reward purpose, and explain or tooltip those terms. The question about the recognition gap follows legitimately from the evidence.","excerpt":"An automatic auditor could check such worlds at scale and provide rewards for agents that build them, but only if it is both accurate and cheap."},{"dimension":"date","status":"pass","explanation":"The displayed original publication date, 2026-11-19, matches the v1 submission date on the arXiv page. The feed date of Nov 20 is a later announcement, not the first publication.","excerpt":"[Submitted on 19 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim's excerpt is verbatim from the abstract and supports the claim text. These include the 55.9% success on 213 tasks, the 13.6-point margin, less than a quarter of the cost, 4.6 times lower cost and about half the latency. 'Competitively' on embodied questions is a fair reading of matching the frontier reviewer and surpassing four other models. The limitations correctly note that the abstract does not explain why recognition lags or break down results by task type. No benefits are invented.","excerpt":"It matches the frontier reviewer exploring on its own at 4.6 times lower cost and about half the latency."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source. No better source-specific media was found.","excerpt":null}],"createdAt":"2026-11-20T08:16:46.042Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}