{"id":"a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579","title":"arXiv q-bio.NC: Perception, Not Reasoning, Limits Visual Theory of Mind","argument":"The authors of the arXiv paper argue that vision-language models struggle with visual theory of mind mainly because they fail to perceive who was present and where objects were, not because they cannot reason about beliefs. They compare the same reasoning task across five conditions that vary perceptual fidelity, from visual-only to text-only, and introduce the Perceptual Contribution Ratio to measure how much each condition closes the visual-to-text performance gap. Across abstract 2D panels and naturalistic 3D game scenes, ground-truth scaffolds substantially narrowed that gap; on the abstract panels and MuMA-ToM, they matched or exceeded text-only reasoning. Automatic-parser scaffolds, including those built by frontier VLMs, failed. The authors identify reality bias—reporting an object’s actual location rather than the location an absent agent believes it to be—as the most common visual-only false-belief error. They argue that structured visual scene-state extraction is the dominant bottleneck under their evaluated protocol. The result challenges an account that treats poor visual performance chiefly as a reasoning problem, while leaving open how broadly the finding applies beyond the tested models and scenes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported conclusion is explicitly limited to the evaluated protocol; the evidence describes two scene types and seven VLMs, so broader generalization remains unestablished. The evidence is the arXiv abstract, not the full paper; it does not provide detailed methods, results, or uncertainty estimates.","speaker":{"name":"Barhdadi, Mohamed Rayan, Wasim, Syed Talal, Gall, Juergen, Serpedin, Erchin, Kurban, Hasan","roleAtSource":"Article author"},"source":{"title":"Perception, Not Reasoning, Limits Visual Theory of Mind","publisher":"arXiv q-bio.NC","format":"Article","url":"https://arxiv.org/abs/2611.10694","publishedAt":"2026-11-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that visual theory-of-mind performance is limited chiefly by perception rather than belief reasoning.","excerpt":"We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The paper tests a protocol that varies perceptual fidelity while holding the reasoning task constant.","excerpt":"a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"Ground-truth scaffolds substantially narrow the visual-to-text gap, while automatic-parser scaffolds fail.","excerpt":"Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The authors identify reality bias as the most common visual-only false-belief failure.","excerpt":"The most common error in the visual-only condition is \\emph{reality bias}, which accounts for 60\\% of false-belief failures.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"Under the evaluated protocol, the authors identify structured visual scene-state extraction as the dominant bottleneck.","excerpt":"Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The evaluation covers seven VLMs and roughly 159,000 API calls, across abstract panels and naturalistic game scenes.","excerpt":"We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10694","checkedAt":"2026-11-12T12:50:10.066Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the authors’ finding that structured visual scene-state extraction is the dominant bottleneck hold beyond the evaluated models and scene types?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv q-bio.NC: Perception, Not Reasoning, Limits Visual Theory of Mind","summary":"The authors of the arXiv paper argue that vision-language models struggle with visual theory of mind mainly because they fail to perceive who was present and where objects were, not because they cannot reason about beliefs. They compare the same reasoning task across five conditions that vary perceptual fidelity, from visual-only to text-only, and introduce the Perceptual Contribution Ratio to measure how much each condition closes the visual-to-text performance gap. Across abstract 2D panels and naturalistic 3D game scenes, ground-truth scaffolds substantially narrowed that gap; on the abstract panels and MuMA-ToM, they matched or exceeded text-only reasoning. Automatic-parser scaffolds, including those built by frontier VLMs, failed. The authors identify reality bias—reporting an object’s actual location rather than the location an absent agent believes it to be—as the most common visual-only false-belief error. They argue that structured visual scene-state extraction is the dominant bottleneck under their evaluated protocol. The result challenges an account that treats poor visual performance chiefly as a reasoning problem, while leaving open how broadly the finding applies beyond the tested models and scenes.","question":"Would the authors’ finding that structured visual scene-state extraction is the dominant bottleneck hold beyond the evaluated models and scene types?","claims":[{"text":"The authors argue that visual theory-of-mind performance is limited chiefly by perception rather than belief reasoning.","excerpt":"We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see.","support":"source-stated"},{"text":"The paper tests a protocol that varies perceptual fidelity while holding the reasoning task constant.","excerpt":"a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only","support":"source-stated"},{"text":"Ground-truth scaffolds substantially narrow the visual-to-text gap, while automatic-parser scaffolds fail.","excerpt":"Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail.","support":"source-stated"},{"text":"The authors identify reality bias as the most common visual-only false-belief failure.","excerpt":"The most common error in the visual-only condition is \\emph{reality bias}, which accounts for 60\\% of false-belief failures.","support":"source-stated"},{"text":"Under the evaluated protocol, the authors identify structured visual scene-state extraction as the dominant bottleneck.","excerpt":"Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.","support":"source-stated"},{"text":"The evaluation covers seven VLMs and roughly 159,000 API calls, across abstract panels and naturalistic game scenes.","excerpt":"We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls.","support":"source-stated"}],"limitations":["The reported conclusion is explicitly limited to the evaluated protocol; the evidence describes two scene types and seven VLMs, so broader generalization remains unestablished.","The evidence is the arXiv abstract, not the full paper; it does not provide detailed methods, results, or uncertainty estimates."],"mediaId":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","correctionReason":null,"id":"a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579","publicationId":"15b3ccb0-96f6-4d77-8999-9f25569a2d81","version":1,"sourceUrl":"https://arxiv.org/abs/2611.10694","sourceTitle":"Perception, Not Reasoning, Limits Visual Theory of Mind","publisher":"arXiv q-bio.NC","publishedAt":null,"originalPublished":{"value":"2026-11-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:34:13.297Z","createdAt":"2026-11-12T12:34:32.749Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","kind":"article","url":"https://arxiv.org/abs/2611.10694","sourceUrl":"https://arxiv.org/abs/2611.10694","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T12:33:33.662Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10694","checkedAt":"2026-11-12T12:50:10.066Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","confidence":0.85,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9ab5382338e0640522da748a9442655c817e958d5859f0aae96411510cb61d64","decidedAt":"2026-11-12T12:33:35.784Z"},"provenance":{"textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observationId":"d271088841173a80d3c626d6fdcc43f3136093b16a8e61a8111d17076702be3d","retrievedAt":"2026-11-12T12:33:33.376Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"24336f8c-c41d-423f-85b6-d01287a3729c"},"reviewer":{"model":"gpt-6-luna","runId":"155f0c4c-301d-45a7-8d9b-cf2d67f90f5b"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T12:34:32.749Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Barhdadi, Mohamed Rayan","url":null,"kind":"unknown"},{"name":"Wasim, Syed Talal","url":null,"kind":"unknown"},{"name":"Gall, Juergen","url":null,"kind":"unknown"},{"name":"Serpedin, Erchin","url":null,"kind":"unknown"},{"name":"Kurban, Hasan","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Barhdadi, Mohamed Rayan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Barhdadi, Mohamed Rayan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Wasim, Syed Talal","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wasim, Syed Talal","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Gall, Juergen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gall, Juergen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Serpedin, Erchin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Serpedin, Erchin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Kurban, Hasan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kurban, Hasan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.10694","snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-q-bio-nc-perception-not-reasoning-limits-visual-theory-of-a9442fea","formats":{"html":"/readings/arxiv-q-bio-nc-perception-not-reasoning-limits-visual-theory-of-a9442fea","markdown":"/readings/arxiv-q-bio-nc-perception-not-reasoning-limits-visual-theory-of-a9442fea.md","json":"/readings/arxiv-q-bio-nc-perception-not-reasoning-limits-visual-theory-of-a9442fea.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579","revision":"15b3ccb0-96f6-4d77-8999-9f25569a2d81","revisionKind":"publication-id","title":"arXiv q-bio.NC: Perception, Not Reasoning, Limits Visual Theory of Mind","url":"https://escapemeridian.com/readings/arxiv-q-bio-nc-perception-not-reasoning-limits-visual-theory-of-a9442fea"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.10694","revision":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","revisionKind":"sha256-source-text","title":"Perception, Not Reasoning, Limits Visual Theory of Mind","url":"https://arxiv.org/abs/2611.10694"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579","title":"arXiv q-bio.NC: Perception, Not Reasoning, Limits Visual Theory of Mind","argument":"The authors of the arXiv paper argue that vision-language models struggle with visual theory of mind mainly because they fail to perceive who was present and where objects were, not because they cannot reason about beliefs. They compare the same reasoning task across five conditions that vary perceptual fidelity, from visual-only to text-only, and introduce the Perceptual Contribution Ratio to measure how much each condition closes the visual-to-text performance gap. Across abstract 2D panels and naturalistic 3D game scenes, ground-truth scaffolds substantially narrowed that gap; on the abstract panels and MuMA-ToM, they matched or exceeded text-only reasoning. Automatic-parser scaffolds, including those built by frontier VLMs, failed. The authors identify reality bias—reporting an object’s actual location rather than the location an absent agent believes it to be—as the most common visual-only false-belief error. They argue that structured visual scene-state extraction is the dominant bottleneck under their evaluated protocol. The result challenges an account that treats poor visual performance chiefly as a reasoning problem, while leaving open how broadly the finding applies beyond the tested models and scenes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported conclusion is explicitly limited to the evaluated protocol; the evidence describes two scene types and seven VLMs, so broader generalization remains unestablished. The evidence is the arXiv abstract, not the full paper; it does not provide detailed methods, results, or uncertainty estimates.","speaker":{"name":"Barhdadi, Mohamed Rayan, Wasim, Syed Talal, Gall, Juergen, Serpedin, Erchin, Kurban, Hasan","roleAtSource":"Article author"},"source":{"title":"Perception, Not Reasoning, Limits Visual Theory of Mind","publisher":"arXiv q-bio.NC","format":"Article","url":"https://arxiv.org/abs/2611.10694","publishedAt":"2026-11-07","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that visual theory-of-mind performance is limited chiefly by perception rather than belief reasoning.","excerpt":"We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The paper tests a protocol that varies perceptual fidelity while holding the reasoning task constant.","excerpt":"a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"Ground-truth scaffolds substantially narrow the visual-to-text gap, while automatic-parser scaffolds fail.","excerpt":"Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The authors identify reality bias as the most common visual-only false-belief failure.","excerpt":"The most common error in the visual-only condition is \\emph{reality bias}, which accounts for 60\\% of false-belief failures.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"Under the evaluated protocol, the authors identify structured visual scene-state extraction as the dominant bottleneck.","excerpt":"Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"},{"text":"The evaluation covers seven VLMs and roughly 159,000 API calls, across abstract panels and naturalistic game scenes.","excerpt":"We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls.","url":"https://arxiv.org/abs/2611.10694","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10694","checkedAt":"2026-11-12T12:50:10.066Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the authors’ finding that structured visual scene-state extraction is the dominant bottleneck hold beyond the evaluated models and scene types?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv q-bio.NC: Perception, Not Reasoning, Limits Visual Theory of Mind","summary":"The authors of the arXiv paper argue that vision-language models struggle with visual theory of mind mainly because they fail to perceive who was present and where objects were, not because they cannot reason about beliefs. They compare the same reasoning task across five conditions that vary perceptual fidelity, from visual-only to text-only, and introduce the Perceptual Contribution Ratio to measure how much each condition closes the visual-to-text performance gap. Across abstract 2D panels and naturalistic 3D game scenes, ground-truth scaffolds substantially narrowed that gap; on the abstract panels and MuMA-ToM, they matched or exceeded text-only reasoning. Automatic-parser scaffolds, including those built by frontier VLMs, failed. The authors identify reality bias—reporting an object’s actual location rather than the location an absent agent believes it to be—as the most common visual-only false-belief error. They argue that structured visual scene-state extraction is the dominant bottleneck under their evaluated protocol. The result challenges an account that treats poor visual performance chiefly as a reasoning problem, while leaving open how broadly the finding applies beyond the tested models and scenes.","question":"Would the authors’ finding that structured visual scene-state extraction is the dominant bottleneck hold beyond the evaluated models and scene types?","claims":[{"text":"The authors argue that visual theory-of-mind performance is limited chiefly by perception rather than belief reasoning.","excerpt":"We argue the dominant bottleneck is perceptual: not what the model cannot reason about, but what it cannot see.","support":"source-stated"},{"text":"The paper tests a protocol that varies perceptual fidelity while holding the reasoning task constant.","excerpt":"a five-condition dissociation protocol that holds the reasoning task constant while varying perceptual fidelity from visual only to text only","support":"source-stated"},{"text":"Ground-truth scaffolds substantially narrow the visual-to-text gap, while automatic-parser scaffolds fail.","excerpt":"Ground-truth scaffolds substantially close the gap in every setting, and on the abstract panels and MuMA-ToM they match or exceed the text-only reasoning. Whereas scaffolds built by automatic parsers, including frontier VLMs, fail.","support":"source-stated"},{"text":"The authors identify reality bias as the most common visual-only false-belief failure.","excerpt":"The most common error in the visual-only condition is \\emph{reality bias}, which accounts for 60\\% of false-belief failures.","support":"source-stated"},{"text":"Under the evaluated protocol, the authors identify structured visual scene-state extraction as the dominant bottleneck.","excerpt":"Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM.","support":"source-stated"},{"text":"The evaluation covers seven VLMs and roughly 159,000 API calls, across abstract panels and naturalistic game scenes.","excerpt":"We test this on two kinds of scenes: abstract 2D panels in the Heider--Simmel tradition, and naturalistic 3D game scenes from MuMA-ToM and MindPower. The evaluation covers seven VLMs and roughly 159,000 API calls.","support":"source-stated"}],"limitations":["The reported conclusion is explicitly limited to the evaluated protocol; the evidence describes two scene types and seven VLMs, so broader generalization remains unestablished.","The evidence is the arXiv abstract, not the full paper; it does not provide detailed methods, results, or uncertainty estimates."],"mediaId":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","correctionReason":null,"id":"a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579","publicationId":"15b3ccb0-96f6-4d77-8999-9f25569a2d81","version":1,"sourceUrl":"https://arxiv.org/abs/2611.10694","sourceTitle":"Perception, Not Reasoning, Limits Visual Theory of Mind","publisher":"arXiv q-bio.NC","publishedAt":null,"originalPublished":{"value":"2026-11-07","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-10T08:34:13.297Z","createdAt":"2026-11-12T12:34:32.749Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","kind":"article","url":"https://arxiv.org/abs/2611.10694","sourceUrl":"https://arxiv.org/abs/2611.10694","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T12:33:33.662Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.10694","checkedAt":"2026-11-12T12:50:10.066Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"7d455635ba6ca6e3807faaa6652cd1300789f2746651a6decec2ad818ad0c373","confidence":0.85,"provider":"typesafe","model":"jev-1.13.0","inputHash":"9ab5382338e0640522da748a9442655c817e958d5859f0aae96411510cb61d64","decidedAt":"2026-11-12T12:33:35.784Z"},"provenance":{"textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observationId":"d271088841173a80d3c626d6fdcc43f3136093b16a8e61a8111d17076702be3d","retrievedAt":"2026-11-12T12:33:33.376Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"24336f8c-c41d-423f-85b6-d01287a3729c"},"reviewer":{"model":"gpt-6-luna","runId":"155f0c4c-301d-45a7-8d9b-cf2d67f90f5b"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T12:34:32.749Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Barhdadi, Mohamed Rayan","url":null,"kind":"unknown"},{"name":"Wasim, Syed Talal","url":null,"kind":"unknown"},{"name":"Gall, Juergen","url":null,"kind":"unknown"},{"name":"Serpedin, Erchin","url":null,"kind":"unknown"},{"name":"Kurban, Hasan","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Barhdadi, Mohamed Rayan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Barhdadi, Mohamed Rayan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Wasim, Syed Talal","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wasim, Syed Talal","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Gall, Juergen","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gall, Juergen","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Serpedin, Erchin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Serpedin, Erchin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}},{"actor":{"name":"Kurban, Hasan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kurban, Hasan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.10694","locator":"head/meta[name=author|citation_author]"},"assertionId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T12:50:10.066Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","sourceUrl":"https://arxiv.org/abs/2611.10694","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z"}}],"participationCoverage":{"total":5,"returned":5,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.10694","snapshotId":"973dedddc64bb57315d1355e9014c98fc84742f53fb4512d99aab971aa31c1c0","contentSha256":"f02e6a4571a0240367b5bd27d5d2129c333dd9cca3ddc7dda2a9813955ca5e7a","textHash":"1834f8247a55d8355469f9a6077500e2d98524f48961838caa71da7cc51b66a0","observedAt":"2026-11-12T12:50:10.066Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a9442fea27c5e8d7b7360eeffc38d44d141e132275b853365534926fdcd2e579/source"}}}],"audits":[{"publicationId":"15b3ccb0-96f6-4d77-8999-9f25569a2d81","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The argument is attributed to the paper's authors throughout, and the conclusion stays tied to their evaluated protocol. The title prefix matches the supplied publisher field. The paper's primary listing is cs.CV and it is cross-listed in q-bio.NC, so the prefix is not a misattribution.","excerpt":"Under the evaluated protocol, structured visual scene-state extraction, rather than belief inference, is the dominant bottleneck for visual ToM."},{"dimension":"summary","status":"uncertain","explanation":"The reading omits the paper's motivating finding: VLMs perform near-human on text false-belief probes but drop more than twenty percentage points when the same problem is shown visually. Without it, the visual-to-text gap and its stakes are hard to follow. It also softens the challenge to a stated consensus that prescribes new belief-reasoning modules. Central terms such as theory of mind and ground-truth scaffolds are left unexplained. Smallest repair: add one sentence on the text-versus-visual drop and the consensus fix, and add tooltips for theory of mind, false-belief and ground-truth scaffold.","excerpt":"Vision-language models pass text-based false-belief probes at near-human levels but drop by over twenty percentage points on abstract panels the moment the same problem is conveyed visually."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-07, which matches the v1 submission date. It is not the later feed date of 2026-11-10.","excerpt":"[Submitted on 7 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim matches a verbatim source excerpt. The limitations accurately note the protocol scope and that only the abstract was available. The phrase about failing to perceive where objects were slightly extends the source, which speaks of tracking which agents were present. It remains a reasonable gloss of reality bias, and the open question follows from the stated scope.","excerpt":"This points to a perceptual front-end that fails to track which agents were present at each moment."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified arXiv abstract page, the direct original source.","excerpt":null}],"createdAt":"2026-11-12T12:34:32.749Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}