Chen, Qianpu, Soydaner, Derya, Saunders, Rob · Mar 4, 2026
arXiv cs.AI: What face-like images reveal about vision models
Markdown · JSON · Original source
In “Faces in Things, Faces in Nothing: Probing Face Selectivity in Vision Models with Pareidolia,” Qianpu Chen, Derya Soydaner and Rob Saunders use face pareidolia—seeing a face in an object that does not depict a person—to test vision models’ “Human” answers. Across six models, they compare each face-like region with three controls from the same photograph: a background crop, shuffled tiles and average color. The authors report that some models call illusory faces Human far more readily than human annotators, who classify them as non-human faces. They also find that models can give Human answers when the face-like arrangement is removed. Similar rates can mask different behavior: Qwen2-VL labels every average-color patch Human, while CLIP ViT-B/32 labels shuffled regions Human more often than real faces. Changing category wording alters results, too, removing a preference for face-like regions in LLaVA-1.5 and creating one in CLIP. The authors’ central warning is that a Human answer alone is not evidence that a model detected a face: its response may persist without the arrangement or change with wording. Their comparisons show why the visual evidence and category descriptions used in a test matter when interpreting a model’s label.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Mar 4, 2026 (2026-03-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T01:03:28.608Z. First observed: 2026-11-05T05:06:21.531Z. Retrieved: 2026-11-10T01:02:49.735Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported experiments cover six vision models and use the FacesInThings dataset; the abstract does not establish whether the patterns generalize beyond them. The abstract reports selected results but does not give detailed experimental procedures or quantitative results for every model and control.
Open question
Would these reported patterns hold for models and images beyond the six vision models and FacesInThings dataset tested here?
Source-stated
The authors test whether vision models’ Human answers to face-like regions depend on the face-like arrangement, comparing each region with three controls from the same photograph.
Each face-like region is paired with three controls from the same photograph that lack the arrangement: a background crop, the region with its tiles shuffled, and its average color.
Source-stated
Some tested models label roughly half of illusory faces Human when categories are described as kinds of face, while annotators classify them as non-human faces.
CLIP ViT-L/14 and two generative models label roughly half of them Human when the categories are described as kinds of face. Annotators, by contrast, read these faces as non-human
Source-stated
Similar Human answer rates can conceal different model behavior, including answers to average-color patches and shuffled regions.
Qwen2-VL calls every average-color patch Human and describes a person in each; CLIP ViT-B/32 calls shuffled regions Human more often than real faces
Source-stated
Changing category wording changes whether Human answers favor face-like regions in the tested models.
rewording the categories changes whether Human answers favor the face at all, removing this preference in LLaVA-1.5 and creating it in CLIP.
Source-stated
The authors caution that a Human answer does not establish that a model detected a face.
A Human answer is not evidence of a face: vision models can keep giving it after the face is gone.
Source and contributor context
Chen, Qianpu, Soydaner, Derya, Saunders, Rob · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 2214a8a0-7db9-4f10-8b9c-77d66e5bc0d6.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T01:03:28.608Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 647ca812ba19186fe256002914ab8c1cbdd5407b06f7cb818b4f963bb651eff8. Source text hash: f8321719e6070d410ae22b01369331f0c94cb17d17f9b78215604d00b3d991fb.
Revision and source-check history
Version 1 · 2026-11-10T01:03:28.608Z
arXiv cs.AI: What face-like images reveal about vision models
In “Faces in Things, Faces in Nothing: Probing Face Selectivity in Vision Models with Pareidolia,” Qianpu Chen, Derya Soydaner and Rob Saunders use face pareidolia—seeing a face in an object that does not depict a person—to test vision models’ “Human” answers. Across six models, they compare each face-like region with three controls from the same photograph: a background crop, shuffled tiles and average color. The authors report that some models call illusory faces Human far more readily than human annotators, who classify them as non-human faces. They also find that models can give Human answers when the face-like arrangement is removed. Similar rates can mask different behavior: Qwen2-VL labels every average-color patch Human, while CLIP ViT-B/32 labels shuffled regions Human more often than real faces. Changing category wording alters results, too, removing a preference for face-like regions in LLaVA-1.5 and creating one in CLIP. The authors’ central warning is that a Human answer alone is not evidence that a model detected a face: its response may persist without the arrangement or change with wording. Their comparisons show why the visual evidence and category descriptions used in a test matter when interpreting a model’s label.
Original source
cs.AI · Article
Source details
Original source date: Mar 4, 2026 (2026-03-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T01:03:28.608Z. First observed: 2026-11-05T05:06:21.531Z. Retrieved: 2026-11-10T01:02:49.735Z.
Limits
The reported experiments cover six vision models and use the FacesInThings dataset; the abstract does not establish whether the patterns generalize beyond them. The abstract reports selected results but does not give detailed experimental procedures or quantitative results for every model and control.
Open question
Would these reported patterns hold for models and images beyond the six vision models and FacesInThings dataset tested here?
Source-stated
The authors test whether vision models’ Human answers to face-like regions depend on the face-like arrangement, comparing each region with three controls from the same photograph.
Each face-like region is paired with three controls from the same photograph that lack the arrangement: a background crop, the region with its tiles shuffled, and its average color.
Source-stated
Some tested models label roughly half of illusory faces Human when categories are described as kinds of face, while annotators classify them as non-human faces.
CLIP ViT-L/14 and two generative models label roughly half of them Human when the categories are described as kinds of face. Annotators, by contrast, read these faces as non-human
Source-stated
Similar Human answer rates can conceal different model behavior, including answers to average-color patches and shuffled regions.
Qwen2-VL calls every average-color patch Human and describes a person in each; CLIP ViT-B/32 calls shuffled regions Human more often than real faces
Source-stated
Changing category wording changes whether Human answers favor face-like regions in the tested models.
rewording the categories changes whether Human answers favor the face at all, removing this preference in LLaVA-1.5 and creating it in CLIP.
Source-stated
The authors caution that a Human answer does not establish that a model detected a face.
A Human answer is not evidence of a face: vision models can keep giving it after the face is gone.
Source and contributor context
Chen, Qianpu, Soydaner, Derya, Saunders, Rob · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 2214a8a0-7db9-4f10-8b9c-77d66e5bc0d6.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T01:03:28.608Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 647ca812ba19186fe256002914ab8c1cbdd5407b06f7cb818b4f963bb651eff8. Source text hash: f8321719e6070d410ae22b01369331f0c94cb17d17f9b78215604d00b3d991fb.
uncertain · 2026-11-10T01:03:28.608Z · anthropic/claude-opus-5.5
Publication: 2214a8a0-7db9-4f10-8b9c-77d66e5bc0d6
attribution — pass: The paper, its title and authors Qianpu Chen, Derya Soydaner and Rob Saunders are correctly identified. Findings are framed as what the authors report or warn, not as established fact or EM opinion. Labeling the title with the arXiv cs.AI feed is acceptable.
Authors:Qianpu Chen, Derya Soydaner, Rob Saunders
summary — uncertain: The reading is clear and faithful overall, but one sentence drops a stated condition. It says some models call illusory faces Human 'far more readily' than annotators. The source limits this to CLIP ViT-L/14 and two generative models labeling roughly half Human 'when the categories are described as kinds of face'. That condition matters because the paper itself shows wording changes results. It also omits the face-detector contrast. Smallest repair: name the three models and add 'roughly half … when categories are described as kinds of face'.
CLIP ViT-L/14 and two generative models label roughly half of them Human when the categories are described as kinds of face
date — pass: originalPublished is 2026-03-04, which matches the v1 submission date. It is not the later v4 revision or the November feed date.
[Submitted on 4 Mar 2026 (v1), last revised 4 Nov 2026 (this version, v4)]
support — pass: Each claim's excerpt is an exact quote from the abstract and supports the claim. The limitations and the question about generalization beyond six models and FacesInThings follow fairly from the stated scope. The reading invents no benefits, costs or forecasts.
A Human answer is not evidence of a face: vision models can keep giving it after the face is gone.
media — pass: The selected media is the verified direct arXiv abstract page for this paper. That is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv