Kim, Woongki, Baek, Seungkook, Lee, Minhyeok · Oct 31, 2026
arXiv cs.AI paper: Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers
Markdown · JSON · Original source
The authors argue that vision-language models (VLMs)—models that process images and language—can serve as synthetic shoppers, but that their shelf choices need correction for answer effects. They compare simulated purchases with six public datasets from three countries. The synthetic baskets match held-out purchases as often as households’ own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression. The abstract also reports that, without fitting, VLM shoppers reproduce some measured patterns, including alcohol purchases by gender and age in Russia and trip sizes by store distance in Taiwan. For individual shelf choices, the authors identify a confound: a model’s answer can reflect a product’s position or letter label, not just the product. Their ShelfSight shelf renderings vary products, positions, labels, viewpoints, and prices independently. A factor model separates product preferences from these answer effects. The authors report that hosted VLMs follow stated needs, keep preferences across views, and respond to price as budget shoppers; they estimate answer effects once per image type and remove them. Their conclusion is that corrected shelf choices reflect product preferences. The abstract does not establish how well these results extend beyond the tested datasets and setups.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 31, 2026 (2026-10-31).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T12:45:59.297Z. First observed: 2026-11-10T08:39:39.437Z. Retrieved: 2026-11-12T12:34:34.518Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the abstract, not the paper’s full methods or results; it does not provide further detail on the comparisons or their limits. The abstract reports purchase comparisons using six public datasets from three countries and ShelfSight tests, but does not establish how well the findings generalize beyond those datasets and setups.
Open question
How well do the reported results carry beyond the six public datasets and three countries used for purchase comparisons?
Source-stated
The authors test VLM shoppers against real consumer data at both purchase and individual shelf-choice levels.
We test whether VLM shoppers follow real consumers at two levels.
Source-stated
The abstract reports that synthetic baskets matched held-out purchases as often as households’ own past trips, and that synthetic group differences correlated with real ones twice as strongly as those of a trained regression.
The synthetic baskets hit held-out purchases as often as the households' own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression.
Source-stated
The authors say that shelf-choice answers can be confounded by product position and letter label, and introduce ShelfSight and a factor model to separate these answer effects from product preferences.
At the level of a single shelf choice, a model's answer confounds the product with its position and letter label. We therefore introduce ShelfSight
Source-stated
The authors conclude that corrected shelf choices reflect product preferences, based on their reported ShelfSight results.
VLMs are thus good synthetic shoppers whose corrected shelf choices reflect product preferences.
Source and contributor context
Kim, Woongki, Baek, Seungkook, Lee, Minhyeok · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 8e265e6d-9c64-4f7e-83bd-2e90d0d994e9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T12:45:59.297Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 92534a2a7e19db1cc4938782b744b4bcc9245a89b360eabc6bce760f16b36990. Source text hash: 139209faa40f04541f1c53411f3b59f3f66a0d23db86058d10710d43bb2c9fc5.
Revision and source-check history
Version 1 · 2026-11-12T12:45:59.297Z
arXiv cs.AI paper: Seeing Like a Shopper: Validating Vision-Language Models as Synthetic Consumers
The authors argue that vision-language models (VLMs)—models that process images and language—can serve as synthetic shoppers, but that their shelf choices need correction for answer effects. They compare simulated purchases with six public datasets from three countries. The synthetic baskets match held-out purchases as often as households’ own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression. The abstract also reports that, without fitting, VLM shoppers reproduce some measured patterns, including alcohol purchases by gender and age in Russia and trip sizes by store distance in Taiwan. For individual shelf choices, the authors identify a confound: a model’s answer can reflect a product’s position or letter label, not just the product. Their ShelfSight shelf renderings vary products, positions, labels, viewpoints, and prices independently. A factor model separates product preferences from these answer effects. The authors report that hosted VLMs follow stated needs, keep preferences across views, and respond to price as budget shoppers; they estimate answer effects once per image type and remove them. Their conclusion is that corrected shelf choices reflect product preferences. The abstract does not establish how well these results extend beyond the tested datasets and setups.
Original source
cs.AI · Article
Source details
Original source date: Oct 31, 2026 (2026-10-31).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T12:45:59.297Z. First observed: 2026-11-10T08:39:39.437Z. Retrieved: 2026-11-12T12:34:34.518Z.
Limits
The supplied evidence is the abstract, not the paper’s full methods or results; it does not provide further detail on the comparisons or their limits. The abstract reports purchase comparisons using six public datasets from three countries and ShelfSight tests, but does not establish how well the findings generalize beyond those datasets and setups.
Open question
How well do the reported results carry beyond the six public datasets and three countries used for purchase comparisons?
Source-stated
The authors test VLM shoppers against real consumer data at both purchase and individual shelf-choice levels.
We test whether VLM shoppers follow real consumers at two levels.
Source-stated
The abstract reports that synthetic baskets matched held-out purchases as often as households’ own past trips, and that synthetic group differences correlated with real ones twice as strongly as those of a trained regression.
The synthetic baskets hit held-out purchases as often as the households' own past trips, and synthetic group differences correlate with real ones twice as strongly as those of a trained regression.
Source-stated
The authors say that shelf-choice answers can be confounded by product position and letter label, and introduce ShelfSight and a factor model to separate these answer effects from product preferences.
At the level of a single shelf choice, a model's answer confounds the product with its position and letter label. We therefore introduce ShelfSight
Source-stated
The authors conclude that corrected shelf choices reflect product preferences, based on their reported ShelfSight results.
VLMs are thus good synthetic shoppers whose corrected shelf choices reflect product preferences.
Source and contributor context
Kim, Woongki, Baek, Seungkook, Lee, Minhyeok · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 8e265e6d-9c64-4f7e-83bd-2e90d0d994e9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T12:45:59.297Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 92534a2a7e19db1cc4938782b744b4bcc9245a89b360eabc6bce760f16b36990. Source text hash: 139209faa40f04541f1c53411f3b59f3f66a0d23db86058d10710d43bb2c9fc5.
uncertain · 2026-11-12T12:45:59.297Z · anthropic/claude-opus-5.5
Publication: 8e265e6d-9c64-4f7e-83bd-2e90d0d994e9
attribution — pass: The reading attributes the claims to the paper's authors and qualifies results as reported by the abstract. Labeling the title as an arXiv cs.AI paper matches the publisher metadata and the cs.AI cross-listing, although cs.CV is the primary category.
Authors:Woongki Kim, Seungkook Baek, Minhyeok Lee
summary — uncertain: The reading omits why synthetic shoppers exist. The abstract says language models already stand in for respondents in surveys, behavioral experiments and market research, which is the core stake. Without that, a general reader may not grasp the purpose. Several central terms also go unexplained: held-out purchases, trained regression, without fitting and hosted VLMs. Smallest repair: add one sentence on the synthetic-respondent and market-research use. Also briefly explain held-out and without fitting, and give the concrete answer effects: a preference for the letter A and for image positions.
Language models are widely used as synthetic respondents in surveys, behavioral experiments, and market research.
date — pass: The originalPublished date of 2026-10-31 matches the v1 submission date. The 2026-11-10 feed date is later and correctly not used.
[Submitted on 31 Oct 2026]
support — pass: Each claim matches the abstract verbatim in substance. The generalization question and the limitations are framed as unknowns, not as invented results. No unsupported benefits or costs are asserted.
These answer effects, a preference for the letter A and for positions in the image, are estimated once per image type and removed.
media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the source itself.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv