Park, Joon Sung, Zou, Carolyn Q., Kamphorst, Jonne, Egan, Niles, Shaw, Aaron, Hill, Benjamin Mako, Cai, Carrie, Morris, Meredith Ringel, Liang, Percy, Willer, Robb, Bernstein, Michael S. · Nov 15, 2024
arXiv cs.AI authors report richer self-reports improve AI simulations of people
Markdown · JSON · Original source
The authors of “AI Simulations Grounded in Rich Self-Reports Increase Accuracy and Reduce Distortion” argue that simulations prompted only with demographic details can misjudge individuals and distort patterns across a group. They tested richer prompts using surveys and interviews: an AI voice interviewer conducted two-hour interviews with U.S. adults, who also completed surveys and behavioral experiments. On General Social Survey items, simulations using both interviews and surveys reached 72.8% accuracy, compared with 60.4% for demographic prompts; participants’ own two-week test-retest agreement was 79.5%. The authors also report that combined interviews and surveys closed a median of 53.5% of eight measured distortion gaps. These improvements did not remove the distortions, and the authors report no improvement in predicting incentivized economic choices or reducing hyper-rationality in economic games. Their results suggest that richer accounts of people’s own views can make these simulations more accurate on some measures, while leaving important gaps. The abstract does not establish how well the approach would work beyond the study’s participants and tested measures.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 15, 2024 (2024-11-15).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T17:46:50.741Z. First observed: 2026-11-18T05:07:07.254Z. Retrieved: 2026-11-18T17:17:07.182Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The abstract reports results for 1,052 U.S. adults and tested responses and measures; it does not establish performance beyond that study. The abstract says surveys and interviews improved prediction of personality traits, but not of incentivized economic choices. The excerpt supporting the final claim is limited to the abstract; its following text reports that neither frontier nor models reduced hyper-rationality in economic games.
Open question
What explains the finding that the models did not reduce hyper-rationality in economic games?
Source-stated
The authors say demographic-prompted simulations can misjudge individuals and distort sample-level patterns; their study tests whether richer self-reports reduce these problems.
AI simulations of people built from demographic prompts often misjudge individuals and distort sample-level patterns. We test whether rich self-report data reduce these problems.
Source-stated
The study compared simulations prompted with demographic attributes, self-authored personas, survey responses, interview responses, and combined surveys and interviews, using held-out responses for evaluation.
For each participant, we compared simulations prompted with demographic attributes, self-authored personas, survey responses, interview responses, or combined surveys and interviews. We evaluated accuracy on held-out responses
Source-stated
On General Social Survey items, combined interview and survey simulations reached 72.8% accuracy, while demographic simulations reached 60.4%; participants’ two-week test-retest agreement was 79.5%.
On General Social Survey (GSS) items, demographic simulation led to 60.4% accuracy, whereas interview and survey simulation achieved 69.4% and 69.3%, and combining them reached 72.8%, compared with 79.5% for participants' two-week test-retest agreement.
Source-stated
The authors report that combining interviews and surveys reduced but did not eliminate measured distortions, and did not reduce hyper-rationality in economic games.
Combined interview and survey simulation closed a median of 53.5% of the eight distortion gaps between demographic simulation and participant responses. An open-weight model fine-tuned on other participants' self-reports and responses to the target questions achieved 75.2% GSS accuracy and closed a
Source and contributor context
Park, Joon Sung, Zou, Carolyn Q., Kamphorst, Jonne, Egan, Niles, Shaw, Aaron, Hill, Benjamin Mako, Cai, Carrie, Morris, Meredith Ringel, Liang, Percy, Willer, Robb, Bernstein, Michael S. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 4798e06e-e521-412c-867d-e53c6ba95de9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T17:46:50.741Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 53cd2c403908468b1e5fa1e24e3b57077a0d8c2c20ff749daa2fb41ec7c67e66. Source text hash: b2d1e3914c51a50ee0410245cddb41501607e48f5934979c5c7d0ae2a95b9d6c.
Revision and source-check history
Version 1 · 2026-11-18T17:46:50.741Z
arXiv cs.AI authors report richer self-reports improve AI simulations of people
The authors of “AI Simulations Grounded in Rich Self-Reports Increase Accuracy and Reduce Distortion” argue that simulations prompted only with demographic details can misjudge individuals and distort patterns across a group. They tested richer prompts using surveys and interviews: an AI voice interviewer conducted two-hour interviews with U.S. adults, who also completed surveys and behavioral experiments. On General Social Survey items, simulations using both interviews and surveys reached 72.8% accuracy, compared with 60.4% for demographic prompts; participants’ own two-week test-retest agreement was 79.5%. The authors also report that combined interviews and surveys closed a median of 53.5% of eight measured distortion gaps. These improvements did not remove the distortions, and the authors report no improvement in predicting incentivized economic choices or reducing hyper-rationality in economic games. Their results suggest that richer accounts of people’s own views can make these simulations more accurate on some measures, while leaving important gaps. The abstract does not establish how well the approach would work beyond the study’s participants and tested measures.
Original source
cs.AI · Article
Source details
Original source date: Nov 15, 2024 (2024-11-15).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-18T17:46:50.741Z. First observed: 2026-11-18T05:07:07.254Z. Retrieved: 2026-11-18T17:17:07.182Z.
Limits
The abstract reports results for 1,052 U.S. adults and tested responses and measures; it does not establish performance beyond that study. The abstract says surveys and interviews improved prediction of personality traits, but not of incentivized economic choices. The excerpt supporting the final claim is limited to the abstract; its following text reports that neither frontier nor models reduced hyper-rationality in economic games.
Open question
What explains the finding that the models did not reduce hyper-rationality in economic games?
Source-stated
The authors say demographic-prompted simulations can misjudge individuals and distort sample-level patterns; their study tests whether richer self-reports reduce these problems.
AI simulations of people built from demographic prompts often misjudge individuals and distort sample-level patterns. We test whether rich self-report data reduce these problems.
Source-stated
The study compared simulations prompted with demographic attributes, self-authored personas, survey responses, interview responses, and combined surveys and interviews, using held-out responses for evaluation.
For each participant, we compared simulations prompted with demographic attributes, self-authored personas, survey responses, interview responses, or combined surveys and interviews. We evaluated accuracy on held-out responses
Source-stated
On General Social Survey items, combined interview and survey simulations reached 72.8% accuracy, while demographic simulations reached 60.4%; participants’ two-week test-retest agreement was 79.5%.
On General Social Survey (GSS) items, demographic simulation led to 60.4% accuracy, whereas interview and survey simulation achieved 69.4% and 69.3%, and combining them reached 72.8%, compared with 79.5% for participants' two-week test-retest agreement.
Source-stated
The authors report that combining interviews and surveys reduced but did not eliminate measured distortions, and did not reduce hyper-rationality in economic games.
Combined interview and survey simulation closed a median of 53.5% of the eight distortion gaps between demographic simulation and participant responses. An open-weight model fine-tuned on other participants' self-reports and responses to the target questions achieved 75.2% GSS accuracy and closed a
Source and contributor context
Park, Joon Sung, Zou, Carolyn Q., Kamphorst, Jonne, Egan, Niles, Shaw, Aaron, Hill, Benjamin Mako, Cai, Carrie, Morris, Meredith Ringel, Liang, Percy, Willer, Robb, Bernstein, Michael S. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 4798e06e-e521-412c-867d-e53c6ba95de9.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T17:46:50.741Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 53cd2c403908468b1e5fa1e24e3b57077a0d8c2c20ff749daa2fb41ec7c67e66. Source text hash: b2d1e3914c51a50ee0410245cddb41501607e48f5934979c5c7d0ae2a95b9d6c.
uncertain · 2026-11-18T17:46:50.741Z · anthropic/claude-opus-5.5
Publication: 4798e06e-e521-412c-867d-e53c6ba95de9
attribution — pass: The draft attributes the findings and framing to the paper's authors. The arXiv listing names Joon Sung Park, Michael S. Bernstein and others, and the results are reported as the authors' claims rather than established fact.
Authors:Joon Sung Park, Carolyn Q. Zou, Jonne Kamphorst, Niles Egan, Aaron Shaw, Benjamin Mako Hill, Carrie Cai, Meredith Ringel Morris, Percy Liang, Robb Willer, Michael S. Bernstein
summary — uncertain: The core figures are accurate. However, 'hyper-rationality', the subject of the question, is never explained; it appears to mean simulated people acting more like idealized rational agents than real participants. 'Test-retest agreement', the human benchmark that gives the 72.8% figure meaning, is also unexplained; it means participants matched their own answers two weeks later 79.5% of the time. Smallest repair: add a plain-language gloss or tooltip for both terms. The summary also omits the fine-tuned open-weight model result (75.2%), which is optional.
Overall, both frontier and fine-tuned models reduced distortions without erasing them, but neither reduced hyper-rationality in economic games.
date — pass: The displayed originalPublished date of 2024-11-15 matches the v1 submission date. Later revisions (v4 on 16 Nov 2026) and the 2026 feed date are correctly not used.
[Submitted on 15 Nov 2024 (v1), last revised 16 Nov 2026 (this version, v4)]
support — uncertain: Claim 4 says combining interviews and surveys did not eliminate distortions and did not reduce hyper-rationality. Its excerpt is cut off mid-sentence ('closed a') and supports neither point. The source states those points in a separate sentence, and attributes them to 'both frontier and fine-tuned models' rather than specifically to the combined interview-and-survey condition. Smallest repair: replace the excerpt with the 'Overall, both frontier and fine-tuned models...' sentence and match its wording. The other claims, the 'some measures' inference and the question are adequately grounded.
Overall, both frontier and fine-tuned models reduced distortions without erasing them, but neither reduced hyper-rationality in economic games.
media — pass: The selected media is the verified arXiv abstract page, which is the direct original source. No other source media was found.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition reference