# Pew Research Center reports model choice reshapes synthetic polling results

[Canonical reading](https://escapemeridian.com/readings/pew-research-center-reports-model-choice-reshapes-synthetic-8b4f8b57)

Pew Research Center’s report, published September 30, 2026, compares AI-generated survey responses with human poll results and examines how results vary by model. The Center used GPT-5.1 and Claude Opus 4.6 to simulate people from its American Trends Panel, using the same questionnaire and respondent profiles. It reports that neither model reproduced the human panel especially well, and that the models often produced sharply different pictures of public opinion. For example, GPT tended to favor extreme answers, while Opus tended to favor middle options; the report says this pattern appeared across questions on different topics. The difference is more than a matter of which model has the lower average error: choosing a model can change the story a synthetic poll tells about issues and groups. That matters because readers of such polls may encounter incompatible depictions of public attitudes even when the synthetic samples are built in the same way. The Center says newer models and changes to synthetic sample construction could reduce errors or alter these patterns. Its findings concern this experiment, including selected panelists and surveys, and do not address other uses of AI models in polling. How would these results change with other models, respondent profiles or survey questions?

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

Pew Research Center · Article

Original source date: Sep 30, 2026 (2026-09-30T17:55:21.000Z).

Date basis: Date supplied by the publisher’s feed.

Added to Escape Meridian: 2026-11-05T09:58:23.020Z. First observed: 2026-10-18T03:39:24.989Z. Retrieved: 2026-10-30T04:35:47.769Z.

- [How synthetic polling results change based on the AI model](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Limits

Text as retrieved on October 30, 2026; originally published September 30, 2026. The analysis compares two models using a particular set of panelist profiles and surveys; the report says newer models or changes to synthetic sample construction could produce different results. The report says its study does not address other uses of AI models in polling.


## Open question

How would these results change with other models, respondent profiles or survey questions?


## Source-stated

Pew Research Center reports that neither tested model replicated the human panel results especially well on average.

> Opus performed slightly better, with an average absolute error of 11.4 percentage points (compared with 13.3 percentage points for GPT).

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center says the synthetic samples produced substantially different pictures of public opinion, and neither reflected actual opinion overall.

> each synthetic sample painted a very different picture of the American public on multiple dimensions, and neither truly reflected actual public opinion.

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center reports a recurring difference in response style: GPT leaned toward extreme choices, while Opus leaned toward middle choices.

> GPT tended to favor response options at the far ends of scales, such as “extremely” or “not at all.” By contrast, Opus tended to favor “middle” options

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center says model choice alone can produce large, systematic differences between synthetic samples built in the same way.

> the choice of model alone is enough to yield large, systematic differences between synthetic samples that were otherwise built in exactly the same way.

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

The report was published on September 30, 2026.

> Report
> |
> September 30, 2026
> Can AI Stand In for Human Survey-Takers? Not Really

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source and contributor context

Pew Research Center · Publisher

The publisher is identified here. No individual author has been inferred.


## Source media

Media retrieval status: unchecked.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Pew Research Center

Pew Research Center studies public attitudes and social change through surveys and other empirical research.

- [Explore this context](/entities/pew-research-center)
- [Reference](https://www.pewresearch.org/)
- [Reference](https://www.pewresearch.org/internet/2025/04/03/how-the-us-public-and-ai-experts-view-artificial-intelligence/)

## Claude

Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.

- [Explore this context](/entities/claude)
- [Reference](https://claude.com/product/overview)
- [Reference](https://www.anthropic.com/news)
- [Reference](https://www.anthropic.com/research/team/economics)

## Editorial provenance

Version 1. Publication ID: 9b903ec1-c646-4563-9ef9-76e7205e20dc.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-05T09:53:45.032Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge\_admitted\_by\_model.

Observation: 8e012886080b5feebc74646401c2907bcf2ef06da72383f1c3a71b86310e9215. Source text hash: 7ece0e991bcb7f3cc522a5c6e378a8b53cd264eaa73f0ae2a3a6ca254dc43de5.


## Revision and source-check history

### Version 1 — 2026-11-05T09:58:23.020Z

Pew Research Center’s report, published September 30, 2026, compares AI-generated survey responses with human poll results and examines how results vary by model. The Center used GPT-5.1 and Claude Opus 4.6 to simulate people from its American Trends Panel, using the same questionnaire and respondent profiles. It reports that neither model reproduced the human panel especially well, and that the models often produced sharply different pictures of public opinion. For example, GPT tended to favor extreme answers, while Opus tended to favor middle options; the report says this pattern appeared across questions on different topics. The difference is more than a matter of which model has the lower average error: choosing a model can change the story a synthetic poll tells about issues and groups. That matters because readers of such polls may encounter incompatible depictions of public attitudes even when the synthetic samples are built in the same way. The Center says newer models and changes to synthetic sample construction could reduce errors or alter these patterns. Its findings concern this experiment, including selected panelists and surveys, and do not address other uses of AI models in polling. How would these results change with other models, respondent profiles or survey questions?

## Original source

Pew Research Center · Article

Original source date: Sep 30, 2026 (2026-09-30T17:55:21.000Z).

Date basis: Date supplied by the publisher’s feed.

Added to Escape Meridian: 2026-11-05T09:58:23.020Z. First observed: 2026-10-18T03:39:24.989Z. Retrieved: 2026-10-30T04:35:47.769Z.

- [How synthetic polling results change based on the AI model](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Limits

Text as retrieved on October 30, 2026; originally published September 30, 2026. The analysis compares two models using a particular set of panelist profiles and surveys; the report says newer models or changes to synthetic sample construction could produce different results. The report says its study does not address other uses of AI models in polling.


## Open question

How would these results change with other models, respondent profiles or survey questions?


## Source-stated

Pew Research Center reports that neither tested model replicated the human panel results especially well on average.

> Opus performed slightly better, with an average absolute error of 11.4 percentage points (compared with 13.3 percentage points for GPT).

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center says the synthetic samples produced substantially different pictures of public opinion, and neither reflected actual opinion overall.

> each synthetic sample painted a very different picture of the American public on multiple dimensions, and neither truly reflected actual public opinion.

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center reports a recurring difference in response style: GPT leaned toward extreme choices, while Opus leaned toward middle choices.

> GPT tended to favor response options at the far ends of scales, such as “extremely” or “not at all.” By contrast, Opus tended to favor “middle” options

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

Pew Research Center says model choice alone can produce large, systematic differences between synthetic samples built in the same way.

> the choice of model alone is enough to yield large, systematic differences between synthetic samples that were otherwise built in exactly the same way.

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source-stated

The report was published on September 30, 2026.

> Report
> |
> September 30, 2026
> Can AI Stand In for Human Survey-Takers? Not Really

- [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-synthetic-polling-results-change-based-on-the-ai-model/)

## Source and contributor context

Pew Research Center · Publisher

The publisher is identified here. No individual author has been inferred.


## Source media

Media retrieval status: unchecked.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Pew Research Center

Pew Research Center studies public attitudes and social change through surveys and other empirical research.

- [Explore this context](/entities/pew-research-center)
- [Reference](https://www.pewresearch.org/)
- [Reference](https://www.pewresearch.org/internet/2025/04/03/how-the-us-public-and-ai-experts-view-artificial-intelligence/)

## Claude

Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.

- [Explore this context](/entities/claude)
- [Reference](https://claude.com/product/overview)
- [Reference](https://www.anthropic.com/news)
- [Reference](https://www.anthropic.com/research/team/economics)

## Editorial provenance

Version 1. Publication ID: 9b903ec1-c646-4563-9ef9-76e7205e20dc.

Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-05T09:53:45.032Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: bridge\_admitted\_by\_model.

Observation: 8e012886080b5feebc74646401c2907bcf2ef06da72383f1c3a71b86310e9215. Source text hash: 7ece0e991bcb7f3cc522a5c6e378a8b53cd264eaa73f0ae2a3a6ca254dc43de5.


### passed — 2026-11-05T09:53:45.032Z — anthropic/claude-opus-5.5

Publication: 9b903ec1-c646-4563-9ef9-76e7205e20dc

attribution — pass: The reading attributes the findings to Pew Research Center, which matches the page's publisher and author byline. The page is one chapter of a single report with its own analysis, not a listing of other pieces. Claims are consistently framed as what Pew reports or says.

> By Athena Chapekis, Arnold Lau, Samuel Bestvater, Sono Shah, Andrew Mercer and Aaron Smith

summary — pass: The reading leads with the actor, Pew, and plainly explains synthetic polling as AI-generated survey responses that simulate panel members. It identifies the two models and preserves the core thesis: model choice can change the story a synthetic poll tells. It accurately conveys the extreme-versus-middle response pattern and Pew's caveats. The question follows from the stated limits. The American Trends Panel is lightly explained but understandable from context. Minor gap: the page is one chapter of the larger report, but this does not mislead.

> Here, the choice of model alone has the potential to reshape the narrative around public opinion of abortion.

date — pass: The originalPublished instant, 2026-09-30, matches the page dateline of September 30, 2026, and the reading states the date at day precision. The page is a publisher page, so no archive disclosure is needed. modifiedAt equals the publication time. The reading makes no hindsight claims and presents the possibility of future model improvements as Pew's conditional statement, not as an outcome.

> September 30, 2026

support — pass: Each claim matches the source: the error figures (11.4 vs 13.3 points); the very different pictures of public opinion; GPT favoring extreme options and Opus favoring middle ones regardless of topic; and model choice alone producing systematic differences. The inference about readers encountering incompatible depictions follows directly from Pew's own narrative framing. The caveats about newer models and scope are source-stated.

> This was broadly true regardless of what the scale was or what the question was about.

media — pass: No media was selected, and no verified media candidates were supplied. The source page's media status is unchecked with no items, so omitting media is appropriate.

## Recorded references

Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/8b4f8b57faf003bfdecd79b4970071f6c75f4a5ca57d2f20e3331a89b8e8e232/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/pew-research-center-reports-model-choice-reshapes-synthetic-8b4f8b57.json)
