# Athena Chapekis and coauthors argue in Pew Research Center report that synthetic polls fall short [Canonical reading](https://escapemeridian.com/readings/athena-chapekis-and-coauthors-argue-in-pew-research-center-71a96380) Pew Research Center’s report, published September 30, 2026, examines whether AI-generated survey data can reproduce results from high-quality polls of people. Athena Chapekis, Arnold Lau, Samuel Bestvater, Sono Shah, Andrew Mercer and Aaron Smith report that AI respondents did not match human respondents especially well across three replicated American Trends Panel survey waves. They say synthetic results differed from human estimates by an average of 12 percentage points, with errors across all major subgroups; performance was especially poor for several groups, including Republicans and Republican leaners and Black adults. The authors also point to cases where simulated responses overstated Hispanic adults’ interest in the World Cup and made views within political groups seem more uniform than they were in human surveys. They connect such results to concerns that models can rely on assumptions or stereotypes about groups. The report says the experiment was designed to evaluate synthetic samples for public-opinion research, not other uses of AI in polling. The Center says speaking to the public is essential to measuring public opinion and that it has no current or future plans to use AI models to generate survey results. Whether other models or approaches would produce similar errors remains an open question. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source Pew Research Center · Article Original source date: Sep 30, 2026 (2026-09-30T17:55:18.000Z). Date basis: Date supplied by the publisher’s feed. Added to Escape Meridian: 2026-11-05T10:08:23.136Z. First observed: 2026-10-18T03:43:21.510Z. Retrieved: 2026-10-30T04:59:47.038Z. - [How well synthetic samples replicate public opinion](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Limits Text as retrieved on October 30, 2026; originally published September 30, 2026. The report’s main findings here concern three replicated American Trends Panel survey waves; synthetic results generally use Claude Opus 4.6. The evidence does not establish how other models or sampling approaches would perform. ## Open question How would the reported errors change with other AI models or different ways of constructing synthetic samples? ## Source-stated The report is dated September 30, 2026. > Report > | > September 30, 2026 - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The authors report that synthetic polling results differed from human poll estimates by an average of 12 percentage points across the three waves. > Across all three waves, the synthetic polling results differed by an average of 12 percentage points from the estimates produced by the human polls. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The report says errors appeared across all major subgroups and were especially high for several groups, including Republicans and Republican leaners and Black adults. > There were also clear errors for all major subgroups in the analysis. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The authors report examples in which synthetic results overstated Hispanic adults’ interest in the World Cup and made political views seem more uniform than in the actual population. > Across numerous such examples, our AI respondents were far less politically diverse than the actual population. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The Center says speaking to the public is essential to measuring public opinion and that it has no current or future plans to use AI models to generate survey results. > The Center believes that speaking to the public is essential to measuring public opinion and has no current or future plans to use AI models to generate survey results. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source and contributor context Pew Research Center · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Pew Research Center Pew Research Center studies public attitudes and social change through surveys and other empirical research. - [Explore this context](/entities/pew-research-center) - [Reference](https://www.pewresearch.org/) - [Reference](https://www.pewresearch.org/internet/2025/04/03/how-the-us-public-and-ai-experts-view-artificial-intelligence/) ## Claude Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding. - [Explore this context](/entities/claude) - [Reference](https://claude.com/product/overview) - [Reference](https://www.anthropic.com/news) - [Reference](https://www.anthropic.com/research/team/economics) ## Editorial provenance Version 1. Publication ID: 92d76bd3-06e6-0a4a-2b82-dcd699e8e5d6. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T10:03:45.542Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model. Observation: f0b37a2f9329ca2e3c7e22a7b8b0caf0881f4412cd7c36e72457807bc7805225. Source text hash: 5060fc128b1d51cb24264b1434b1888602e7f1d00c4178de626a7ecfe1e5b48c. ## Revision and source-check history ### Version 1 — 2026-11-05T10:08:23.136Z Pew Research Center’s report, published September 30, 2026, examines whether AI-generated survey data can reproduce results from high-quality polls of people. Athena Chapekis, Arnold Lau, Samuel Bestvater, Sono Shah, Andrew Mercer and Aaron Smith report that AI respondents did not match human respondents especially well across three replicated American Trends Panel survey waves. They say synthetic results differed from human estimates by an average of 12 percentage points, with errors across all major subgroups; performance was especially poor for several groups, including Republicans and Republican leaners and Black adults. The authors also point to cases where simulated responses overstated Hispanic adults’ interest in the World Cup and made views within political groups seem more uniform than they were in human surveys. They connect such results to concerns that models can rely on assumptions or stereotypes about groups. The report says the experiment was designed to evaluate synthetic samples for public-opinion research, not other uses of AI in polling. The Center says speaking to the public is essential to measuring public opinion and that it has no current or future plans to use AI models to generate survey results. Whether other models or approaches would produce similar errors remains an open question. ## Original source Pew Research Center · Article Original source date: Sep 30, 2026 (2026-09-30T17:55:18.000Z). Date basis: Date supplied by the publisher’s feed. Added to Escape Meridian: 2026-11-05T10:08:23.136Z. First observed: 2026-10-18T03:43:21.510Z. Retrieved: 2026-10-30T04:59:47.038Z. - [How well synthetic samples replicate public opinion](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Limits Text as retrieved on October 30, 2026; originally published September 30, 2026. The report’s main findings here concern three replicated American Trends Panel survey waves; synthetic results generally use Claude Opus 4.6. The evidence does not establish how other models or sampling approaches would perform. ## Open question How would the reported errors change with other AI models or different ways of constructing synthetic samples? ## Source-stated The report is dated September 30, 2026. > Report > | > September 30, 2026 - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The authors report that synthetic polling results differed from human poll estimates by an average of 12 percentage points across the three waves. > Across all three waves, the synthetic polling results differed by an average of 12 percentage points from the estimates produced by the human polls. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The report says errors appeared across all major subgroups and were especially high for several groups, including Republicans and Republican leaners and Black adults. > There were also clear errors for all major subgroups in the analysis. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The authors report examples in which synthetic results overstated Hispanic adults’ interest in the World Cup and made political views seem more uniform than in the actual population. > Across numerous such examples, our AI respondents were far less politically diverse than the actual population. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source-stated The Center says speaking to the public is essential to measuring public opinion and that it has no current or future plans to use AI models to generate survey results. > The Center believes that speaking to the public is essential to measuring public opinion and has no current or future plans to use AI models to generate survey results. - [Supporting source](https://www.pewresearch.org/data-labs/2026/09/30/how-well-synthetic-samples-replicate-public-opinion/) ## Source and contributor context Pew Research Center · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Pew Research Center Pew Research Center studies public attitudes and social change through surveys and other empirical research. - [Explore this context](/entities/pew-research-center) - [Reference](https://www.pewresearch.org/) - [Reference](https://www.pewresearch.org/internet/2025/04/03/how-the-us-public-and-ai-experts-view-artificial-intelligence/) ## Claude Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding. - [Explore this context](/entities/claude) - [Reference](https://claude.com/product/overview) - [Reference](https://www.anthropic.com/news) - [Reference](https://www.anthropic.com/research/team/economics) ## Editorial provenance Version 1. Publication ID: 92d76bd3-06e6-0a4a-2b82-dcd699e8e5d6. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T10:03:45.542Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model. Observation: f0b37a2f9329ca2e3c7e22a7b8b0caf0881f4412cd7c36e72457807bc7805225. Source text hash: 5060fc128b1d51cb24264b1434b1888602e7f1d00c4178de626a7ecfe1e5b48c. ### uncertain — 2026-11-05T10:03:45.542Z — anthropic/claude-opus-5.5 Publication: 92d76bd3-06e6-0a4a-2b82-dcd699e8e5d6 attribution — pass: The reading correctly attributes the report to Pew Research Center and its six listed authors. It keeps findings attributed to the authors and states the Center's AI policy as the Center's own position. > By Athena Chapekis, Arnold Lau, Samuel Bestvater, Sono Shah, Andrew Mercer and Aaron Smith summary — uncertain: The core findings are faithful and readable. Two gaps remain. First, the summary never explains how the AI respondents were built: an AI model adopted personas of real panelists, the 'digital twins' approach. It names neither the model, Claude Opus 4.6, nor that approach outside the limitations, so a lay reader cannot see what was tested. Second, the closing open question about other models leaves out that Pew tested several models and Opus 4.6 performed best. Smallest repair: add one sentence on the persona method and the model, and narrow the question to untested approaches. > We used a “digital twins” approach for this study, asking an AI model to adopt the personas of real humans who are members of the ATP. date — pass: originalPublished is 2026-09-30T17:55Z, so the UTC day is September 30, 2026. This matches the report's dateline, and the reading states the date at day precision. It uses no later events and no hindsight framing. The page is a publisher page, so no archive disclosure is needed, and modifiedAt equals the publication time. > Report | September 30, 2026 support — uncertain: The stated claims are each supported by source excerpts: the 12-point average error, subgroup errors, the World Cup and partisan uniformity examples, and the Center's policy. However, the reading presents other models' performance as an open question, and a limitation says the evidence does not establish how other models would perform. The source says several models were evaluated and Opus 4.6 performed best, which implies the others did worse. Smallest repair: state that Opus 4.6 was the best of several models Pew tested, and limit the open question to approaches Pew did not test. > We tested multiple models, but all synthetic results unless noted otherwise come from Anthropic’s Claude Opus 4.6. media — pass: No media was selected, and no verified media candidates were supplied, so there is no media identity or relevance issue. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/71a96380ad1076f5039a55dff63cecc978e936d1ad838e663bc18cc5346cb6e9/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/athena-chapekis-and-coauthors-argue-in-pew-research-center-71a96380.json)