{"id":"ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e","title":"arXiv cs.AI study: LLMs do not consistently reproduce individuals’ questionnaire responses","argument":"In an arXiv cs.AI paper, Francesco Di Cursi, Chiara Boldrini, Andrea Passarella and Marco Conti test whether language models can answer a personality questionnaire as a specific person would, using that person’s social-media posts. They compare predicted trait scores with participants’ actual scores, and with predictions made without personal text or from general population tendencies.\n\nThe authors report that personal writing does not consistently improve predictions. Models perform better for people near the middle of the trait distribution; at either end, they often stay close to central values or perform unevenly. More text does not systematically reduce error: open-source models fluctuate more, while GPT-4 is comparatively stable. Given an explicit personality profile without user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.\n\nThe authors conclude that the evaluated models do not consistently reproduce a particular person’s questionnaire behavior. The abstract does not establish how well the findings generalize beyond the tested models and dataset.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports evaluation on GPT-4, Gemma, Llama 3.1, and Mistral using the MyPersonality dataset; it does not establish how well the findings generalize beyond these models and dataset. The abstract does not provide numerical error measures or details of the questionnaire results by trait beyond the patterns it describes.","speaker":{"name":"Di Cursi, Francesco, Boldrini, Chiara, Passarella, Andrea, Conti, Marco","roleAtSource":"Article author"},"source":{"title":"Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.16586","publishedAt":"2026-11-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study tests whether language models can answer a personality questionnaire as a specific individual would, using that person’s social-media posts.","excerpt":"This paper investigates whether Large Language Models can answer a personality questionnaire as a specific individual would. Given a user's social-media posts, the model completes the BFI-2-60 Big Five questionnaire as that user.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"The authors report that user text does not consistently improve model performance.","excerpt":"The results show that user text does not consistently improve performance.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"Models perform better near the middle of the trait distribution; at the lower and upper ends, they may stay near central values or perform unevenly across ends.","excerpt":"Models perform better near the middle of the trait distribution, while at the lower and upper ends they often remain close to central values or perform well at one end but poorly at the other.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"More context does not systematically reduce error; open-source models fluctuate more, while GPT-4 remains comparatively stable.","excerpt":"Increasing context does not systematically reduce error: open-source models fluctuate more, whereas GPT-4 remains comparatively stable.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"With an explicit personality profile but no user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.","excerpt":"When given an explicit profile, GPT-4 most clearly translates trait information into consistent questionnaire responses, particularly for Extraversion and Neuroticism.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"The authors conclude that the evaluated models do not consistently reproduce specific individuals’ questionnaire behavior.","excerpt":"Overall, the evaluated models do not consistently reproduce the questionnaire behavior of specific individuals.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16586","checkedAt":"2026-11-13T21:32:12.484Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would evaluation on people or settings beyond the MyPersonality dataset change the reported pattern?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI study: LLMs do not consistently reproduce individuals’ questionnaire responses","summary":"In an arXiv cs.AI paper, Francesco Di Cursi, Chiara Boldrini, Andrea Passarella and Marco Conti test whether language models can answer a personality questionnaire as a specific person would, using that person’s social-media posts. They compare predicted trait scores with participants’ actual scores, and with predictions made without personal text or from general population tendencies.\n\nThe authors report that personal writing does not consistently improve predictions. Models perform better for people near the middle of the trait distribution; at either end, they often stay close to central values or perform unevenly. More text does not systematically reduce error: open-source models fluctuate more, while GPT-4 is comparatively stable. Given an explicit personality profile without user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.\n\nThe authors conclude that the evaluated models do not consistently reproduce a particular person’s questionnaire behavior. The abstract does not establish how well the findings generalize beyond the tested models and dataset.","question":"Would evaluation on people or settings beyond the MyPersonality dataset change the reported pattern?","claims":[{"text":"The study tests whether language models can answer a personality questionnaire as a specific individual would, using that person’s social-media posts.","excerpt":"This paper investigates whether Large Language Models can answer a personality questionnaire as a specific individual would. Given a user's social-media posts, the model completes the BFI-2-60 Big Five questionnaire as that user.","support":"source-stated"},{"text":"The authors report that user text does not consistently improve model performance.","excerpt":"The results show that user text does not consistently improve performance.","support":"source-stated"},{"text":"Models perform better near the middle of the trait distribution; at the lower and upper ends, they may stay near central values or perform unevenly across ends.","excerpt":"Models perform better near the middle of the trait distribution, while at the lower and upper ends they often remain close to central values or perform well at one end but poorly at the other.","support":"source-stated"},{"text":"More context does not systematically reduce error; open-source models fluctuate more, while GPT-4 remains comparatively stable.","excerpt":"Increasing context does not systematically reduce error: open-source models fluctuate more, whereas GPT-4 remains comparatively stable.","support":"source-stated"},{"text":"With an explicit personality profile but no user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.","excerpt":"When given an explicit profile, GPT-4 most clearly translates trait information into consistent questionnaire responses, particularly for Extraversion and Neuroticism.","support":"source-stated"},{"text":"The authors conclude that the evaluated models do not consistently reproduce specific individuals’ questionnaire behavior.","excerpt":"Overall, the evaluated models do not consistently reproduce the questionnaire behavior of specific individuals.","support":"source-stated"}],"limitations":["The abstract reports evaluation on GPT-4, Gemma, Llama 3.1, and Mistral using the MyPersonality dataset; it does not establish how well the findings generalize beyond these models and dataset.","The abstract does not provide numerical error measures or details of the questionnaire results by trait beyond the patterns it describes."],"mediaId":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","correctionReason":null,"id":"ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e","publicationId":"0545a80a-bc3e-48f1-8150-38504984d89e","version":1,"sourceUrl":"https://arxiv.org/abs/2611.16586","sourceTitle":"Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-12","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:43:44.251Z","createdAt":"2026-11-13T17:17:18.186Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","kind":"article","url":"https://arxiv.org/abs/2611.16586","sourceUrl":"https://arxiv.org/abs/2611.16586","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T17:04:51.169Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16586","checkedAt":"2026-11-13T21:32:12.484Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"141c79f49fa1e0d2860587af8e1783e197024302cfee39af04715a296ce5f282","decidedAt":"2026-11-13T17:04:53.650Z"},"provenance":{"textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observationId":"e1afe88d11befcedb0a5a5d6f4b3c85e96930870cb34704c413d9c54a5101714","retrievedAt":"2026-11-13T17:04:50.866Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c2db391f-527a-4cc9-89fa-5342bf0193ae"},"reviewer":{"model":"gpt-6-luna","runId":"01227225-bfb2-451a-85d6-cdcba0f6edb9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T17:17:18.186Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Di Cursi, Francesco","url":null,"kind":"unknown"},{"name":"Boldrini, Chiara","url":null,"kind":"unknown"},{"name":"Passarella, Andrea","url":null,"kind":"unknown"},{"name":"Conti, Marco","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Di Cursi, Francesco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Di Cursi, Francesco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Boldrini, Chiara","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Boldrini, Chiara","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Passarella, Andrea","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Passarella, Andrea","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Conti, Marco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Conti, Marco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.16586","snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-study-llms-do-not-consistently-reproduce-ef1816f3","formats":{"html":"/readings/arxiv-cs-ai-study-llms-do-not-consistently-reproduce-ef1816f3","markdown":"/readings/arxiv-cs-ai-study-llms-do-not-consistently-reproduce-ef1816f3.md","json":"/readings/arxiv-cs-ai-study-llms-do-not-consistently-reproduce-ef1816f3.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e","revision":"0545a80a-bc3e-48f1-8150-38504984d89e","revisionKind":"publication-id","title":"arXiv cs.AI study: LLMs do not consistently reproduce individuals’ questionnaire responses","url":"https://escapemeridian.com/readings/arxiv-cs-ai-study-llms-do-not-consistently-reproduce-ef1816f3"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.16586","revision":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","revisionKind":"sha256-source-text","title":"Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation","url":"https://arxiv.org/abs/2611.16586"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e","title":"arXiv cs.AI study: LLMs do not consistently reproduce individuals’ questionnaire responses","argument":"In an arXiv cs.AI paper, Francesco Di Cursi, Chiara Boldrini, Andrea Passarella and Marco Conti test whether language models can answer a personality questionnaire as a specific person would, using that person’s social-media posts. They compare predicted trait scores with participants’ actual scores, and with predictions made without personal text or from general population tendencies.\n\nThe authors report that personal writing does not consistently improve predictions. Models perform better for people near the middle of the trait distribution; at either end, they often stay close to central values or perform unevenly. More text does not systematically reduce error: open-source models fluctuate more, while GPT-4 is comparatively stable. Given an explicit personality profile without user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.\n\nThe authors conclude that the evaluated models do not consistently reproduce a particular person’s questionnaire behavior. The abstract does not establish how well the findings generalize beyond the tested models and dataset.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract reports evaluation on GPT-4, Gemma, Llama 3.1, and Mistral using the MyPersonality dataset; it does not establish how well the findings generalize beyond these models and dataset. The abstract does not provide numerical error measures or details of the questionnaire results by trait beyond the patterns it describes.","speaker":{"name":"Di Cursi, Francesco, Boldrini, Chiara, Passarella, Andrea, Conti, Marco","roleAtSource":"Article author"},"source":{"title":"Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.16586","publishedAt":"2026-11-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study tests whether language models can answer a personality questionnaire as a specific individual would, using that person’s social-media posts.","excerpt":"This paper investigates whether Large Language Models can answer a personality questionnaire as a specific individual would. Given a user's social-media posts, the model completes the BFI-2-60 Big Five questionnaire as that user.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"The authors report that user text does not consistently improve model performance.","excerpt":"The results show that user text does not consistently improve performance.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"Models perform better near the middle of the trait distribution; at the lower and upper ends, they may stay near central values or perform unevenly across ends.","excerpt":"Models perform better near the middle of the trait distribution, while at the lower and upper ends they often remain close to central values or perform well at one end but poorly at the other.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"More context does not systematically reduce error; open-source models fluctuate more, while GPT-4 remains comparatively stable.","excerpt":"Increasing context does not systematically reduce error: open-source models fluctuate more, whereas GPT-4 remains comparatively stable.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"With an explicit personality profile but no user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.","excerpt":"When given an explicit profile, GPT-4 most clearly translates trait information into consistent questionnaire responses, particularly for Extraversion and Neuroticism.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"},{"text":"The authors conclude that the evaluated models do not consistently reproduce specific individuals’ questionnaire behavior.","excerpt":"Overall, the evaluated models do not consistently reproduce the questionnaire behavior of specific individuals.","url":"https://arxiv.org/abs/2611.16586","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16586","checkedAt":"2026-11-13T21:32:12.484Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would evaluation on people or settings beyond the MyPersonality dataset change the reported pattern?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI study: LLMs do not consistently reproduce individuals’ questionnaire responses","summary":"In an arXiv cs.AI paper, Francesco Di Cursi, Chiara Boldrini, Andrea Passarella and Marco Conti test whether language models can answer a personality questionnaire as a specific person would, using that person’s social-media posts. They compare predicted trait scores with participants’ actual scores, and with predictions made without personal text or from general population tendencies.\n\nThe authors report that personal writing does not consistently improve predictions. Models perform better for people near the middle of the trait distribution; at either end, they often stay close to central values or perform unevenly. More text does not systematically reduce error: open-source models fluctuate more, while GPT-4 is comparatively stable. Given an explicit personality profile without user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.\n\nThe authors conclude that the evaluated models do not consistently reproduce a particular person’s questionnaire behavior. The abstract does not establish how well the findings generalize beyond the tested models and dataset.","question":"Would evaluation on people or settings beyond the MyPersonality dataset change the reported pattern?","claims":[{"text":"The study tests whether language models can answer a personality questionnaire as a specific individual would, using that person’s social-media posts.","excerpt":"This paper investigates whether Large Language Models can answer a personality questionnaire as a specific individual would. Given a user's social-media posts, the model completes the BFI-2-60 Big Five questionnaire as that user.","support":"source-stated"},{"text":"The authors report that user text does not consistently improve model performance.","excerpt":"The results show that user text does not consistently improve performance.","support":"source-stated"},{"text":"Models perform better near the middle of the trait distribution; at the lower and upper ends, they may stay near central values or perform unevenly across ends.","excerpt":"Models perform better near the middle of the trait distribution, while at the lower and upper ends they often remain close to central values or perform well at one end but poorly at the other.","support":"source-stated"},{"text":"More context does not systematically reduce error; open-source models fluctuate more, while GPT-4 remains comparatively stable.","excerpt":"Increasing context does not systematically reduce error: open-source models fluctuate more, whereas GPT-4 remains comparatively stable.","support":"source-stated"},{"text":"With an explicit personality profile but no user text, GPT-4 most clearly produces consistent questionnaire responses, particularly for Extraversion and Neuroticism.","excerpt":"When given an explicit profile, GPT-4 most clearly translates trait information into consistent questionnaire responses, particularly for Extraversion and Neuroticism.","support":"source-stated"},{"text":"The authors conclude that the evaluated models do not consistently reproduce specific individuals’ questionnaire behavior.","excerpt":"Overall, the evaluated models do not consistently reproduce the questionnaire behavior of specific individuals.","support":"source-stated"}],"limitations":["The abstract reports evaluation on GPT-4, Gemma, Llama 3.1, and Mistral using the MyPersonality dataset; it does not establish how well the findings generalize beyond these models and dataset.","The abstract does not provide numerical error measures or details of the questionnaire results by trait beyond the patterns it describes."],"mediaId":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","correctionReason":null,"id":"ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e","publicationId":"0545a80a-bc3e-48f1-8150-38504984d89e","version":1,"sourceUrl":"https://arxiv.org/abs/2611.16586","sourceTitle":"Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-12","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:43:44.251Z","createdAt":"2026-11-13T17:17:18.186Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","kind":"article","url":"https://arxiv.org/abs/2611.16586","sourceUrl":"https://arxiv.org/abs/2611.16586","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T17:04:51.169Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16586","checkedAt":"2026-11-13T21:32:12.484Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"6b6c69de48a80af93bfb7c5744717c5bbce0afc251f6224cb623ee26ae39c44a","confidence":0.69,"provider":"typesafe","model":"jev-1.13.0","inputHash":"141c79f49fa1e0d2860587af8e1783e197024302cfee39af04715a296ce5f282","decidedAt":"2026-11-13T17:04:53.650Z"},"provenance":{"textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observationId":"e1afe88d11befcedb0a5a5d6f4b3c85e96930870cb34704c413d9c54a5101714","retrievedAt":"2026-11-13T17:04:50.866Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"c2db391f-527a-4cc9-89fa-5342bf0193ae"},"reviewer":{"model":"gpt-6-luna","runId":"01227225-bfb2-451a-85d6-cdcba0f6edb9"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T17:17:18.186Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Di Cursi, Francesco","url":null,"kind":"unknown"},{"name":"Boldrini, Chiara","url":null,"kind":"unknown"},{"name":"Passarella, Andrea","url":null,"kind":"unknown"},{"name":"Conti, Marco","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Di Cursi, Francesco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Di Cursi, Francesco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Boldrini, Chiara","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Boldrini, Chiara","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Passarella, Andrea","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Passarella, Andrea","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}},{"actor":{"name":"Conti, Marco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Conti, Marco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16586","locator":"head/meta[name=author|citation_author]"},"assertionId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T21:32:12.484Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","sourceUrl":"https://arxiv.org/abs/2611.16586","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.16586","snapshotId":"52db9433f85464b761b1d722d09084f446715ee221b8c56c3b9f358d478cd005","contentSha256":"e45f0fcdfde07d274ca471a24239a679e50d227c3b28beb7c8b3abc03fca78fe","textHash":"5ca9d78b9d92f63e7189099eb04db1b7b3e3cf6641da9d586570d3179941847c","observedAt":"2026-11-13T21:32:12.484Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ef1816f3f27497dff8e98b99dc79bc930353008fe396686e167aa2da0caf149e/source"}}}],"audits":[{"publicationId":"0545a80a-bc3e-48f1-8150-38504984d89e","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the paper to Francesco Di Cursi, Chiara Boldrini, Andrea Passarella and Marco Conti on arXiv cs.AI. Findings are framed as the authors' reports and conclusions rather than established fact.","excerpt":"Authors:Francesco Di Cursi, Chiara Boldrini, Andrea Passarella, Marco Conti"},{"dimension":"summary","status":"uncertain","explanation":"The findings are faithful, but the reading omits the paper's central framing: LLMs as 'digital twins', meaning AI stand-ins for specific people. That framing is why the test matters, so a general reader gets results without clear significance. It names only GPT-4, not Gemma, Llama 3.1 and Mistral, so 'open-source models' is vague. The question mentions the 'MyPersonality dataset' without explaining it. The Big Five questionnaire is also not named in the body. Smallest repair: add one sentence that the authors frame this as testing whether LLMs can act as digital twins of individuals, and name all four models.","excerpt":"Title:Large Language Models as Digital Twins: a Distribution-Aware Questionnaire-Based Evaluation"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-12, which matches the v1 submission date. The feed date of 2026-11-13 is later and is correctly not used.","excerpt":"[v1]\nThu, 12 Nov 2026 10:18:16 UTC (761 KB)"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract closely. The limitations correctly note that the abstract tests four models on a single dataset and gives no numerical error measures. The question about generalization follows from the evidence and is not a leading claim. No benefits or costs are invented.","excerpt":"Overall, the evaluated models do not consistently reproduce the questionnaire behavior of specific individuals."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to access the source.","excerpt":null}],"createdAt":"2026-11-13T17:17:18.186Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}