{"id":"24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81","title":"arXiv cs.AI: Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","argument":"Difan Jiao, George Eilender, Zhenwei Tang and Ashton Anderson study Maia-2, a chess transformer that predicts human moves conditioned on player skill. They ask whether weaker play reflects less knowledge or a different use of knowledge the model retains.\n\nThe authors report that probes for 172 chess concepts found nearly constant accuracy across skill conditions, and that probes trained at one level transferred to others. In positions where skill conditioning changed a prediction from a blunder to the best move, fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%. The authors also report that training on highest-skill representations retained most of the improvement at lower levels.\n\nThey interpret these results as evidence that skill conditioning changes how retained concept knowledge influences move selection, rather than simply removing that knowledge. This distinction matters for interpreting simulated low-skill behavior: in this chess model, weaker choices may understate knowledge available internally. Whether similar results hold beyond chess, or for other ways of measuring knowledge, remains an open question; the evidence here concerns Maia-2 and chess concepts.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence described here concerns Maia-2, chess positions, and deterministically labeled chess concepts; the abstract does not establish whether the results generalize to other models or domains. The supplied evidence is the paper's abstract, not its full methods or results, so details needed to assess the experiments are not available here.","speaker":{"name":"Jiao, Difan, Eilender, George, Tang, Zhenwei, Anderson, Ashton","roleAtSource":"Article author"},"source":{"title":"Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.03439","publishedAt":"2026-11-02","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors study Maia-2, a chess transformer that predicts human moves conditioned on player skill.","excerpt":"a chess transformer that predicts human moves conditioned on player skill","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"Probes for 172 chess concepts had nearly constant accuracy across skill conditions and transferred accurately between levels.","excerpt":"Probe accuracy remains nearly constant across skill conditions, and probes trained at one level transfer accurately to the others.","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"Fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%.","excerpt":"raising best-move accuracy in the lowest skill band from 14.4% to 82.8%","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"The authors conclude that skill conditioning changes how retained concept knowledge influences move selection, so weaker behavior can understate knowledge available within the model.","excerpt":"skill conditioning changes how retained concept knowledge influences move selection, showing that weaker behavior can understate the knowledge available within a model.","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"The paper reports that training the final output layer only on highest-skill representations retained most of the improvement at lower levels.","excerpt":"Training this layer only on highest-skill representations retains most of the improvement at lower levels","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.03439","checkedAt":"2026-11-10T07:48:08.786Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do similar differences between retained knowledge and its use appear in models beyond chess, or with other ways of measuring knowledge?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","summary":"Difan Jiao, George Eilender, Zhenwei Tang and Ashton Anderson study Maia-2, a chess transformer that predicts human moves conditioned on player skill. They ask whether weaker play reflects less knowledge or a different use of knowledge the model retains.\n\nThe authors report that probes for 172 chess concepts found nearly constant accuracy across skill conditions, and that probes trained at one level transferred to others. In positions where skill conditioning changed a prediction from a blunder to the best move, fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%. The authors also report that training on highest-skill representations retained most of the improvement at lower levels.\n\nThey interpret these results as evidence that skill conditioning changes how retained concept knowledge influences move selection, rather than simply removing that knowledge. This distinction matters for interpreting simulated low-skill behavior: in this chess model, weaker choices may understate knowledge available internally. Whether similar results hold beyond chess, or for other ways of measuring knowledge, remains an open question; the evidence here concerns Maia-2 and chess concepts.","question":"Do similar differences between retained knowledge and its use appear in models beyond chess, or with other ways of measuring knowledge?","claims":[{"text":"The authors study Maia-2, a chess transformer that predicts human moves conditioned on player skill.","excerpt":"a chess transformer that predicts human moves conditioned on player skill","support":"source-stated"},{"text":"Probes for 172 chess concepts had nearly constant accuracy across skill conditions and transferred accurately between levels.","excerpt":"Probe accuracy remains nearly constant across skill conditions, and probes trained at one level transfer accurately to the others.","support":"source-stated"},{"text":"Fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%.","excerpt":"raising best-move accuracy in the lowest skill band from 14.4% to 82.8%","support":"source-stated"},{"text":"The authors conclude that skill conditioning changes how retained concept knowledge influences move selection, so weaker behavior can understate knowledge available within the model.","excerpt":"skill conditioning changes how retained concept knowledge influences move selection, showing that weaker behavior can understate the knowledge available within a model.","support":"source-stated"},{"text":"The paper reports that training the final output layer only on highest-skill representations retained most of the improvement at lower levels.","excerpt":"Training this layer only on highest-skill representations retains most of the improvement at lower levels","support":"source-stated"}],"limitations":["The evidence described here concerns Maia-2, chess positions, and deterministically labeled chess concepts; the abstract does not establish whether the results generalize to other models or domains.","The supplied evidence is the paper's abstract, not its full methods or results, so details needed to assess the experiments are not available here."],"mediaId":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","correctionReason":null,"id":"24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81","publicationId":"4e9dd0d8-b4c8-4fe4-8b15-376674e37811","version":1,"sourceUrl":"https://arxiv.org/abs/2611.03439","sourceTitle":"Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-02","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-03T09:04:44.324Z","createdAt":"2026-11-10T07:33:25.797Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","kind":"article","url":"https://arxiv.org/abs/2611.03439","sourceUrl":"https://arxiv.org/abs/2611.03439","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-04T04:48:28.064Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.03439","checkedAt":"2026-11-10T07:48:08.786Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","confidence":0.8700000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a557797bea44d7ea2b924760b327377339ed6cdf20e172284f79be9c402ffeab","decidedAt":"2026-11-04T04:48:29.656Z"},"provenance":{"textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observationId":"f886c2cbd800645d0d7523fc6fc1173e11b567260a85c8cc1a1a7582fc41c29e","retrievedAt":"2026-11-04T04:48:27.708Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0b340728-0032-4997-873a-13633f79363b"},"reviewer":{"model":"gpt-6-luna","runId":"e69f8166-f9fe-4966-85dd-cbed9906e769"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T07:33:25.797Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Jiao, Difan","url":null,"kind":"unknown"},{"name":"Eilender, George","url":null,"kind":"unknown"},{"name":"Tang, Zhenwei","url":null,"kind":"unknown"},{"name":"Anderson, Ashton","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Jiao, Difan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiao, Difan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Eilender, George","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eilender, George","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Tang, Zhenwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Zhenwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Anderson, Ashton","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Anderson, Ashton","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.03439","snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-playing-dumb-how-a-chess-transformer-simulates-24233d96","formats":{"html":"/readings/arxiv-cs-ai-playing-dumb-how-a-chess-transformer-simulates-24233d96","markdown":"/readings/arxiv-cs-ai-playing-dumb-how-a-chess-transformer-simulates-24233d96.md","json":"/readings/arxiv-cs-ai-playing-dumb-how-a-chess-transformer-simulates-24233d96.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-fine-tuning","name":"Fine-tuning","explanation":"Further training of an existing model to adapt it to a particular task or use.","referenceUrl":"https://developers.google.com/machine-learning/glossary#fine-tuning"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81","revision":"4e9dd0d8-b4c8-4fe4-8b15-376674e37811","revisionKind":"publication-id","title":"arXiv cs.AI: Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","url":"https://escapemeridian.com/readings/arxiv-cs-ai-playing-dumb-how-a-chess-transformer-simulates-24233d96"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.03439","revision":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","revisionKind":"sha256-source-text","title":"Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","url":"https://arxiv.org/abs/2611.03439"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81","title":"arXiv cs.AI: Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","argument":"Difan Jiao, George Eilender, Zhenwei Tang and Ashton Anderson study Maia-2, a chess transformer that predicts human moves conditioned on player skill. They ask whether weaker play reflects less knowledge or a different use of knowledge the model retains.\n\nThe authors report that probes for 172 chess concepts found nearly constant accuracy across skill conditions, and that probes trained at one level transferred to others. In positions where skill conditioning changed a prediction from a blunder to the best move, fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%. The authors also report that training on highest-skill representations retained most of the improvement at lower levels.\n\nThey interpret these results as evidence that skill conditioning changes how retained concept knowledge influences move selection, rather than simply removing that knowledge. This distinction matters for interpreting simulated low-skill behavior: in this chess model, weaker choices may understate knowledge available internally. Whether similar results hold beyond chess, or for other ways of measuring knowledge, remains an open question; the evidence here concerns Maia-2 and chess concepts.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence described here concerns Maia-2, chess positions, and deterministically labeled chess concepts; the abstract does not establish whether the results generalize to other models or domains. The supplied evidence is the paper's abstract, not its full methods or results, so details needed to assess the experiments are not available here.","speaker":{"name":"Jiao, Difan, Eilender, George, Tang, Zhenwei, Anderson, Ashton","roleAtSource":"Article author"},"source":{"title":"Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.03439","publishedAt":"2026-11-02","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors study Maia-2, a chess transformer that predicts human moves conditioned on player skill.","excerpt":"a chess transformer that predicts human moves conditioned on player skill","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"Probes for 172 chess concepts had nearly constant accuracy across skill conditions and transferred accurately between levels.","excerpt":"Probe accuracy remains nearly constant across skill conditions, and probes trained at one level transfer accurately to the others.","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"Fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%.","excerpt":"raising best-move accuracy in the lowest skill band from 14.4% to 82.8%","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"The authors conclude that skill conditioning changes how retained concept knowledge influences move selection, so weaker behavior can understate knowledge available within the model.","excerpt":"skill conditioning changes how retained concept knowledge influences move selection, showing that weaker behavior can understate the knowledge available within a model.","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"},{"text":"The paper reports that training the final output layer only on highest-skill representations retained most of the improvement at lower levels.","excerpt":"Training this layer only on highest-skill representations retains most of the improvement at lower levels","url":"https://arxiv.org/abs/2611.03439","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.03439","checkedAt":"2026-11-10T07:48:08.786Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do similar differences between retained knowledge and its use appear in models beyond chess, or with other ways of measuring knowledge?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","summary":"Difan Jiao, George Eilender, Zhenwei Tang and Ashton Anderson study Maia-2, a chess transformer that predicts human moves conditioned on player skill. They ask whether weaker play reflects less knowledge or a different use of knowledge the model retains.\n\nThe authors report that probes for 172 chess concepts found nearly constant accuracy across skill conditions, and that probes trained at one level transferred to others. In positions where skill conditioning changed a prediction from a blunder to the best move, fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%. The authors also report that training on highest-skill representations retained most of the improvement at lower levels.\n\nThey interpret these results as evidence that skill conditioning changes how retained concept knowledge influences move selection, rather than simply removing that knowledge. This distinction matters for interpreting simulated low-skill behavior: in this chess model, weaker choices may understate knowledge available internally. Whether similar results hold beyond chess, or for other ways of measuring knowledge, remains an open question; the evidence here concerns Maia-2 and chess concepts.","question":"Do similar differences between retained knowledge and its use appear in models beyond chess, or with other ways of measuring knowledge?","claims":[{"text":"The authors study Maia-2, a chess transformer that predicts human moves conditioned on player skill.","excerpt":"a chess transformer that predicts human moves conditioned on player skill","support":"source-stated"},{"text":"Probes for 172 chess concepts had nearly constant accuracy across skill conditions and transferred accurately between levels.","excerpt":"Probe accuracy remains nearly constant across skill conditions, and probes trained at one level transfer accurately to the others.","support":"source-stated"},{"text":"Fine-tuning only the final output layer raised best-move accuracy in the lowest skill band from 14.4% to 82.8%.","excerpt":"raising best-move accuracy in the lowest skill band from 14.4% to 82.8%","support":"source-stated"},{"text":"The authors conclude that skill conditioning changes how retained concept knowledge influences move selection, so weaker behavior can understate knowledge available within the model.","excerpt":"skill conditioning changes how retained concept knowledge influences move selection, showing that weaker behavior can understate the knowledge available within a model.","support":"source-stated"},{"text":"The paper reports that training the final output layer only on highest-skill representations retained most of the improvement at lower levels.","excerpt":"Training this layer only on highest-skill representations retains most of the improvement at lower levels","support":"source-stated"}],"limitations":["The evidence described here concerns Maia-2, chess positions, and deterministically labeled chess concepts; the abstract does not establish whether the results generalize to other models or domains.","The supplied evidence is the paper's abstract, not its full methods or results, so details needed to assess the experiments are not available here."],"mediaId":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","correctionReason":null,"id":"24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81","publicationId":"4e9dd0d8-b4c8-4fe4-8b15-376674e37811","version":1,"sourceUrl":"https://arxiv.org/abs/2611.03439","sourceTitle":"Playing Dumb: How a Chess Transformer Simulates Users Across Skill Levels","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-02","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-03T09:04:44.324Z","createdAt":"2026-11-10T07:33:25.797Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","kind":"article","url":"https://arxiv.org/abs/2611.03439","sourceUrl":"https://arxiv.org/abs/2611.03439","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-04T04:48:28.064Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.03439","checkedAt":"2026-11-10T07:48:08.786Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"6f5a0e0af9ef3723dd6d93337f81932e3e9c5f354ea47a37912bbee1063b897b","confidence":0.8700000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a557797bea44d7ea2b924760b327377339ed6cdf20e172284f79be9c402ffeab","decidedAt":"2026-11-04T04:48:29.656Z"},"provenance":{"textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observationId":"f886c2cbd800645d0d7523fc6fc1173e11b567260a85c8cc1a1a7582fc41c29e","retrievedAt":"2026-11-04T04:48:27.708Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"0b340728-0032-4997-873a-13633f79363b"},"reviewer":{"model":"gpt-6-luna","runId":"e69f8166-f9fe-4966-85dd-cbed9906e769"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-10T07:33:25.797Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Jiao, Difan","url":null,"kind":"unknown"},{"name":"Eilender, George","url":null,"kind":"unknown"},{"name":"Tang, Zhenwei","url":null,"kind":"unknown"},{"name":"Anderson, Ashton","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Jiao, Difan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiao, Difan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Eilender, George","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Eilender, George","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Tang, Zhenwei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Zhenwei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}},{"actor":{"name":"Anderson, Ashton","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Anderson, Ashton","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.03439","locator":"head/meta[name=author|citation_author]"},"assertionId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-10T07:48:08.786Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","sourceUrl":"https://arxiv.org/abs/2611.03439","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.03439","snapshotId":"6c1167aa3f19434bbe1a8347687e694ad43df89e99be37f2585607d0dcab6bf2","contentSha256":"91db9305504f1080807877a4d8dd532017023835da6c588a8918129c1a84aeed","textHash":"6b5986b2c10890e95ed6cb6c70d0fb490c30a83602d4c2bd7edaf9981e5b2611","observedAt":"2026-11-10T07:48:08.786Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/24233d960fa53f63e8a5a3142d533261cbcc0460de837564507d5f1abee68f81/source"}}}],"audits":[{"publicationId":"4e9dd0d8-b4c8-4fe4-8b15-376674e37811","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly names authors Difan Jiao, George Eilender, Zhenwei Tang and Ashton Anderson. It attributes the findings and interpretation to them with phrases such as 'the authors report' and 'they interpret', rather than presenting them as established fact.","excerpt":"Authors:Difan Jiao, George Eilender, Zhenwei Tang, Ashton Anderson"},{"dimension":"summary","status":"uncertain","explanation":"The reading is faithful but may be hard for a non-specialist to follow. 'Probes' carries the central knowledge-retention evidence yet is never explained; 'fine-tuning', 'skill conditioning' and 'transformer' are also unexplained. It also omits the stakes the abstract gives: generative models are used to simulate users of different skill levels in education and AI evaluation. Smallest repair: briefly gloss 'probes' (small classifiers that read concepts from internal states) or add tooltips, and add one sentence on the education/evaluation use. The sparse autoencoder steering result is also omitted, though that is minor.","excerpt":"Generative models increasingly simulate users at different skill levels in education and AI evaluation."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-02, which matches the arXiv v1 submission date. The feed date of Nov 3 is later and correctly not used.","excerpt":"[Submitted on 2 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim matches an abstract excerpt. This includes the 172 concepts, the near-constant probe accuracy and transfer, the rise from 14.4% to 82.8%, the retained gains from training on highest-skill representations, and the authors' interpretation. The generalization question and the limitations are framed as unknowns, not as claims. No implied benefits or costs go beyond the evidence.","excerpt":"Probe accuracy remains nearly constant across skill conditions, and probes trained at one level transfer accurately to the others."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-10T07:33:25.797Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}