{"id":"8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0","title":"AI GameStore: Evaluating machine intelligence through human games","argument":"The authors of “AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games” argue that conventional benchmarks cover narrow capabilities and are often quickly saturating as AI improves. They propose evaluating how AI systems play and learn human-designed games, compared with people who have similar experience, time, or other resources. Their “Multiverse of Human Games” is the space of games people can imagine and enjoy.\n\nAs a first step, the authors introduce AI GameStore, a platform that uses LLMs (large language models) with human involvement to generate games by adapting standardized environments from popular digital gaming platforms. They tested seven frontier vision-language models on short play episodes across 100 generated games. The best models scored less than 10% of the human average on most games, and struggled especially with games challenging world-model learning—learning how the game’s world works—memory, and planning.\n\nThe authors present AI GameStore as an initial step toward a practical way to measure and drive progress toward human-like general intelligence, not as a completed measure. The abstract does not establish how well the generated games represent the broader range of human games.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported evaluation covers 100 generated games and short episodes of play; the abstract does not establish how representative these games are of all human games. The evidence provided is the paper’s abstract, which does not detail the evaluation methods or the authors’ proposed next steps.","speaker":{"name":"Ying, Lance, Truong, Ryan, Sharma, Prafull, Zhao, Kaiya Ivy, Cloos, Nathan, Allen, Kelsey R., Griffiths, Thomas L., Collins, Katherine M., Hernández-Orallo, José, Isola, Phillip, Gershman, Samuel J., Tenenbaum, Joshua B.","roleAtSource":"Article author"},"source":{"title":"AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2602.17594","publishedAt":"2026-02-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that conventional AI benchmarks often cover narrow capabilities and can saturate as models improve.","excerpt":"Conventional AI benchmarks typically assess only narrow capabilities in a limited range of human activity. Most are also static, quickly saturating as model capabilities improve.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors propose evaluating AI by comparing its play and learning across human-designed games with human players who have comparable resources.","excerpt":"studying how and how well they play and learn to play all conceivable human games, in comparison to human players with the same level of experience, time, or other resources.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors introduce AI GameStore, which uses LLMs with human involvement to generate games by adapting standardized environments from popular digital gaming platforms.","excerpt":"a scalable and open-ended platform that uses LLMs with humans-in-the-loop to synthesize new representative human games, by automatically sourcing and adapting standardized and containerized variants","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"In short episodes across 100 generated games, the best of seven evaluated frontier vision-language models scored less than 10% of the human average on most games.","excerpt":"The best models achieved less than 10% of the human average score on the majority of the games","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors report that models especially struggled with games that challenge world-model learning, memory, and planning.","excerpt":"especially struggled with games that challenge world-model learning, memory and planning.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors present AI GameStore as a first step toward a practical way to measure and drive progress toward human-like general intelligence.","excerpt":"We conclude with a set of next steps for building out the AI GameStore as a practical way to measure and drive progress toward human-like general intelligence in machines.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2602.17594","checkedAt":"2026-11-21T02:22:09.988Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How representative are the 100 generated games of the broader “Multiverse of Human Games” the authors propose evaluating?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"AI GameStore: Evaluating machine intelligence through human games","summary":"The authors of “AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games” argue that conventional benchmarks cover narrow capabilities and are often quickly saturating as AI improves. They propose evaluating how AI systems play and learn human-designed games, compared with people who have similar experience, time, or other resources. Their “Multiverse of Human Games” is the space of games people can imagine and enjoy.\n\nAs a first step, the authors introduce AI GameStore, a platform that uses LLMs (large language models) with human involvement to generate games by adapting standardized environments from popular digital gaming platforms. They tested seven frontier vision-language models on short play episodes across 100 generated games. The best models scored less than 10% of the human average on most games, and struggled especially with games challenging world-model learning—learning how the game’s world works—memory, and planning.\n\nThe authors present AI GameStore as an initial step toward a practical way to measure and drive progress toward human-like general intelligence, not as a completed measure. The abstract does not establish how well the generated games represent the broader range of human games.","question":"How representative are the 100 generated games of the broader “Multiverse of Human Games” the authors propose evaluating?","claims":[{"text":"The authors argue that conventional AI benchmarks often cover narrow capabilities and can saturate as models improve.","excerpt":"Conventional AI benchmarks typically assess only narrow capabilities in a limited range of human activity. Most are also static, quickly saturating as model capabilities improve.","support":"source-stated"},{"text":"The authors propose evaluating AI by comparing its play and learning across human-designed games with human players who have comparable resources.","excerpt":"studying how and how well they play and learn to play all conceivable human games, in comparison to human players with the same level of experience, time, or other resources.","support":"source-stated"},{"text":"The authors introduce AI GameStore, which uses LLMs with human involvement to generate games by adapting standardized environments from popular digital gaming platforms.","excerpt":"a scalable and open-ended platform that uses LLMs with humans-in-the-loop to synthesize new representative human games, by automatically sourcing and adapting standardized and containerized variants","support":"source-stated"},{"text":"In short episodes across 100 generated games, the best of seven evaluated frontier vision-language models scored less than 10% of the human average on most games.","excerpt":"The best models achieved less than 10% of the human average score on the majority of the games","support":"source-stated"},{"text":"The authors report that models especially struggled with games that challenge world-model learning, memory, and planning.","excerpt":"especially struggled with games that challenge world-model learning, memory and planning.","support":"source-stated"},{"text":"The authors present AI GameStore as a first step toward a practical way to measure and drive progress toward human-like general intelligence.","excerpt":"We conclude with a set of next steps for building out the AI GameStore as a practical way to measure and drive progress toward human-like general intelligence in machines.","support":"source-stated"}],"limitations":["The reported evaluation covers 100 generated games and short episodes of play; the abstract does not establish how representative these games are of all human games.","The evidence provided is the paper’s abstract, which does not detail the evaluation methods or the authors’ proposed next steps."],"mediaId":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","correctionReason":null,"id":"8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0","publicationId":"363f9947-be6c-4a3c-8682-efadf1db2ceb","version":1,"sourceUrl":"https://arxiv.org/abs/2602.17594","sourceTitle":"AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-02-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:17.722Z","createdAt":"2026-11-20T09:19:56.182Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","kind":"article","url":"https://arxiv.org/abs/2602.17594","sourceUrl":"https://arxiv.org/abs/2602.17594","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T09:18:40.046Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2602.17594","checkedAt":"2026-11-21T02:22:09.988Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"51140c55ffc6e3408b125020832cc997e67f2369da21398fd7df6585d0ed3f5f","decidedAt":"2026-11-20T09:18:42.173Z"},"provenance":{"textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observationId":"0e577815d668486a95e4ed6a69676be279b50c0d11e9cf781ec4a90bcfa7f7e7","retrievedAt":"2026-11-20T09:18:39.716Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"92084bfb-009c-446b-878a-1f020ab711a7"},"reviewer":{"model":"gpt-6-luna","runId":"d544335b-218c-4052-8b99-b814b693b909"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T09:19:56.182Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ying, Lance","url":null,"kind":"unknown"},{"name":"Truong, Ryan","url":null,"kind":"unknown"},{"name":"Sharma, Prafull","url":null,"kind":"unknown"},{"name":"Zhao, Kaiya Ivy","url":null,"kind":"unknown"},{"name":"Cloos, Nathan","url":null,"kind":"unknown"},{"name":"Allen, Kelsey R.","url":null,"kind":"unknown"},{"name":"Griffiths, Thomas L.","url":null,"kind":"unknown"},{"name":"Collins, Katherine M.","url":null,"kind":"unknown"},{"name":"Hernández-Orallo, José","url":null,"kind":"unknown"},{"name":"Isola, Phillip","url":null,"kind":"unknown"},{"name":"Gershman, Samuel J.","url":null,"kind":"unknown"},{"name":"Tenenbaum, Joshua B.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ying, Lance","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ying, Lance","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Truong, Ryan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Truong, Ryan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Sharma, Prafull","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sharma, Prafull","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Zhao, Kaiya Ivy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Kaiya Ivy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Cloos, Nathan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cloos, Nathan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Allen, Kelsey R.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Allen, Kelsey R.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Griffiths, Thomas L.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Griffiths, Thomas L.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Collins, Katherine M.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Collins, Katherine M.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Hernández-Orallo, José","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hernández-Orallo, José","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Isola, Phillip","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Isola, Phillip","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Gershman, Samuel J.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gershman, Samuel J.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Tenenbaum, Joshua B.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tenenbaum, Joshua B.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}}],"participationCoverage":{"total":12,"returned":12,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2602.17594","snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z","basis":"publisher-page-metadata","sourceLinks":50,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0/source"}},"canonicalUrl":"https://escapemeridian.com/readings/ai-gamestore-evaluating-machine-intelligence-through-human-games-8c402525","formats":{"html":"/readings/ai-gamestore-evaluating-machine-intelligence-through-human-games-8c402525","markdown":"/readings/ai-gamestore-evaluating-machine-intelligence-through-human-games-8c402525.md","json":"/readings/ai-gamestore-evaluating-machine-intelligence-through-human-games-8c402525.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"},{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-world-model","name":"World model","explanation":"An AI system's internal model of how an environment behaves, used to predict what happens next or to plan.","referenceUrl":"https://arxiv.org/abs/1803.10122"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0","revision":"363f9947-be6c-4a3c-8682-efadf1db2ceb","revisionKind":"publication-id","title":"AI GameStore: Evaluating machine intelligence through human games","url":"https://escapemeridian.com/readings/ai-gamestore-evaluating-machine-intelligence-through-human-games-8c402525"},"source":{"type":"source","id":"https://arxiv.org/abs/2602.17594","revision":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","revisionKind":"sha256-source-text","title":"AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games","url":"https://arxiv.org/abs/2602.17594"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0","title":"AI GameStore: Evaluating machine intelligence through human games","argument":"The authors of “AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games” argue that conventional benchmarks cover narrow capabilities and are often quickly saturating as AI improves. They propose evaluating how AI systems play and learn human-designed games, compared with people who have similar experience, time, or other resources. Their “Multiverse of Human Games” is the space of games people can imagine and enjoy.\n\nAs a first step, the authors introduce AI GameStore, a platform that uses LLMs (large language models) with human involvement to generate games by adapting standardized environments from popular digital gaming platforms. They tested seven frontier vision-language models on short play episodes across 100 generated games. The best models scored less than 10% of the human average on most games, and struggled especially with games challenging world-model learning—learning how the game’s world works—memory, and planning.\n\nThe authors present AI GameStore as an initial step toward a practical way to measure and drive progress toward human-like general intelligence, not as a completed measure. The abstract does not establish how well the generated games represent the broader range of human games.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported evaluation covers 100 generated games and short episodes of play; the abstract does not establish how representative these games are of all human games. The evidence provided is the paper’s abstract, which does not detail the evaluation methods or the authors’ proposed next steps.","speaker":{"name":"Ying, Lance, Truong, Ryan, Sharma, Prafull, Zhao, Kaiya Ivy, Cloos, Nathan, Allen, Kelsey R., Griffiths, Thomas L., Collins, Katherine M., Hernández-Orallo, José, Isola, Phillip, Gershman, Samuel J., Tenenbaum, Joshua B.","roleAtSource":"Article author"},"source":{"title":"AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2602.17594","publishedAt":"2026-02-19","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors argue that conventional AI benchmarks often cover narrow capabilities and can saturate as models improve.","excerpt":"Conventional AI benchmarks typically assess only narrow capabilities in a limited range of human activity. Most are also static, quickly saturating as model capabilities improve.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors propose evaluating AI by comparing its play and learning across human-designed games with human players who have comparable resources.","excerpt":"studying how and how well they play and learn to play all conceivable human games, in comparison to human players with the same level of experience, time, or other resources.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors introduce AI GameStore, which uses LLMs with human involvement to generate games by adapting standardized environments from popular digital gaming platforms.","excerpt":"a scalable and open-ended platform that uses LLMs with humans-in-the-loop to synthesize new representative human games, by automatically sourcing and adapting standardized and containerized variants","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"In short episodes across 100 generated games, the best of seven evaluated frontier vision-language models scored less than 10% of the human average on most games.","excerpt":"The best models achieved less than 10% of the human average score on the majority of the games","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors report that models especially struggled with games that challenge world-model learning, memory, and planning.","excerpt":"especially struggled with games that challenge world-model learning, memory and planning.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"},{"text":"The authors present AI GameStore as a first step toward a practical way to measure and drive progress toward human-like general intelligence.","excerpt":"We conclude with a set of next steps for building out the AI GameStore as a practical way to measure and drive progress toward human-like general intelligence in machines.","url":"https://arxiv.org/abs/2602.17594","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2602.17594","checkedAt":"2026-11-21T02:22:09.988Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How representative are the 100 generated games of the broader “Multiverse of Human Games” the authors propose evaluating?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"AI GameStore: Evaluating machine intelligence through human games","summary":"The authors of “AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games” argue that conventional benchmarks cover narrow capabilities and are often quickly saturating as AI improves. They propose evaluating how AI systems play and learn human-designed games, compared with people who have similar experience, time, or other resources. Their “Multiverse of Human Games” is the space of games people can imagine and enjoy.\n\nAs a first step, the authors introduce AI GameStore, a platform that uses LLMs (large language models) with human involvement to generate games by adapting standardized environments from popular digital gaming platforms. They tested seven frontier vision-language models on short play episodes across 100 generated games. The best models scored less than 10% of the human average on most games, and struggled especially with games challenging world-model learning—learning how the game’s world works—memory, and planning.\n\nThe authors present AI GameStore as an initial step toward a practical way to measure and drive progress toward human-like general intelligence, not as a completed measure. The abstract does not establish how well the generated games represent the broader range of human games.","question":"How representative are the 100 generated games of the broader “Multiverse of Human Games” the authors propose evaluating?","claims":[{"text":"The authors argue that conventional AI benchmarks often cover narrow capabilities and can saturate as models improve.","excerpt":"Conventional AI benchmarks typically assess only narrow capabilities in a limited range of human activity. Most are also static, quickly saturating as model capabilities improve.","support":"source-stated"},{"text":"The authors propose evaluating AI by comparing its play and learning across human-designed games with human players who have comparable resources.","excerpt":"studying how and how well they play and learn to play all conceivable human games, in comparison to human players with the same level of experience, time, or other resources.","support":"source-stated"},{"text":"The authors introduce AI GameStore, which uses LLMs with human involvement to generate games by adapting standardized environments from popular digital gaming platforms.","excerpt":"a scalable and open-ended platform that uses LLMs with humans-in-the-loop to synthesize new representative human games, by automatically sourcing and adapting standardized and containerized variants","support":"source-stated"},{"text":"In short episodes across 100 generated games, the best of seven evaluated frontier vision-language models scored less than 10% of the human average on most games.","excerpt":"The best models achieved less than 10% of the human average score on the majority of the games","support":"source-stated"},{"text":"The authors report that models especially struggled with games that challenge world-model learning, memory, and planning.","excerpt":"especially struggled with games that challenge world-model learning, memory and planning.","support":"source-stated"},{"text":"The authors present AI GameStore as a first step toward a practical way to measure and drive progress toward human-like general intelligence.","excerpt":"We conclude with a set of next steps for building out the AI GameStore as a practical way to measure and drive progress toward human-like general intelligence in machines.","support":"source-stated"}],"limitations":["The reported evaluation covers 100 generated games and short episodes of play; the abstract does not establish how representative these games are of all human games.","The evidence provided is the paper’s abstract, which does not detail the evaluation methods or the authors’ proposed next steps."],"mediaId":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","correctionReason":null,"id":"8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0","publicationId":"363f9947-be6c-4a3c-8682-efadf1db2ceb","version":1,"sourceUrl":"https://arxiv.org/abs/2602.17594","sourceTitle":"AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-02-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:17.722Z","createdAt":"2026-11-20T09:19:56.182Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","kind":"article","url":"https://arxiv.org/abs/2602.17594","sourceUrl":"https://arxiv.org/abs/2602.17594","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T09:18:40.046Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2602.17594","checkedAt":"2026-11-21T02:22:09.988Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"b0ffc905466a7a49a0e7a3044fdcee0719bca7613ff2c8c584ecf0a3eff65921","confidence":0.79,"provider":"typesafe","model":"jev-1.13.0","inputHash":"51140c55ffc6e3408b125020832cc997e67f2369da21398fd7df6585d0ed3f5f","decidedAt":"2026-11-20T09:18:42.173Z"},"provenance":{"textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observationId":"0e577815d668486a95e4ed6a69676be279b50c0d11e9cf781ec4a90bcfa7f7e7","retrievedAt":"2026-11-20T09:18:39.716Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"92084bfb-009c-446b-878a-1f020ab711a7"},"reviewer":{"model":"gpt-6-luna","runId":"d544335b-218c-4052-8b99-b814b693b909"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T09:19:56.182Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Ying, Lance","url":null,"kind":"unknown"},{"name":"Truong, Ryan","url":null,"kind":"unknown"},{"name":"Sharma, Prafull","url":null,"kind":"unknown"},{"name":"Zhao, Kaiya Ivy","url":null,"kind":"unknown"},{"name":"Cloos, Nathan","url":null,"kind":"unknown"},{"name":"Allen, Kelsey R.","url":null,"kind":"unknown"},{"name":"Griffiths, Thomas L.","url":null,"kind":"unknown"},{"name":"Collins, Katherine M.","url":null,"kind":"unknown"},{"name":"Hernández-Orallo, José","url":null,"kind":"unknown"},{"name":"Isola, Phillip","url":null,"kind":"unknown"},{"name":"Gershman, Samuel J.","url":null,"kind":"unknown"},{"name":"Tenenbaum, Joshua B.","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Ying, Lance","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ying, Lance","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Truong, Ryan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Truong, Ryan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Sharma, Prafull","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Sharma, Prafull","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Zhao, Kaiya Ivy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Kaiya Ivy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Cloos, Nathan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Cloos, Nathan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Allen, Kelsey R.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Allen, Kelsey R.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Griffiths, Thomas L.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Griffiths, Thomas L.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Collins, Katherine M.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Collins, Katherine M.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Hernández-Orallo, José","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hernández-Orallo, José","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:8","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Isola, Phillip","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Isola, Phillip","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:9","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Gershman, Samuel J.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gershman, Samuel J.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:10","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}},{"actor":{"name":"Tenenbaum, Joshua B.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tenenbaum, Joshua B.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2602.17594","locator":"head/meta[name=author|citation_author]"},"assertionId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5:participation:11","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:22:09.988Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","sourceUrl":"https://arxiv.org/abs/2602.17594","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z"}}],"participationCoverage":{"total":12,"returned":12,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2602.17594","snapshotId":"525c7c4ede427d472797aa3cff9e6d27b6b0420568ed77aab6dd5e83e1cd61c5","contentSha256":"d7e440988bfd5fc6151eadf588c9a3dc9359e5c6c04ef7aa0197aeefdc2bd95c","textHash":"eb8567364c6b1df49b3b690eea317b646785c8057053f3318ca4cc046aa2167c","observedAt":"2026-11-21T02:22:09.988Z","basis":"publisher-page-metadata","sourceLinks":50,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/8c402525705a3a7a93e15a28823b2af305d4f6e7bf51607b0f892dfaa58681a0/source"}}}],"audits":[{"publicationId":"363f9947-be6c-4a3c-8682-efadf1db2ceb","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently credits the arguments, the platform and the results to the paper's authors. It presents the benchmark critique and the evaluation results as the authors' claims, not as established facts.","excerpt":"We propose that a more promising way to evaluate human-like general intelligence in AI systems is through a particularly strong form of general game playing"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question accurately convey the authors' thesis, platform, method and results. It explains LLMs, world-model learning and the Multiverse of Human Games in plain language. Omitting that the games came from Apple App Store and Steam top charts is minor. The representativeness question follows from the evidence: the authors call the games representative, but the abstract does not show how this was checked.","excerpt":"We generated 100 such games based on the top charts of Apple App Store and Steam, and evaluated seven frontier vision-language models (VLMs) on short episodes of play."},{"dimension":"date","status":"pass","explanation":"The original publication date of 2026-02-19 matches the v1 submission date. It is not the date of the later v2 revision or the feed entry.","excerpt":"Submitted on 19 Feb 2026 (v1), last revised 18 Nov 2026 (this version, v2)"},{"dimension":"support","status":"pass","explanation":"Every claim is backed by a verbatim abstract excerpt. The description of the work as a first step rather than a completed measure is supported by the source. The limitations correctly note that the evidence is limited to the abstract and to short episodes. No test score is presented as real-world reliability.","excerpt":"Taking a first step towards this vision, we introduce the AI GameStore"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to reach the source.","excerpt":null}],"createdAt":"2026-11-20T09:19:56.182Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}