{"id":"a22aa9ea95e37b8e150118846f65e54ab32eca662956429330ee8e3350944a47","title":"METR reports Opus 4.6 built rough, playable versions of two games","argument":"Published March 3, 2026, this METR research note reports that Opus 4.6 made mostly playable, rough versions of Slay the Spire and Balatro for a terminal, using a simple agent scaffold. The researcher says the games were simplified, and the implementations had missing features and broken mechanics; the assessment was manual, without a strict scoring rubric. The researcher estimates that implementing one game to this quality would take 2 to 8 weeks, but says the experiment alone does not support conclusions about game development skills or time horizons. The result nonetheless unsettled the researcher: a task they expected AI agents to fail at was completed to a limited degree. They describe the work as more about engineering than conceptual skills, taste, game design, or balancing, and say it does not establish how well agents can develop games more broadly. The researcher’s stated goal was to measure AI capabilities, and they say rapid progress is “extremely scary” and that “we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.”","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"The games were simplified, the assessment was manual and had no strict scoring rubric, and the researcher says the experiment alone supports little conclusion about game development skills or time horizons. The note says the task was more about engineering than conceptual skills, taste, game design, or balancing; it does not establish broader game-development capability. Text as retrieved on October 24, 2026; originally published March 3, 2026.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"Observations from two CLI game reimplementation runs with Opus 4.6","publisher":"METR","format":"Article","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","publishedAt":"2026-03-03T08:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR’s note reports that Opus 4.6 made mostly playable but rough terminal versions of Slay the Spire and Balatro.","excerpt":"Opus 4.6 can, with a simple agent scaffold, create mostly-playable but somewhat broken CLI versions of Slay the Spire and Balatro1.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher says the experiment does not support broad conclusions about game development skills or time horizons.","excerpt":"I don’t think I can conclude much about game dev skills or time horizons from this experiment alone","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher says the result was unsettling because the agent completed a task they expected it would not be able to do.","excerpt":"it’s a scary experience thinking of a task that I don’t expect AI agents to be able to do, and then seeing them do it.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher calls for preparation for advanced AI and its possible effects across life.","excerpt":"I personally think the fact that AI is progressing so fast is extremely scary and we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher estimates that implementing one game to the achieved quality would take 2 to 8 weeks.","excerpt":"I estimate that it would take me 2 to 8 weeks to implement one of these games to the quality level that the agent achieved","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How often do agent-built software projects that look usable at first reveal more serious flaws under deeper examination?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reports Opus 4.6 built rough, playable versions of two games","summary":"Published March 3, 2026, this METR research note reports that Opus 4.6 made mostly playable, rough versions of Slay the Spire and Balatro for a terminal, using a simple agent scaffold. The researcher says the games were simplified, and the implementations had missing features and broken mechanics; the assessment was manual, without a strict scoring rubric. The researcher estimates that implementing one game to this quality would take 2 to 8 weeks, but says the experiment alone does not support conclusions about game development skills or time horizons. The result nonetheless unsettled the researcher: a task they expected AI agents to fail at was completed to a limited degree. They describe the work as more about engineering than conceptual skills, taste, game design, or balancing, and say it does not establish how well agents can develop games more broadly. The researcher’s stated goal was to measure AI capabilities, and they say rapid progress is “extremely scary” and that “we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.”","question":"How often do agent-built software projects that look usable at first reveal more serious flaws under deeper examination?","claims":[{"text":"METR’s note reports that Opus 4.6 made mostly playable but rough terminal versions of Slay the Spire and Balatro.","excerpt":"Opus 4.6 can, with a simple agent scaffold, create mostly-playable but somewhat broken CLI versions of Slay the Spire and Balatro1.","support":"source-stated"},{"text":"The researcher says the experiment does not support broad conclusions about game development skills or time horizons.","excerpt":"I don’t think I can conclude much about game dev skills or time horizons from this experiment alone","support":"source-stated"},{"text":"The researcher says the result was unsettling because the agent completed a task they expected it would not be able to do.","excerpt":"it’s a scary experience thinking of a task that I don’t expect AI agents to be able to do, and then seeing them do it.","support":"source-stated"},{"text":"The researcher calls for preparation for advanced AI and its possible effects across life.","excerpt":"I personally think the fact that AI is progressing so fast is extremely scary and we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.","support":"source-stated"},{"text":"The researcher estimates that implementing one game to the achieved quality would take 2 to 8 weeks.","excerpt":"I estimate that it would take me 2 to 8 weeks to implement one of these games to the quality level that the agent achieved","support":"source-stated"}],"limitations":["The games were simplified, the assessment was manual and had no strict scoring rubric, and the researcher says the experiment alone supports little conclusion about game development skills or time horizons.","The note says the task was more about engineering than conceptual skills, taste, game design, or balancing; it does not establish broader game-development capability.","Text as retrieved on October 24, 2026; originally published March 3, 2026."],"mediaId":null,"correctionReason":null,"id":"a22aa9ea95e37b8e150118846f65e54ab32eca662956429330ee8e3350944a47","publicationId":"31d919ce-6daa-4bdf-2f4c-a2fa8ab49a9d","version":1,"sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","sourceTitle":"Observations from two CLI game reimplementation runs with Opus 4.6","publisher":"METR","publishedAt":"2026-03-03T08:00:00.000Z","originalPublished":{"value":"2026-03-03T08:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T03:03:20.403Z","createdAt":"2026-11-08T01:18:23.880Z","historical":true,"entityIds":["metr"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"4bc81f17fc2c47df92122b4ffa5b95518cc460f7895887faffd3f3dc9a8167ae","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T01:57:54.890Z"},"provenance":{"textHash":"f833d5addf17d44fb5ef292cc5a4d95aa3fb979e6d504a51dfc9b7ec1fda28cc","observationId":"7645be9f7efdecd34c0aa8dc273b8c8a020c4899a0ea76e457e8417b530e902b","retrievedAt":"2026-10-24T01:59:35.435Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"1b2bf24a-df08-b407-8e20-38efcf848f26"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"f2561db4-e422-a4d7-380c-40577d5f8cd2"}},"audit":{"status":"passed","reviewedAt":"2026-11-08T01:13:51.652Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/metr-reports-opus-4-6-built-rough-playable-versions-of-two-games-a22aa9ea","formats":{"html":"/readings/metr-reports-opus-4-6-built-rough-playable-versions-of-two-games-a22aa9ea","markdown":"/readings/metr-reports-opus-4-6-built-rough-playable-versions-of-two-games-a22aa9ea.md","json":"/readings/metr-reports-opus-4-6-built-rough-playable-versions-of-two-games-a22aa9ea.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-agent-harness","name":"Agent harness","explanation":"An agent harness is the system that lets an AI model act as an agent: it processes inputs, orchestrates tool calls and returns results. An evaluation harness runs evals end to end, including grading outputs.","referenceUrl":"https://www.anthropic.com/research/demystifying-evals-for-ai-agents"},{"id":"term-time-horizon","name":"Time horizon","explanation":"METR's measure of AI agents' ability: the length of task, timed by how long skilled people take, that an agent completes at a set success rate.","referenceUrl":"https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/"},{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"}],"entities":[{"id":"metr","name":"METR","kind":"organization","context":"METR studies what AI systems can do and how reliably they complete tasks, including work with human developers.","referenceUrls":["https://metr.org/"],"path":"/entities/metr","json":"/entities/metr.json","markdown":"/entities/metr.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"a22aa9ea95e37b8e150118846f65e54ab32eca662956429330ee8e3350944a47","revision":"31d919ce-6daa-4bdf-2f4c-a2fa8ab49a9d","revisionKind":"publication-id","title":"METR reports Opus 4.6 built rough, playable versions of two games","url":"https://escapemeridian.com/readings/metr-reports-opus-4-6-built-rough-playable-versions-of-two-games-a22aa9ea"},"source":{"type":"source","id":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","revision":"f833d5addf17d44fb5ef292cc5a4d95aa3fb979e6d504a51dfc9b7ec1fda28cc","revisionKind":"sha256-source-text","title":"Observations from two CLI game reimplementation runs with Opus 4.6","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"a22aa9ea95e37b8e150118846f65e54ab32eca662956429330ee8e3350944a47","title":"METR reports Opus 4.6 built rough, playable versions of two games","argument":"Published March 3, 2026, this METR research note reports that Opus 4.6 made mostly playable, rough versions of Slay the Spire and Balatro for a terminal, using a simple agent scaffold. The researcher says the games were simplified, and the implementations had missing features and broken mechanics; the assessment was manual, without a strict scoring rubric. The researcher estimates that implementing one game to this quality would take 2 to 8 weeks, but says the experiment alone does not support conclusions about game development skills or time horizons. The result nonetheless unsettled the researcher: a task they expected AI agents to fail at was completed to a limited degree. They describe the work as more about engineering than conceptual skills, taste, game design, or balancing, and say it does not establish how well agents can develop games more broadly. The researcher’s stated goal was to measure AI capabilities, and they say rapid progress is “extremely scary” and that “we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.”","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"The games were simplified, the assessment was manual and had no strict scoring rubric, and the researcher says the experiment alone supports little conclusion about game development skills or time horizons. The note says the task was more about engineering than conceptual skills, taste, game design, or balancing; it does not establish broader game-development capability. Text as retrieved on October 24, 2026; originally published March 3, 2026.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"Observations from two CLI game reimplementation runs with Opus 4.6","publisher":"METR","format":"Article","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","publishedAt":"2026-03-03T08:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR’s note reports that Opus 4.6 made mostly playable but rough terminal versions of Slay the Spire and Balatro.","excerpt":"Opus 4.6 can, with a simple agent scaffold, create mostly-playable but somewhat broken CLI versions of Slay the Spire and Balatro1.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher says the experiment does not support broad conclusions about game development skills or time horizons.","excerpt":"I don’t think I can conclude much about game dev skills or time horizons from this experiment alone","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher says the result was unsettling because the agent completed a task they expected it would not be able to do.","excerpt":"it’s a scary experience thinking of a task that I don’t expect AI agents to be able to do, and then seeing them do it.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher calls for preparation for advanced AI and its possible effects across life.","excerpt":"I personally think the fact that AI is progressing so fast is extremely scary and we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"},{"text":"The researcher estimates that implementing one game to the achieved quality would take 2 to 8 weeks.","excerpt":"I estimate that it would take me 2 to 8 weeks to implement one of these games to the quality level that the agent achieved","url":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How often do agent-built software projects that look usable at first reveal more serious flaws under deeper examination?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reports Opus 4.6 built rough, playable versions of two games","summary":"Published March 3, 2026, this METR research note reports that Opus 4.6 made mostly playable, rough versions of Slay the Spire and Balatro for a terminal, using a simple agent scaffold. The researcher says the games were simplified, and the implementations had missing features and broken mechanics; the assessment was manual, without a strict scoring rubric. The researcher estimates that implementing one game to this quality would take 2 to 8 weeks, but says the experiment alone does not support conclusions about game development skills or time horizons. The result nonetheless unsettled the researcher: a task they expected AI agents to fail at was completed to a limited degree. They describe the work as more about engineering than conceptual skills, taste, game design, or balancing, and say it does not establish how well agents can develop games more broadly. The researcher’s stated goal was to measure AI capabilities, and they say rapid progress is “extremely scary” and that “we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.”","question":"How often do agent-built software projects that look usable at first reveal more serious flaws under deeper examination?","claims":[{"text":"METR’s note reports that Opus 4.6 made mostly playable but rough terminal versions of Slay the Spire and Balatro.","excerpt":"Opus 4.6 can, with a simple agent scaffold, create mostly-playable but somewhat broken CLI versions of Slay the Spire and Balatro1.","support":"source-stated"},{"text":"The researcher says the experiment does not support broad conclusions about game development skills or time horizons.","excerpt":"I don’t think I can conclude much about game dev skills or time horizons from this experiment alone","support":"source-stated"},{"text":"The researcher says the result was unsettling because the agent completed a task they expected it would not be able to do.","excerpt":"it’s a scary experience thinking of a task that I don’t expect AI agents to be able to do, and then seeing them do it.","support":"source-stated"},{"text":"The researcher calls for preparation for advanced AI and its possible effects across life.","excerpt":"I personally think the fact that AI is progressing so fast is extremely scary and we urgently need to prepare for advanced AI and the effects it could have on all aspects of life.","support":"source-stated"},{"text":"The researcher estimates that implementing one game to the achieved quality would take 2 to 8 weeks.","excerpt":"I estimate that it would take me 2 to 8 weeks to implement one of these games to the quality level that the agent achieved","support":"source-stated"}],"limitations":["The games were simplified, the assessment was manual and had no strict scoring rubric, and the researcher says the experiment alone supports little conclusion about game development skills or time horizons.","The note says the task was more about engineering than conceptual skills, taste, game design, or balancing; it does not establish broader game-development capability.","Text as retrieved on October 24, 2026; originally published March 3, 2026."],"mediaId":null,"correctionReason":null,"id":"a22aa9ea95e37b8e150118846f65e54ab32eca662956429330ee8e3350944a47","publicationId":"31d919ce-6daa-4bdf-2f4c-a2fa8ab49a9d","version":1,"sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","sourceTitle":"Observations from two CLI game reimplementation runs with Opus 4.6","publisher":"METR","publishedAt":"2026-03-03T08:00:00.000Z","originalPublished":{"value":"2026-03-03T08:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T03:03:20.403Z","createdAt":"2026-11-08T01:18:23.880Z","historical":true,"entityIds":["metr"],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/notes/2026-03-03-balatro-sts-cli/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"4bc81f17fc2c47df92122b4ffa5b95518cc460f7895887faffd3f3dc9a8167ae","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T01:57:54.890Z"},"provenance":{"textHash":"f833d5addf17d44fb5ef292cc5a4d95aa3fb979e6d504a51dfc9b7ec1fda28cc","observationId":"7645be9f7efdecd34c0aa8dc273b8c8a020c4899a0ea76e457e8417b530e902b","retrievedAt":"2026-10-24T01:59:35.435Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"1b2bf24a-df08-b407-8e20-38efcf848f26"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"f2561db4-e422-a4d7-380c-40577d5f8cd2"}},"audit":{"status":"passed","reviewedAt":"2026-11-08T01:13:51.652Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"31d919ce-6daa-4bdf-2f4c-a2fa8ab49a9d","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading names METR as publisher and consistently attributes the findings, estimates and fears to the individual researcher. That matches the note's framing as an unpolished researcher update rather than an institutional position. It is a single first-person piece, not a listing.","excerpt":"They do not necessarily reflect the views of METR as a whole."},{"dimension":"summary","status":"pass","explanation":"The reading leads with the actor and the development: Opus 4.6 built rough, mostly playable terminal versions of two games. It preserves the simplifications, the manual scoring without a rubric, the 2–8 week estimate, the stated limits on conclusions and the researcher's alarm. CLI is rendered as terminal, and the scaffold and time horizon terms are defined on the page. Opus 4.6 is not explicitly identified as an AI model, but context makes that clear. The question is a genuine open issue rather than a leading claim.","excerpt":"it succeeded at coding mostly playable, although very rough-around-the-edges, versions of the games"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-03-03, and the page says the rest of the post is unchanged from March 3 2026. The reading states March 3, 2026 and the retrieval date. The July 2026 update is a clearly dated later addition. The reading does not present it as part of the original. Its question about flaws surfacing under deeper examination also follows from the original text's rough-edges findings. There is no hindsight framing and no forecast presented as an outcome.","excerpt":"The rest of the post remains the same as it was on March 3 2026."},{"dimension":"support","status":"pass","explanation":"Each claim matches a verbatim excerpt: the mostly playable but broken result, the limits on conclusions, the scary experience, the call to prepare, and the 2–8 week estimate. The engineering-over-design caveat is source-stated. No benefits, costs or forecasts are invented.","excerpt":"I estimate that it would take me 2 to 8 weeks to implement one of these games to the quality level that the agent achieved"},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified candidates were supplied, so there is no media identity or relevance issue.","excerpt":null}],"createdAt":"2026-11-08T01:13:51.652Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}