{"id":"c40e8852206e47f633148a679a9e9a304b052541153d4188b41b7bbc1c3f5732","title":"METR reviews Anthropic's automated R&D risk assessment","argument":"METR published this review on May 8, 2026, assessing Anthropic’s argument that catastrophic risk from its models automating research and development is very low. METR says the report’s survey evidence has problems with sample size, question detail, framing, and calibrated responses, and that it miscounts a missing response as a negative one. METR also argues that the report overlooks the possibility that AI could substantially accelerate research and development before fully automating it.\n\nMETR says evidence gathered after Claude Opus 4.6’s release, including METR evaluations and the lack of public reports of the model automating a key domain, supports the report’s low-risk conclusion. But METR says the report’s own evidence is inadequate to establish that conclusion. It recommends changes to Anthropic’s surveys and more reporting of other evidence that could indicate AI progress. METR expects the public report to be updated and says it may publish another review if changes materially affect its opinions. The review also draws on non-public materials, so its assessment is not based only on public evidence.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published May 8, 2026. METR says it used additional non-public materials, including information shared during a previous review; this summary cannot independently assess those materials. The supplied text is the executive summary of METR’s original review, not the full review documents.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"Review of the \"Risks from automated R&D\" section in the Anthropic Risk Report (February 2026)","publisher":"METR","format":"Article","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","publishedAt":"2026-05-08T07:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR says the Anthropic report does not adequately support its conclusion that catastrophic risk from automated R&D is very low.","excerpt":"We do not think the report adequately supports its conclusion.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says survey design and interpretation problems limit what the cited survey results show about overall risk.","excerpt":"the cited results of the survey provide little evidence about the level of overall risk","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says Anthropic miscounted a missing survey response as a negative response.","excerpt":"Anthropic summarizes the survey results in a way that miscounts one missing response to a question as a negative response.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says evidence after Claude Opus 4.6’s release supports the low-risk conclusion, while the report’s evidence alone is inadequate to establish it.","excerpt":"we agree with the bottom-line conclusion of the report — that the risk of a catastrophe from Opus 4.6 or a less capable Anthropic model automating R&D in any domain is very low — but we think the evidence presented in the report is inadequate to establish this.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR recommends improvements to Anthropic’s internal model use surveys and reporting of other evidence that could indicate AI progress.","excerpt":"recommend improvements that Anthropic could make to their internal model use surveys","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR expects the public report to be updated and may publish a further review if changes materially affect its opinions.","excerpt":"if the updated public version includes any changes that materially affect our opinions, we will publish a further updated review.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will changes to Anthropic’s public report or survey methods materially affect METR’s assessment?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reviews Anthropic's automated R&D risk assessment","summary":"METR published this review on May 8, 2026, assessing Anthropic’s argument that catastrophic risk from its models automating research and development is very low. METR says the report’s survey evidence has problems with sample size, question detail, framing, and calibrated responses, and that it miscounts a missing response as a negative one. METR also argues that the report overlooks the possibility that AI could substantially accelerate research and development before fully automating it.\n\nMETR says evidence gathered after Claude Opus 4.6’s release, including METR evaluations and the lack of public reports of the model automating a key domain, supports the report’s low-risk conclusion. But METR says the report’s own evidence is inadequate to establish that conclusion. It recommends changes to Anthropic’s surveys and more reporting of other evidence that could indicate AI progress. METR expects the public report to be updated and says it may publish another review if changes materially affect its opinions. The review also draws on non-public materials, so its assessment is not based only on public evidence.","question":"Will changes to Anthropic’s public report or survey methods materially affect METR’s assessment?","claims":[{"text":"METR says the Anthropic report does not adequately support its conclusion that catastrophic risk from automated R&D is very low.","excerpt":"We do not think the report adequately supports its conclusion.","support":"source-stated"},{"text":"METR says survey design and interpretation problems limit what the cited survey results show about overall risk.","excerpt":"the cited results of the survey provide little evidence about the level of overall risk","support":"source-stated"},{"text":"METR says Anthropic miscounted a missing survey response as a negative response.","excerpt":"Anthropic summarizes the survey results in a way that miscounts one missing response to a question as a negative response.","support":"source-stated"},{"text":"METR says evidence after Claude Opus 4.6’s release supports the low-risk conclusion, while the report’s evidence alone is inadequate to establish it.","excerpt":"we agree with the bottom-line conclusion of the report — that the risk of a catastrophe from Opus 4.6 or a less capable Anthropic model automating R&D in any domain is very low — but we think the evidence presented in the report is inadequate to establish this.","support":"source-stated"},{"text":"METR recommends improvements to Anthropic’s internal model use surveys and reporting of other evidence that could indicate AI progress.","excerpt":"recommend improvements that Anthropic could make to their internal model use surveys","support":"source-stated"},{"text":"METR expects the public report to be updated and may publish a further review if changes materially affect its opinions.","excerpt":"if the updated public version includes any changes that materially affect our opinions, we will publish a further updated review.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published May 8, 2026.","METR says it used additional non-public materials, including information shared during a previous review; this summary cannot independently assess those materials.","The supplied text is the executive summary of METR’s original review, not the full review documents."],"mediaId":null,"correctionReason":null,"id":"c40e8852206e47f633148a679a9e9a304b052541153d4188b41b7bbc1c3f5732","publicationId":"66e9c0e1-1461-fbd1-a8c1-616aa73fed39","version":1,"sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","sourceTitle":"Review of the \"Risks from automated R&D\" section in the Anthropic Risk Report (February 2026)","publisher":"METR","publishedAt":"2026-05-08T07:00:00.000Z","originalPublished":{"value":"2026-05-08T07:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:53:25.163Z","createdAt":"2026-10-31T00:23:57.045Z","historical":true,"entityIds":["metr"],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"ecb3a407c6b8957066233a12ecde8229ff0a8b3af7945cc7b127603f41395471","reasonCodes":["bridge_screen"],"rubricVersion":"bridge-screen-v5","confidence":0.61,"provider":"typesafe","model":"jev-1.13.0","decidedAt":"2026-10-29T16:44:39.466Z"},"provenance":{"textHash":"ae148d4abd6ee25541280ea4b1e694ee7939c857ebb3d85f2c6cef59af79736a","observationId":"553c25e0109f98fb2b01794f3e0293913412ca037c054f2138d7e576810bdc86","retrievedAt":"2026-10-23T13:51:43.240Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"d44941f9-50ad-301c-53e2-a52dfa1fe2a5"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"530a01d9-1109-d9ae-2ea2-dd4d4bdbb66d"}},"audit":{"status":"passed","reviewedAt":"2026-10-31T00:23:55.880Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/metr-reviews-anthropic-s-automated-r-and-d-risk-assessment-c40e8852","formats":{"html":"/readings/metr-reviews-anthropic-s-automated-r-and-d-risk-assessment-c40e8852","markdown":"/readings/metr-reviews-anthropic-s-automated-r-and-d-risk-assessment-c40e8852.md","json":"/readings/metr-reviews-anthropic-s-automated-r-and-d-risk-assessment-c40e8852.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"metr","name":"METR","kind":"organization","context":"METR studies what AI systems can do and how reliably they complete tasks, including work with human developers.","referenceUrls":["https://metr.org/"],"path":"/entities/metr","json":"/entities/metr.json","markdown":"/entities/metr.md"},{"id":"anthropic","name":"Anthropic","kind":"organization","context":"Anthropic develops Claude and publishes research about AI capability, safety and how people use its systems.","referenceUrls":["https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/anthropic","json":"/entities/anthropic.json","markdown":"/entities/anthropic.md"},{"id":"claude","name":"Claude","kind":"model","context":"Claude is Anthropic’s family of AI models and assistants for tasks such as writing, analysis and coding.","referenceUrls":["https://claude.com/product/overview","https://www.anthropic.com/news","https://www.anthropic.com/research/team/economics"],"path":"/entities/claude","json":"/entities/claude.json","markdown":"/entities/claude.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"c40e8852206e47f633148a679a9e9a304b052541153d4188b41b7bbc1c3f5732","revision":"66e9c0e1-1461-fbd1-a8c1-616aa73fed39","revisionKind":"publication-id","title":"METR reviews Anthropic's automated R&D risk assessment","url":"https://escapemeridian.com/readings/metr-reviews-anthropic-s-automated-r-and-d-risk-assessment-c40e8852"},"source":{"type":"source","id":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","revision":"ae148d4abd6ee25541280ea4b1e694ee7939c857ebb3d85f2c6cef59af79736a","revisionKind":"sha256-source-text","title":"Review of the \"Risks from automated R&D\" section in the Anthropic Risk Report (February 2026)","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"c40e8852206e47f633148a679a9e9a304b052541153d4188b41b7bbc1c3f5732","title":"METR reviews Anthropic's automated R&D risk assessment","argument":"METR published this review on May 8, 2026, assessing Anthropic’s argument that catastrophic risk from its models automating research and development is very low. METR says the report’s survey evidence has problems with sample size, question detail, framing, and calibrated responses, and that it miscounts a missing response as a negative one. METR also argues that the report overlooks the possibility that AI could substantially accelerate research and development before fully automating it.\n\nMETR says evidence gathered after Claude Opus 4.6’s release, including METR evaluations and the lack of public reports of the model automating a key domain, supports the report’s low-risk conclusion. But METR says the report’s own evidence is inadequate to establish that conclusion. It recommends changes to Anthropic’s surveys and more reporting of other evidence that could indicate AI progress. METR expects the public report to be updated and says it may publish another review if changes materially affect its opinions. The review also draws on non-public materials, so its assessment is not based only on public evidence.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 23, 2026; originally published May 8, 2026. METR says it used additional non-public materials, including information shared during a previous review; this summary cannot independently assess those materials. The supplied text is the executive summary of METR’s original review, not the full review documents.","speaker":{"name":"METR","roleAtSource":"Publisher"},"source":{"title":"Review of the \"Risks from automated R&D\" section in the Anthropic Risk Report (February 2026)","publisher":"METR","format":"Article","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","publishedAt":"2026-05-08T07:00:00.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"METR says the Anthropic report does not adequately support its conclusion that catastrophic risk from automated R&D is very low.","excerpt":"We do not think the report adequately supports its conclusion.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says survey design and interpretation problems limit what the cited survey results show about overall risk.","excerpt":"the cited results of the survey provide little evidence about the level of overall risk","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says Anthropic miscounted a missing survey response as a negative response.","excerpt":"Anthropic summarizes the survey results in a way that miscounts one missing response to a question as a negative response.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR says evidence after Claude Opus 4.6’s release supports the low-risk conclusion, while the report’s evidence alone is inadequate to establish it.","excerpt":"we agree with the bottom-line conclusion of the report — that the risk of a catastrophe from Opus 4.6 or a less capable Anthropic model automating R&D in any domain is very low — but we think the evidence presented in the report is inadequate to establish this.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR recommends improvements to Anthropic’s internal model use surveys and reporting of other evidence that could indicate AI progress.","excerpt":"recommend improvements that Anthropic could make to their internal model use surveys","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"},{"text":"METR expects the public report to be updated and may publish a further review if changes materially affect its opinions.","excerpt":"if the updated public version includes any changes that materially affect our opinions, we will publish a further updated review.","url":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Will changes to Anthropic’s public report or survey methods materially affect METR’s assessment?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"METR reviews Anthropic's automated R&D risk assessment","summary":"METR published this review on May 8, 2026, assessing Anthropic’s argument that catastrophic risk from its models automating research and development is very low. METR says the report’s survey evidence has problems with sample size, question detail, framing, and calibrated responses, and that it miscounts a missing response as a negative one. METR also argues that the report overlooks the possibility that AI could substantially accelerate research and development before fully automating it.\n\nMETR says evidence gathered after Claude Opus 4.6’s release, including METR evaluations and the lack of public reports of the model automating a key domain, supports the report’s low-risk conclusion. But METR says the report’s own evidence is inadequate to establish that conclusion. It recommends changes to Anthropic’s surveys and more reporting of other evidence that could indicate AI progress. METR expects the public report to be updated and says it may publish another review if changes materially affect its opinions. The review also draws on non-public materials, so its assessment is not based only on public evidence.","question":"Will changes to Anthropic’s public report or survey methods materially affect METR’s assessment?","claims":[{"text":"METR says the Anthropic report does not adequately support its conclusion that catastrophic risk from automated R&D is very low.","excerpt":"We do not think the report adequately supports its conclusion.","support":"source-stated"},{"text":"METR says survey design and interpretation problems limit what the cited survey results show about overall risk.","excerpt":"the cited results of the survey provide little evidence about the level of overall risk","support":"source-stated"},{"text":"METR says Anthropic miscounted a missing survey response as a negative response.","excerpt":"Anthropic summarizes the survey results in a way that miscounts one missing response to a question as a negative response.","support":"source-stated"},{"text":"METR says evidence after Claude Opus 4.6’s release supports the low-risk conclusion, while the report’s evidence alone is inadequate to establish it.","excerpt":"we agree with the bottom-line conclusion of the report — that the risk of a catastrophe from Opus 4.6 or a less capable Anthropic model automating R&D in any domain is very low — but we think the evidence presented in the report is inadequate to establish this.","support":"source-stated"},{"text":"METR recommends improvements to Anthropic’s internal model use surveys and reporting of other evidence that could indicate AI progress.","excerpt":"recommend improvements that Anthropic could make to their internal model use surveys","support":"source-stated"},{"text":"METR expects the public report to be updated and may publish a further review if changes materially affect its opinions.","excerpt":"if the updated public version includes any changes that materially affect our opinions, we will publish a further updated review.","support":"source-stated"}],"limitations":["Text as retrieved on October 23, 2026; originally published May 8, 2026.","METR says it used additional non-public materials, including information shared during a previous review; this summary cannot independently assess those materials.","The supplied text is the executive summary of METR’s original review, not the full review documents."],"mediaId":null,"correctionReason":null,"id":"c40e8852206e47f633148a679a9e9a304b052541153d4188b41b7bbc1c3f5732","publicationId":"66e9c0e1-1461-fbd1-a8c1-616aa73fed39","version":1,"sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","sourceTitle":"Review of the \"Risks from automated R&D\" section in the Anthropic Risk Report (February 2026)","publisher":"METR","publishedAt":"2026-05-08T07:00:00.000Z","originalPublished":{"value":"2026-05-08T07:00:00.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-18T02:53:25.163Z","createdAt":"2026-10-31T00:23:57.045Z","historical":true,"entityIds":["metr"],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://metr.org/blog/2026-05-08-rd-section-anthropic-risk-report-feb-2026-review/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"ecb3a407c6b8957066233a12ecde8229ff0a8b3af7945cc7b127603f41395471","reasonCodes":["bridge_screen"],"rubricVersion":"bridge-screen-v5","confidence":0.61,"provider":"typesafe","model":"jev-1.13.0","decidedAt":"2026-10-29T16:44:39.466Z"},"provenance":{"textHash":"ae148d4abd6ee25541280ea4b1e694ee7939c857ebb3d85f2c6cef59af79736a","observationId":"553c25e0109f98fb2b01794f3e0293913412ca037c054f2138d7e576810bdc86","retrievedAt":"2026-10-23T13:51:43.240Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"d44941f9-50ad-301c-53e2-a52dfa1fe2a5"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"530a01d9-1109-d9ae-2ea2-dd4d4bdbb66d"}},"audit":{"status":"passed","reviewedAt":"2026-10-31T00:23:55.880Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"66e9c0e1-1461-fbd1-a8c1-616aa73fed39","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading consistently attributes the assessment, criticisms, agreement with the bottom line, and recommendations to METR. It also correctly identifies the reviewed document as Anthropic's February 2026 Risk Report section. This is a single review piece, not a listing.","excerpt":"This document is METR’s external review of the “Risks from automated R&D” section in the Anthropic Risk Report: February 2026"},{"dimension":"summary","status":"pass","explanation":"The reading leads with METR's central position: the report's conclusion is right, but its own evidence is inadequate. It spells out R&D in plain language and covers the survey critiques, the miscount, the overlooked acceleration-before-automation pathway, the recommendations and the update plan. It could have noted METR's stronger line that, on the report's evidence alone, it would likely disagree, but the core meaning is preserved. The question follows from the source's stated possibility of a further review.","excerpt":"If we had to solely rely on the evidence presented by Anthropic in the original Risk Report, we would likely disagree with the report’s conclusion"},{"dimension":"date","status":"pass","explanation":"evidence.originalPublished is 2026-05-08T07:00Z, whose UTC calendar day is May 8, 2026; the URL path matches. The reading states May 8, 2026 and does not present any later events. METR's expected report update is framed as an expectation, not an outcome. This is a publisher page, so no archive disclosure is required.","excerpt":null},{"dimension":"support","status":"pass","explanation":"Each claim is directly supported by the source text, with verbatim excerpts. The summary's mention of the acceleration-before-automation critique and the non-public materials is also source-stated. No unsupported benefits, costs or inferences are added.","excerpt":"the overall argument misses the possibility of substantial AI R&D acceleration before its full automation"},{"dimension":"media","status":"pass","explanation":"No media is selected and no verified media candidates were supplied, so nothing is misidentified or irrelevant.","excerpt":null}],"createdAt":"2026-10-31T00:23:55.880Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}