{"id":"4311dcc484ad289051e920ca3d33d028132ab0f77faaa54fb83339dde1fc3672","title":"Luca Righetti argues in Planned Obsolescence for harder dangerous-capability tests","argument":"Luca Righetti’s essay was published on August 20, 2024. He argues that current tests of AI’s dangerous biological capabilities can be too easy to justify costly precautions, yet passing them may still leave unclear whether an AI can help someone create a biological weapon. Knowledge tests do not establish that a model can troubleshoot protocols: biological work can require adapting detailed procedures to a particular laboratory. Even stronger tests may not show that a layperson can act on AI advice or overcome practical barriers outside a professional lab.\n\nRighetti describes a one-way problem: failure on a test may suggest safety, while passing still may not establish danger. He proposes working backward from a hypothetical “gold standard” test: a randomized controlled trial in which non-experts attempt to create a relatively harmless virus, with AI mentors or internet access, using a secure garage-like lab. He says such a test would be costly and might be impractical or unethical, but could give decision-makers a stronger basis for costly measures. His conclusion is that difficult, realistic tests should be designed in advance, rather than made harder without a clear plan. Whether a safe, ethical test could establish the capabilities that would justify those measures remains unresolved.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 28, 2026; originally published August 20, 2024. The proposed gold-standard test is hypothetical; the essay does not report that it was conducted. Righetti notes that the Future House study compared models without tools against human evaluators who could use tools, a limitation that may affect the reported comparison.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Dangerous capability tests should be harder","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","publishedAt":"2024-08-20T15:42:19+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Righetti argues that passing a dangerous-capability test may not establish that an AI can help a layperson create a biological weapon.","excerpt":"if it succeeds, it’s still not clear whether it’s actually dangerous","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti says biological work involves adapting protocols to a specific laboratory, not just recalling facts.","excerpt":"It involves designing detailed, step-by-step plans (known as “protocols”) and tailoring them to a specific laboratory environment.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti proposes working backward from a hypothetical test in which non-experts try to create a relatively harmless virus, with AI mentors or internet access.","excerpt":"Half the people would have AI mentors and the other half can only look stuff up on the internet.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti argues that difficult, realistic tests should be designed in advance to help justify costly measures.","excerpt":"we need to agree in advance on some tests that are hard enough and realistic enough that they clearly justify action.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti says the hypothetical test could be too impractical or unethical, but argues that designing hard tests should begin now.","excerpt":"even if this exact test turns out to be too impractical (or unethical) to be worth it, we need to agree in advance on some tests","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What safe, realistic test could show whether AI meaningfully helps non-experts overcome the practical barriers to creating a biological weapon?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Luca Righetti argues in Planned Obsolescence for harder dangerous-capability tests","summary":"Luca Righetti’s essay was published on August 20, 2024. He argues that current tests of AI’s dangerous biological capabilities can be too easy to justify costly precautions, yet passing them may still leave unclear whether an AI can help someone create a biological weapon. Knowledge tests do not establish that a model can troubleshoot protocols: biological work can require adapting detailed procedures to a particular laboratory. Even stronger tests may not show that a layperson can act on AI advice or overcome practical barriers outside a professional lab.\n\nRighetti describes a one-way problem: failure on a test may suggest safety, while passing still may not establish danger. He proposes working backward from a hypothetical “gold standard” test: a randomized controlled trial in which non-experts attempt to create a relatively harmless virus, with AI mentors or internet access, using a secure garage-like lab. He says such a test would be costly and might be impractical or unethical, but could give decision-makers a stronger basis for costly measures. His conclusion is that difficult, realistic tests should be designed in advance, rather than made harder without a clear plan. Whether a safe, ethical test could establish the capabilities that would justify those measures remains unresolved.","question":"What safe, realistic test could show whether AI meaningfully helps non-experts overcome the practical barriers to creating a biological weapon?","claims":[{"text":"Righetti argues that passing a dangerous-capability test may not establish that an AI can help a layperson create a biological weapon.","excerpt":"if it succeeds, it’s still not clear whether it’s actually dangerous","support":"source-stated"},{"text":"Righetti says biological work involves adapting protocols to a specific laboratory, not just recalling facts.","excerpt":"It involves designing detailed, step-by-step plans (known as “protocols”) and tailoring them to a specific laboratory environment.","support":"source-stated"},{"text":"Righetti proposes working backward from a hypothetical test in which non-experts try to create a relatively harmless virus, with AI mentors or internet access.","excerpt":"Half the people would have AI mentors and the other half can only look stuff up on the internet.","support":"source-stated"},{"text":"Righetti argues that difficult, realistic tests should be designed in advance to help justify costly measures.","excerpt":"we need to agree in advance on some tests that are hard enough and realistic enough that they clearly justify action.","support":"source-stated"},{"text":"Righetti says the hypothetical test could be too impractical or unethical, but argues that designing hard tests should begin now.","excerpt":"even if this exact test turns out to be too impractical (or unethical) to be worth it, we need to agree in advance on some tests","support":"source-stated"}],"limitations":["Text as retrieved on October 28, 2026; originally published August 20, 2024.","The proposed gold-standard test is hypothetical; the essay does not report that it was conducted.","Righetti notes that the Future House study compared models without tools against human evaluators who could use tools, a limitation that may affect the reported comparison."],"mediaId":null,"correctionReason":null,"id":"4311dcc484ad289051e920ca3d33d028132ab0f77faaa54fb83339dde1fc3672","publicationId":"db14d3ff-0461-e5e3-3412-505d6b276f21","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","sourceTitle":"Dangerous capability tests should be harder","publisher":"Ajeya Cotra","publishedAt":"2024-08-20T15:42:19+00:00","originalPublished":{"value":"2024-08-20T15:42:19+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-28T20:34:00.543Z","createdAt":"2026-11-17T11:33:27.197Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"19086d7e88859af808750e43889647dfad0130fdbaaecc219a0dfe68d8f5d970","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-28T20:33:57.870Z"},"provenance":{"textHash":"2dccc6022b4fa1a33bef0574b596676b61660d2f785126769fcf915b38eeb49b","observationId":"6a9b656d15082dba0fa53e051bd6efba9392901aecfc8c41d4064aac98bd7bc0","retrievedAt":"2026-10-28T20:51:33.658Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"09d212a3-0694-cc7c-e5ac-2ad8a66f56dd"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"1dbff833-191c-b357-2db1-fec7d69e55ae"}},"audit":{"status":"passed","reviewedAt":"2026-11-17T11:28:42.326Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/luca-righetti-argues-in-planned-obsolescence-for-harder-4311dcc4","formats":{"html":"/readings/luca-righetti-argues-in-planned-obsolescence-for-harder-4311dcc4","markdown":"/readings/luca-righetti-argues-in-planned-obsolescence-for-harder-4311dcc4.md","json":"/readings/luca-righetti-argues-in-planned-obsolescence-for-harder-4311dcc4.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-rct","name":"Randomized controlled trial","explanation":"A study that randomly assigns people to groups so that differences in outcomes can be traced to the treatment.","referenceUrl":"https://en.wikipedia.org/wiki/Randomized_controlled_trial"}],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"4311dcc484ad289051e920ca3d33d028132ab0f77faaa54fb83339dde1fc3672","revision":"db14d3ff-0461-e5e3-3412-505d6b276f21","revisionKind":"publication-id","title":"Luca Righetti argues in Planned Obsolescence for harder dangerous-capability tests","url":"https://escapemeridian.com/readings/luca-righetti-argues-in-planned-obsolescence-for-harder-4311dcc4"},"source":{"type":"source","id":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","revision":"2dccc6022b4fa1a33bef0574b596676b61660d2f785126769fcf915b38eeb49b","revisionKind":"sha256-source-text","title":"Dangerous capability tests should be harder","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"4311dcc484ad289051e920ca3d33d028132ab0f77faaa54fb83339dde1fc3672","title":"Luca Righetti argues in Planned Obsolescence for harder dangerous-capability tests","argument":"Luca Righetti’s essay was published on August 20, 2024. He argues that current tests of AI’s dangerous biological capabilities can be too easy to justify costly precautions, yet passing them may still leave unclear whether an AI can help someone create a biological weapon. Knowledge tests do not establish that a model can troubleshoot protocols: biological work can require adapting detailed procedures to a particular laboratory. Even stronger tests may not show that a layperson can act on AI advice or overcome practical barriers outside a professional lab.\n\nRighetti describes a one-way problem: failure on a test may suggest safety, while passing still may not establish danger. He proposes working backward from a hypothetical “gold standard” test: a randomized controlled trial in which non-experts attempt to create a relatively harmless virus, with AI mentors or internet access, using a secure garage-like lab. He says such a test would be costly and might be impractical or unethical, but could give decision-makers a stronger basis for costly measures. His conclusion is that difficult, realistic tests should be designed in advance, rather than made harder without a clear plan. Whether a safe, ethical test could establish the capabilities that would justify those measures remains unresolved.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 28, 2026; originally published August 20, 2024. The proposed gold-standard test is hypothetical; the essay does not report that it was conducted. Righetti notes that the Future House study compared models without tools against human evaluators who could use tools, a limitation that may affect the reported comparison.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Dangerous capability tests should be harder","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","publishedAt":"2024-08-20T15:42:19+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Righetti argues that passing a dangerous-capability test may not establish that an AI can help a layperson create a biological weapon.","excerpt":"if it succeeds, it’s still not clear whether it’s actually dangerous","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti says biological work involves adapting protocols to a specific laboratory, not just recalling facts.","excerpt":"It involves designing detailed, step-by-step plans (known as “protocols”) and tailoring them to a specific laboratory environment.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti proposes working backward from a hypothetical test in which non-experts try to create a relatively harmless virus, with AI mentors or internet access.","excerpt":"Half the people would have AI mentors and the other half can only look stuff up on the internet.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti argues that difficult, realistic tests should be designed in advance to help justify costly measures.","excerpt":"we need to agree in advance on some tests that are hard enough and realistic enough that they clearly justify action.","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"},{"text":"Righetti says the hypothetical test could be too impractical or unethical, but argues that designing hard tests should begin now.","excerpt":"even if this exact test turns out to be too impractical (or unethical) to be worth it, we need to agree in advance on some tests","url":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What safe, realistic test could show whether AI meaningfully helps non-experts overcome the practical barriers to creating a biological weapon?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Luca Righetti argues in Planned Obsolescence for harder dangerous-capability tests","summary":"Luca Righetti’s essay was published on August 20, 2024. He argues that current tests of AI’s dangerous biological capabilities can be too easy to justify costly precautions, yet passing them may still leave unclear whether an AI can help someone create a biological weapon. Knowledge tests do not establish that a model can troubleshoot protocols: biological work can require adapting detailed procedures to a particular laboratory. Even stronger tests may not show that a layperson can act on AI advice or overcome practical barriers outside a professional lab.\n\nRighetti describes a one-way problem: failure on a test may suggest safety, while passing still may not establish danger. He proposes working backward from a hypothetical “gold standard” test: a randomized controlled trial in which non-experts attempt to create a relatively harmless virus, with AI mentors or internet access, using a secure garage-like lab. He says such a test would be costly and might be impractical or unethical, but could give decision-makers a stronger basis for costly measures. His conclusion is that difficult, realistic tests should be designed in advance, rather than made harder without a clear plan. Whether a safe, ethical test could establish the capabilities that would justify those measures remains unresolved.","question":"What safe, realistic test could show whether AI meaningfully helps non-experts overcome the practical barriers to creating a biological weapon?","claims":[{"text":"Righetti argues that passing a dangerous-capability test may not establish that an AI can help a layperson create a biological weapon.","excerpt":"if it succeeds, it’s still not clear whether it’s actually dangerous","support":"source-stated"},{"text":"Righetti says biological work involves adapting protocols to a specific laboratory, not just recalling facts.","excerpt":"It involves designing detailed, step-by-step plans (known as “protocols”) and tailoring them to a specific laboratory environment.","support":"source-stated"},{"text":"Righetti proposes working backward from a hypothetical test in which non-experts try to create a relatively harmless virus, with AI mentors or internet access.","excerpt":"Half the people would have AI mentors and the other half can only look stuff up on the internet.","support":"source-stated"},{"text":"Righetti argues that difficult, realistic tests should be designed in advance to help justify costly measures.","excerpt":"we need to agree in advance on some tests that are hard enough and realistic enough that they clearly justify action.","support":"source-stated"},{"text":"Righetti says the hypothetical test could be too impractical or unethical, but argues that designing hard tests should begin now.","excerpt":"even if this exact test turns out to be too impractical (or unethical) to be worth it, we need to agree in advance on some tests","support":"source-stated"}],"limitations":["Text as retrieved on October 28, 2026; originally published August 20, 2024.","The proposed gold-standard test is hypothetical; the essay does not report that it was conducted.","Righetti notes that the Future House study compared models without tools against human evaluators who could use tools, a limitation that may affect the reported comparison."],"mediaId":null,"correctionReason":null,"id":"4311dcc484ad289051e920ca3d33d028132ab0f77faaa54fb83339dde1fc3672","publicationId":"db14d3ff-0461-e5e3-3412-505d6b276f21","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","sourceTitle":"Dangerous capability tests should be harder","publisher":"Ajeya Cotra","publishedAt":"2024-08-20T15:42:19+00:00","originalPublished":{"value":"2024-08-20T15:42:19+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-28T20:34:00.543Z","createdAt":"2026-11-17T11:33:27.197Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/dangerous-capability-tests-should-be-harder","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"19086d7e88859af808750e43889647dfad0130fdbaaecc219a0dfe68d8f5d970","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-28T20:33:57.870Z"},"provenance":{"textHash":"2dccc6022b4fa1a33bef0574b596676b61660d2f785126769fcf915b38eeb49b","observationId":"6a9b656d15082dba0fa53e051bd6efba9392901aecfc8c41d4064aac98bd7bc0","retrievedAt":"2026-10-28T20:51:33.658Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"09d212a3-0694-cc7c-e5ac-2ad8a66f56dd"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"1dbff833-191c-b357-2db1-fec7d69e55ae"}},"audit":{"status":"passed","reviewedAt":"2026-11-17T11:28:42.326Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"db14d3ff-0461-e5e3-3412-505d6b276f21","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The essay is credited to Luca Righetti, matching the byline. It appears on the Planned Obsolescence site (planned-obsolescence.org), edited by Ajeya Cotra. Every argument in the reading is attributed to Righetti.","excerpt":"Luca Righetti\nAug 20, 2024"},{"dimension":"summary","status":"pass","explanation":"The reading captures the core argument: tests are one-directional, knowledge tests miss protocol troubleshooting and tacit skills, and we should work backward from a hypothetical gold-standard test. It also keeps the author's conclusion that such tests should be agreed in advance. Protocols are explained in plain language, and the randomized controlled trial term is defined on the page. The urgency the essay ties to possible 2025–2026 progress is only implied by 'begin now', but this does not prevent understanding. The question follows from the evidence.","excerpt":"All these tests have a weird one-directionality to them: If an AI fails, it’s probably safe; but if it succeeds, it’s still not clear whether it’s actually dangerous."},{"dimension":"date","status":"pass","explanation":"The stated date, August 20, 2024, matches the dateline and the originalPublished instant (UTC). The modification timestamp is the same as publication. The page is a publisher page, so no archive disclosure is needed. There is no hindsight framing, and the essay's predictions are not presented as outcomes.","excerpt":"Aug 20, 2024"},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated and backed by its excerpt. The limitations accurately note that the test is hypothetical and accurately describe the Future House tools caveat from the footnote. The reading implies no unsupported benefits or costs. Its statement that a costly gold-standard test could give decision-makers a stronger basis tracks the source.","excerpt":"I could actually imagine experts and decision-makers agreeing that if an AI passes this kind of test, then it poses massive risks"},{"dimension":"media","status":"pass","explanation":"No media is selected, and no verified media candidates were supplied. This is appropriate.","excerpt":null}],"createdAt":"2026-11-17T11:28:42.326Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}