{"id":"2301860379aeffab5a012b4799a4e7f2421c0a997ebfc809481435270c8e2f59","title":"Arthur Holland Michel argues in MIT Technology Review that AI refusal is a risky safeguard","argument":"MIT Technology Review published this newsletter on October 9, 2026. Arthur Holland Michel argues that people are putting too much faith in AI models’ ability to refuse dangerous requests. He says models are trained to refuse many prompts, but that refusals can fail, sometimes with horrific consequences. The newsletter points to people attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.\n\nMichel also argues that relying on refusal requires drawing a line between what a model should obey and what it must disobey, leaving governments able to draw their own lines and potentially restrict free speech. The difficulty, as he frames it, is that useful capabilities can also be dangerous: AI that helps cure cancer would need genetics expertise that could also produce bioweapons. The newsletter points readers to a fuller story on these tradeoffs, but does not provide its details. It leaves open how refusal should be handled when the same expertise could serve beneficial and harmful ends.","topicIds":["investment-booms-and-busts","artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 20, 2026; originally published October 9, 2026. The evidence is a newsletter summary that points to a fuller story on AI refusal tradeoffs; it does not include that story’s details.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: AI’s refusal problem and weight-loss drug side effects","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","publishedAt":"2026-10-09T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"Arthur Holland Michel says people are placing too much faith in AI models’ ability to refuse dangerous prompts.","excerpt":"We’re putting too much faith in AI’s ability to say no","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"The newsletter says models are trained to refuse many prompts, but refusals can fail, sometimes with horrific consequences.","excerpt":"Today’s AI models are trained to refuse a vast number of prompts. If you ask your chatbot how to poison a colleague or how to tie a noose, chances are it’ll turn you down. But refusal fails, sometimes horrifically.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"The newsletter says some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.","excerpt":"Some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms. Sooner or later, failed refusals may result in global calamity.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"Michel argues that relying on refusal means drawing a line between what a model should obey and what it must disobey, and says governments may draw lines that restrict free speech.","excerpt":"What’s more, relying on refusal means drawing a line between what a model should obey and what it must disobey.\nGovernments will also get to draw their own lines, potentially restricting free speech.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"Michel argues that capabilities useful for beneficial purposes could also be dangerous, giving genetics expertise as an example.","excerpt":"If we want it to help cure cancer, AI needs genetics expertise that could also produce bioweapons.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What approach to AI safety does the full story discuss for handling capabilities that could support both cancer research and bioweapons?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Arthur Holland Michel argues in MIT Technology Review that AI refusal is a risky safeguard","summary":"MIT Technology Review published this newsletter on October 9, 2026. Arthur Holland Michel argues that people are putting too much faith in AI models’ ability to refuse dangerous requests. He says models are trained to refuse many prompts, but that refusals can fail, sometimes with horrific consequences. The newsletter points to people attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.\n\nMichel also argues that relying on refusal requires drawing a line between what a model should obey and what it must disobey, leaving governments able to draw their own lines and potentially restrict free speech. The difficulty, as he frames it, is that useful capabilities can also be dangerous: AI that helps cure cancer would need genetics expertise that could also produce bioweapons. The newsletter points readers to a fuller story on these tradeoffs, but does not provide its details. It leaves open how refusal should be handled when the same expertise could serve beneficial and harmful ends.","question":"What approach to AI safety does the full story discuss for handling capabilities that could support both cancer research and bioweapons?","claims":[{"text":"Arthur Holland Michel says people are placing too much faith in AI models’ ability to refuse dangerous prompts.","excerpt":"We’re putting too much faith in AI’s ability to say no","support":"source-stated"},{"text":"The newsletter says models are trained to refuse many prompts, but refusals can fail, sometimes with horrific consequences.","excerpt":"Today’s AI models are trained to refuse a vast number of prompts. If you ask your chatbot how to poison a colleague or how to tie a noose, chances are it’ll turn you down. But refusal fails, sometimes horrifically.","support":"source-stated"},{"text":"The newsletter says some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.","excerpt":"Some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms. Sooner or later, failed refusals may result in global calamity.","support":"source-stated"},{"text":"Michel argues that relying on refusal means drawing a line between what a model should obey and what it must disobey, and says governments may draw lines that restrict free speech.","excerpt":"What’s more, relying on refusal means drawing a line between what a model should obey and what it must disobey.\nGovernments will also get to draw their own lines, potentially restricting free speech.","support":"source-stated"},{"text":"Michel argues that capabilities useful for beneficial purposes could also be dangerous, giving genetics expertise as an example.","excerpt":"If we want it to help cure cancer, AI needs genetics expertise that could also produce bioweapons.","support":"source-stated"}],"limitations":["Text as retrieved on November 20, 2026; originally published October 9, 2026.","The evidence is a newsletter summary that points to a fuller story on AI refusal tradeoffs; it does not include that story’s details."],"mediaId":null,"correctionReason":null,"id":"2301860379aeffab5a012b4799a4e7f2421c0a997ebfc809481435270c8e2f59","publicationId":"427987a7-0313-02c5-fc11-4e5e86f3dfbe","version":1,"sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","sourceTitle":"The Download: AI’s refusal problem and weight-loss drug side effects","publisher":"MIT Technology Review","publishedAt":"2026-10-09T12:10:00Z","originalPublished":{"value":"2026-10-09T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-20T03:40:11.312Z","createdAt":"2026-11-20T05:38:11.265Z","historical":true,"entityIds":[],"topicIds":["investment-booms-and-busts","artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"4df3dd9ec28e39d32e671231636d18cc7d8fa542f6afafaf6edfe215b721ec4a","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-20T03:40:01.987Z"},"provenance":{"textHash":"9ffe47cd79d3d1d37dbc13885e7a7bba27a97fa9001e50191a4d583333446fee","observationId":"a378080fc1d8602c3bdf6a2b6fd4f0cbd81946f8d399d89d950748edc5f80b5a","retrievedAt":"2026-11-20T03:42:01.533Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"002c9137-835e-7571-0f9b-a2230d36fbc6"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"9ad5d49e-666e-6d6c-dfe2-1639f359c5f0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:33:28.663Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/arthur-holland-michel-argues-in-mit-technology-review-that-ai-23018603","formats":{"html":"/readings/arthur-holland-michel-argues-in-mit-technology-review-that-ai-23018603","markdown":"/readings/arthur-holland-michel-argues-in-mit-technology-review-that-ai-23018603.md","json":"/readings/arthur-holland-michel-argues-in-mit-technology-review-that-ai-23018603.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"2301860379aeffab5a012b4799a4e7f2421c0a997ebfc809481435270c8e2f59","revision":"427987a7-0313-02c5-fc11-4e5e86f3dfbe","revisionKind":"publication-id","title":"Arthur Holland Michel argues in MIT Technology Review that AI refusal is a risky safeguard","url":"https://escapemeridian.com/readings/arthur-holland-michel-argues-in-mit-technology-review-that-ai-23018603"},"source":{"type":"source","id":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","revision":"9ffe47cd79d3d1d37dbc13885e7a7bba27a97fa9001e50191a4d583333446fee","revisionKind":"sha256-source-text","title":"The Download: AI’s refusal problem and weight-loss drug side effects","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"2301860379aeffab5a012b4799a4e7f2421c0a997ebfc809481435270c8e2f59","title":"Arthur Holland Michel argues in MIT Technology Review that AI refusal is a risky safeguard","argument":"MIT Technology Review published this newsletter on October 9, 2026. Arthur Holland Michel argues that people are putting too much faith in AI models’ ability to refuse dangerous requests. He says models are trained to refuse many prompts, but that refusals can fail, sometimes with horrific consequences. The newsletter points to people attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.\n\nMichel also argues that relying on refusal requires drawing a line between what a model should obey and what it must disobey, leaving governments able to draw their own lines and potentially restrict free speech. The difficulty, as he frames it, is that useful capabilities can also be dangerous: AI that helps cure cancer would need genetics expertise that could also produce bioweapons. The newsletter points readers to a fuller story on these tradeoffs, but does not provide its details. It leaves open how refusal should be handled when the same expertise could serve beneficial and harmful ends.","topicIds":["investment-booms-and-busts","artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 20, 2026; originally published October 9, 2026. The evidence is a newsletter summary that points to a fuller story on AI refusal tradeoffs; it does not include that story’s details.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: AI’s refusal problem and weight-loss drug side effects","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","publishedAt":"2026-10-09T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"Arthur Holland Michel says people are placing too much faith in AI models’ ability to refuse dangerous prompts.","excerpt":"We’re putting too much faith in AI’s ability to say no","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"The newsletter says models are trained to refuse many prompts, but refusals can fail, sometimes with horrific consequences.","excerpt":"Today’s AI models are trained to refuse a vast number of prompts. If you ask your chatbot how to poison a colleague or how to tie a noose, chances are it’ll turn you down. But refusal fails, sometimes horrifically.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"The newsletter says some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.","excerpt":"Some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms. Sooner or later, failed refusals may result in global calamity.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"Michel argues that relying on refusal means drawing a line between what a model should obey and what it must disobey, and says governments may draw lines that restrict free speech.","excerpt":"What’s more, relying on refusal means drawing a line between what a model should obey and what it must disobey.\nGovernments will also get to draw their own lines, potentially restricting free speech.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"},{"text":"Michel argues that capabilities useful for beneficial purposes could also be dangerous, giving genetics expertise as an example.","excerpt":"If we want it to help cure cancer, AI needs genetics expertise that could also produce bioweapons.","url":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What approach to AI safety does the full story discuss for handling capabilities that could support both cancer research and bioweapons?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Arthur Holland Michel argues in MIT Technology Review that AI refusal is a risky safeguard","summary":"MIT Technology Review published this newsletter on October 9, 2026. Arthur Holland Michel argues that people are putting too much faith in AI models’ ability to refuse dangerous requests. He says models are trained to refuse many prompts, but that refusals can fail, sometimes with horrific consequences. The newsletter points to people attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.\n\nMichel also argues that relying on refusal requires drawing a line between what a model should obey and what it must disobey, leaving governments able to draw their own lines and potentially restrict free speech. The difficulty, as he frames it, is that useful capabilities can also be dangerous: AI that helps cure cancer would need genetics expertise that could also produce bioweapons. The newsletter points readers to a fuller story on these tradeoffs, but does not provide its details. It leaves open how refusal should be handled when the same expertise could serve beneficial and harmful ends.","question":"What approach to AI safety does the full story discuss for handling capabilities that could support both cancer research and bioweapons?","claims":[{"text":"Arthur Holland Michel says people are placing too much faith in AI models’ ability to refuse dangerous prompts.","excerpt":"We’re putting too much faith in AI’s ability to say no","support":"source-stated"},{"text":"The newsletter says models are trained to refuse many prompts, but refusals can fail, sometimes with horrific consequences.","excerpt":"Today’s AI models are trained to refuse a vast number of prompts. If you ask your chatbot how to poison a colleague or how to tie a noose, chances are it’ll turn you down. But refusal fails, sometimes horrifically.","support":"source-stated"},{"text":"The newsletter says some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms, and warns that failed refusals may sooner or later result in global calamity.","excerpt":"Some people are attempting to use AI to hone biological pathogens and build autonomous drone swarms. Sooner or later, failed refusals may result in global calamity.","support":"source-stated"},{"text":"Michel argues that relying on refusal means drawing a line between what a model should obey and what it must disobey, and says governments may draw lines that restrict free speech.","excerpt":"What’s more, relying on refusal means drawing a line between what a model should obey and what it must disobey.\nGovernments will also get to draw their own lines, potentially restricting free speech.","support":"source-stated"},{"text":"Michel argues that capabilities useful for beneficial purposes could also be dangerous, giving genetics expertise as an example.","excerpt":"If we want it to help cure cancer, AI needs genetics expertise that could also produce bioweapons.","support":"source-stated"}],"limitations":["Text as retrieved on November 20, 2026; originally published October 9, 2026.","The evidence is a newsletter summary that points to a fuller story on AI refusal tradeoffs; it does not include that story’s details."],"mediaId":null,"correctionReason":null,"id":"2301860379aeffab5a012b4799a4e7f2421c0a997ebfc809481435270c8e2f59","publicationId":"427987a7-0313-02c5-fc11-4e5e86f3dfbe","version":1,"sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","sourceTitle":"The Download: AI’s refusal problem and weight-loss drug side effects","publisher":"MIT Technology Review","publishedAt":"2026-10-09T12:10:00Z","originalPublished":{"value":"2026-10-09T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-20T03:40:11.312Z","createdAt":"2026-11-20T05:38:11.265Z","historical":true,"entityIds":[],"topicIds":["investment-booms-and-busts","artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2026/10/09/1146250/the-download-ai-refusal-problem-weight-loss-drug-side-effects/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"4df3dd9ec28e39d32e671231636d18cc7d8fa542f6afafaf6edfe215b721ec4a","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-11-20T03:40:01.987Z"},"provenance":{"textHash":"9ffe47cd79d3d1d37dbc13885e7a7bba27a97fa9001e50191a4d583333446fee","observationId":"a378080fc1d8602c3bdf6a2b6fd4f0cbd81946f8d399d89d950748edc5f80b5a","retrievedAt":"2026-11-20T03:42:01.533Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"002c9137-835e-7571-0f9b-a2230d36fbc6"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"9ad5d49e-666e-6d6c-dfe2-1639f359c5f0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-20T05:33:28.663Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"427987a7-0313-02c5-fc11-4e5e86f3dfbe","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The issue is a newsletter that comments on several items in its own words, so it counts as one piece. The reading focuses on the AI-refusal item, which is signed by Arthur Holland Michel and summarizes his story, and it attributes the arguments to him in MIT Technology Review. Calling him \"Michel\" rather than \"Holland Michel\" on later mentions is a minor naming imprecision, not misattribution.","excerpt":"Read the full story on the formidable tradeoffs of AI refusal.\n—Arthur Holland Michel"},{"dimension":"summary","status":"uncertain","explanation":"The body faithfully conveys the argument, including the obey/disobey line, the free-speech concern and the cancer/bioweapons dual-use tension, in plain language. The question is the problem. It asks what approach the full story discusses, but that story is absent from the evidence, as the reading itself notes. This presumes content the source does not show rather than posing an unresolved issue that follows from the evidence. Smallest repair: rephrase it as an open issue the blurb raises, such as how refusal lines should be set when the same expertise serves cure and weapon.","excerpt":"If we want it to help cure cancer, AI needs genetics expertise that could also produce bioweapons."},{"dimension":"date","status":"pass","explanation":"The reading gives October 9, 2026, which matches the UTC day of originalPublished (2026-10-09T12:10Z). It uses no later material from the page, such as the print-issue note or the Deep Dive listings, and uses no hindsight framing. The evidence is a publisher page, so no archive disclosure is needed. The dateModified of 11:32Z precedes the publication instant, so it does not indicate a later edit.","excerpt":null},{"dimension":"support","status":"pass","explanation":"Each claim matches its excerpt, and each is framed as the author's or the newsletter's assertion. The warning about global calamity keeps the source's \"may\" and \"sooner or later\". The free-speech point keeps \"potentially\". No benefits, costs or forecasts are added beyond the source.","excerpt":"Sooner or later, failed refusals may result in global calamity."},{"dimension":"media","status":"pass","explanation":"No media was selected, and no verified media candidates were supplied, so there is nothing to misidentify.","excerpt":null}],"createdAt":"2026-11-20T05:33:28.663Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}