{"id":"eb359e0f3d9977a420f2c9a5b02f2e2668852293ca74fa772095f91788e39276","title":"James O'Donnell argues in MIT Technology Review that chatbots should be able to end conversations","argument":"MIT Technology Review’s James O'Donnell argues on October 21, 2025, that chatbots should be able to stop talking to users. He says chatbots can produce endless streams of humanlike, authoritative and helpful text, which can facilitate delusional spirals, worsen mental-health crises and otherwise harm vulnerable people. The proposed safeguard would let a chatbot end a conversation, even though that could reduce the time people spend using the product. O'Donnell asks why companies are not using it, but this newsletter excerpt does not give their reasons or explain how the safeguard would work. His argument centers on a tension between continued product use and the risk of harm to vulnerable users.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 1, 2026; originally published October 21, 2025. The retrieved newsletter excerpt does not explain how the proposed safeguard would work or why companies are not using it; it points readers to the full story.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: embryo ethics, and reducing chatbot risks","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","publishedAt":"2025-10-21T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"James O'Donnell argues that chatbots should be able to stop talking to users.","excerpt":"Why AI should be able to “hang up” on you","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"},{"text":"O'Donnell says chatbots' capacity to generate endless humanlike, authoritative and helpful text can harm vulnerable people.","excerpt":"AI’s ability to generate endless streams of humanlike, authoritative, and helpful text can facilitate delusional spirals, worsen mental-health crises, and otherwise harm vulnerable people.","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"},{"text":"O'Donnell frames a chatbot ending a conversation as a safeguard that could reduce time spent using the product.","excerpt":"Why should a tech company build a feature that reduces the time people spend using its product?","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Why are companies not using the safeguard O'Donnell proposes, and how would it work in practice?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"James O'Donnell argues in MIT Technology Review that chatbots should be able to end conversations","summary":"MIT Technology Review’s James O'Donnell argues on October 21, 2025, that chatbots should be able to stop talking to users. He says chatbots can produce endless streams of humanlike, authoritative and helpful text, which can facilitate delusional spirals, worsen mental-health crises and otherwise harm vulnerable people. The proposed safeguard would let a chatbot end a conversation, even though that could reduce the time people spend using the product. O'Donnell asks why companies are not using it, but this newsletter excerpt does not give their reasons or explain how the safeguard would work. His argument centers on a tension between continued product use and the risk of harm to vulnerable users.","question":"Why are companies not using the safeguard O'Donnell proposes, and how would it work in practice?","claims":[{"text":"James O'Donnell argues that chatbots should be able to stop talking to users.","excerpt":"Why AI should be able to “hang up” on you","support":"source-stated"},{"text":"O'Donnell says chatbots' capacity to generate endless humanlike, authoritative and helpful text can harm vulnerable people.","excerpt":"AI’s ability to generate endless streams of humanlike, authoritative, and helpful text can facilitate delusional spirals, worsen mental-health crises, and otherwise harm vulnerable people.","support":"source-stated"},{"text":"O'Donnell frames a chatbot ending a conversation as a safeguard that could reduce time spent using the product.","excerpt":"Why should a tech company build a feature that reduces the time people spend using its product?","support":"source-stated"}],"limitations":["Text as retrieved on November 1, 2026; originally published October 21, 2025.","The retrieved newsletter excerpt does not explain how the proposed safeguard would work or why companies are not using it; it points readers to the full story."],"mediaId":null,"correctionReason":null,"id":"eb359e0f3d9977a420f2c9a5b02f2e2668852293ca74fa772095f91788e39276","publicationId":"ca88679e-a9fb-e6f8-fd52-4e155489e1cd","version":1,"sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","sourceTitle":"The Download: embryo ethics, and reducing chatbot risks","publisher":"MIT Technology Review","publishedAt":"2025-10-21T12:10:00Z","originalPublished":{"value":"2025-10-21T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-01T17:27:46.722Z","createdAt":"2026-11-11T15:48:25.164Z","historical":true,"entityIds":[],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"05a80bb632501ed3f86f4bc657e46f0376cc3147598016094d767acab94a730e","rubricVersion":"unrecorded","provider":"typesafe","model":"jev-1.13.0","reasonCodes":["bridge_admitted_by_model"],"confidence":0.56,"decidedAt":"2026-11-01T17:27:39.733Z"},"provenance":{"textHash":"c9b9a2c6e8f81e4a84c93e09a39e9503b379078dbcab47d15a45f857c558860b","observationId":"fb919d40ac28f79cb825922f573cc9a8eb3ce93371d27de33a8058a82b599f81","retrievedAt":"2026-11-01T17:29:21.749Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"e2f7f6b6-16eb-411a-ad50-5d3abf739444"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"0a5b642d-ffda-9a54-0979-adb92c24dfef"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T15:44:51.576Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/james-o-donnell-argues-in-mit-technology-review-that-chatbots-eb359e0f","formats":{"html":"/readings/james-o-donnell-argues-in-mit-technology-review-that-chatbots-eb359e0f","markdown":"/readings/james-o-donnell-argues-in-mit-technology-review-that-chatbots-eb359e0f.md","json":"/readings/james-o-donnell-argues-in-mit-technology-review-that-chatbots-eb359e0f.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"eb359e0f3d9977a420f2c9a5b02f2e2668852293ca74fa772095f91788e39276","revision":"ca88679e-a9fb-e6f8-fd52-4e155489e1cd","revisionKind":"publication-id","title":"James O'Donnell argues in MIT Technology Review that chatbots should be able to end conversations","url":"https://escapemeridian.com/readings/james-o-donnell-argues-in-mit-technology-review-that-chatbots-eb359e0f"},"source":{"type":"source","id":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","revision":"c9b9a2c6e8f81e4a84c93e09a39e9503b379078dbcab47d15a45f857c558860b","revisionKind":"sha256-source-text","title":"The Download: embryo ethics, and reducing chatbot risks","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"eb359e0f3d9977a420f2c9a5b02f2e2668852293ca74fa772095f91788e39276","title":"James O'Donnell argues in MIT Technology Review that chatbots should be able to end conversations","argument":"MIT Technology Review’s James O'Donnell argues on October 21, 2025, that chatbots should be able to stop talking to users. He says chatbots can produce endless streams of humanlike, authoritative and helpful text, which can facilitate delusional spirals, worsen mental-health crises and otherwise harm vulnerable people. The proposed safeguard would let a chatbot end a conversation, even though that could reduce the time people spend using the product. O'Donnell asks why companies are not using it, but this newsletter excerpt does not give their reasons or explain how the safeguard would work. His argument centers on a tension between continued product use and the risk of harm to vulnerable users.","topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on November 1, 2026; originally published October 21, 2025. The retrieved newsletter excerpt does not explain how the proposed safeguard would work or why companies are not using it; it points readers to the full story.","speaker":{"name":"MIT Technology Review","roleAtSource":"Publisher"},"source":{"title":"The Download: embryo ethics, and reducing chatbot risks","publisher":"MIT Technology Review","format":"Article","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","publishedAt":"2025-10-21T12:10:00Z","dateBasis":"Date from the publisher’s own records, through its API."},"evidence":[{"text":"James O'Donnell argues that chatbots should be able to stop talking to users.","excerpt":"Why AI should be able to “hang up” on you","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"},{"text":"O'Donnell says chatbots' capacity to generate endless humanlike, authoritative and helpful text can harm vulnerable people.","excerpt":"AI’s ability to generate endless streams of humanlike, authoritative, and helpful text can facilitate delusional spirals, worsen mental-health crises, and otherwise harm vulnerable people.","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"},{"text":"O'Donnell frames a chatbot ending a conversation as a safeguard that could reduce time spent using the product.","excerpt":"Why should a tech company build a feature that reduces the time people spend using its product?","url":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Why are companies not using the safeguard O'Donnell proposes, and how would it work in practice?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"James O'Donnell argues in MIT Technology Review that chatbots should be able to end conversations","summary":"MIT Technology Review’s James O'Donnell argues on October 21, 2025, that chatbots should be able to stop talking to users. He says chatbots can produce endless streams of humanlike, authoritative and helpful text, which can facilitate delusional spirals, worsen mental-health crises and otherwise harm vulnerable people. The proposed safeguard would let a chatbot end a conversation, even though that could reduce the time people spend using the product. O'Donnell asks why companies are not using it, but this newsletter excerpt does not give their reasons or explain how the safeguard would work. His argument centers on a tension between continued product use and the risk of harm to vulnerable users.","question":"Why are companies not using the safeguard O'Donnell proposes, and how would it work in practice?","claims":[{"text":"James O'Donnell argues that chatbots should be able to stop talking to users.","excerpt":"Why AI should be able to “hang up” on you","support":"source-stated"},{"text":"O'Donnell says chatbots' capacity to generate endless humanlike, authoritative and helpful text can harm vulnerable people.","excerpt":"AI’s ability to generate endless streams of humanlike, authoritative, and helpful text can facilitate delusional spirals, worsen mental-health crises, and otherwise harm vulnerable people.","support":"source-stated"},{"text":"O'Donnell frames a chatbot ending a conversation as a safeguard that could reduce time spent using the product.","excerpt":"Why should a tech company build a feature that reduces the time people spend using its product?","support":"source-stated"}],"limitations":["Text as retrieved on November 1, 2026; originally published October 21, 2025.","The retrieved newsletter excerpt does not explain how the proposed safeguard would work or why companies are not using it; it points readers to the full story."],"mediaId":null,"correctionReason":null,"id":"eb359e0f3d9977a420f2c9a5b02f2e2668852293ca74fa772095f91788e39276","publicationId":"ca88679e-a9fb-e6f8-fd52-4e155489e1cd","version":1,"sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","sourceTitle":"The Download: embryo ethics, and reducing chatbot risks","publisher":"MIT Technology Review","publishedAt":"2025-10-21T12:10:00Z","originalPublished":{"value":"2025-10-21T12:10:00Z","precision":"instant","basis":"backfill:api_published"},"firstObservedAt":"2026-11-01T17:27:46.722Z","createdAt":"2026-11-11T15:48:25.164Z","historical":true,"entityIds":[],"topicIds":["work-and-business--jobs-and-occupations","job-displacement-and-creation"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.technologyreview.com/2025/10/21/1126189/the-download-embryo-ethics-and-reducing-chatbot-risks/","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"05a80bb632501ed3f86f4bc657e46f0376cc3147598016094d767acab94a730e","rubricVersion":"unrecorded","provider":"typesafe","model":"jev-1.13.0","reasonCodes":["bridge_admitted_by_model"],"confidence":0.56,"decidedAt":"2026-11-01T17:27:39.733Z"},"provenance":{"textHash":"c9b9a2c6e8f81e4a84c93e09a39e9503b379078dbcab47d15a45f857c558860b","observationId":"fb919d40ac28f79cb825922f573cc9a8eb3ce93371d27de33a8058a82b599f81","retrievedAt":"2026-11-01T17:29:21.749Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"e2f7f6b6-16eb-411a-ad50-5d3abf739444"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"0a5b642d-ffda-9a54-0979-adb92c24dfef"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-11T15:44:51.576Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"ca88679e-a9fb-e6f8-fd52-4e155489e1cd","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"This newsletter issue includes editorial commentary, so it counts as one piece, not a bare listing. The reading draws only on the segment signed by James O'Donnell and correctly attributes the argument to him at MIT Technology Review.","excerpt":"So, why aren’t companies using this obvious safeguard? Read the full story.\n—James O'Donnell"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question match the segment's argument: chatbots should be able to stop conversations because endless text can harm vulnerable people, despite reducing product use. The reading is in plain language, discloses that it relies on an excerpt, and makes its gaps clear. The question follows from the source's own unanswered question.","excerpt":"But the one thing that almost no chatbot will ever do is stop talking to you."},{"dimension":"date","status":"uncertain","explanation":"October 21, 2025 matches the UTC day of evidence.originalPublished for this Download issue. However, the reading says O'Donnell argues this on that date, while the source says the segment originally appeared earlier in The Algorithm, on a date not given. His argument's first publication may precede October 21. A smaller wording repair would date the newsletter issue rather than the argument. The reading uses none of the later Deep Dive items.","excerpt":"This story originally appeared in The Algorithm, our weekly newsletter on AI."},{"dimension":"support","status":"pass","explanation":"Each claim is source-stated with exact supporting excerpts. The text calls the feature a safeguard, ties it to reduced usage time, and lists harms to vulnerable people. The reading adds no unsupported benefits or reasons, and it notes that the excerpt does not explain why companies do not use the safeguard or how it would work.","excerpt":"AI’s ability to generate endless streams of humanlike, authoritative, and helpful text can facilitate delusional spirals, worsen mental-health crises, and otherwise harm vulnerable people."},{"dimension":"media","status":"pass","explanation":"No media was selected, and no verified media candidates were supplied. That is acceptable.","excerpt":null}],"createdAt":"2026-11-11T15:44:51.576Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}