{"id":"bca0bcbeca0d8a53c59448bc38c2a3e9f2a30f1beae8bc7dfc42b0f6e9285695","title":"Arvind Narayanan and Sayash Kapoor argue for a broader AI safety movement","argument":"On October 1, 2026, Arvind Narayanan and Sayash Kapoor argue that AI safety debates often miss a possibility: warnings about existential risk may be sincere but mistaken and counterproductive. They distinguish those warnings from risks they see as existing systemic problems that AI can amplify, including cyberattacks and gradual institutional decay. The authors say society underinvests in resilience against catastrophic risks, while arguing that the public and policymakers give more attention to existential-risk framing than to these other concerns. They worry that this framing could polarize policy debates and direct effort toward stopping AI development rather than strengthening defenses against harms from existing systems. Their alternative is “big-tent safety”: a movement that can include disagreement about existential risk, draw on pluralist values, and pursue policies such as transparency, liability, and embedded evaluation. They present this as an argument, not evidence that a broader movement or particular policies will work. The essay does not establish how much public attention or policy resources would shift under either approach.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 24, 2026; originally published October 1, 2026. The essay presents the authors’ arguments but does not establish whether existential-risk framing changes policy priorities or whether the proposed approach would improve safety.","speaker":{"name":"Arvind Narayanan and Sayash Kapoor","roleAtSource":"Publisher"},"source":{"title":"A big-tent or small-tent AI safety movement?","publisher":"Arvind Narayanan and Sayash Kapoor","format":"Article","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","publishedAt":"2026-10-01T16:34:51.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Arvind Narayanan and Sayash Kapoor argue that warnings about existential risk may be sincere but wrong and counterproductive to AI safety.","excerpt":"Few have considered the third possibility that x-risk warnings are sincere but simply wrong and counterproductive to AI safety.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The authors argue that AI can amplify existing systemic risks and that society underinvests in defending against catastrophic risks.","excerpt":"Our view is that AI is an amplifier of existing systemic risks.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"They argue that existential-risk framing may polarize safety policy and misdirect attention from defenses against catastrophic and systemic risks from existing AI systems.","excerpt":"The more likely outcome is that the dominance of the x-risk framing is actively counterproductive, for two main reasons.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The authors propose big-tent safety, including people who disagree about existential risk and policies such as transparency, liability, and embedded evaluation.","excerpt":"A big-tent movement would include members who are not concerned about x-risk","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The source is dated October 1, 2026.","excerpt":"Oct 01, 2026","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would show whether existential-risk framing draws resources away from defenses against harms from existing AI systems?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Arvind Narayanan and Sayash Kapoor argue for a broader AI safety movement","summary":"On October 1, 2026, Arvind Narayanan and Sayash Kapoor argue that AI safety debates often miss a possibility: warnings about existential risk may be sincere but mistaken and counterproductive. They distinguish those warnings from risks they see as existing systemic problems that AI can amplify, including cyberattacks and gradual institutional decay. The authors say society underinvests in resilience against catastrophic risks, while arguing that the public and policymakers give more attention to existential-risk framing than to these other concerns. They worry that this framing could polarize policy debates and direct effort toward stopping AI development rather than strengthening defenses against harms from existing systems. Their alternative is “big-tent safety”: a movement that can include disagreement about existential risk, draw on pluralist values, and pursue policies such as transparency, liability, and embedded evaluation. They present this as an argument, not evidence that a broader movement or particular policies will work. The essay does not establish how much public attention or policy resources would shift under either approach.","question":"What evidence would show whether existential-risk framing draws resources away from defenses against harms from existing AI systems?","claims":[{"text":"Arvind Narayanan and Sayash Kapoor argue that warnings about existential risk may be sincere but wrong and counterproductive to AI safety.","excerpt":"Few have considered the third possibility that x-risk warnings are sincere but simply wrong and counterproductive to AI safety.","support":"source-stated"},{"text":"The authors argue that AI can amplify existing systemic risks and that society underinvests in defending against catastrophic risks.","excerpt":"Our view is that AI is an amplifier of existing systemic risks.","support":"source-stated"},{"text":"They argue that existential-risk framing may polarize safety policy and misdirect attention from defenses against catastrophic and systemic risks from existing AI systems.","excerpt":"The more likely outcome is that the dominance of the x-risk framing is actively counterproductive, for two main reasons.","support":"source-stated"},{"text":"The authors propose big-tent safety, including people who disagree about existential risk and policies such as transparency, liability, and embedded evaluation.","excerpt":"A big-tent movement would include members who are not concerned about x-risk","support":"source-stated"},{"text":"The source is dated October 1, 2026.","excerpt":"Oct 01, 2026","support":"source-stated"}],"limitations":["Text as retrieved on October 24, 2026; originally published October 1, 2026.","The essay presents the authors’ arguments but does not establish whether existential-risk framing changes policy priorities or whether the proposed approach would improve safety."],"mediaId":null,"correctionReason":null,"id":"bca0bcbeca0d8a53c59448bc38c2a3e9f2a30f1beae8bc7dfc42b0f6e9285695","publicationId":"765d4311-7eea-1655-6175-157ab67e0bd4","version":1,"sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","sourceTitle":"A big-tent or small-tent AI safety movement?","publisher":"Arvind Narayanan and Sayash Kapoor","publishedAt":"2026-10-01T16:34:51.000Z","originalPublished":{"value":"2026-10-01T16:34:51.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-24T00:49:53.207Z","createdAt":"2026-10-29T16:34:00.883Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"08373f99242691e1cc870420cd83638942ef6e45f9ff50e371127ddd6c864b38","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T00:49:47.433Z"},"provenance":{"textHash":"7e3e5800a990fc80437e6296e98e24285f136f7aa7eecc048a1f2941afabe3b8","observationId":"e39df7f34cdb93a9d2eb5dae168b0a6e6d3863feddb000f5e9f2c1f1f37b78b3","retrievedAt":"2026-10-24T00:51:47.436Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"f5579edd-ca94-6b31-e038-83b76e787e71"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"819f0132-b3ed-3cfb-ca27-f652ce6e46f4"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T16:31:20.323Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/arvind-narayanan-and-sayash-kapoor-argue-for-a-broader-ai-bca0bcbe","formats":{"html":"/readings/arvind-narayanan-and-sayash-kapoor-argue-for-a-broader-ai-bca0bcbe","markdown":"/readings/arvind-narayanan-and-sayash-kapoor-argue-for-a-broader-ai-bca0bcbe.md","json":"/readings/arvind-narayanan-and-sayash-kapoor-argue-for-a-broader-ai-bca0bcbe.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"bca0bcbeca0d8a53c59448bc38c2a3e9f2a30f1beae8bc7dfc42b0f6e9285695","revision":"765d4311-7eea-1655-6175-157ab67e0bd4","revisionKind":"publication-id","title":"Arvind Narayanan and Sayash Kapoor argue for a broader AI safety movement","url":"https://escapemeridian.com/readings/arvind-narayanan-and-sayash-kapoor-argue-for-a-broader-ai-bca0bcbe"},"source":{"type":"source","id":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","revision":"7e3e5800a990fc80437e6296e98e24285f136f7aa7eecc048a1f2941afabe3b8","revisionKind":"sha256-source-text","title":"A big-tent or small-tent AI safety movement?","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"bca0bcbeca0d8a53c59448bc38c2a3e9f2a30f1beae8bc7dfc42b0f6e9285695","title":"Arvind Narayanan and Sayash Kapoor argue for a broader AI safety movement","argument":"On October 1, 2026, Arvind Narayanan and Sayash Kapoor argue that AI safety debates often miss a possibility: warnings about existential risk may be sincere but mistaken and counterproductive. They distinguish those warnings from risks they see as existing systemic problems that AI can amplify, including cyberattacks and gradual institutional decay. The authors say society underinvests in resilience against catastrophic risks, while arguing that the public and policymakers give more attention to existential-risk framing than to these other concerns. They worry that this framing could polarize policy debates and direct effort toward stopping AI development rather than strengthening defenses against harms from existing systems. Their alternative is “big-tent safety”: a movement that can include disagreement about existential risk, draw on pluralist values, and pursue policies such as transparency, liability, and embedded evaluation. They present this as an argument, not evidence that a broader movement or particular policies will work. The essay does not establish how much public attention or policy resources would shift under either approach.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 24, 2026; originally published October 1, 2026. The essay presents the authors’ arguments but does not establish whether existential-risk framing changes policy priorities or whether the proposed approach would improve safety.","speaker":{"name":"Arvind Narayanan and Sayash Kapoor","roleAtSource":"Publisher"},"source":{"title":"A big-tent or small-tent AI safety movement?","publisher":"Arvind Narayanan and Sayash Kapoor","format":"Article","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","publishedAt":"2026-10-01T16:34:51.000Z","dateBasis":"Date supplied by the publisher’s feed."},"evidence":[{"text":"Arvind Narayanan and Sayash Kapoor argue that warnings about existential risk may be sincere but wrong and counterproductive to AI safety.","excerpt":"Few have considered the third possibility that x-risk warnings are sincere but simply wrong and counterproductive to AI safety.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The authors argue that AI can amplify existing systemic risks and that society underinvests in defending against catastrophic risks.","excerpt":"Our view is that AI is an amplifier of existing systemic risks.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"They argue that existential-risk framing may polarize safety policy and misdirect attention from defenses against catastrophic and systemic risks from existing AI systems.","excerpt":"The more likely outcome is that the dominance of the x-risk framing is actively counterproductive, for two main reasons.","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The authors propose big-tent safety, including people who disagree about existential risk and policies such as transparency, liability, and embedded evaluation.","excerpt":"A big-tent movement would include members who are not concerned about x-risk","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"},{"text":"The source is dated October 1, 2026.","excerpt":"Oct 01, 2026","url":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would show whether existential-risk framing draws resources away from defenses against harms from existing AI systems?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Arvind Narayanan and Sayash Kapoor argue for a broader AI safety movement","summary":"On October 1, 2026, Arvind Narayanan and Sayash Kapoor argue that AI safety debates often miss a possibility: warnings about existential risk may be sincere but mistaken and counterproductive. They distinguish those warnings from risks they see as existing systemic problems that AI can amplify, including cyberattacks and gradual institutional decay. The authors say society underinvests in resilience against catastrophic risks, while arguing that the public and policymakers give more attention to existential-risk framing than to these other concerns. They worry that this framing could polarize policy debates and direct effort toward stopping AI development rather than strengthening defenses against harms from existing systems. Their alternative is “big-tent safety”: a movement that can include disagreement about existential risk, draw on pluralist values, and pursue policies such as transparency, liability, and embedded evaluation. They present this as an argument, not evidence that a broader movement or particular policies will work. The essay does not establish how much public attention or policy resources would shift under either approach.","question":"What evidence would show whether existential-risk framing draws resources away from defenses against harms from existing AI systems?","claims":[{"text":"Arvind Narayanan and Sayash Kapoor argue that warnings about existential risk may be sincere but wrong and counterproductive to AI safety.","excerpt":"Few have considered the third possibility that x-risk warnings are sincere but simply wrong and counterproductive to AI safety.","support":"source-stated"},{"text":"The authors argue that AI can amplify existing systemic risks and that society underinvests in defending against catastrophic risks.","excerpt":"Our view is that AI is an amplifier of existing systemic risks.","support":"source-stated"},{"text":"They argue that existential-risk framing may polarize safety policy and misdirect attention from defenses against catastrophic and systemic risks from existing AI systems.","excerpt":"The more likely outcome is that the dominance of the x-risk framing is actively counterproductive, for two main reasons.","support":"source-stated"},{"text":"The authors propose big-tent safety, including people who disagree about existential risk and policies such as transparency, liability, and embedded evaluation.","excerpt":"A big-tent movement would include members who are not concerned about x-risk","support":"source-stated"},{"text":"The source is dated October 1, 2026.","excerpt":"Oct 01, 2026","support":"source-stated"}],"limitations":["Text as retrieved on October 24, 2026; originally published October 1, 2026.","The essay presents the authors’ arguments but does not establish whether existential-risk framing changes policy priorities or whether the proposed approach would improve safety."],"mediaId":null,"correctionReason":null,"id":"bca0bcbeca0d8a53c59448bc38c2a3e9f2a30f1beae8bc7dfc42b0f6e9285695","publicationId":"765d4311-7eea-1655-6175-157ab67e0bd4","version":1,"sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","sourceTitle":"A big-tent or small-tent AI safety movement?","publisher":"Arvind Narayanan and Sayash Kapoor","publishedAt":"2026-10-01T16:34:51.000Z","originalPublished":{"value":"2026-10-01T16:34:51.000Z","precision":"instant","basis":"backfill:feed_published"},"firstObservedAt":"2026-10-24T00:49:53.207Z","createdAt":"2026-10-29T16:34:00.883Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.normaltech.ai/p/a-big-tent-or-small-tent-ai-safety","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"08373f99242691e1cc870420cd83638942ef6e45f9ff50e371127ddd6c864b38","rubricVersion":"unrecorded","provider":"unrecorded","model":"anthropic/claude-opus-5.5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-24T00:49:47.433Z"},"provenance":{"textHash":"7e3e5800a990fc80437e6296e98e24285f136f7aa7eecc048a1f2941afabe3b8","observationId":"e39df7f34cdb93a9d2eb5dae168b0a6e6d3863feddb000f5e9f2c1f1f37b78b3","retrievedAt":"2026-10-24T00:51:47.436Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"f5579edd-ca94-6b31-e038-83b76e787e71"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"819f0132-b3ed-3cfb-ca27-f652ce6e46f4"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T16:31:20.323Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"765d4311-7eea-1655-6175-157ab67e0bd4","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the essay and its arguments to Arvind Narayanan and Sayash Kapoor, matching the byline. Their positions are presented as the authors' arguments, not as established facts.","excerpt":"Arvind Narayanan and Sayash Kapoor"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question accurately capture the thesis: x-risk warnings may be sincere but wrong; AI amplifies existing systemic risks; x-risk framing may polarize and misdirect effort; and the big-tent alternative. Big-tent safety and its examples are explained in plain language. The question follows from the misdirection argument and is not leading. The summary is understandable without specialist background.","excerpt":"This is why we worry that the two framings of AI safety are in competition. We hope we are wrong about this!"},{"dimension":"date","status":"pass","explanation":"The October 1, 2026 date matches the source dateline and the UTC day of evidence.originalPublished. The page is a publisher page, not an archive copy, so no archive disclosure is needed. modifiedAt equals the publication time. The reading uses no hindsight framing and presents no forecasts as outcomes.","excerpt":"Oct 01, 2026"},{"dimension":"support","status":"pass","explanation":"Each claim is grounded in the source. The underinvestment argument, polarization, misdirection toward bans, and the policies of transparency, liability and embedded evaluation are all stated in the text. The reading adds appropriate caveats that these are arguments, not demonstrated outcomes.","excerpt":"Two such clusters of policies have become clear: transparency and liability. Embedded evaluation is urgent"},{"dimension":"media","status":"pass","explanation":"No media was selected, and no verified media candidates were supplied. A null selection is appropriate.","excerpt":null}],"createdAt":"2026-10-29T16:31:20.323Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}