{"id":"66f7427078f0225d3dfb65781b8e52d581deb92a8cbffce1b23470da30b67736","title":"Ajeya Cotra argues a leading AI company could gain extraordinary power","argument":"Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 25, 2026; originally published June 5, 2026. The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Could a company overpower nations?","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","publishedAt":"2026-06-05T14:03:36+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.","excerpt":"we’ll increasingly need to rely on AI to protect ourselves from AI.","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.","excerpt":"there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.","excerpt":"Require AI companies to make any model they use internally available for anyone to purchase externally.\nRequire AI companies to train their models to obey the law rather than the company itself","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra says both proposed interventions would require outside verification of compliance.","excerpt":"Both of these interventions would require a third party to verify compliance.","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Ajeya Cotra argues a leading AI company could gain extraordinary power","summary":"Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.","question":"How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?","claims":[{"text":"Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.","excerpt":"we’ll increasingly need to rely on AI to protect ourselves from AI.","support":"source-stated"},{"text":"Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.","excerpt":"there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI","support":"source-stated"},{"text":"Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.","excerpt":"Require AI companies to make any model they use internally available for anyone to purchase externally.\nRequire AI companies to train their models to obey the law rather than the company itself","support":"source-stated"},{"text":"Cotra says both proposed interventions would require outside verification of compliance.","excerpt":"Both of these interventions would require a third party to verify compliance.","support":"source-stated"}],"limitations":["Text as retrieved on October 25, 2026; originally published June 5, 2026.","The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work."],"mediaId":null,"correctionReason":null,"id":"66f7427078f0225d3dfb65781b8e52d581deb92a8cbffce1b23470da30b67736","publicationId":"b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","sourceTitle":"Could a company overpower nations?","publisher":"Ajeya Cotra","publishedAt":"2026-06-05T14:03:36+00:00","originalPublished":{"value":"2026-06-05T14:03:36+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-25T03:45:51.885Z","createdAt":"2026-10-30T08:04:00.635Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"53ab872dc25fb740acb587ec4b17195b1711f53c282ea2297d453a54bf651151","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.52,"decidedAt":"2026-10-25T03:45:51.173Z"},"provenance":{"textHash":"7e48be426e17613d894805f2b56d83fd5f60813691ab88d18db8056e51d0f8b4","observationId":"0292b66efe016c46fe35f767cd1993c2fddfea269a59ff508c4e42d1c5debfc8","retrievedAt":"2026-10-25T03:47:38.556Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"898d46e3-f1ec-781a-15ca-3d77e55862b6"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"482aff64-7d49-3554-cd25-0a916ffc2f59"}},"audit":{"status":"passed","reviewedAt":"2026-10-30T08:03:56.035Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/ajeya-cotra-argues-a-leading-ai-company-could-gain-66f74270","formats":{"html":"/readings/ajeya-cotra-argues-a-leading-ai-company-could-gain-66f74270","markdown":"/readings/ajeya-cotra-argues-a-leading-ai-company-could-gain-66f74270.md","json":"/readings/ajeya-cotra-argues-a-leading-ai-company-could-gain-66f74270.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"66f7427078f0225d3dfb65781b8e52d581deb92a8cbffce1b23470da30b67736","revision":"b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4","revisionKind":"publication-id","title":"Ajeya Cotra argues a leading AI company could gain extraordinary power","url":"https://escapemeridian.com/readings/ajeya-cotra-argues-a-leading-ai-company-could-gain-66f74270"},"source":{"type":"source","id":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","revision":"7e48be426e17613d894805f2b56d83fd5f60813691ab88d18db8056e51d0f8b4","revisionKind":"sha256-source-text","title":"Could a company overpower nations?","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"66f7427078f0225d3dfb65781b8e52d581deb92a8cbffce1b23470da30b67736","title":"Ajeya Cotra argues a leading AI company could gain extraordinary power","argument":"Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 25, 2026; originally published June 5, 2026. The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Could a company overpower nations?","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","publishedAt":"2026-06-05T14:03:36+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.","excerpt":"we’ll increasingly need to rely on AI to protect ourselves from AI.","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.","excerpt":"there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.","excerpt":"Require AI companies to make any model they use internally available for anyone to purchase externally.\nRequire AI companies to train their models to obey the law rather than the company itself","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"},{"text":"Cotra says both proposed interventions would require outside verification of compliance.","excerpt":"Both of these interventions would require a third party to verify compliance.","url":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Ajeya Cotra argues a leading AI company could gain extraordinary power","summary":"Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.","question":"How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?","claims":[{"text":"Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.","excerpt":"we’ll increasingly need to rely on AI to protect ourselves from AI.","support":"source-stated"},{"text":"Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.","excerpt":"there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI","support":"source-stated"},{"text":"Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.","excerpt":"Require AI companies to make any model they use internally available for anyone to purchase externally.\nRequire AI companies to train their models to obey the law rather than the company itself","support":"source-stated"},{"text":"Cotra says both proposed interventions would require outside verification of compliance.","excerpt":"Both of these interventions would require a third party to verify compliance.","support":"source-stated"}],"limitations":["Text as retrieved on October 25, 2026; originally published June 5, 2026.","The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work."],"mediaId":null,"correctionReason":null,"id":"66f7427078f0225d3dfb65781b8e52d581deb92a8cbffce1b23470da30b67736","publicationId":"b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","sourceTitle":"Could a company overpower nations?","publisher":"Ajeya Cotra","publishedAt":"2026-06-05T14:03:36+00:00","originalPublished":{"value":"2026-06-05T14:03:36+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-25T03:45:51.885Z","createdAt":"2026-10-30T08:04:00.635Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/could-a-company-overpower-nations","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"53ab872dc25fb740acb587ec4b17195b1711f53c282ea2297d453a54bf651151","rubricVersion":"unrecorded","provider":"vercel","model":"typesafe-ai/jev","reasonCodes":["bridge_admitted_by_model"],"confidence":0.52,"decidedAt":"2026-10-25T03:45:51.173Z"},"provenance":{"textHash":"7e48be426e17613d894805f2b56d83fd5f60813691ab88d18db8056e51d0f8b4","observationId":"0292b66efe016c46fe35f767cd1993c2fddfea269a59ff508c4e42d1c5debfc8","retrievedAt":"2026-10-25T03:47:38.556Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"898d46e3-f1ec-781a-15ca-3d77e55862b6"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"482aff64-7d49-3554-cd25-0a916ffc2f59"}},"audit":{"status":"passed","reviewedAt":"2026-10-30T08:03:56.035Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The argument is correctly attributed to Ajeya Cotra, who is shown as the author and publisher of the piece. The proposals and scenarios are framed as her views throughout.","excerpt":"Could a company overpower nations?\nThe leading AI company could gain unprecedented power\nAjeya Cotra"},{"dimension":"summary","status":"pass","explanation":"The summary accurately conveys the main lines of the essay: dependence on AI to defend against AI, a leading company pulling ahead in a rapid takeoff, two scenarios of concentrated power, her two proposed interventions, and the tension with takeoff risk. The term intelligence explosion is used but partly explained by the surrounding text, and the essay's alternative misalignment scenario is omitted without distorting meaning. The question about third-party verification follows from the source.","excerpt":"in a rapid feedback loop where AI enormously accelerates AI R&D, the same gap in calendar time translates into a much larger gap in capability level"},{"dimension":"date","status":"pass","explanation":"June 5, 2026 matches the UTC day of originalPublished and the source dateline. The evidence kind is a publisher page, so no archive disclosure is needed. The modification time equals the publication time. The scenarios are presented as conditional possibilities, and there is no hindsight framing.","excerpt":"Ajeya Cotra\nJun 05, 2026"},{"dimension":"support","status":"pass","explanation":"Each claim is supported by a verbatim excerpt. The summary's statement that keeping companies at similar capability levels could conflict with reducing takeover risk matches the source. The outcomes are hedged as conditional possibilities rather than predictions presented as facts.","excerpt":"Unfortunately, this is in tension with addressing AI takeover risk (a tighter race means less slack to do alignment and control)"},{"dimension":"media","status":"pass","explanation":"No media was selected, and none was supplied in the evidence, so this is consistent.","excerpt":null}],"createdAt":"2026-10-30T08:03:56.035Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}