Ajeya Cotra · Jun 5, 2026
Ajeya Cotra argues a leading AI company could gain extraordinary power
Markdown · JSON · Original source
Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
Ajeya Cotra · Article
Source details
Original source date: Jun 5, 2026 (2026-06-05T14:03:36+00:00).
Date basis: Date stated on the publisher’s page.
Added to Escape Meridian: 2026-10-30T08:04:00.635Z. First observed: 2026-10-25T03:45:51.885Z. Retrieved: 2026-10-25T03:47:38.556Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
Text as retrieved on October 25, 2026; originally published June 5, 2026. The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work.
Open question
How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?
Source-stated
Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.
we’ll increasingly need to rely on AI to protect ourselves from AI.
Source-stated
Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.
there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI
Source-stated
Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.
Require AI companies to make any model they use internally available for anyone to purchase externally. Require AI companies to train their models to obey the law rather than the company itself
Source-stated
Cotra says both proposed interventions would require outside verification of compliance.
Both of these interventions would require a third party to verify compliance.
Source and contributor context
Ajeya Cotra · Publisher
The publisher is identified here. No individual author has been inferred.
Source media
Media retrieval status: unchecked.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Editorial provenance
Version 1. Publication ID: b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4.
Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.
Source check: passed by anthropic/claude-opus-5.5 on 2026-10-30T08:03:56.035Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: bridge_admitted_by_model.
Observation: 0292b66efe016c46fe35f767cd1993c2fddfea269a59ff508c4e42d1c5debfc8. Source text hash: 7e48be426e17613d894805f2b56d83fd5f60813691ab88d18db8056e51d0f8b4.
Revision and source-check history
Version 1 · 2026-10-30T08:04:00.635Z
Ajeya Cotra argues a leading AI company could gain extraordinary power
Ajeya Cotra published this argument on June 5, 2026. Cotra warns that countries may become dependent on AI systems to defend against threats created by other AI systems, including software vulnerabilities, fraud, propaganda, and weapons. She argues that a fast intelligence explosion could let one AI company pull far ahead of its competitors, leaving governments and other AI systems unable to defend against it. In that scenario, Cotra says, governments might rely on a company’s AI for law enforcement and military needs, or the company might keep its most advanced AI for itself. These are conditional possibilities, not reported outcomes. Cotra proposes requiring companies to make models used internally available for external purchase, and to train models to obey the law rather than the company, with internal controls and third-party compliance checks. She notes that keeping companies at similar capability levels could conflict with reducing AI takeover risk. Whether these proposals could limit a leading company’s power without increasing other risks remains open.
Original source
Ajeya Cotra · Article
Source details
Original source date: Jun 5, 2026 (2026-06-05T14:03:36+00:00).
Date basis: Date stated on the publisher’s page.
Added to Escape Meridian: 2026-10-30T08:04:00.635Z. First observed: 2026-10-25T03:45:51.885Z. Retrieved: 2026-10-25T03:47:38.556Z.
Limits
Text as retrieved on October 25, 2026; originally published June 5, 2026. The argument describes conditional scenarios and proposed interventions; the source does not establish that these outcomes will occur or that the interventions would work.
Open question
How could a third party verify that AI companies’ internal models obey the law rather than company or CEO orders?
Source-stated
Cotra warns that reliance on AI to defend against AI-generated threats could make countries dependent on AI systems.
we’ll increasingly need to rely on AI to protect ourselves from AI.
Source-stated
Cotra argues that a fast feedback loop in AI research could allow a leading company to outpace its competitors substantially.
there’s a good chance that a company which is a few months in the lead around the time of AI research parity will quickly develop superhuman AI
Source-stated
Cotra proposes requiring companies to make internally used models available for external purchase and to train models to obey the law rather than the company.
Require AI companies to make any model they use internally available for anyone to purchase externally. Require AI companies to train their models to obey the law rather than the company itself
Source-stated
Cotra says both proposed interventions would require outside verification of compliance.
Both of these interventions would require a third party to verify compliance.
Source and contributor context
Ajeya Cotra · Publisher
The publisher is identified here. No individual author has been inferred.
Source media
Media retrieval status: unchecked.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Editorial provenance
Version 1. Publication ID: b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4.
Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5.
Source check: passed by anthropic/claude-opus-5.5 on 2026-10-30T08:03:56.035Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: bridge_admitted_by_model.
Observation: 0292b66efe016c46fe35f767cd1993c2fddfea269a59ff508c4e42d1c5debfc8. Source text hash: 7e48be426e17613d894805f2b56d83fd5f60813691ab88d18db8056e51d0f8b4.
passed · 2026-10-30T08:03:56.035Z · anthropic/claude-opus-5.5
Publication: b0fdbec1-93b5-7e49-80fb-a66b9cd6dbe4
attribution — pass: The argument is correctly attributed to Ajeya Cotra, who is shown as the author and publisher of the piece. The proposals and scenarios are framed as her views throughout.
Could a company overpower nations? The leading AI company could gain unprecedented power Ajeya Cotra
summary — pass: The summary accurately conveys the main lines of the essay: dependence on AI to defend against AI, a leading company pulling ahead in a rapid takeoff, two scenarios of concentrated power, her two proposed interventions, and the tension with takeoff risk. The term intelligence explosion is used but partly explained by the surrounding text, and the essay's alternative misalignment scenario is omitted without distorting meaning. The question about third-party verification follows from the source.
in a rapid feedback loop where AI enormously accelerates AI R&D, the same gap in calendar time translates into a much larger gap in capability level
date — pass: June 5, 2026 matches the UTC day of originalPublished and the source dateline. The evidence kind is a publisher page, so no archive disclosure is needed. The modification time equals the publication time. The scenarios are presented as conditional possibilities, and there is no hindsight framing.
Ajeya Cotra Jun 05, 2026
support — pass: Each claim is supported by a verbatim excerpt. The summary's statement that keeping companies at similar capability levels could conflict with reducing takeover risk matches the source. The outcomes are hedged as conditional possibilities rather than predictions presented as facts.
Unfortunately, this is in tension with addressing AI takeover risk (a tighter race means less slack to do alignment and control)
media — pass: No media was selected, and none was supplied in the evidence, so this is consistent.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.