# Rakshit S Trivedi and co-authors argue in arXiv for cooperative AI design [Canonical reading](https://escapemeridian.com/readings/rakshit-s-trivedi-and-co-authors-argue-in-arxiv-for-cooperative-1bb3b466) The authors’ work was published on June 4, 2026. Rakshit S Trivedi, Natasha Jaques, Logan Cross, Alexander Sasha Vezhnevets and Joel Z Leibo argue that a superintelligence developed as a solipsistic task solver is unlikely to cooperate. They say the usual approach treats the world as a fixed source of feedback, but deploying AI systems changes the conditions those systems encounter. They call this mismatch the “self-undermining property of unilateral optimization.” In their account, cooperation is not simply another task for AI to solve: it is how multiple actors navigate their interdependence. The authors call for research that makes this interdependence central to AI design, including evaluations with adaptive counterparties, treating institutions as design primitives, and preserving human agency as a structural feature of AI systems. Their argument shifts attention from capability alone to coexistence, and makes human agency part of the design question. The abstract does not specify how these proposals would be implemented or demonstrate that they would make AI systems cooperative. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source Google DeepMind · Article Original source date: Jun 4, 2026 (2026-06-04T00:00:00+00:00). Date basis: Date stated on the publisher’s page. Added to Escape Meridian: 2026-11-06T22:08:24.340Z. First observed: 2026-11-02T23:25:57.408Z. Retrieved: 2026-11-02T23:27:21.125Z. - [Solipsistic superintelligence is unlikely to be cooperative](https://deepmind.google/research/publications/231466/) ## Limits Text as retrieved on November 2, 2026; originally published June 4, 2026. The available evidence is the publication page’s abstract; it does not provide details of the proposed methods or evidence that they would produce cooperative systems. ## Open question How would dynamic evaluations involving adaptive counterparties show whether an AI system can participate in cooperation? ## Source-stated The authors argue that superintelligence developed through a solipsistic approach to AI design is unlikely to be cooperative. > superintelligence, an extremely capable task solver, born out of such a solipsistic approach to AI design, is unlikely to be cooperative. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors say deploying AI systems changes the conditions they encounter, creating a gap between historical distributions and deployment context. > Deploying AI systems induces endogenous non-stationarity, resulting in a train-test-deploy gap where historical distributions diverge from the deployment context. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors define cooperation as an equilibrium-selection process through which multiple actors navigate interdependence. > the equilibrium-selection process through which multiple actors navigate their interdependence. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors call for a research paradigm that treats interdependence as a core design principle, with adaptive evaluations, institutions as design primitives, and human agency as a structural feature. > This entails building dynamic evaluation testbeds involving adaptive counterparties, treating institutions as design primitives, and preserving human agency as a structural feature of the systems we build. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source and contributor context Google DeepMind · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Superintelligence A hypothetical AI far more capable than people across most intellectual tasks. - [Definition reference](https://en.wikipedia.org/wiki/Superintelligence) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Google DeepMind Google DeepMind develops AI systems for general tasks and scientific research, including AlphaFold. - [Explore this context](/entities/google-deepmind) - [Reference](https://deepmind.google/blog/) - [Reference](https://deepmind.google/science/alphafold/) ## The World The World is a public radio news program publishing international reporting on politics, society, labor and technology. - [Explore this context](/entities/the-world) - [Reference](https://theworld.org/) ## Editorial provenance Version 1. Publication ID: 4b4b3318-3306-65a0-12f8-eca53f06d12a. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-06T22:03:28.158Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model, second\_opinion\_categorical. Observation: 39b65c32f6dcc23587e7dda8301488021a8f60fc2afe14f12022615999f9cdb9. Source text hash: c569e2f4d6d5c45f1790602b3465b1f9fa35af104ebb5df396d0bf3ae26d93f9. ## Revision and source-check history ### Version 1 — 2026-11-06T22:08:24.340Z The authors’ work was published on June 4, 2026. Rakshit S Trivedi, Natasha Jaques, Logan Cross, Alexander Sasha Vezhnevets and Joel Z Leibo argue that a superintelligence developed as a solipsistic task solver is unlikely to cooperate. They say the usual approach treats the world as a fixed source of feedback, but deploying AI systems changes the conditions those systems encounter. They call this mismatch the “self-undermining property of unilateral optimization.” In their account, cooperation is not simply another task for AI to solve: it is how multiple actors navigate their interdependence. The authors call for research that makes this interdependence central to AI design, including evaluations with adaptive counterparties, treating institutions as design primitives, and preserving human agency as a structural feature of AI systems. Their argument shifts attention from capability alone to coexistence, and makes human agency part of the design question. The abstract does not specify how these proposals would be implemented or demonstrate that they would make AI systems cooperative. ## Original source Google DeepMind · Article Original source date: Jun 4, 2026 (2026-06-04T00:00:00+00:00). Date basis: Date stated on the publisher’s page. Added to Escape Meridian: 2026-11-06T22:08:24.340Z. First observed: 2026-11-02T23:25:57.408Z. Retrieved: 2026-11-02T23:27:21.125Z. - [Solipsistic superintelligence is unlikely to be cooperative](https://deepmind.google/research/publications/231466/) ## Limits Text as retrieved on November 2, 2026; originally published June 4, 2026. The available evidence is the publication page’s abstract; it does not provide details of the proposed methods or evidence that they would produce cooperative systems. ## Open question How would dynamic evaluations involving adaptive counterparties show whether an AI system can participate in cooperation? ## Source-stated The authors argue that superintelligence developed through a solipsistic approach to AI design is unlikely to be cooperative. > superintelligence, an extremely capable task solver, born out of such a solipsistic approach to AI design, is unlikely to be cooperative. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors say deploying AI systems changes the conditions they encounter, creating a gap between historical distributions and deployment context. > Deploying AI systems induces endogenous non-stationarity, resulting in a train-test-deploy gap where historical distributions diverge from the deployment context. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors define cooperation as an equilibrium-selection process through which multiple actors navigate interdependence. > the equilibrium-selection process through which multiple actors navigate their interdependence. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source-stated The authors call for a research paradigm that treats interdependence as a core design principle, with adaptive evaluations, institutions as design primitives, and human agency as a structural feature. > This entails building dynamic evaluation testbeds involving adaptive counterparties, treating institutions as design primitives, and preserving human agency as a structural feature of the systems we build. - [Supporting source](https://deepmind.google/research/publications/231466/) ## Source and contributor context Google DeepMind · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Superintelligence A hypothetical AI far more capable than people across most intellectual tasks. - [Definition reference](https://en.wikipedia.org/wiki/Superintelligence) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Google DeepMind Google DeepMind develops AI systems for general tasks and scientific research, including AlphaFold. - [Explore this context](/entities/google-deepmind) - [Reference](https://deepmind.google/blog/) - [Reference](https://deepmind.google/science/alphafold/) ## The World The World is a public radio news program publishing international reporting on politics, society, labor and technology. - [Explore this context](/entities/the-world) - [Reference](https://theworld.org/) ## Editorial provenance Version 1. Publication ID: 4b4b3318-3306-65a0-12f8-eca53f06d12a. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-06T22:03:28.158Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model, second\_opinion\_categorical. Observation: 39b65c32f6dcc23587e7dda8301488021a8f60fc2afe14f12022615999f9cdb9. Source text hash: c569e2f4d6d5c45f1790602b3465b1f9fa35af104ebb5df396d0bf3ae26d93f9. ### passed — 2026-11-06T22:03:28.158Z — anthropic/claude-opus-5.5 Publication: 4b4b3318-3306-65a0-12f8-eca53f06d12a attribution — pass: The reading names the five listed authors and credits the argument to them. The arXiv venue matches the page. It is a single publication abstract, not a listing. > Rakshit S Trivedi, Natasha Jaques, Logan Cross, Alexander Sasha Vezhnevets, Joel Z Leibo summary — pass: The summary faithfully gives the thesis, the deployment mismatch, the authors' view of cooperation and their three proposals. It keeps the claims attributed and the framing of a shift from capability to coexistence. The term solipsistic is explained in context as treating the world as a fixed source of feedback, and superintelligence is defined on the page. Terms such as design primitives and adaptive counterparties remain unexplained but are not central. The question follows from the source. The limitation correctly says no implementation details or evidence are given. > AI's central challenge is shifting from capability to coexistence. date — pass: The June 4, 2026 date matches both the page dateline and evidence.originalPublished. The source gives the date at day precision. There is no hindsight framing. The evidence is a publisher page, so no archive disclosure is needed. > June 4, 2026 support — pass: Each claim is source-stated and backed by an exact excerpt. The summary implies no benefits, costs or outcomes beyond the abstract. It also states that the abstract does not demonstrate the proposals would work. > We refer to this as the self-undermining property of unilateral optimization. media — pass: No media was selected and no verified candidates were supplied, so nothing is misidentified or irrelevant. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/1bb3b466765fb7db5fc6edc5c9c98c05eb26528ea7dc12aa0acfc344fef8dd66/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/rakshit-s-trivedi-and-co-authors-argue-in-arxiv-for-cooperative-1bb3b466.json)