{"id":"b0169f99a0efe2702c7df6caf13628981269249db1241b351109b62e0df86761","title":"Ajeya Cotra argues alignment researchers need clearer shared assumptions","argument":"Ajeya Cotra’s article was published on March 26, 2023. Cotra describes AI alignment research as technical work on building powerful AI systems that try to do what their designers intend, rather than deliberately circumventing or disregarding that intent. She says the field lacks a shared foundation, in part because researchers disagree about how to define alignment, how likely misalignment is, what its consequences might be, and which research matters most.\n\nCotra also emphasizes that researchers may hold very different assumptions about the risks of advanced AI and the value of different approaches. She describes her own view: that advanced AI could pose severe risks, and that alignment research can make progress within the deep learning paradigm. She notes that many, but not all, researchers share aspects of that perspective.\n\nCotra argues that researchers could work more effectively if they developed common assumptions, or at least made their existing assumptions clearer. She is cautiously optimistic about that possibility, while describing it as a long and difficult process. For people new to the field, her central point is that research from one camp may be unintelligible to another because they start from different assumptions.\n\nWhat shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 28, 2026; originally published March 26, 2023. Cotra presents her perspective and acknowledges that researchers disagree; the article does not establish how representative any camp or position is. The article describes possible risks and research priorities, not demonstrated outcomes of future AI systems.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Alignment researchers disagree a lot","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","publishedAt":"2023-03-26T18:08:18+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Cotra defines AI alignment research as technical work intended to make powerful AI systems act in accordance with their designers’ intentions.","excerpt":"technical research that’s trying to develop ways of building powerful AI systems so that they “try their best” to do what their designers want them to do","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra says researchers disagree about the definition, likelihood, consequences, and priorities of AI alignment research.","excerpt":"vastly different ideas about how to define the alignment problem, how likely misalignment is in the first place, what the consequences of powerful misaligned AI are likely to be","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra argues that a shared set of assumptions, or clearer articulation of existing assumptions, could help the field work more effectively and make disagreements easier to understand.","excerpt":"the field as a whole could be much more effective if different camps could arrive at a workable set of common assumptions","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra says her own concern about alignment includes the possibility that advanced AI systems could take over the world, while noting that not all relevant researchers share her view.","excerpt":"I think that there’s a good chance that advanced AI systems will take over the world in a possibly-violent uprising or coup unless we make more research progress; many but not all people working on the relevant technical research problems share this picture.","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Ajeya Cotra argues alignment researchers need clearer shared assumptions","summary":"Ajeya Cotra’s article was published on March 26, 2023. Cotra describes AI alignment research as technical work on building powerful AI systems that try to do what their designers intend, rather than deliberately circumventing or disregarding that intent. She says the field lacks a shared foundation, in part because researchers disagree about how to define alignment, how likely misalignment is, what its consequences might be, and which research matters most.\n\nCotra also emphasizes that researchers may hold very different assumptions about the risks of advanced AI and the value of different approaches. She describes her own view: that advanced AI could pose severe risks, and that alignment research can make progress within the deep learning paradigm. She notes that many, but not all, researchers share aspects of that perspective.\n\nCotra argues that researchers could work more effectively if they developed common assumptions, or at least made their existing assumptions clearer. She is cautiously optimistic about that possibility, while describing it as a long and difficult process. For people new to the field, her central point is that research from one camp may be unintelligible to another because they start from different assumptions.\n\nWhat shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","question":"What shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","claims":[{"text":"Cotra defines AI alignment research as technical work intended to make powerful AI systems act in accordance with their designers’ intentions.","excerpt":"technical research that’s trying to develop ways of building powerful AI systems so that they “try their best” to do what their designers want them to do","support":"source-stated"},{"text":"Cotra says researchers disagree about the definition, likelihood, consequences, and priorities of AI alignment research.","excerpt":"vastly different ideas about how to define the alignment problem, how likely misalignment is in the first place, what the consequences of powerful misaligned AI are likely to be","support":"source-stated"},{"text":"Cotra argues that a shared set of assumptions, or clearer articulation of existing assumptions, could help the field work more effectively and make disagreements easier to understand.","excerpt":"the field as a whole could be much more effective if different camps could arrive at a workable set of common assumptions","support":"source-stated"},{"text":"Cotra says her own concern about alignment includes the possibility that advanced AI systems could take over the world, while noting that not all relevant researchers share her view.","excerpt":"I think that there’s a good chance that advanced AI systems will take over the world in a possibly-violent uprising or coup unless we make more research progress; many but not all people working on the relevant technical research problems share this picture.","support":"source-stated"}],"limitations":["Text as retrieved on October 28, 2026; originally published March 26, 2023.","Cotra presents her perspective and acknowledges that researchers disagree; the article does not establish how representative any camp or position is.","The article describes possible risks and research priorities, not demonstrated outcomes of future AI systems."],"mediaId":null,"correctionReason":null,"id":"b0169f99a0efe2702c7df6caf13628981269249db1241b351109b62e0df86761","publicationId":"d49ff4e8-fc81-7b31-b101-ff15397f9de4","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","sourceTitle":"Alignment researchers disagree a lot","publisher":"Ajeya Cotra","publishedAt":"2023-03-26T18:08:18+00:00","originalPublished":{"value":"2023-03-26T18:08:18+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-28T20:54:01.566Z","createdAt":"2026-10-29T15:59:57.726Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"59a8b02648a60a75ece19fa6ba60a42ad677ea31a12c97f8ccbeeccf5b63742d","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-28T20:53:59.209Z"},"provenance":{"textHash":"95520bd3d677687829f76342c3f9c0f666c91bcdc64d43d9719d24a4888aab24","observationId":"41a391e5f469019f11fe423ff7576318e1c86559aa597ec426fb4716f5f40a79","retrievedAt":"2026-10-28T20:55:34.470Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"583a364b-6de7-3f75-d7bb-ece2fc37e305"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"1016a0a7-9002-d3d3-3bc8-01b7144c9a15"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T15:58:33.696Z","model":"anthropic/claude-opus-5.5"}},"canonicalUrl":"https://escapemeridian.com/readings/ajeya-cotra-argues-alignment-researchers-need-clearer-shared-b0169f99","formats":{"html":"/readings/ajeya-cotra-argues-alignment-researchers-need-clearer-shared-b0169f99","markdown":"/readings/ajeya-cotra-argues-alignment-researchers-need-clearer-shared-b0169f99.md","json":"/readings/ajeya-cotra-argues-alignment-researchers-need-clearer-shared-b0169f99.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-ai-alignment","name":"AI alignment","explanation":"Research and practice aimed at making AI systems pursue the goals their builders and users intend.","referenceUrl":"https://en.wikipedia.org/wiki/AI_alignment"},{"id":"term-deep-learning","name":"Deep learning","explanation":"Machine learning that uses many layers of simple calculations; the basis of most current AI.","referenceUrl":"https://en.wikipedia.org/wiki/Deep_learning"}],"entities":[]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"b0169f99a0efe2702c7df6caf13628981269249db1241b351109b62e0df86761","revision":"d49ff4e8-fc81-7b31-b101-ff15397f9de4","revisionKind":"publication-id","title":"Ajeya Cotra argues alignment researchers need clearer shared assumptions","url":"https://escapemeridian.com/readings/ajeya-cotra-argues-alignment-researchers-need-clearer-shared-b0169f99"},"source":{"type":"source","id":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","revision":"95520bd3d677687829f76342c3f9c0f666c91bcdc64d43d9719d24a4888aab24","revisionKind":"sha256-source-text","title":"Alignment researchers disagree a lot","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"b0169f99a0efe2702c7df6caf13628981269249db1241b351109b62e0df86761","title":"Ajeya Cotra argues alignment researchers need clearer shared assumptions","argument":"Ajeya Cotra’s article was published on March 26, 2023. Cotra describes AI alignment research as technical work on building powerful AI systems that try to do what their designers intend, rather than deliberately circumventing or disregarding that intent. She says the field lacks a shared foundation, in part because researchers disagree about how to define alignment, how likely misalignment is, what its consequences might be, and which research matters most.\n\nCotra also emphasizes that researchers may hold very different assumptions about the risks of advanced AI and the value of different approaches. She describes her own view: that advanced AI could pose severe risks, and that alignment research can make progress within the deep learning paradigm. She notes that many, but not all, researchers share aspects of that perspective.\n\nCotra argues that researchers could work more effectively if they developed common assumptions, or at least made their existing assumptions clearer. She is cautiously optimistic about that possibility, while describing it as a long and difficult process. For people new to the field, her central point is that research from one camp may be unintelligible to another because they start from different assumptions.\n\nWhat shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","topicIds":["artificial-general-intelligence"],"domain":"other","claimType":"attributed reading","limits":"Text as retrieved on October 28, 2026; originally published March 26, 2023. Cotra presents her perspective and acknowledges that researchers disagree; the article does not establish how representative any camp or position is. The article describes possible risks and research priorities, not demonstrated outcomes of future AI systems.","speaker":{"name":"Ajeya Cotra","roleAtSource":"Publisher"},"source":{"title":"Alignment researchers disagree a lot","publisher":"Ajeya Cotra","format":"Article","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","publishedAt":"2023-03-26T18:08:18+00:00","dateBasis":"Date stated on the publisher’s page."},"evidence":[{"text":"Cotra defines AI alignment research as technical work intended to make powerful AI systems act in accordance with their designers’ intentions.","excerpt":"technical research that’s trying to develop ways of building powerful AI systems so that they “try their best” to do what their designers want them to do","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra says researchers disagree about the definition, likelihood, consequences, and priorities of AI alignment research.","excerpt":"vastly different ideas about how to define the alignment problem, how likely misalignment is in the first place, what the consequences of powerful misaligned AI are likely to be","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra argues that a shared set of assumptions, or clearer articulation of existing assumptions, could help the field work more effectively and make disagreements easier to understand.","excerpt":"the field as a whole could be much more effective if different camps could arrive at a workable set of common assumptions","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"},{"text":"Cotra says her own concern about alignment includes the possibility that advanced AI systems could take over the world, while noting that not all relevant researchers share her view.","excerpt":"I think that there’s a good chance that advanced AI systems will take over the world in a possibly-violent uprising or coup unless we make more research progress; many but not all people working on the relevant technical research problems share this picture.","url":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","relationship":"Source-stated"}],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","checkedAt":null,"items":[]},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Ajeya Cotra argues alignment researchers need clearer shared assumptions","summary":"Ajeya Cotra’s article was published on March 26, 2023. Cotra describes AI alignment research as technical work on building powerful AI systems that try to do what their designers intend, rather than deliberately circumventing or disregarding that intent. She says the field lacks a shared foundation, in part because researchers disagree about how to define alignment, how likely misalignment is, what its consequences might be, and which research matters most.\n\nCotra also emphasizes that researchers may hold very different assumptions about the risks of advanced AI and the value of different approaches. She describes her own view: that advanced AI could pose severe risks, and that alignment research can make progress within the deep learning paradigm. She notes that many, but not all, researchers share aspects of that perspective.\n\nCotra argues that researchers could work more effectively if they developed common assumptions, or at least made their existing assumptions clearer. She is cautiously optimistic about that possibility, while describing it as a long and difficult process. For people new to the field, her central point is that research from one camp may be unintelligible to another because they start from different assumptions.\n\nWhat shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","question":"What shared assumptions, if any, could alignment researchers agree on without obscuring their substantive disagreements?","claims":[{"text":"Cotra defines AI alignment research as technical work intended to make powerful AI systems act in accordance with their designers’ intentions.","excerpt":"technical research that’s trying to develop ways of building powerful AI systems so that they “try their best” to do what their designers want them to do","support":"source-stated"},{"text":"Cotra says researchers disagree about the definition, likelihood, consequences, and priorities of AI alignment research.","excerpt":"vastly different ideas about how to define the alignment problem, how likely misalignment is in the first place, what the consequences of powerful misaligned AI are likely to be","support":"source-stated"},{"text":"Cotra argues that a shared set of assumptions, or clearer articulation of existing assumptions, could help the field work more effectively and make disagreements easier to understand.","excerpt":"the field as a whole could be much more effective if different camps could arrive at a workable set of common assumptions","support":"source-stated"},{"text":"Cotra says her own concern about alignment includes the possibility that advanced AI systems could take over the world, while noting that not all relevant researchers share her view.","excerpt":"I think that there’s a good chance that advanced AI systems will take over the world in a possibly-violent uprising or coup unless we make more research progress; many but not all people working on the relevant technical research problems share this picture.","support":"source-stated"}],"limitations":["Text as retrieved on October 28, 2026; originally published March 26, 2023.","Cotra presents her perspective and acknowledges that researchers disagree; the article does not establish how representative any camp or position is.","The article describes possible risks and research priorities, not demonstrated outcomes of future AI systems."],"mediaId":null,"correctionReason":null,"id":"b0169f99a0efe2702c7df6caf13628981269249db1241b351109b62e0df86761","publicationId":"d49ff4e8-fc81-7b31-b101-ff15397f9de4","version":1,"sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","sourceTitle":"Alignment researchers disagree a lot","publisher":"Ajeya Cotra","publishedAt":"2023-03-26T18:08:18+00:00","originalPublished":{"value":"2023-03-26T18:08:18+00:00","precision":"instant","basis":"backfill:article_published"},"firstObservedAt":"2026-10-28T20:54:01.566Z","createdAt":"2026-10-29T15:59:57.726Z","historical":true,"entityIds":[],"topicIds":["artificial-general-intelligence"],"media":[],"sourceMedia":{"status":"unchecked","sourceUrl":"https://www.planned-obsolescence.org/p/disagreement-in-alignment","checkedAt":null,"items":[]},"editorialDecision":{"outcome":"accept","mediaId":null,"inputHash":"59a8b02648a60a75ece19fa6ba60a42ad677ea31a12c97f8ccbeeccf5b63742d","rubricVersion":"unrecorded","provider":"anthropic","model":"claude-opus-5-5","reasonCodes":["bridge_admitted_by_model","second_opinion_categorical"],"confidence":1,"decidedAt":"2026-10-28T20:53:59.209Z"},"provenance":{"textHash":"95520bd3d677687829f76342c3f9c0f666c91bcdc64d43d9719d24a4888aab24","observationId":"41a391e5f469019f11fe423ff7576318e1c86559aa597ec426fb4716f5f40a79","retrievedAt":"2026-10-28T20:55:34.470Z","kind":"publisher-page","preparer":{"model":"openai/gpt-6-luna","runId":"583a364b-6de7-3f75-d7bb-ece2fc37e305"},"reviewer":{"model":"anthropic/claude-opus-5.5","runId":"1016a0a7-9002-d3d3-3bc8-01b7144c9a15"}},"audit":{"status":"passed","reviewedAt":"2026-10-29T15:58:33.696Z","model":"anthropic/claude-opus-5.5"}}}],"audits":[{"publicationId":"d49ff4e8-fc81-7b31-b101-ff15397f9de4","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the article and its views to Ajeya Cotra, the author shown on the publisher page. Cotra's personal views are framed as hers, and the reading notes that other researchers disagree.","excerpt":"Like anyone else who thinks about this area, I’m coming from my own particular perspective"},{"dimension":"summary","status":"pass","explanation":"The summary accurately conveys the definition of alignment research, the field's lack of shared foundations, the dimensions of disagreement, Cotra's own view, and her call for common or clearer assumptions. Alignment is explained in plain language for a general reader. Describing her takeover concern as 'severe risks' is softer than the source but not misleading, and claim 4 states it directly. The question follows from the source without leading.","excerpt":"It’s a pre-paradigmatic field — there’s very little shared foundation that researchers can lay bricks on top of right now."},{"dimension":"date","status":"pass","explanation":"The stated date, March 26, 2023, matches evidence.originalPublished (2023-03-26T18:08 UTC) and the dateline. modifiedAt is the same instant, so there is no sign of a later edit. The evidence kind is publisher-page, so no archive disclosure is needed. The reading contains no hindsight framing and presents nothing from after that date as known.","excerpt":"Ajeya Cotra\nMar 26, 2023"},{"dimension":"support","status":"pass","explanation":"All four claims are source-stated, and each excerpt matches the text verbatim. The limitations correctly frame the article's risks as possibilities and her position as one perspective among several. The reading draws no unsupported inferences about benefits or costs.","excerpt":"I think that the field as a whole could be much more effective if different camps could arrive at a workable set of common assumptions that could be built upon."},{"dimension":"media","status":"pass","explanation":"No media was selected and no verified media candidates were supplied, so selecting none is appropriate.","excerpt":null}],"createdAt":"2026-10-29T15:58:33.696Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}