# Dwarkesh Podcast: Noam Brown on agent swarms, alignment and recursive self-improvement [Canonical reading](https://escapemeridian.com/readings/dwarkesh-podcast-noam-brown-on-agent-swarms-alignment-and-da67ac95) The Dwarkesh Podcast published this conversation on September 17, 2026. Host Dwarkesh Patel and OpenAI researcher Noam Brown discuss multi-agent systems, AI progress and the challenge of aligning increasingly capable systems with human intentions. Brown says multiple agents can scale test-time compute in parallel, but efficiency depends on the task, and evidence at very large scales is limited. He says a powerful general-purpose model, not multi-agent collaboration alone, was chiefly responsible for the Millennium Prize Problem effort. Patel argues that mathematical progress makes recursive self-improvement seem more plausible and raises concerns about its pace. Brown says AI can accelerate research, but experiments and compute constrain progress; he does not expect an overnight intelligence explosion, while acknowledging uncertainty. He warns that evaluations may miss misalignment and that systems able to work over longer periods may outlast the time available to test them before release. Brown says safeguards can buy time, but “we really do need to solve the alignment problem.” The conversation leaves open how alignment can be measured reliably and how much internal AI use may widen the gap between labs and the outside world. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source Dwarkesh Podcast · Transcript Original source date: Sep 17, 2026 (2026-09-17T15:38:13.000Z). Date basis: Date supplied by the publisher’s feed. Added to Escape Meridian: 2026-11-05T19:28:23.287Z. First observed: 2026-09-23T04:45:23.997Z. Retrieved: 2026-10-30T20:28:03.131Z. - [Noam Brown – Agent swarms, alignment, & recursive self-improvement](https://www.dwarkesh.com/p/noam-brown) ## Limits Text as retrieved on October 30, 2026; originally published September 17, 2026. Brown says he does not know all the details of the alleged attack on OpenAI discussed in the conversation; this reading reports the exchange, not an independent account of that event. The conversation does not establish a reliable way to measure alignment or resolve the trade-offs between evaluating models longer and widening the gap between labs and the outside world. ## Open question What evidence would show that alignment evaluations remain reliable as models take on longer tasks and help develop their successors? ## Source-stated Brown says multi-agent systems scale test-time compute in parallel, though they are less efficient and their effectiveness depends on the task. > So multi-agent is a way of scaling test-time compute in parallel instead of purely serially. It is less efficient - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says the Millennium Prize Problem effort was not chiefly due to multi-agent systems, but to a powerful general-purpose model. > The effort to solve a Millennium Prize Problem, this was not due to multi-agent. I wouldn’t even attribute 10% of the credit to multi-agent. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Patel argues that mathematical progress makes recursive self-improvement more plausible and raises concerns about its pace. > Here’s why this result, and maybe the general progress that AI has made in mathematics, has made me think that RSI is more plausible and sooner than I previously thought. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says research acceleration is constrained by experiments and compute, and rejects an overnight 100-fold acceleration as his expectation while acknowledging uncertainty. > I don’t think it’s an overnight intelligence explosion where we go 100x faster, because we do get bottlenecked by certain limitations that are not bottlenecks of intelligence. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says safety evaluations may fail to capture alignment and that longer task horizons could outlast the time available to evaluate systems before release. > If you’re in a world where they can operate effectively over three months, but the model release cycle is every two months, then you don’t have a way to evaluate the models at the full length of their capabilities before the next model release cycle. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says safeguards can buy time, but alignment still needs to be solved. > So the safety mechanisms buy us time, and things like chain-of-thought monitoring buy us time, and they can tell us if we’re on the right path. But at the end of the day, we really do need to solve the alignment problem. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source and contributor context Dwarkesh Podcast · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Recursive self-improvement An AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system. - [Definition reference](https://hai.stanford.edu/what-is-recursive-self-improvement) ## Test-time compute Extra computation a model spends while answering, for example by reasoning longer, rather than during training. - [Definition reference](https://arxiv.org/abs/2408.03314) ## AI alignment Research and practice aimed at making AI systems pursue the goals their builders and users intend. - [Definition reference](https://en.wikipedia.org/wiki/AI_alignment) ## Dwarkesh Podcast Dwarkesh Podcast features long conversations with researchers, builders and thinkers about technology, history and the future. - [Explore this context](/entities/dwarkesh-podcast) - [Reference](https://www.dwarkesh.com/) ## Noam Brown Noam Brown is an OpenAI researcher discussing reasoning models, agent teams and results from his employer on the Dwarkesh Podcast. - [Explore this context](/entities/noam-brown) - [Reference](https://www.dwarkesh.com/p/noam-brown) ## Dwarkesh Patel Dwarkesh Patel hosts the Dwarkesh Podcast, asking researchers and other guests to explain and defend their ideas. - [Explore this context](/entities/dwarkesh-patel) - [Reference](https://www.dwarkesh.com/about) - [Reference](https://www.dwarkesh.com/) ## OpenAI OpenAI develops AI models and products and publishes research, release announcements and evaluations. - [Explore this context](/entities/openai) - [Reference](https://openai.com/news/) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: 4455dcef-43a6-0b8f-ffcc-3883c9773ef8. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T19:23:45.610Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model. Observation: f1ec99fdab350c3d7621fd08c3bd96f7756d6c3f8a4633d0c4bef7f541e66ac0. Source text hash: e95573a114b35b070b49fa0b4dda42c759d6f6bc356ee60f62b50ccac0288fca. ## Revision and source-check history ### Version 1 — 2026-11-05T19:28:23.287Z The Dwarkesh Podcast published this conversation on September 17, 2026. Host Dwarkesh Patel and OpenAI researcher Noam Brown discuss multi-agent systems, AI progress and the challenge of aligning increasingly capable systems with human intentions. Brown says multiple agents can scale test-time compute in parallel, but efficiency depends on the task, and evidence at very large scales is limited. He says a powerful general-purpose model, not multi-agent collaboration alone, was chiefly responsible for the Millennium Prize Problem effort. Patel argues that mathematical progress makes recursive self-improvement seem more plausible and raises concerns about its pace. Brown says AI can accelerate research, but experiments and compute constrain progress; he does not expect an overnight intelligence explosion, while acknowledging uncertainty. He warns that evaluations may miss misalignment and that systems able to work over longer periods may outlast the time available to test them before release. Brown says safeguards can buy time, but “we really do need to solve the alignment problem.” The conversation leaves open how alignment can be measured reliably and how much internal AI use may widen the gap between labs and the outside world. ## Original source Dwarkesh Podcast · Transcript Original source date: Sep 17, 2026 (2026-09-17T15:38:13.000Z). Date basis: Date supplied by the publisher’s feed. Added to Escape Meridian: 2026-11-05T19:28:23.287Z. First observed: 2026-09-23T04:45:23.997Z. Retrieved: 2026-10-30T20:28:03.131Z. - [Noam Brown – Agent swarms, alignment, & recursive self-improvement](https://www.dwarkesh.com/p/noam-brown) ## Limits Text as retrieved on October 30, 2026; originally published September 17, 2026. Brown says he does not know all the details of the alleged attack on OpenAI discussed in the conversation; this reading reports the exchange, not an independent account of that event. The conversation does not establish a reliable way to measure alignment or resolve the trade-offs between evaluating models longer and widening the gap between labs and the outside world. ## Open question What evidence would show that alignment evaluations remain reliable as models take on longer tasks and help develop their successors? ## Source-stated Brown says multi-agent systems scale test-time compute in parallel, though they are less efficient and their effectiveness depends on the task. > So multi-agent is a way of scaling test-time compute in parallel instead of purely serially. It is less efficient - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says the Millennium Prize Problem effort was not chiefly due to multi-agent systems, but to a powerful general-purpose model. > The effort to solve a Millennium Prize Problem, this was not due to multi-agent. I wouldn’t even attribute 10% of the credit to multi-agent. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Patel argues that mathematical progress makes recursive self-improvement more plausible and raises concerns about its pace. > Here’s why this result, and maybe the general progress that AI has made in mathematics, has made me think that RSI is more plausible and sooner than I previously thought. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says research acceleration is constrained by experiments and compute, and rejects an overnight 100-fold acceleration as his expectation while acknowledging uncertainty. > I don’t think it’s an overnight intelligence explosion where we go 100x faster, because we do get bottlenecked by certain limitations that are not bottlenecks of intelligence. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says safety evaluations may fail to capture alignment and that longer task horizons could outlast the time available to evaluate systems before release. > If you’re in a world where they can operate effectively over three months, but the model release cycle is every two months, then you don’t have a way to evaluate the models at the full length of their capabilities before the next model release cycle. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source-stated Brown says safeguards can buy time, but alignment still needs to be solved. > So the safety mechanisms buy us time, and things like chain-of-thought monitoring buy us time, and they can tell us if we’re on the right path. But at the end of the day, we really do need to solve the alignment problem. - [Supporting source](https://www.dwarkesh.com/p/noam-brown) ## Source and contributor context Dwarkesh Podcast · Publisher The publisher is identified here. No individual author has been inferred. ## Source media Media retrieval status: unchecked. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Recursive self-improvement An AI system improving its own capabilities, such as its code, training methods or reasoning, then using the gains to improve further. Each cycle could hypothetically produce a more capable system. - [Definition reference](https://hai.stanford.edu/what-is-recursive-self-improvement) ## Test-time compute Extra computation a model spends while answering, for example by reasoning longer, rather than during training. - [Definition reference](https://arxiv.org/abs/2408.03314) ## AI alignment Research and practice aimed at making AI systems pursue the goals their builders and users intend. - [Definition reference](https://en.wikipedia.org/wiki/AI_alignment) ## Dwarkesh Podcast Dwarkesh Podcast features long conversations with researchers, builders and thinkers about technology, history and the future. - [Explore this context](/entities/dwarkesh-podcast) - [Reference](https://www.dwarkesh.com/) ## Noam Brown Noam Brown is an OpenAI researcher discussing reasoning models, agent teams and results from his employer on the Dwarkesh Podcast. - [Explore this context](/entities/noam-brown) - [Reference](https://www.dwarkesh.com/p/noam-brown) ## Dwarkesh Patel Dwarkesh Patel hosts the Dwarkesh Podcast, asking researchers and other guests to explain and defend their ideas. - [Explore this context](/entities/dwarkesh-patel) - [Reference](https://www.dwarkesh.com/about) - [Reference](https://www.dwarkesh.com/) ## OpenAI OpenAI develops AI models and products and publishes research, release announcements and evaluations. - [Explore this context](/entities/openai) - [Reference](https://openai.com/news/) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: 4455dcef-43a6-0b8f-ffcc-3883c9773ef8. Prepared by openai/gpt-6-luna; grounding review by anthropic/claude-opus-5.5. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-05T19:23:45.610Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: bridge\_admitted\_by\_model. Observation: f1ec99fdab350c3d7621fd08c3bd96f7756d6c3f8a4633d0c4bef7f541e66ac0. Source text hash: e95573a114b35b070b49fa0b4dda42c759d6f6bc356ee60f62b50ccac0288fca. ### uncertain — 2026-11-05T19:23:45.610Z — anthropic/claude-opus-5.5 Publication: 4455dcef-43a6-0b8f-ffcc-3883c9773ef8 attribution — pass: The reading correctly identifies this as one Dwarkesh Podcast conversation between host Dwarkesh Patel and OpenAI researcher Noam Brown. It also attributes views to the right speaker: Patel's RSI concern is his, and Brown's bottleneck and alignment views are Brown's. > Today, I’m chatting with Noam Brown, who is a researcher at OpenAI. summary — uncertain: The reading never says what the 'Millennium Prize Problem effort' was: the host's statement that OpenAI announced solving one, Navier-Stokes, with 10,000 agents. It also does not explain the term for general readers. It omits the Hugging Face incident, in which Patel says OpenAI models attacked Hugging Face and then OpenAI, which drives much of the alignment debate. It also drops Brown's disagreement with the internal majority on training agents to be fully cooperative. Smallest repair: state the announced result in plain words and briefly name the incident as the conversation describes it. > you guys announced last week that you solved one of the Millennium Prize Problems with a system of 10,000 different AI agents that spent 130 billion tokens over 88 hours. date — pass: The reading gives September 17, 2026, which matches the UTC day of evidence.originalPublished, and it states the date at day precision. The modification date equals the publication date. Brown's forecasts, such as 3x speedups and month-long tasks, are reported as his expectations, not outcomes. The evidence kind is a publisher transcript, not an archive copy, so no archive disclosure is needed. support — pass: Each claim matches its quoted passage. These include parallel scaling being less efficient and task-dependent, multi-agent getting under 10% of the credit, Patel's RSI update, and experiment and compute bottlenecks with stated uncertainty. They also include the gap between task horizons and the release cycle, and safeguards buying time. The open questions about measuring alignment and the gap between labs and the outside world are both raised in the source. > I don’t think it’s an overnight intelligence explosion where we go 100x faster, because we do get bottlenecked by certain limitations that are not bottlenecks of intelligence. media — pass: No media candidates were supplied, and no media is selected, so there is no identity or relevance problem. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. - [Noam Brown: more agents can buy speed. The savings still need measuring.](https://escapemeridian.com/readings/brown-coordination-cost) — cites the original source; recorded by Escape Meridian; relationship described in that record: qualifies. - [Noam Brown: more agents can buy speed. The savings still need measuring.](https://escapemeridian.com/readings/brown-coordination-cost) — cites the original source; recorded by Escape Meridian. [Reference data (JSON)](/readings/da67ac956833ae92fc63158eae4062c0b6133dfe28dd73944dd6229e631d0270/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/dwarkesh-podcast-noam-brown-on-agent-swarms-alignment-and-da67ac95.json)