MIT Technology Review on what may come after today’s LLMs

MIT Technology Review on what may come after today’s LLMs

MIT Technology Review published this piece on April 21, 2026. It argues that the next step after today’s large language models (LLMs) may be “LLMs+”: systems better able to handle complex, multi-part problems over longer periods. The piece says that reaching this goal depends partly on making LLMs more efficient and cheaper to run. It describes several approaches, including mixture-of-experts, which activates only some parts of a model for a task, and diffusion models as an alternative to the neural networks underpinning almost all LLMs today. It also points to DeepSeek’s approach of encoding text in images to cut computation costs. The piece identifies the context window—the amount of text or video a model can take in at once—as another area of progress. But it warns that larger context windows and longer tasks can make models go off track or forget what they were doing. It describes recursive LLMs from a paper by researchers at MIT CSAIL: they divide input into chunks and pass those chunks among copies of the model for further processing. The piece says these systems “seem to be far more reliable for long, hard tasks.” Its closing idea is that what comes next is still LLMs, but in a different form; how much recursive LLMs improve performance on such tasks remains an open question.

Publication: 8acbcd00-8024-43fa-a76f-6dd64e2b0521

attribution — pass: The reading attributes the argument to MIT Technology Review, which matches the publisher. No author byline appears in the retrieved text. The page is a single article, not a listing. Its claims are kept as the piece's assertions.

Spoiler alert: The next big thing after LLMs is more LLMs. But better. Let’s call them LLMs+.

summary — uncertain: Most of the reading is faithful and understandable. However, the passage 'diffusion models as an alternative to the neural networks underpinning almost all LLMs today' drops the technical term 'transformers' and can be read as saying diffusion models are not neural networks. The source calls diffusion models 'an alternative type of neural network' replacing transformers. Smallest repair: say diffusion models are proposed as an alternative to transformers, the type of neural network underpinning almost all LLMs, and add 'transformer' to the term library.

ditch transformers—the type of neural network underpinning almost all of them today—in favor of diffusion models, an alternative type of neural network

date — pass: The stated date of April 21, 2026 matches the UTC day of originalPublished (2026-04-21T20:45Z). The page was edited on 2026-05-06, but the reading draws only on the core article body. It uses nothing from the later Deep Dive sidebar and makes no hindsight claims. Its limitations give the capture date. Kind is publisher-page, so no archive disclosure is needed.

support — pass: Each claim is directly supported by the core article text, including the hedged 'seem to be far more reliable'. The interpretation claim is labeled as Escape Meridian's and correctly notes that the source gives no quantified result. The page was edited after publication, but the cited passages are plainly part of the main article body rather than later sidebar material.

Multiple LLMs processing smaller pieces of information seem to be far more reliable for long, hard tasks.

media — pass: No media is selected, and no verified media candidates were supplied. Selecting nothing is appropriate.