# arXiv cs.AI: Sampling Is Not Curiosity: Why LLM Agents Should Investigate [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-sampling-is-not-curiosity-why-llm-agents-should-e14cb39c) The authors of “Sampling Is Not Curiosity: Why LLM Agents Should Investigate” argue that current LLM agents explore stochastically, not curiously. At inference time, they say, an LLM’s pretrained weights fix its mapping from context to next-token distribution. Temperature, best-of-N, tree search and RAG alter sampling or conditioning, but do not update the agent’s model of the environment. The authors reserve “curiosity” for systems with a predictive structure that improves through interaction, guides actions through predicted improvement, and persists beyond the context window. In open-ended settings, the agent should also originate what to investigate. The paper proposes a framework for defining curiosity; the abstract does not report a built or tested implementation. Escape Meridian interpretation: the distinction is between varying how an agent generates or conditions responses and improving its model through the environment’s responses to its actions. The authors say their framework opens research directions, but the abstract does not detail implementation or evaluation methods. The paper is identified as a position paper accepted to NeurIPS 2026. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 7, 2026 (2026-11-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T16:50:09.242Z. First observed: 2026-11-10T08:40:01.003Z. Retrieved: 2026-11-10T16:48:58.014Z. - [Sampling Is Not Curiosity: Why LLM Agents Should Investigate](https://arxiv.org/abs/2611.10501) ## Limits The supplied evidence is the publisher page and abstract; it does not provide the paper’s detailed framework, research directions, or evaluation methods. The source describes criteria for curiosity but the abstract does not identify an implementation that meets them. ## Open question What predictive structures and action-selection methods would meet the authors’ criteria, including persistence beyond the context window and intrinsically originating investigations? ## Source-stated The authors argue that current LLM agents vary sampling or conditioning but do not update their model of the environment at inference time. > Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent's model of the environment. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated The authors define curiosity in terms of a predictive structure that improves through interaction, guides action selection, and persists beyond the context window. > it requires a predictive structure over how the environment responds to the agent's actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated For open-ended curiosity, the authors say an agent should originate what to investigate. > Additionally, in its open-ended form, the agent should intrinsically originate what to investigate. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated The authors propose a framework that reserves “curiosity” for systems meeting their criteria and say it opens research directions. > we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Escape Meridian interpretation The abstract presents a framework and research directions, not a report of a built or tested implementation. > we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source and contributor context Amayuelas, Alfonso, Piękos, Piotr, Wang, Xin Eric, Wang, William Yang, Schmidhuber, Jürgen, Pentland, Alex · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Retrieval-augmented generation A setup in which a model first looks up relevant documents and then answers using them. - [Definition reference](https://developers.google.com/machine-learning/glossary#retrieval-augmented-generation-rag) ## Context window How much text a model can take in and consider at one time. - [Definition reference](https://developers.google.com/machine-learning/glossary#context-window) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: 7b4858f5-5533-4b1d-8162-b53bdc6176af. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T16:50:09.242Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: cd9e397839d23d3f286ba5d0977ca96879221311632457d9d911a1662e13b153. Source text hash: 19d7257e246bc65f94b234295feaab1f823abd0fad516979029baedbeffc00ef. ## Revision and source-check history ### Version 1 — 2026-11-10T16:50:09.242Z The authors of “Sampling Is Not Curiosity: Why LLM Agents Should Investigate” argue that current LLM agents explore stochastically, not curiously. At inference time, they say, an LLM’s pretrained weights fix its mapping from context to next-token distribution. Temperature, best-of-N, tree search and RAG alter sampling or conditioning, but do not update the agent’s model of the environment. The authors reserve “curiosity” for systems with a predictive structure that improves through interaction, guides actions through predicted improvement, and persists beyond the context window. In open-ended settings, the agent should also originate what to investigate. The paper proposes a framework for defining curiosity; the abstract does not report a built or tested implementation. Escape Meridian interpretation: the distinction is between varying how an agent generates or conditions responses and improving its model through the environment’s responses to its actions. The authors say their framework opens research directions, but the abstract does not detail implementation or evaluation methods. The paper is identified as a position paper accepted to NeurIPS 2026. ## Original source arXiv cs.AI · Article Original source date: Nov 7, 2026 (2026-11-07). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T16:50:09.242Z. First observed: 2026-11-10T08:40:01.003Z. Retrieved: 2026-11-10T16:48:58.014Z. - [Sampling Is Not Curiosity: Why LLM Agents Should Investigate](https://arxiv.org/abs/2611.10501) ## Limits The supplied evidence is the publisher page and abstract; it does not provide the paper’s detailed framework, research directions, or evaluation methods. The source describes criteria for curiosity but the abstract does not identify an implementation that meets them. ## Open question What predictive structures and action-selection methods would meet the authors’ criteria, including persistence beyond the context window and intrinsically originating investigations? ## Source-stated The authors argue that current LLM agents vary sampling or conditioning but do not update their model of the environment at inference time. > Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent's model of the environment. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated The authors define curiosity in terms of a predictive structure that improves through interaction, guides action selection, and persists beyond the context window. > it requires a predictive structure over how the environment responds to the agent's actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated For open-ended curiosity, the authors say an agent should originate what to investigate. > Additionally, in its open-ended form, the agent should intrinsically originate what to investigate. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source-stated The authors propose a framework that reserves “curiosity” for systems meeting their criteria and say it opens research directions. > we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Escape Meridian interpretation The abstract presents a framework and research directions, not a report of a built or tested implementation. > we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. - [Supporting source](https://arxiv.org/abs/2611.10501) ## Source and contributor context Amayuelas, Alfonso, Piękos, Piotr, Wang, Xin Eric, Wang, William Yang, Schmidhuber, Jürgen, Pentland, Alex · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## Pre-training A model's initial training on a large dataset, before further adaptation for particular uses. - [Definition reference](https://developers.google.com/machine-learning/glossary#pre-training) ## Retrieval-augmented generation A setup in which a model first looks up relevant documents and then answers using them. - [Definition reference](https://developers.google.com/machine-learning/glossary#retrieval-augmented-generation-rag) ## Context window How much text a model can take in and consider at one time. - [Definition reference](https://developers.google.com/machine-learning/glossary#context-window) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## TIME TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services. - [Explore this context](/entities/time) - [Reference](https://time.com/) ## Editorial provenance Version 1. Publication ID: 7b4858f5-5533-4b1d-8162-b53bdc6176af. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T16:50:09.242Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: cd9e397839d23d3f286ba5d0977ca96879221311632457d9d911a1662e13b153. Source text hash: 19d7257e246bc65f94b234295feaab1f823abd0fad516979029baedbeffc00ef. ### passed — 2026-11-10T16:50:09.242Z — anthropic/claude-opus-5.5 Publication: 7b4858f5-5533-4b1d-8162-b53bdc6176af attribution — pass: The argument is consistently credited to the paper's authors, as listed on the arXiv page. Interpretive framing is explicitly labeled as Escape Meridian interpretation. The NeurIPS acceptance is correctly framed as how the paper is identified, not as an independent fact. > Authors:Alfonso Amayuelas, Piotr Piękos, Xin Eric Wang, William Yang Wang, Jürgen Schmidhuber, Alex Pentland summary — pass: The reading leads with the thesis, keeps the sharp contrast between stochastic and curious exploration, and covers each criterion and the open-ended condition. It also notes the paper is a position paper with no reported implementation. The EM interpretation line gives lay readers a plain-language version of the core distinction. Technical terms are kept exactly (temperature, best-of-N, RAG, context window), suitable for tooltips. Two small omissions do not distort meaning: the RL-literature grounding, and the word 'online'. The question follows directly from the evidence. > We argue that current LLM agents do not explore curiously; they explore stochastically. date — pass: The original publication date of 2026-11-07 matches the arXiv v1 submission date. The later feed date of 2026-11-10 was correctly not used. > \[Submitted on 7 Nov 2026\] support — pass: Each claim matches the abstract's wording. The claim that no implementation is reported is properly labeled as interpretation and stays within what the abstract shows. The reading does not overstate benefits, and it states the gaps in evaluation and detail. The NeurIPS position-track acceptance appears on the page. > Accepted to the 40th Conference on Neural Information Processing Systems (NeurIPS 2026). Position Paper Track media — pass: The selected media is the verified direct link to the arXiv abstract page for this paper. That is the most direct way for readers to access the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/e14cb39c8b2409fc8d368e58bc7ea3ec2db27545b325f71f2751f43cbe0f6d49/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-sampling-is-not-curiosity-why-llm-agents-should-e14cb39c.json)