Amayuelas, Alfonso, Piękos, Piotr, Wang, Xin Eric, Wang, William Yang, Schmidhuber, Jürgen, Pentland, Alex · Nov 7, 2026
arXiv cs.AI: Sampling Is Not Curiosity: Why LLM Agents Should Investigate
Markdown · JSON · Original source
The authors of “Sampling Is Not Curiosity: Why Agents Should Investigate” argue that current LLM agents explore stochastically, not curiously. At inference , they say, an LLM’s weights fix its mapping from context to next-token distribution. Temperature, best-of-N, tree search and alter sampling or conditioning, but do not update the agent’s model of the environment. The authors reserve “curiosity” for systems with a predictive structure that improves through interaction, guides actions through predicted improvement, and persists beyond the . In open-ended settings, the agent should also originate what to investigate. The paper proposes a framework for defining curiosity; the abstract does not report a built or tested implementation. Escape Meridian interpretation: the distinction is between varying how an agent generates or conditions responses and improving its model through the environment’s responses to its actions. The authors say their framework opens research directions, but the abstract does not detail implementation or evaluation methods. The paper is identified as a position paper accepted to NeurIPS 2026.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 7, 2026 (2026-11-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T16:50:09.242Z. First observed: 2026-11-10T08:40:01.003Z. Retrieved: 2026-11-10T16:48:58.014Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the publisher page and abstract; it does not provide the paper’s detailed framework, research directions, or evaluation methods. The source describes criteria for curiosity but the abstract does not identify an implementation that meets them.
Open question
What predictive structures and action-selection methods would meet the authors’ criteria, including persistence beyond the and intrinsically originating investigations?
Source-stated
The authors argue that current LLM agents vary sampling or conditioning but do not update their model of the environment at inference time.
Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent's model of the environment.
Source-stated
The authors define curiosity in terms of a predictive structure that improves through interaction, guides action selection, and persists beyond the context window.
it requires a predictive structure over how the environment responds to the agent's actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window.
Source-stated
For open-ended curiosity, the authors say an agent should originate what to investigate.
Additionally, in its open-ended form, the agent should intrinsically originate what to investigate.
Source-stated
The authors propose a framework that reserves “curiosity” for systems meeting their criteria and say it opens research directions.
we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up.
Escape Meridian interpretation
The abstract presents a framework and research directions, not a report of a built or tested implementation.
we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it.
Source and contributor context
Amayuelas, Alfonso, Piękos, Piotr, Wang, Xin Eric, Wang, William Yang, Schmidhuber, Jürgen, Pentland, Alex · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Retrieval-augmented generation
A setup in which a model first looks up relevant documents and then answers using them.
Context window
How much text a model can take in and consider at one time.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
TIME
TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.
Editorial provenance
Version 1. Publication ID: 7b4858f5-5533-4b1d-8162-b53bdc6176af.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T16:50:09.242Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: cd9e397839d23d3f286ba5d0977ca96879221311632457d9d911a1662e13b153. Source text hash: 19d7257e246bc65f94b234295feaab1f823abd0fad516979029baedbeffc00ef.
Revision and source-check history
Version 1 · 2026-11-10T16:50:09.242Z
arXiv cs.AI: Sampling Is Not Curiosity: Why LLM Agents Should Investigate
The authors of “Sampling Is Not Curiosity: Why Agents Should Investigate” argue that current LLM agents explore stochastically, not curiously. At inference , they say, an LLM’s weights fix its mapping from context to next-token distribution. Temperature, best-of-N, tree search and alter sampling or conditioning, but do not update the agent’s model of the environment. The authors reserve “curiosity” for systems with a predictive structure that improves through interaction, guides actions through predicted improvement, and persists beyond the . In open-ended settings, the agent should also originate what to investigate. The paper proposes a framework for defining curiosity; the abstract does not report a built or tested implementation. Escape Meridian interpretation: the distinction is between varying how an agent generates or conditions responses and improving its model through the environment’s responses to its actions. The authors say their framework opens research directions, but the abstract does not detail implementation or evaluation methods. The paper is identified as a position paper accepted to NeurIPS 2026.
Original source
cs.AI · Article
Source details
Original source date: Nov 7, 2026 (2026-11-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T16:50:09.242Z. First observed: 2026-11-10T08:40:01.003Z. Retrieved: 2026-11-10T16:48:58.014Z.
Limits
The supplied evidence is the publisher page and abstract; it does not provide the paper’s detailed framework, research directions, or evaluation methods. The source describes criteria for curiosity but the abstract does not identify an implementation that meets them.
Open question
What predictive structures and action-selection methods would meet the authors’ criteria, including persistence beyond the and intrinsically originating investigations?
Source-stated
The authors argue that current LLM agents vary sampling or conditioning but do not update their model of the environment at inference time.
Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent's model of the environment.
Source-stated
The authors define curiosity in terms of a predictive structure that improves through interaction, guides action selection, and persists beyond the context window.
it requires a predictive structure over how the environment responds to the agent's actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window.
Source-stated
For open-ended curiosity, the authors say an agent should originate what to investigate.
Additionally, in its open-ended form, the agent should intrinsically originate what to investigate.
Source-stated
The authors propose a framework that reserves “curiosity” for systems meeting their criteria and say it opens research directions.
we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up.
Escape Meridian interpretation
The abstract presents a framework and research directions, not a report of a built or tested implementation.
we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it.
Source and contributor context
Amayuelas, Alfonso, Piękos, Piotr, Wang, Xin Eric, Wang, William Yang, Schmidhuber, Jürgen, Pentland, Alex · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Retrieval-augmented generation
A setup in which a model first looks up relevant documents and then answers using them.
Context window
How much text a model can take in and consider at one time.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
TIME
TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.
Editorial provenance
Version 1. Publication ID: 7b4858f5-5533-4b1d-8162-b53bdc6176af.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-10T16:50:09.242Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: cd9e397839d23d3f286ba5d0977ca96879221311632457d9d911a1662e13b153. Source text hash: 19d7257e246bc65f94b234295feaab1f823abd0fad516979029baedbeffc00ef.
passed · 2026-11-10T16:50:09.242Z · anthropic/claude-opus-5.5
Publication: 7b4858f5-5533-4b1d-8162-b53bdc6176af
attribution — pass: The argument is consistently credited to the paper's authors, as listed on the arXiv page. Interpretive framing is explicitly labeled as Escape Meridian interpretation. The NeurIPS acceptance is correctly framed as how the paper is identified, not as an independent fact.
Authors:Alfonso Amayuelas, Piotr Piękos, Xin Eric Wang, William Yang Wang, Jürgen Schmidhuber, Alex Pentland
summary — pass: The reading leads with the thesis, keeps the sharp contrast between stochastic and curious exploration, and covers each criterion and the open-ended condition. It also notes the paper is a position paper with no reported implementation. The EM interpretation line gives lay readers a plain-language version of the core distinction. Technical terms are kept exactly (temperature, best-of-N, RAG, context window), suitable for tooltips. Two small omissions do not distort meaning: the RL-literature grounding, and the word 'online'. The question follows directly from the evidence.
We argue that current LLM agents do not explore curiously; they explore stochastically.
date — pass: The original publication date of 2026-11-07 matches the arXiv v1 submission date. The later feed date of 2026-11-10 was correctly not used.
[Submitted on 7 Nov 2026]
support — pass: Each claim matches the abstract's wording. The claim that no implementation is reported is properly labeled as interpretation and stays within what the abstract shows. The reading does not overstate benefits, and it states the gaps in evaluation and detail. The NeurIPS position-track acceptance appears on the page.
Accepted to the 40th Conference on Neural Information Processing Systems (NeurIPS 2026). Position Paper Track
media — pass: The selected media is the verified direct link to the arXiv abstract page for this paper. That is the most direct way for readers to access the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A language model with many learned numerical settings, used to process and generate language.
Definition referenceTIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.
Explore TIMEA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceA setup in which a model first looks up relevant documents and then answers using them.
Definition referenceHow much text a model can take in and consider at one time.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivHow much text a model can take in and consider at one time.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referenceTIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.
Explore TIMEA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceA setup in which a model first looks up relevant documents and then answers using them.
Definition referenceHow much text a model can take in and consider at one time.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivHow much text a model can take in and consider at one time.
Definition reference