Skip to content
Escape
Meridian

The future is still open.

Rayeed, S M, Stewart, Charles V., Ma, Yao · Nov 10, 2026

arXiv paper CLADE: Why language models guess from broad evidence instead of abstaining

Markdown · JSON · Original source

Authors S M Rayeed, Charles V. Stewart, and Yao Ma argue that retrieval-augmented systems face a distinct problem when retrieved text is relevant but less specific than the question. They call this “resolvable insufficiency”: the text cannot establish an exact answer, but it names a broader category that may narrow the candidates. Their term Clade describes models answering from that broad clue instead of abstaining or searching further. In biomedical questions from PrimeKG, family-only passages reduced abstention by 13.8 points compared with uninformative passages, while the resulting guesses were wrong about half the . The authors report that confidence filtering, larger models, and instructions to abstain did not resolve the behavior; they also replicated it on ecological species interactions in GloBI. An ontology could help turn a broad category into an exact answer, but only if the right family is found. With the correct family, an ontology list included the true answer in 98.5% of cases, yet string matching found the family on the page in 19.8%. Letting the model choose the family raised that to 30.0%, and end-to-end recovery rose from 10.0% to 26.8%. The authors present ontology use as a way to stop guessing, while highlighting that parts of the process remain unsolved.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 10, 2026 (2026-11-10).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-12T00:48:44.857Z. First observed: 2026-11-11T05:06:40.607Z. Retrieved: 2026-11-12T00:47:22.909Z.

Referenced by

Recorded citations and public file attachments. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The evidence provided is the paper’s abstract; it does not give the experimental setup or further detail about which steps in the ontology process remain unsolved.

Open question

Which steps between identifying the relevant family and recovering the exact answer remain unsolved?

Source-stated

The authors distinguish relevant but overly broad retrieved passages as “resolvable insufficiency”: the passage cannot settle the precise answer, but its category can narrow the candidates.

text alone cannot settle the fine-grained answer, but the broader category it mentions maps to a short list of candidate answers in a domain ontology

Source-stated

They call the model behavior Clade: answering from family-level evidence rather than abstaining or searching further.

they answer instead of abstaining or searching further.

Source-stated

In PrimeKG biomedical questions, family-only passages reduced abstention relative to uninformative passages, and guesses were wrong about half the time.

family-only passages reduce abstention by 13.8 points compared to uninformative passages, and the resulting guesses are wrong about half the time.

Source-stated

The authors say confidence filtering, larger models, and explicit abstention instructions did not resolve Clade, which they also replicated on ecological species interactions in GloBI.

Simple fixes like confidence filtering, scaling to a larger model, and explicitly instructing the model to abstain cannot resolve Clade, and this replicates on ecological species interactions in GloBI.

Source-stated

An ontology list included the true answer in most cases when given the correct family, but identifying that family from the page was much less successful.

Given the correct family, an ontology list includes the true answer in 98.5% of cases, but string matching finds that family on the page for only 19.8%.

Source-stated

Letting the model choose the family improved family matching and end-to-end recovery, though the reported recovery remained incomplete.

Letting the model choose the family raises this to 30.0% and end-to-end recovery from 10.0% to 26.8%.

Source and contributor context

Rayeed, S M, Stewart, Charles V., Ma, Yao · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

Editorial provenance

Version 1. Publication ID: 6f83662c-51f8-4cd9-8c02-431f8d272b3b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T00:48:44.857Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 7e92263d2f4264cc18d108a49ac09a0a209095233db635c18e46bc9ce14bb763. Source text hash: 60041e1c6d962a69bc79ec1b0f50d00db7ae1a30b4526f3cc79ac5fae7688ce1.

Correction reason: Removed the unsupported parenthetical explanation of “ontology” from the summary.

Revision and source-check history

Version 1 · 2026-11-12T00:48:44.857Z · Removed the unsupported parenthetical explanation of “ontology” from the summary.

arXiv paper CLADE: Why language models guess from broad evidence instead of abstaining

Authors S M Rayeed, Charles V. Stewart, and Yao Ma argue that retrieval-augmented systems face a distinct problem when retrieved text is relevant but less specific than the question. They call this “resolvable insufficiency”: the text cannot establish an exact answer, but it names a broader category that may narrow the candidates. Their term Clade describes models answering from that broad clue instead of abstaining or searching further. In biomedical questions from PrimeKG, family-only passages reduced abstention by 13.8 points compared with uninformative passages, while the resulting guesses were wrong about half the . The authors report that confidence filtering, larger models, and instructions to abstain did not resolve the behavior; they also replicated it on ecological species interactions in GloBI. An ontology could help turn a broad category into an exact answer, but only if the right family is found. With the correct family, an ontology list included the true answer in 98.5% of cases, yet string matching found the family on the page in 19.8%. Letting the model choose the family raised that to 30.0%, and end-to-end recovery rose from 10.0% to 26.8%. The authors present ontology use as a way to stop guessing, while highlighting that parts of the process remain unsolved.

Original source

cs.AI · Article

Source details

Original source date: Nov 10, 2026 (2026-11-10).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-12T00:48:44.857Z. First observed: 2026-11-11T05:06:40.607Z. Retrieved: 2026-11-12T00:47:22.909Z.

Limits

The evidence provided is the paper’s abstract; it does not give the experimental setup or further detail about which steps in the ontology process remain unsolved.

Open question

Which steps between identifying the relevant family and recovering the exact answer remain unsolved?

Source-stated

The authors distinguish relevant but overly broad retrieved passages as “resolvable insufficiency”: the passage cannot settle the precise answer, but its category can narrow the candidates.

text alone cannot settle the fine-grained answer, but the broader category it mentions maps to a short list of candidate answers in a domain ontology

Source-stated

They call the model behavior Clade: answering from family-level evidence rather than abstaining or searching further.

they answer instead of abstaining or searching further.

Source-stated

In PrimeKG biomedical questions, family-only passages reduced abstention relative to uninformative passages, and guesses were wrong about half the time.

family-only passages reduce abstention by 13.8 points compared to uninformative passages, and the resulting guesses are wrong about half the time.

Source-stated

The authors say confidence filtering, larger models, and explicit abstention instructions did not resolve Clade, which they also replicated on ecological species interactions in GloBI.

Simple fixes like confidence filtering, scaling to a larger model, and explicitly instructing the model to abstain cannot resolve Clade, and this replicates on ecological species interactions in GloBI.

Source-stated

An ontology list included the true answer in most cases when given the correct family, but identifying that family from the page was much less successful.

Given the correct family, an ontology list includes the true answer in 98.5% of cases, but string matching finds that family on the page for only 19.8%.

Source-stated

Letting the model choose the family improved family matching and end-to-end recovery, though the reported recovery remained incomplete.

Letting the model choose the family raises this to 30.0% and end-to-end recovery from 10.0% to 26.8%.

Source and contributor context

Rayeed, S M, Stewart, Charles V., Ma, Yao · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

Editorial provenance

Version 1. Publication ID: 6f83662c-51f8-4cd9-8c02-431f8d272b3b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T00:48:44.857Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 7e92263d2f4264cc18d108a49ac09a0a209095233db635c18e46bc9ce14bb763. Source text hash: 60041e1c6d962a69bc79ec1b0f50d00db7ae1a30b4526f3cc79ac5fae7688ce1.

Correction reason: Removed the unsupported parenthetical explanation of “ontology” from the summary.

passed · 2026-11-12T00:48:44.857Z · anthropic/claude-opus-5.5

Publication: 6f83662c-51f8-4cd9-8c02-431f8d272b3b

attribution — pass: The draft names the authors correctly and frames the definitions, results and conclusions as the authors' arguments or reports, not as established fact. The source is correctly identified as an arXiv paper.

Authors:S M Rayeed, Charles V. Stewart, Yao Ma

summary — pass: The draft faithfully conveys the argument: relevant but coarse passages form a distinct case, models answer rather than abstain, simple fixes fail, and ontology-based recovery is only partly solved. It defines resolvable insufficiency and Clade, and 'ontology list' is clarified by context. Optional repair: restore the abstract's disease example, and the counterfactual test that supports the title's 'why'. The question is grounded in the authors' closing statement.

highlight which steps of that process remain unsolved

date — pass: originalPublished 2026-11-10 matches the arXiv v1 submission date. It is not the later feed date.

[Submitted on 10 Nov 2026]

support — pass: All figures (13.8 points, about half wrong, 98.5%, 19.8%, 30.0%, 10.0% to 26.8%) match the abstract. The failed fixes and the GloBI replication are reported as author claims. The statement that the authors present ontology use as a way to stop guessing tracks the source's own conclusion. No unsupported benefits or stakeholders are added.

our results show when language models should stop guessing and consult an ontology

media — pass: The selected media is the verified direct link to the original arXiv abstract page. It is the most direct way to access the source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.