Skip to content
Escape
Meridian

The future is still open.

Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Aug 7, 2026

arXiv: Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods

Markdown · JSON · Original source

Authors Ieuan Higgs, Todd Jones, Kieran Hunt and Anna-Louise Ellis argue that explanations of AI predictions in geoscience need to be judged against physics where a suitable reference exists. They build references for sensitivity and attribution methods from the governing equations of the Lorenz-63 system, then compare them with an AI emulator. Their results show that different method families answer distinct questions rather than approximating one true explanation. They also report that the emulator’s explanations can depart most from the physical references where its forecasts are best: predictive skill alone does not show that a model learned physically realistic relationships. The authors review applications to Earth system regression, where no physical reference may exist and explanations can be complicated by computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement. They add that a mathematically valid method may be only partly relevant to a stakeholder group. The paper closes with future directions and practical recommendations for responsible use, while noting that an idealised system cannot address all these practical issues.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv physics.ao-phArticle · arxiv.orgOpen original source

Original source

physics.ao-ph · Article

Source details

Original source date: Aug 7, 2026 (2026-08-07).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-10T07:54:44.337Z. First observed: 2026-11-03T08:51:15.841Z. Retrieved: 2026-11-03T17:35:11.167Z.

Referenced by

Recorded citations and public file attachments. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The authors state that an idealised system cannot address computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement where no physical reference exists. The source describes a review and practical recommendations, but the abstract does not detail the recommendations or establish how they perform in operational geoscientific modelling.

Open question

How well do the authors’ physical references for sensitivity and attribution methods carry over to Earth system regression cases without a known physical reference?

Source-stated

The authors construct references for sensitivity and attribution methods using the governing equations of a dynamical system with known physics.

matched references can be built directly from the physics. We extend established sensitivity methods to provide physical references for both sensitivity and attribution

Source-stated

In the Lorenz-63 emulator, different XAI method families answer distinct questions rather than approximating one true explanation.

these references show that method families answer distinct questions rather than approximating one ``true'' explanation.

Source-stated

The authors report that the emulator’s sensitivities and attributions can depart most from physical references where its forecasts are best, so predictive skill alone does not establish physical realism.

The emulator's sensitivities and attributions can depart most from their physical references where it forecasts best, so predictive skill is not a substitute for the physical realism of what a model has learned.

Source-stated

The review identifies computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement as issues that an idealised system cannot address.

extending to issues an idealised system cannot address: computational scalability, strongly correlated high-dimensional predictors, and reliance on expert judgement

Source-stated

The authors caution that mathematical validity does not ensure an XAI method is fully relevant to a stakeholder group.

an XAI method can be mathematically valid yet only partially relevant to a given stakeholder group.

Source and contributor context

Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

xAI

xAI develops the Grok family of AI models and publishes its own release claims and evaluations.

Editorial provenance

Version 1. Publication ID: 6beddb1f-fd47-4bda-8806-6e48c360148e.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T07:54:44.337Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: useful_perspective.

Observation: 530716fae9c6723c92c32f39c247bc44095a423f4fd063aa994849ca129fde93. Source text hash: 377d7f6948c45908c538ba0451f02d1bc59955e7b044b23c20673af525cc9f63.

Revision and source-check history

Version 1 · 2026-11-10T07:54:44.337Z

arXiv: Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods

Authors Ieuan Higgs, Todd Jones, Kieran Hunt and Anna-Louise Ellis argue that explanations of AI predictions in geoscience need to be judged against physics where a suitable reference exists. They build references for sensitivity and attribution methods from the governing equations of the Lorenz-63 system, then compare them with an AI emulator. Their results show that different method families answer distinct questions rather than approximating one true explanation. They also report that the emulator’s explanations can depart most from the physical references where its forecasts are best: predictive skill alone does not show that a model learned physically realistic relationships. The authors review applications to Earth system regression, where no physical reference may exist and explanations can be complicated by computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement. They add that a mathematically valid method may be only partly relevant to a stakeholder group. The paper closes with future directions and practical recommendations for responsible use, while noting that an idealised system cannot address all these practical issues.

Original source

physics.ao-ph · Article

Source details

Original source date: Aug 7, 2026 (2026-08-07).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-10T07:54:44.337Z. First observed: 2026-11-03T08:51:15.841Z. Retrieved: 2026-11-03T17:35:11.167Z.

Limits

The authors state that an idealised system cannot address computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement where no physical reference exists. The source describes a review and practical recommendations, but the abstract does not detail the recommendations or establish how they perform in operational geoscientific modelling.

Open question

How well do the authors’ physical references for sensitivity and attribution methods carry over to Earth system regression cases without a known physical reference?

Source-stated

The authors construct references for sensitivity and attribution methods using the governing equations of a dynamical system with known physics.

matched references can be built directly from the physics. We extend established sensitivity methods to provide physical references for both sensitivity and attribution

Source-stated

In the Lorenz-63 emulator, different XAI method families answer distinct questions rather than approximating one true explanation.

these references show that method families answer distinct questions rather than approximating one ``true'' explanation.

Source-stated

The authors report that the emulator’s sensitivities and attributions can depart most from physical references where its forecasts are best, so predictive skill alone does not establish physical realism.

The emulator's sensitivities and attributions can depart most from their physical references where it forecasts best, so predictive skill is not a substitute for the physical realism of what a model has learned.

Source-stated

The review identifies computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement as issues that an idealised system cannot address.

extending to issues an idealised system cannot address: computational scalability, strongly correlated high-dimensional predictors, and reliance on expert judgement

Source-stated

The authors caution that mathematical validity does not ensure an XAI method is fully relevant to a stakeholder group.

an XAI method can be mathematically valid yet only partially relevant to a given stakeholder group.

Source and contributor context

Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

xAI

xAI develops the Grok family of AI models and publishes its own release claims and evaluations.

Editorial provenance

Version 1. Publication ID: 6beddb1f-fd47-4bda-8806-6e48c360148e.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T07:54:44.337Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: useful_perspective.

Observation: 530716fae9c6723c92c32f39c247bc44095a423f4fd063aa994849ca129fde93. Source text hash: 377d7f6948c45908c538ba0451f02d1bc59955e7b044b23c20673af525cc9f63.

uncertain · 2026-11-10T07:54:44.337Z · anthropic/claude-opus-5.5

Publication: 6beddb1f-fd47-4bda-8806-6e48c360148e

attribution — pass: The draft correctly credits the four listed authors and presents the findings and recommendations as their reported results and arguments, not as established fact.

Authors:Ieuan Higgs, Todd Jones, Kieran Hunt, Anna-Louise Ellis

summary — uncertain: The reading is faithful, but central terms go unexplained for a non-specialist. 'XAI' is never expanded in the summary. Lorenz-63 is not described as a simple, idealised chaotic system with known equations. 'Sensitivity', 'attribution', 'regression' and 'AI emulator' are also undefined. Without these, readers cannot see why a toy system gives a physics answer key. Smallest repair: expand XAI and add one plain clause each on Lorenz-63 and on emulator, sensitivity and attribution, or provide term-library tooltips. The title and question are otherwise apt.

Applied to an AI emulator of the Lorenz-63 system, these references show that method families answer distinct questions

date — pass: originalPublished is 2026-08-07, which matches the v1 submission date. It is not the 30 Oct revision or the November feed date.

[Submitted on 7 Aug 2026 (v1), last revised 30 Oct 2026 (this version, v2)]

support — pass: Every claim has a verbatim excerpt and stays within the abstract's scope, including the conditional 'can depart most'. The limitations correctly note that the abstract does not detail the recommendations. The question follows from the stated gap where no physical reference exists. No benefits or costs are invented.

so predictive skill is not a substitute for the physical realism of what a model has learned

media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct way to reach the source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.