Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Aug 7, 2026
arXiv: Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods
Markdown · JSON · Original source
Authors Ieuan Higgs, Todd Jones, Kieran Hunt and Anna-Louise Ellis argue that explanations of AI predictions in geoscience need to be judged against physics where a suitable reference exists. They build references for sensitivity and attribution methods from the governing equations of the Lorenz-63 system, then compare them with an AI emulator. Their results show that different method families answer distinct questions rather than approximating one true explanation. They also report that the emulator’s explanations can depart most from the physical references where its forecasts are best: predictive skill alone does not show that a model learned physically realistic relationships. The authors review applications to Earth system regression, where no physical reference may exist and explanations can be complicated by computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement. They add that a mathematically valid method may be only partly relevant to a stakeholder group. The paper closes with future directions and practical recommendations for responsible use, while noting that an idealised system cannot address all these practical issues.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
physics.ao-ph · Article
Source details
Original source date: Aug 7, 2026 (2026-08-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T07:54:44.337Z. First observed: 2026-11-03T08:51:15.841Z. Retrieved: 2026-11-03T17:35:11.167Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The authors state that an idealised system cannot address computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement where no physical reference exists. The source describes a review and practical recommendations, but the abstract does not detail the recommendations or establish how they perform in operational geoscientific modelling.
Open question
How well do the authors’ physical references for sensitivity and attribution methods carry over to Earth system regression cases without a known physical reference?
Source-stated
The authors construct references for sensitivity and attribution methods using the governing equations of a dynamical system with known physics.
matched references can be built directly from the physics. We extend established sensitivity methods to provide physical references for both sensitivity and attribution
Source-stated
In the Lorenz-63 emulator, different XAI method families answer distinct questions rather than approximating one true explanation.
these references show that method families answer distinct questions rather than approximating one ``true'' explanation.
Source-stated
The authors report that the emulator’s sensitivities and attributions can depart most from physical references where its forecasts are best, so predictive skill alone does not establish physical realism.
The emulator's sensitivities and attributions can depart most from their physical references where it forecasts best, so predictive skill is not a substitute for the physical realism of what a model has learned.
Source-stated
The review identifies computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement as issues that an idealised system cannot address.
extending to issues an idealised system cannot address: computational scalability, strongly correlated high-dimensional predictors, and reliance on expert judgement
Source-stated
The authors caution that mathematical validity does not ensure an XAI method is fully relevant to a stakeholder group.
an XAI method can be mathematically valid yet only partially relevant to a given stakeholder group.
Source and contributor context
Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
xAI
xAI develops the Grok family of AI models and publishes its own release claims and evaluations.
Editorial provenance
Version 1. Publication ID: 6beddb1f-fd47-4bda-8806-6e48c360148e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T07:54:44.337Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 530716fae9c6723c92c32f39c247bc44095a423f4fd063aa994849ca129fde93. Source text hash: 377d7f6948c45908c538ba0451f02d1bc59955e7b044b23c20673af525cc9f63.
Revision and source-check history
Version 1 · 2026-11-10T07:54:44.337Z
arXiv: Explainable AI for Geoscientific Regression: Evaluating Sensitivity and Attribution Methods
Authors Ieuan Higgs, Todd Jones, Kieran Hunt and Anna-Louise Ellis argue that explanations of AI predictions in geoscience need to be judged against physics where a suitable reference exists. They build references for sensitivity and attribution methods from the governing equations of the Lorenz-63 system, then compare them with an AI emulator. Their results show that different method families answer distinct questions rather than approximating one true explanation. They also report that the emulator’s explanations can depart most from the physical references where its forecasts are best: predictive skill alone does not show that a model learned physically realistic relationships. The authors review applications to Earth system regression, where no physical reference may exist and explanations can be complicated by computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement. They add that a mathematically valid method may be only partly relevant to a stakeholder group. The paper closes with future directions and practical recommendations for responsible use, while noting that an idealised system cannot address all these practical issues.
Original source
physics.ao-ph · Article
Source details
Original source date: Aug 7, 2026 (2026-08-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T07:54:44.337Z. First observed: 2026-11-03T08:51:15.841Z. Retrieved: 2026-11-03T17:35:11.167Z.
Limits
The authors state that an idealised system cannot address computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement where no physical reference exists. The source describes a review and practical recommendations, but the abstract does not detail the recommendations or establish how they perform in operational geoscientific modelling.
Open question
How well do the authors’ physical references for sensitivity and attribution methods carry over to Earth system regression cases without a known physical reference?
Source-stated
The authors construct references for sensitivity and attribution methods using the governing equations of a dynamical system with known physics.
matched references can be built directly from the physics. We extend established sensitivity methods to provide physical references for both sensitivity and attribution
Source-stated
In the Lorenz-63 emulator, different XAI method families answer distinct questions rather than approximating one true explanation.
these references show that method families answer distinct questions rather than approximating one ``true'' explanation.
Source-stated
The authors report that the emulator’s sensitivities and attributions can depart most from physical references where its forecasts are best, so predictive skill alone does not establish physical realism.
The emulator's sensitivities and attributions can depart most from their physical references where it forecasts best, so predictive skill is not a substitute for the physical realism of what a model has learned.
Source-stated
The review identifies computational scalability, strongly correlated high-dimensional predictors and reliance on expert judgement as issues that an idealised system cannot address.
extending to issues an idealised system cannot address: computational scalability, strongly correlated high-dimensional predictors, and reliance on expert judgement
Source-stated
The authors caution that mathematical validity does not ensure an XAI method is fully relevant to a stakeholder group.
an XAI method can be mathematically valid yet only partially relevant to a given stakeholder group.
Source and contributor context
Higgs, Ieuan, Jones, Todd, Hunt, Kieran, Ellis, Anna-Louise · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
xAI
xAI develops the Grok family of AI models and publishes its own release claims and evaluations.
Editorial provenance
Version 1. Publication ID: 6beddb1f-fd47-4bda-8806-6e48c360148e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T07:54:44.337Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 530716fae9c6723c92c32f39c247bc44095a423f4fd063aa994849ca129fde93. Source text hash: 377d7f6948c45908c538ba0451f02d1bc59955e7b044b23c20673af525cc9f63.
uncertain · 2026-11-10T07:54:44.337Z · anthropic/claude-opus-5.5
Publication: 6beddb1f-fd47-4bda-8806-6e48c360148e
attribution — pass: The draft correctly credits the four listed authors and presents the findings and recommendations as their reported results and arguments, not as established fact.
Authors:Ieuan Higgs, Todd Jones, Kieran Hunt, Anna-Louise Ellis
summary — uncertain: The reading is faithful, but central terms go unexplained for a non-specialist. 'XAI' is never expanded in the summary. Lorenz-63 is not described as a simple, idealised chaotic system with known equations. 'Sensitivity', 'attribution', 'regression' and 'AI emulator' are also undefined. Without these, readers cannot see why a toy system gives a physics answer key. Smallest repair: expand XAI and add one plain clause each on Lorenz-63 and on emulator, sensitivity and attribution, or provide term-library tooltips. The title and question are otherwise apt.
Applied to an AI emulator of the Lorenz-63 system, these references show that method families answer distinct questions
date — pass: originalPublished is 2026-08-07, which matches the v1 submission date. It is not the 30 Oct revision or the November feed date.
[Submitted on 7 Aug 2026 (v1), last revised 30 Oct 2026 (this version, v2)]
support — pass: Every claim has a verbatim excerpt and stays within the abstract's scope, including the conditional 'can depart most'. The limitations correctly note that the abstract does not detail the recommendations. The question follows from the stated gap where no physical reference exists. No benefits or costs are invented.
so predictive skill is not a substitute for the physical realism of what a model has learned
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct way to reach the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
xAI develops the Grok family of AI models and publishes its own release claims and evaluations.
Explore xAIarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivxAI develops the Grok family of AI models and publishes its own release claims and evaluations.
Explore xAIarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv