{"id":"60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56","title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","argument":"The paper’s authors, Gregor Baer, Chao Zhang, Isel Grau and Pieter Van Gorp, test whether more functionally correct explanations help people understand an AI system. In a user study, 200 participants used explanations of a simulated AI’s decisions in a synthetic time series classification task. The authors varied explanation correctness across four levels and measured participants’ ability to predict the AI’s decisions, using that accuracy as a proxy for understanding. Accuracy was lower with explanations at 70% and 55% correctness than with fully correct explanations; the authors found no conclusive difference between 85% and 100%, or further reduction below 70%. Lower correctness meant fewer participants predicted accurately, rather than uniformly lowering everyone’s accuracy. Even with fully correct explanations, only a subset predicted well above chance. The authors also report exploratory findings: some participants predicted decisions accurately but described the wrong pattern the AI used, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct. Their argument is that computational measures of explanation correctness do not reliably map onto human understanding at every level, so those measures need validation against human outcomes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study used a synthetic time series classification task and a simulated AI; the reported results are specific to that study setup. The authors define understanding through participants’ forward simulation accuracy, which they use as a proxy. The explanations were constructed to resemble feature attributions, and correctness was measured against known ground truth rather than estimated from a trained model. The excerpt reports exploratory analyses but does not provide further detail on their methods or results.","speaker":{"name":"Baer, Gregor, Zhang, Chao, Grau, Isel, Van Gorp, Pieter","roleAtSource":"Article author"},"source":{"title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2603.25251","publishedAt":"2026-03-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors tested how explanation correctness relates to participants’ ability to predict a simulated AI’s decisions in a synthetic time series classification task.","excerpt":"We conducted a user study (N=200) that manipulated explanation correctness at four levels (100%, 85%, 70%, 55%) in a synthetic time series classification task","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"Participants’ prediction accuracy was used as a proxy for understanding; it fell at 70% and 55% correctness compared with 100%, with no conclusive difference between 85% and 100%.","excerpt":"accuracy dropped at 70% and 55% relative to 100%, with no further reduction below 70% and no conclusive difference between 85% and 100%.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"Lower correctness reduced the number of participants who predicted accurately, and only a subset predicted well above chance even with fully correct explanations.","excerpt":"Lower correctness reduced how many participants predicted accurately rather than lowering accuracy uniformly, and even with fully correct explanations, only a subset of participants predicted well above chance.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"In exploratory analyses, some participants predicted decisions accurately but described the wrong pattern, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct.","excerpt":"some participants predicted decisions accurately but described the wrong pattern when asked what the AI used, and self-reported ratings correlated with forward simulation accuracy only when explanations were fully correct.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"The authors argue that functional correctness differences do not always translate into differences in human understanding, and call for validation against human outcomes.","excerpt":"not all differences in functional correctness translate to differences in human understanding, highlighting the need to validate functional metrics against human outcomes.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.25251","checkedAt":"2026-11-09T03:56:09.227Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the pattern hold when people use explanations for tasks beyond this synthetic time series classification task?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","summary":"The paper’s authors, Gregor Baer, Chao Zhang, Isel Grau and Pieter Van Gorp, test whether more functionally correct explanations help people understand an AI system. In a user study, 200 participants used explanations of a simulated AI’s decisions in a synthetic time series classification task. The authors varied explanation correctness across four levels and measured participants’ ability to predict the AI’s decisions, using that accuracy as a proxy for understanding. Accuracy was lower with explanations at 70% and 55% correctness than with fully correct explanations; the authors found no conclusive difference between 85% and 100%, or further reduction below 70%. Lower correctness meant fewer participants predicted accurately, rather than uniformly lowering everyone’s accuracy. Even with fully correct explanations, only a subset predicted well above chance. The authors also report exploratory findings: some participants predicted decisions accurately but described the wrong pattern the AI used, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct. Their argument is that computational measures of explanation correctness do not reliably map onto human understanding at every level, so those measures need validation against human outcomes.","question":"Would the pattern hold when people use explanations for tasks beyond this synthetic time series classification task?","claims":[{"text":"The authors tested how explanation correctness relates to participants’ ability to predict a simulated AI’s decisions in a synthetic time series classification task.","excerpt":"We conducted a user study (N=200) that manipulated explanation correctness at four levels (100%, 85%, 70%, 55%) in a synthetic time series classification task","support":"source-stated"},{"text":"Participants’ prediction accuracy was used as a proxy for understanding; it fell at 70% and 55% correctness compared with 100%, with no conclusive difference between 85% and 100%.","excerpt":"accuracy dropped at 70% and 55% relative to 100%, with no further reduction below 70% and no conclusive difference between 85% and 100%.","support":"source-stated"},{"text":"Lower correctness reduced the number of participants who predicted accurately, and only a subset predicted well above chance even with fully correct explanations.","excerpt":"Lower correctness reduced how many participants predicted accurately rather than lowering accuracy uniformly, and even with fully correct explanations, only a subset of participants predicted well above chance.","support":"source-stated"},{"text":"In exploratory analyses, some participants predicted decisions accurately but described the wrong pattern, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct.","excerpt":"some participants predicted decisions accurately but described the wrong pattern when asked what the AI used, and self-reported ratings correlated with forward simulation accuracy only when explanations were fully correct.","support":"source-stated"},{"text":"The authors argue that functional correctness differences do not always translate into differences in human understanding, and call for validation against human outcomes.","excerpt":"not all differences in functional correctness translate to differences in human understanding, highlighting the need to validate functional metrics against human outcomes.","support":"source-stated"}],"limitations":["The study used a synthetic time series classification task and a simulated AI; the reported results are specific to that study setup.","The authors define understanding through participants’ forward simulation accuracy, which they use as a proxy.","The explanations were constructed to resemble feature attributions, and correctness was measured against known ground truth rather than estimated from a trained model.","The excerpt reports exploratory analyses but does not provide further detail on their methods or results."],"mediaId":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","correctionReason":null,"id":"60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56","publicationId":"57e70792-3486-4cba-8fe5-40462e22aa64","version":1,"sourceUrl":"https://arxiv.org/abs/2603.25251","sourceTitle":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-03-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:29.996Z","createdAt":"2026-11-09T01:48:50.128Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","kind":"article","url":"https://arxiv.org/abs/2603.25251","sourceUrl":"https://arxiv.org/abs/2603.25251","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T01:48:09.288Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.25251","checkedAt":"2026-11-09T03:56:09.227Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"23320521f96cafa143fb5a6a08ee7b454ec5d87a32a3c48fabddced04ca5c867","decidedAt":"2026-11-09T01:48:10.400Z"},"provenance":{"textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observationId":"d1c2bcb77f402e1037780365d709edfe3639aeec655edebeb82ccfde05443630","retrievedAt":"2026-11-09T01:48:09.108Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5005f906-fe4e-4bb9-8996-78fab117b45c"},"reviewer":{"model":"gpt-6-luna","runId":"869e71cd-4773-44cc-869c-a7e70035d6e0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T01:48:50.128Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Baer, Gregor","url":null,"kind":"unknown"},{"name":"Zhang, Chao","url":null,"kind":"unknown"},{"name":"Grau, Isel","url":null,"kind":"unknown"},{"name":"Van Gorp, Pieter","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Baer, Gregor","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Baer, Gregor","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Zhang, Chao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Chao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Grau, Isel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Grau, Isel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Van Gorp, Pieter","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Van Gorp, Pieter","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2603.25251","snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56/source"}},"canonicalUrl":"https://escapemeridian.com/readings/does-explanation-correctness-matter-linking-computational-xai-60c716c2","formats":{"html":"/readings/does-explanation-correctness-matter-linking-computational-xai-60c716c2","markdown":"/readings/does-explanation-correctness-matter-linking-computational-xai-60c716c2.md","json":"/readings/does-explanation-correctness-matter-linking-computational-xai-60c716c2.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-time-series","name":"Time-series","explanation":"Observations arranged over time, such as monthly sales; forecasting uses their patterns to estimate later values.","referenceUrl":"https://developers.google.com/machine-learning/glossary#time-series-analysis"}],"entities":[{"id":"xai","name":"xAI","kind":"organization","context":"xAI develops the Grok family of AI models and publishes its own release claims and evaluations.","referenceUrls":["https://x.ai/","https://x.ai/news/grok-4-7"],"path":"/entities/xai","json":"/entities/xai.json","markdown":"/entities/xai.md"},{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56","revision":"57e70792-3486-4cba-8fe5-40462e22aa64","revisionKind":"publication-id","title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","url":"https://escapemeridian.com/readings/does-explanation-correctness-matter-linking-computational-xai-60c716c2"},"source":{"type":"source","id":"https://arxiv.org/abs/2603.25251","revision":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","revisionKind":"sha256-source-text","title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","url":"https://arxiv.org/abs/2603.25251"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56","title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","argument":"The paper’s authors, Gregor Baer, Chao Zhang, Isel Grau and Pieter Van Gorp, test whether more functionally correct explanations help people understand an AI system. In a user study, 200 participants used explanations of a simulated AI’s decisions in a synthetic time series classification task. The authors varied explanation correctness across four levels and measured participants’ ability to predict the AI’s decisions, using that accuracy as a proxy for understanding. Accuracy was lower with explanations at 70% and 55% correctness than with fully correct explanations; the authors found no conclusive difference between 85% and 100%, or further reduction below 70%. Lower correctness meant fewer participants predicted accurately, rather than uniformly lowering everyone’s accuracy. Even with fully correct explanations, only a subset predicted well above chance. The authors also report exploratory findings: some participants predicted decisions accurately but described the wrong pattern the AI used, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct. Their argument is that computational measures of explanation correctness do not reliably map onto human understanding at every level, so those measures need validation against human outcomes.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study used a synthetic time series classification task and a simulated AI; the reported results are specific to that study setup. The authors define understanding through participants’ forward simulation accuracy, which they use as a proxy. The explanations were constructed to resemble feature attributions, and correctness was measured against known ground truth rather than estimated from a trained model. The excerpt reports exploratory analyses but does not provide further detail on their methods or results.","speaker":{"name":"Baer, Gregor, Zhang, Chao, Grau, Isel, Van Gorp, Pieter","roleAtSource":"Article author"},"source":{"title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2603.25251","publishedAt":"2026-03-26","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors tested how explanation correctness relates to participants’ ability to predict a simulated AI’s decisions in a synthetic time series classification task.","excerpt":"We conducted a user study (N=200) that manipulated explanation correctness at four levels (100%, 85%, 70%, 55%) in a synthetic time series classification task","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"Participants’ prediction accuracy was used as a proxy for understanding; it fell at 70% and 55% correctness compared with 100%, with no conclusive difference between 85% and 100%.","excerpt":"accuracy dropped at 70% and 55% relative to 100%, with no further reduction below 70% and no conclusive difference between 85% and 100%.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"Lower correctness reduced the number of participants who predicted accurately, and only a subset predicted well above chance even with fully correct explanations.","excerpt":"Lower correctness reduced how many participants predicted accurately rather than lowering accuracy uniformly, and even with fully correct explanations, only a subset of participants predicted well above chance.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"In exploratory analyses, some participants predicted decisions accurately but described the wrong pattern, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct.","excerpt":"some participants predicted decisions accurately but described the wrong pattern when asked what the AI used, and self-reported ratings correlated with forward simulation accuracy only when explanations were fully correct.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"},{"text":"The authors argue that functional correctness differences do not always translate into differences in human understanding, and call for validation against human outcomes.","excerpt":"not all differences in functional correctness translate to differences in human understanding, highlighting the need to validate functional metrics against human outcomes.","url":"https://arxiv.org/abs/2603.25251","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.25251","checkedAt":"2026-11-09T03:56:09.227Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the pattern hold when people use explanations for tasks beyond this synthetic time series classification task?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","summary":"The paper’s authors, Gregor Baer, Chao Zhang, Isel Grau and Pieter Van Gorp, test whether more functionally correct explanations help people understand an AI system. In a user study, 200 participants used explanations of a simulated AI’s decisions in a synthetic time series classification task. The authors varied explanation correctness across four levels and measured participants’ ability to predict the AI’s decisions, using that accuracy as a proxy for understanding. Accuracy was lower with explanations at 70% and 55% correctness than with fully correct explanations; the authors found no conclusive difference between 85% and 100%, or further reduction below 70%. Lower correctness meant fewer participants predicted accurately, rather than uniformly lowering everyone’s accuracy. Even with fully correct explanations, only a subset predicted well above chance. The authors also report exploratory findings: some participants predicted decisions accurately but described the wrong pattern the AI used, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct. Their argument is that computational measures of explanation correctness do not reliably map onto human understanding at every level, so those measures need validation against human outcomes.","question":"Would the pattern hold when people use explanations for tasks beyond this synthetic time series classification task?","claims":[{"text":"The authors tested how explanation correctness relates to participants’ ability to predict a simulated AI’s decisions in a synthetic time series classification task.","excerpt":"We conducted a user study (N=200) that manipulated explanation correctness at four levels (100%, 85%, 70%, 55%) in a synthetic time series classification task","support":"source-stated"},{"text":"Participants’ prediction accuracy was used as a proxy for understanding; it fell at 70% and 55% correctness compared with 100%, with no conclusive difference between 85% and 100%.","excerpt":"accuracy dropped at 70% and 55% relative to 100%, with no further reduction below 70% and no conclusive difference between 85% and 100%.","support":"source-stated"},{"text":"Lower correctness reduced the number of participants who predicted accurately, and only a subset predicted well above chance even with fully correct explanations.","excerpt":"Lower correctness reduced how many participants predicted accurately rather than lowering accuracy uniformly, and even with fully correct explanations, only a subset of participants predicted well above chance.","support":"source-stated"},{"text":"In exploratory analyses, some participants predicted decisions accurately but described the wrong pattern, and self-reported ratings correlated with prediction accuracy only when explanations were fully correct.","excerpt":"some participants predicted decisions accurately but described the wrong pattern when asked what the AI used, and self-reported ratings correlated with forward simulation accuracy only when explanations were fully correct.","support":"source-stated"},{"text":"The authors argue that functional correctness differences do not always translate into differences in human understanding, and call for validation against human outcomes.","excerpt":"not all differences in functional correctness translate to differences in human understanding, highlighting the need to validate functional metrics against human outcomes.","support":"source-stated"}],"limitations":["The study used a synthetic time series classification task and a simulated AI; the reported results are specific to that study setup.","The authors define understanding through participants’ forward simulation accuracy, which they use as a proxy.","The explanations were constructed to resemble feature attributions, and correctness was measured against known ground truth rather than estimated from a trained model.","The excerpt reports exploratory analyses but does not provide further detail on their methods or results."],"mediaId":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","correctionReason":null,"id":"60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56","publicationId":"57e70792-3486-4cba-8fe5-40462e22aa64","version":1,"sourceUrl":"https://arxiv.org/abs/2603.25251","sourceTitle":"Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-03-26","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-05T05:06:29.996Z","createdAt":"2026-11-09T01:48:50.128Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","kind":"article","url":"https://arxiv.org/abs/2603.25251","sourceUrl":"https://arxiv.org/abs/2603.25251","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T01:48:09.288Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2603.25251","checkedAt":"2026-11-09T03:56:09.227Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"8873a6b7ca44ad218ea06c0815fc29f0a84a146a367985941c226dc8a9a80be5","confidence":0.73,"provider":"typesafe","model":"jev-1.13.0","inputHash":"23320521f96cafa143fb5a6a08ee7b454ec5d87a32a3c48fabddced04ca5c867","decidedAt":"2026-11-09T01:48:10.400Z"},"provenance":{"textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observationId":"d1c2bcb77f402e1037780365d709edfe3639aeec655edebeb82ccfde05443630","retrievedAt":"2026-11-09T01:48:09.108Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"5005f906-fe4e-4bb9-8996-78fab117b45c"},"reviewer":{"model":"gpt-6-luna","runId":"869e71cd-4773-44cc-869c-a7e70035d6e0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T01:48:50.128Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Baer, Gregor","url":null,"kind":"unknown"},{"name":"Zhang, Chao","url":null,"kind":"unknown"},{"name":"Grau, Isel","url":null,"kind":"unknown"},{"name":"Van Gorp, Pieter","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Baer, Gregor","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Baer, Gregor","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Zhang, Chao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Chao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Grau, Isel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Grau, Isel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}},{"actor":{"name":"Van Gorp, Pieter","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Van Gorp, Pieter","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2603.25251","locator":"head/meta[name=author|citation_author]"},"assertionId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T03:56:09.227Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","sourceUrl":"https://arxiv.org/abs/2603.25251","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2603.25251","snapshotId":"4cf4bff781cb8bb9d1bd81e4b8199a6eb293a0ae6049320eabaeedd7c13a0e2a","contentSha256":"ab0a148c1ba58979d624d8051fd5ccddb08d5312f2197a396a34abd73478c73f","textHash":"8153a82c381c42f1f562766810c24e35c1387808752b5921c1433d09b5499151","observedAt":"2026-11-09T03:56:09.227Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/60c716c201efe7074bc00335706131adb1cc58e113a3bc034e6c18048a9aec56/source"}}}],"audits":[{"publicationId":"57e70792-3486-4cba-8fe5-40462e22aa64","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the study and its findings to the listed arXiv authors, Gregor Baer, Chao Zhang, Isel Grau and Pieter Van Gorp. It frames the conclusions as the authors' findings and argument, not as established fact.","excerpt":"Authors:Gregor Baer, Chao Zhang, Isel Grau, Pieter Van Gorp"},{"dimension":"summary","status":"uncertain","explanation":"The numbers and findings are faithful, but central terms go unexplained for a general reader. The summary never says what functional correctness is (how closely an explanation reflects the model's reasoning). XAI (in the title) and feature attributions are also undefined. The closing sentence drops the source's scope, 'for feature-attribution-style explanations', and hardens 'suggest... not all differences' into 'do not reliably map'. Smallest repair: briefly define correctness and XAI, and restore the feature-attribution qualifier and the hedged wording.","excerpt":"These findings suggest that, for feature-attribution-style explanations, not all differences in functional correctness translate to differences in human understanding"},{"dimension":"date","status":"pass","explanation":"The value in evidence.originalPublished, 2026-03-26, matches the v1 submission date. Later revisions (v2 to v4) and the November feed date are correctly not used.","excerpt":"[Submitted on 26 Mar 2026 (v1), last revised 5 Nov 2026 (this version, v4)]"},{"dimension":"support","status":"pass","explanation":"Each claim is directly supported by its abstract excerpt. The limitations accurately reflect the study design. The question about generalizing beyond the synthetic task follows from the stated setup and does not imply an unsupported conclusion. No invented benefits or costs.","excerpt":"Correctness affected forward simulation accuracy, but not at every level"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified, direct arXiv abstract page for this paper. It is the most direct way to access the source.","excerpt":null}],"createdAt":"2026-11-09T01:48:50.128Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}