Young, Richard J., Matthews, Alice M. · Nov 11, 2026
arXiv cs.AI: Young and Matthews audit racial and sex bias in pain-management models
Markdown · JSON · Original source
Richard J. Young and Alice M. Matthews report an exploratory audit of whether assign different pain severity or opioid treatment when patients’ race or sex changes but the clinical case stays the same. Across two studies, they found no differences that survived statistical correction; measured pain-severity differences were also within the study’s equivalence bounds. They stress that this is not proof of no bias: opioid decisions were measured less precisely, and the first study could not rule out differences of about 20 percentage points. The authors’ striking comparison is that responses varied much more across models and settings than across patient identities: the reference patient received a high opioid dose in a range from 6% to 93% of responses. Because serving software, provider and prompt format also differed, the authors do not attribute that variation to model settings alone. Their practical argument is that fairness audits should test multiple names per group, compare patients using the same sampling seed, report the noise floor and examine each deployed configuration. The results apply to the paper’s single-prompt, JSON-constrained task, not to clinical care generally.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 11, 2026 (2026-11-11).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-16T21:46:56.653Z. First observed: 2026-11-13T07:39:27.929Z. Retrieved: 2026-11-16T21:45:57.362Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The authors describe the analyses as exploratory and non-preregistered. The reported results come from a single-prompt, JSON-constrained task; the evidence does not establish how models perform in clinical care. Study 1 could not exclude opioid-decision differences of about 20 percentage points. Serving software, provider and prompt format differed, so the reported variation cannot be attributed to model settings alone.
Open question
What would testing each deployed configuration reveal about differences in opioid decisions between patient identities?
Source-stated
The authors report no racial or sex differences that survived correction in either study, and say measured pain-severity differences fell within their equivalence bounds.
no difference survived correction in Study 1, none of 1,386 comparisons survived the false discovery rate in Study 2, and every pain-severity difference was equivalent to zero within one point on a 0-10 scale
Source-stated
The authors caution that the opioid results do not establish the absence of differences; Study 1 could not rule out differences of about 20 percentage points.
Opioid decisions were bounded less precisely (Study 1 could not exclude differences of about 20 percentage points), so they show no detected difference, not proof of none.
Source-stated
The authors report much greater variation across models and settings than between patient identities, while noting that multiple factors differed across settings.
Models differed far more from one another and across their own settings than between patients (the reference patient received the high opioid dose in 6% to 93% of responses), although serving software, provider and prompt format also differed.
Source-stated
The authors recommend auditing multiple names per group, pairing comparisons on the same seed, reporting the noise floor and testing each deployed configuration.
Fairness audits of clinical AI should use several names per group, pair comparisons on the seed, report the noise floor and test each deployed configuration.
Source and contributor context
Young, Richard J., Matthews, Alice M. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 4bc5f0ad-54f5-4cda-84dd-36c6ca8d9b65.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T21:46:56.653Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 01b605d2336828f2df811f1a52046de56273a42559cb196a206c37fd2024ba6b. Source text hash: 22aa1e0c76dcb06187715773fcac1aa87de90072d4960441b11811f9ddc70966.
Revision and source-check history
Version 1 · 2026-11-16T21:46:56.653Z
arXiv cs.AI: Young and Matthews audit racial and sex bias in pain-management models
Richard J. Young and Alice M. Matthews report an exploratory audit of whether assign different pain severity or opioid treatment when patients’ race or sex changes but the clinical case stays the same. Across two studies, they found no differences that survived statistical correction; measured pain-severity differences were also within the study’s equivalence bounds. They stress that this is not proof of no bias: opioid decisions were measured less precisely, and the first study could not rule out differences of about 20 percentage points. The authors’ striking comparison is that responses varied much more across models and settings than across patient identities: the reference patient received a high opioid dose in a range from 6% to 93% of responses. Because serving software, provider and prompt format also differed, the authors do not attribute that variation to model settings alone. Their practical argument is that fairness audits should test multiple names per group, compare patients using the same sampling seed, report the noise floor and examine each deployed configuration. The results apply to the paper’s single-prompt, JSON-constrained task, not to clinical care generally.
Original source
cs.AI · Article
Source details
Original source date: Nov 11, 2026 (2026-11-11).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-16T21:46:56.653Z. First observed: 2026-11-13T07:39:27.929Z. Retrieved: 2026-11-16T21:45:57.362Z.
Limits
The authors describe the analyses as exploratory and non-preregistered. The reported results come from a single-prompt, JSON-constrained task; the evidence does not establish how models perform in clinical care. Study 1 could not exclude opioid-decision differences of about 20 percentage points. Serving software, provider and prompt format differed, so the reported variation cannot be attributed to model settings alone.
Open question
What would testing each deployed configuration reveal about differences in opioid decisions between patient identities?
Source-stated
The authors report no racial or sex differences that survived correction in either study, and say measured pain-severity differences fell within their equivalence bounds.
no difference survived correction in Study 1, none of 1,386 comparisons survived the false discovery rate in Study 2, and every pain-severity difference was equivalent to zero within one point on a 0-10 scale
Source-stated
The authors caution that the opioid results do not establish the absence of differences; Study 1 could not rule out differences of about 20 percentage points.
Opioid decisions were bounded less precisely (Study 1 could not exclude differences of about 20 percentage points), so they show no detected difference, not proof of none.
Source-stated
The authors report much greater variation across models and settings than between patient identities, while noting that multiple factors differed across settings.
Models differed far more from one another and across their own settings than between patients (the reference patient received the high opioid dose in 6% to 93% of responses), although serving software, provider and prompt format also differed.
Source-stated
The authors recommend auditing multiple names per group, pairing comparisons on the same seed, reporting the noise floor and testing each deployed configuration.
Fairness audits of clinical AI should use several names per group, pair comparisons on the seed, report the noise floor and test each deployed configuration.
Source and contributor context
Young, Richard J., Matthews, Alice M. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 4bc5f0ad-54f5-4cda-84dd-36c6ca8d9b65.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-16T21:46:56.653Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 01b605d2336828f2df811f1a52046de56273a42559cb196a206c37fd2024ba6b. Source text hash: 22aa1e0c76dcb06187715773fcac1aa87de90072d4960441b11811f9ddc70966.
uncertain · 2026-11-16T21:46:56.653Z · anthropic/claude-opus-5.5
Publication: 4bc5f0ad-54f5-4cda-84dd-36c6ca8d9b65
attribution — pass: The reading correctly attributes the work to Richard J. Young and Alice M. Matthews on arXiv, and keeps the findings framed as the authors' report.
Authors:Richard J. Young, Alice M. Matthews
summary — uncertain: Mostly faithful and careful about limits. However, it drops the source's note that a few differences did survive correction within individual models and that they favoured Black patients. This tempers the blanket statement that 'no differences' survived. Smallest repair: add one sentence saying the few within-model differences that survived correction favoured Black patients. Central terms such as sampling seed, noise floor and JSON-constrained are not explained for non-specialists; tooltips could cover them.
The few differences surviving correction within a model favoured Black patients.
date — pass: originalPublished is 2026-11-11, which matches the v1 submission date. The feed date of Nov 13 was correctly not used.
[Submitted on 11 Nov 2026]
support — uncertain: Claim 1 says no racial or sex differences survived correction in either study. The source's study-level results support this, but the source also reports a few within-model differences surviving correction. The unqualified wording therefore risks overstating the null result. Qualifying it as 'study-level' comparisons, or noting the within-model exceptions, would fix this. The other claims, limitations and the non-leading question are supported.
none of 1,386 comparisons survived the false discovery rate in Study 2
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most relevant way to access the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv