Wang, Jinyuan, Chu, Minh Duc, Ross, Frances, Fitzsimmons-Craft, Ellen, Lerman, Kristina · Nov 7, 2026
arXiv cs.AI: Safer for Whom? A Systematic Exploration of AI Safety in Eating Disorder Interactions
Markdown · JSON · Original source
Jinyuan Wang and coauthors report that three gave less protective responses to questions from an online pro-anorexia community when the questions came without information about the user. The authors evaluated 100 questions using clinically informed criteria for eating-disorder-related harms, comparing responses with user information about race, gender, body mass index (BMI), and explicit eating-disorder vulnerability. High-risk responses were approximately twice as frequent without user information; explicit vulnerability signals improved safety by 10–14 points across models. Responses also differed by race, gender, and BMI, with body size showing the largest disparities. The authors say the patterns are consistent with reliance on a stereotype that eating disorders primarily affect thin, White women, potentially leaving people outside that profile with less protective responses. Their results put a specific question at the center of AI safety in diet, exercise, and weight-loss advice: does a model recognize vulnerability when a user does not state it explicitly? The study reports results for three models and this set of questions; whether similar patterns appear with other models and interactions remains open.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 7, 2026 (2026-11-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T07:32:30.290Z. First observed: 2026-11-10T08:39:58.741Z. Retrieved: 2026-11-12T07:31:33.806Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported evaluation covers three and 100 questions sourced from an online pro-anorexia community; the evidence does not establish whether the findings generalize to other models or interactions. The reported stereotype-based explanation is presented by the authors as a possible interpretation of the response patterns, not as a demonstrated mechanism.
Open question
Would the differences the authors report also appear with other models and with eating-disorder interactions beyond the 100 questions studied?
Source-stated
The authors evaluated responses from three open-weight large language models to 100 questions sourced from an online pro-anorexia community.
We evaluate responses from three open-weight large language models to 100 questions sourced from an online pro-anorexia community.
Source-stated
The study compared responses with and without user information about race, gender, body mass index (BMI), and explicit eating-disorder vulnerability.
questions are accompanied by information about the user varying race, gender, body mass index (BMI), and explicit ED vulnerability.
Source-stated
High-risk responses were approximately twice as frequent without user information, and explicit eating-disorder vulnerability signals improved safety by 10–14 points across models.
High-risk responses are approximately twice as frequent without bios, suggesting that models do not consistently recognize vulnerability from language alone. Explicit signals of ED vulnerability improve safety by 10--14 points across models.
Source-stated
Responses differed significantly by race, gender, and BMI, with body size producing the largest disparities.
Responses also differ significantly by race, gender, and BMI, with body size producing the largest disparities.
Source-stated
The authors say the disparities are consistent with reliance on a stereotype about who primarily has eating disorders, potentially leaving others with less protective responses.
These patterns are consistent with reliance on the stereotype that EDs primarily affect thin, White women, potentially leaving users outside this profile with less protective responses.
Source and contributor context
Wang, Jinyuan, Chu, Minh Duc, Ross, Frances, Fitzsimmons-Craft, Ellen, Lerman, Kristina · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Open weights
A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6156ad83-7712-468a-8133-23e37fba757e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T07:32:30.290Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ca689c7fa7b799d8c4410fe67ddab74588f174b7a1d6fcefc900314aadc94802. Source text hash: c54c43070ffe3d649c1a94fcda98701dca13eede81aa566dce98f5e9172fba84.
Revision and source-check history
Version 1 · 2026-11-12T07:32:30.290Z
arXiv cs.AI: Safer for Whom? A Systematic Exploration of AI Safety in Eating Disorder Interactions
Jinyuan Wang and coauthors report that three gave less protective responses to questions from an online pro-anorexia community when the questions came without information about the user. The authors evaluated 100 questions using clinically informed criteria for eating-disorder-related harms, comparing responses with user information about race, gender, body mass index (BMI), and explicit eating-disorder vulnerability. High-risk responses were approximately twice as frequent without user information; explicit vulnerability signals improved safety by 10–14 points across models. Responses also differed by race, gender, and BMI, with body size showing the largest disparities. The authors say the patterns are consistent with reliance on a stereotype that eating disorders primarily affect thin, White women, potentially leaving people outside that profile with less protective responses. Their results put a specific question at the center of AI safety in diet, exercise, and weight-loss advice: does a model recognize vulnerability when a user does not state it explicitly? The study reports results for three models and this set of questions; whether similar patterns appear with other models and interactions remains open.
Original source
cs.AI · Article
Source details
Original source date: Nov 7, 2026 (2026-11-07).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T07:32:30.290Z. First observed: 2026-11-10T08:39:58.741Z. Retrieved: 2026-11-12T07:31:33.806Z.
Limits
The reported evaluation covers three and 100 questions sourced from an online pro-anorexia community; the evidence does not establish whether the findings generalize to other models or interactions. The reported stereotype-based explanation is presented by the authors as a possible interpretation of the response patterns, not as a demonstrated mechanism.
Open question
Would the differences the authors report also appear with other models and with eating-disorder interactions beyond the 100 questions studied?
Source-stated
The authors evaluated responses from three open-weight large language models to 100 questions sourced from an online pro-anorexia community.
We evaluate responses from three open-weight large language models to 100 questions sourced from an online pro-anorexia community.
Source-stated
The study compared responses with and without user information about race, gender, body mass index (BMI), and explicit eating-disorder vulnerability.
questions are accompanied by information about the user varying race, gender, body mass index (BMI), and explicit ED vulnerability.
Source-stated
High-risk responses were approximately twice as frequent without user information, and explicit eating-disorder vulnerability signals improved safety by 10–14 points across models.
High-risk responses are approximately twice as frequent without bios, suggesting that models do not consistently recognize vulnerability from language alone. Explicit signals of ED vulnerability improve safety by 10--14 points across models.
Source-stated
Responses differed significantly by race, gender, and BMI, with body size producing the largest disparities.
Responses also differ significantly by race, gender, and BMI, with body size producing the largest disparities.
Source-stated
The authors say the disparities are consistent with reliance on a stereotype about who primarily has eating disorders, potentially leaving others with less protective responses.
These patterns are consistent with reliance on the stereotype that EDs primarily affect thin, White women, potentially leaving users outside this profile with less protective responses.
Source and contributor context
Wang, Jinyuan, Chu, Minh Duc, Ross, Frances, Fitzsimmons-Craft, Ellen, Lerman, Kristina · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Open weights
A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6156ad83-7712-468a-8133-23e37fba757e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T07:32:30.290Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ca689c7fa7b799d8c4410fe67ddab74588f174b7a1d6fcefc900314aadc94802. Source text hash: c54c43070ffe3d649c1a94fcda98701dca13eede81aa566dce98f5e9172fba84.
passed · 2026-11-12T07:32:30.290Z · anthropic/claude-opus-5.5
Publication: 6156ad83-7712-468a-8133-23e37fba757e
attribution — pass: The reading correctly attributes the study to Jinyuan Wang and coauthors, as listed on the arXiv page. It frames the findings and the stereotype interpretation as the authors' claims rather than established fact. The arXiv cs.AI label matches the publisher, since the paper is cross-listed in cs.AI.
Authors:Jinyuan Wang, Minh Duc Chu, Frances Ross, Ellen Fitzsimmons-Craft, Kristina Lerman
summary — pass: The summary leads with the actor and the central finding. It explains BMI and the setup: 100 questions from a pro-anorexia community, three models, and matched user information. It conveys why the work matters, namely whether models recognize vulnerability that users do not state. It keeps the authors' hedged force on the stereotype explanation. Technical terms such as open-weight are kept exactly and are suitable for tooltips. The question addresses a real open issue about generalization rather than leading the reader.
providing limited insight into whether models recognize implicit vulnerability in natural interactions or protect users consistently
date — pass: The originalPublished date of 2026-11-07 matches the arXiv v1 submission date. The feed date of 2026-11-10 is later and was correctly not used.
Sat, 7 Nov 2026 05:30:37 UTC (342 KB)
support — pass: Each claim matches the abstract. This covers the 2x high-risk rate without bios, the 10–14 point improvement from explicit vulnerability signals, and disparities by race, gender and BMI, with body size producing the largest. The stereotype explanation is kept as 'consistent with' and 'potentially,' and the limitations preserve that hedge. No unsupported benefits, costs or stakeholder claims are added.
High-risk responses are approximately twice as frequent without bios, suggesting that models do not consistently recognize vulnerability from language alone.
media — pass: The selected media ID is the verified direct link to the arXiv abstract page. This is the original source and gives readers the easiest access to the paper.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referenceA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model whose trained numbers are published so others can download, run and inspect it; the license and training data may still be restricted.
Definition referenceA language model with many learned numerical settings, used to process and generate language.
Definition reference