Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Jan 8, 2025
arXiv paper reports hiring-model decisions sensitive to small resume changes
Markdown · JSON · Original source
In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether -based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
· Article
Source details
Original source date: Jan 8, 2025 (2025-01-08).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-17T13:31:15.156Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:30:22.653Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's abstract, so it does not provide detailed methods or results beyond the abstract's summary.
Open question
Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?
Source-stated
The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.
through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings
Source-stated
The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.
generated summaries exhibit meaningful differences more frequently for race than for gender perturbations
Source-stated
The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.
non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations
Source-stated
The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.
retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness
Source-stated
The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.
can exhibit notable biases that lead to discriminatory outcomes in real-world contexts
Source and contributor context
Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 8f083368-6715-45ad-89cf-2ae0151a7f68.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-17T13:31:15.156Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61. Source text hash: 6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91.
Revision and source-check history
Version 1 · 2026-11-17T13:31:15.156Z
arXiv paper reports hiring-model decisions sensitive to small resume changes
In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether -based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.
Original source
· Article
Source details
Original source date: Jan 8, 2025 (2025-01-08).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-17T13:31:15.156Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:30:22.653Z.
Limits
The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's abstract, so it does not provide detailed methods or results beyond the abstract's summary.
Open question
Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?
Source-stated
The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.
through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings
Source-stated
The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.
generated summaries exhibit meaningful differences more frequently for race than for gender perturbations
Source-stated
The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.
non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations
Source-stated
The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.
retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness
Source-stated
The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.
can exhibit notable biases that lead to discriminatory outcomes in real-world contexts
Source and contributor context
Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Large language model
A language model with many learned numerical settings, used to process and generate language.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 8f083368-6715-45ad-89cf-2ae0151a7f68.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-17T13:31:15.156Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: useful_perspective.
Observation: 81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61. Source text hash: 6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91.
uncertain · 2026-11-17T13:31:15.156Z · anthropic/claude-opus-5.5
Publication: 8f083368-6715-45ad-89cf-2ae0151a7f68
attribution — pass: The reading names the four listed authors and attributes findings and interpretations to them ('The authors report', 'they say', 'The abstract says'). Source assertions are not presented as established fact.
Authors:Preethi Seshadri, Hongyu Chen, Sameer Singh, Seraphina Goldfarb-Tarrant
summary — pass: The title and summary faithfully cover the two tasks, the synthetic dataset, the race/gender and retrieval findings, the brittleness interpretation and the real-world warning. The question follows from the gap between synthetic tests and actual hiring. The 'Surprisingly' framing is softened, but this is stylistic. 'Retrieval' and 'perturbations' could use term-library tooltips. Context such as 'resume changes' and 'selected for ranking' keeps the reading understandable to a general reader.
Surprisingly, retrieval models can show comparable sensitivity to both demographic and non-demographic changes
date — pass: originalPublished 2025-01-08 matches the v1 submission date. It is not the 4 Sep 2025 revision date.
Submitted on 8 Jan 2025 (v1), last revised 4 Sep 2025 (this version, v2)
support — uncertain: Most claims are directly supported. However, the sentence 'retrieval can affect which applicants are selected for ranking in the first place' describes a pipeline structure the abstract does not set out. The abstract only reports non-uniform retrieval selection patterns and stresses the retrieval stage. Smallest repair: attribute that framing to the abstract's emphasis on the retrieval stage, or label it as Escape Meridian interpretation. Separately, the claim adds 'also' ('may also stem'), which slightly alters the source's 'may stem from broader model brittleness'. Repair: remove 'also'.
Overall, our results indicate that LLM-based hiring systems, especially in the retrieval stage, can exhibit notable biases
media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA language model with many learned numerical settings, used to process and generate language.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv