Escape Meridian

Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Jan 8, 2025

arXiv paper reports hiring-model decisions sensitive to small resume changes

Markdown · JSON · Original source

In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether -based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXivArticle · arxiv.orgOpen original source

Original source

· Article

Source details

Original source date: Jan 8, 2025 (2025-01-08).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-17T13:31:15.156Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:30:22.653Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's abstract, so it does not provide detailed methods or results beyond the abstract's summary.

Open question

Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?

Source-stated

The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.

through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings

Source-stated

The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.

generated summaries exhibit meaningful differences more frequently for race than for gender perturbations

Source-stated

The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.

non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations

Source-stated

The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.

retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness

Source-stated

The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.

can exhibit notable biases that lead to discriminatory outcomes in real-world contexts

Source and contributor context

Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 8f083368-6715-45ad-89cf-2ae0151a7f68.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-17T13:31:15.156Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: useful_perspective.

Observation: 81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61. Source text hash: 6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91.

Revision and source-check history

Version 1 · 2026-11-17T13:31:15.156Z

arXiv paper reports hiring-model decisions sensitive to small resume changes

In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether -based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.

Original source

· Article

Source details

Original source date: Jan 8, 2025 (2025-01-08).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-17T13:31:15.156Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:30:22.653Z.

Limits

The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's abstract, so it does not provide detailed methods or results beyond the abstract's summary.

Open question

Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?

Source-stated

The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.

through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings

Source-stated

The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.

generated summaries exhibit meaningful differences more frequently for race than for gender perturbations

Source-stated

The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.

non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations

Source-stated

The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.

retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness

Source-stated

The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.

can exhibit notable biases that lead to discriminatory outcomes in real-world contexts

Source and contributor context

Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 8f083368-6715-45ad-89cf-2ae0151a7f68.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-17T13:31:15.156Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: useful_perspective.

Observation: 81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61. Source text hash: 6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91.

uncertain · 2026-11-17T13:31:15.156Z · anthropic/claude-opus-5.5

Publication: 8f083368-6715-45ad-89cf-2ae0151a7f68

attribution — pass: The reading names the four listed authors and attributes findings and interpretations to them ('The authors report', 'they say', 'The abstract says'). Source assertions are not presented as established fact.

Authors:Preethi Seshadri, Hongyu Chen, Sameer Singh, Seraphina Goldfarb-Tarrant

summary — pass: The title and summary faithfully cover the two tasks, the synthetic dataset, the race/gender and retrieval findings, the brittleness interpretation and the real-world warning. The question follows from the gap between synthetic tests and actual hiring. The 'Surprisingly' framing is softened, but this is stylistic. 'Retrieval' and 'perturbations' could use term-library tooltips. Context such as 'resume changes' and 'selected for ranking' keeps the reading understandable to a general reader.

Surprisingly, retrieval models can show comparable sensitivity to both demographic and non-demographic changes

date — pass: originalPublished 2025-01-08 matches the v1 submission date. It is not the 4 Sep 2025 revision date.

Submitted on 8 Jan 2025 (v1), last revised 4 Sep 2025 (this version, v2)

support — uncertain: Most claims are directly supported. However, the sentence 'retrieval can affect which applicants are selected for ranking in the first place' describes a pipeline structure the abstract does not set out. The abstract only reports non-uniform retrieval selection patterns and stresses the retrieval stage. Smallest repair: attribute that framing to the abstract's emphasis on the retrieval stage, or label it as Escape Meridian interpretation. Separately, the claim adds 'also' ('may also stem'), which slightly alters the source's 'may stem from broader model brittleness'. Repair: remove 'also'.

Overall, our results indicate that LLM-based hiring systems, especially in the retrieval stage, can exhibit notable biases

media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.