Escape Meridian

Wilson, Kyra, Caliskan, Aylin · Jul 29, 2024

arXiv paper: Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval

Markdown · JSON · Original source

Kyra Wilson and Aylin Caliskan report an audit of Massive Text Embedding (MTE) models used in a document retrieval framework that simulates job candidate selection. Across nine occupations, they tested more than 500 publicly available resumes against 500 job descriptions. The authors say the models significantly favored White-associated names in 85.1% of cases and female-associated names in only 11.1%; a minority of cases showed no differences. They also report that Black males were disadvantaged in up to 100% of cases, and that their analyses validate three hypotheses of intersectionality. The study further finds that document length and the corpus frequency of names affected resume selection. The authors connect these results to AI tools automating employment, and to fairness and tech policy. Escape Meridian interpretation: these are results from a simulated audit, not evidence in this abstract about outcomes from hiring systems in actual workplaces. The paper page notes that its current version was revised to include an errata description.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXivArticle · arxiv.orgOpen original source

Original source

· Article

Source details

Original source date: Jul 29, 2024 (2024-07-29).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-17T13:24:55.961Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:24:06.041Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

This evidence is the paper's abstract and page, not the full paper; it does not provide the audit's detailed methods or results by occupation. The reported audit simulates job candidate selection using resumes and job descriptions; the abstract does not establish how these results translate to hiring outcomes in actual workplaces. The page says the current version includes an errata description but does not state the errata's substance in the supplied text.

Open question

How do document length and the corpus frequency of names affect which resumes these models select?

Source-stated

The authors tested MTE models in a document retrieval framework simulating job candidate selection, across nine occupations with publicly available resumes and job descriptions.

Using that framework, we then perform a resume audit study to determine whether a selection of Massive Text Embedding (MTE) models are biased in resume screening scenarios.

Source-stated

The authors report significant preference for White-associated names in most cases, and for female-associated names in a smaller share of cases.

significantly favoring White-associated names in 85.1\% of cases and female-associated names in only 11.1\% of cases

Source-stated

The authors report that Black males were disadvantaged in up to 100% of cases and say their analyses validate three hypotheses of intersectionality.

Black males are disadvantaged in up to 100\% of cases, replicating real-world patterns of bias in employment settings, and validate three hypotheses of intersectionality.

Source-stated

The authors report that document length and the corpus frequency of names affected resume selection.

We also find an impact of document length as well as the corpus frequency of names in the selection of resumes.

Escape Meridian interpretation

The abstract describes a simulated resume audit; it does not report observed hiring outcomes from actual workplaces.

using a collection of over 500 publicly available resumes and 500 job descriptions.

Source-stated

The arXiv page says the current version was revised to include an errata description.

last revised 30 Aug 2026 (this version, v3)

Source and contributor context

Wilson, Kyra, Caliskan, Aylin · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Statistical significance

A test of whether a result is unlikely to be due to chance alone; it does not say how large or important an effect is.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 4f4c01b3-5341-49f9-8a4d-1230aa1c5b9f.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-17T13:24:55.961Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 37002255c288b9c46cd39fc64f30f6764e5d931b82e3bd1145fb59faac82e9ca. Source text hash: 2d91ba5eeda7325131ecc0b7633f818d1d733b17a0441545e8c4d16f7fdaaf7b.

Revision and source-check history

Version 1 · 2026-11-17T13:24:55.961Z

arXiv paper: Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval

Kyra Wilson and Aylin Caliskan report an audit of Massive Text Embedding (MTE) models used in a document retrieval framework that simulates job candidate selection. Across nine occupations, they tested more than 500 publicly available resumes against 500 job descriptions. The authors say the models significantly favored White-associated names in 85.1% of cases and female-associated names in only 11.1%; a minority of cases showed no differences. They also report that Black males were disadvantaged in up to 100% of cases, and that their analyses validate three hypotheses of intersectionality. The study further finds that document length and the corpus frequency of names affected resume selection. The authors connect these results to AI tools automating employment, and to fairness and tech policy. Escape Meridian interpretation: these are results from a simulated audit, not evidence in this abstract about outcomes from hiring systems in actual workplaces. The paper page notes that its current version was revised to include an errata description.

Original source

· Article

Source details

Original source date: Jul 29, 2024 (2024-07-29).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-17T13:24:55.961Z. First observed: 2026-11-16T22:56:25.147Z. Retrieved: 2026-11-17T13:24:06.041Z.

Limits

This evidence is the paper's abstract and page, not the full paper; it does not provide the audit's detailed methods or results by occupation. The reported audit simulates job candidate selection using resumes and job descriptions; the abstract does not establish how these results translate to hiring outcomes in actual workplaces. The page says the current version includes an errata description but does not state the errata's substance in the supplied text.

Open question

How do document length and the corpus frequency of names affect which resumes these models select?

Source-stated

The authors tested MTE models in a document retrieval framework simulating job candidate selection, across nine occupations with publicly available resumes and job descriptions.

Using that framework, we then perform a resume audit study to determine whether a selection of Massive Text Embedding (MTE) models are biased in resume screening scenarios.

Source-stated

The authors report significant preference for White-associated names in most cases, and for female-associated names in a smaller share of cases.

significantly favoring White-associated names in 85.1\% of cases and female-associated names in only 11.1\% of cases

Source-stated

The authors report that Black males were disadvantaged in up to 100% of cases and say their analyses validate three hypotheses of intersectionality.

Black males are disadvantaged in up to 100\% of cases, replicating real-world patterns of bias in employment settings, and validate three hypotheses of intersectionality.

Source-stated

The authors report that document length and the corpus frequency of names affected resume selection.

We also find an impact of document length as well as the corpus frequency of names in the selection of resumes.

Escape Meridian interpretation

The abstract describes a simulated resume audit; it does not report observed hiring outcomes from actual workplaces.

using a collection of over 500 publicly available resumes and 500 job descriptions.

Source-stated

The arXiv page says the current version was revised to include an errata description.

last revised 30 Aug 2026 (this version, v3)

Source and contributor context

Wilson, Kyra, Caliskan, Aylin · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Statistical significance

A test of whether a result is unlikely to be due to chance alone; it does not say how large or important an effect is.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 4f4c01b3-5341-49f9-8a4d-1230aa1c5b9f.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: passed by anthropic/claude-opus-5.5 on 2026-11-17T13:24:55.961Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 37002255c288b9c46cd39fc64f30f6764e5d931b82e3bd1145fb59faac82e9ca. Source text hash: 2d91ba5eeda7325131ecc0b7633f818d1d733b17a0441545e8c4d16f7fdaaf7b.

passed · 2026-11-17T13:24:55.961Z · anthropic/claude-opus-5.5

Publication: 4f4c01b3-5341-49f9-8a4d-1230aa1c5b9f

attribution — pass: The draft correctly credits Kyra Wilson and Aylin Caliskan and attributes the findings to them ('The authors say', 'They also report'). The Escape Meridian interpretation is clearly labeled and kept separate from the authors' claims.

Authors:Kyra Wilson, Aylin Caliskan

summary — pass: The summary accurately reflects the abstract: an MTE-based retrieval simulation across nine occupations, the 85.1% and 11.1% figures, Black males disadvantaged in up to 100% of cases, three intersectionality hypotheses, and effects of document length and name frequency. The question follows from the source. Minor point: the abstract says the Black-male result replicates real-world patterns of employment bias, which the draft omits. Terms such as MTE, document retrieval and corpus frequency rely on tooltips, but the core finding remains understandable.

We find that the MTEs are biased, significantly favoring White-associated names in 85.1\% of cases and female-associated names in only 11.1\% of cases

date — pass: The originalPublished date, 2024-07-29, matches the v1 submission date. It is not the later v3 revision date of 30 Aug 2026.

[Submitted on 29 Jul 2024 (v1), last revised 30 Aug 2026 (this version, v3)]

support — pass: Each claim is supported by a source excerpt. The interpretation that this is a simulated audit, not observed workplace outcomes, is labeled and consistent with the abstract's description of a framework that simulates candidate selection. The errata note is supported, and the draft correctly says the errata's substance is unknown. The draft adds no unsupported benefits or costs.

via a document retrieval framework that simulates job candidate selection

media — pass: The selected media is the verified arXiv abstract page, which is the direct original source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.