{"id":"0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f","title":"PubMed Central: An and colleagues find intersecting biases in LLM resume scores","argument":"Jiafu An and colleagues report that five large language models gave different resume scores to fictitious applicants whose qualifications were otherwise similar but whose names signaled different gender and racial identities. In their randomized experiment, the models generally gave female candidates higher scores, while most gave black male candidates lower scores than comparable white male candidates. The authors emphasize that broad group averages can hide these opposing patterns: a model could favor female candidates and still disadvantage black men. They also found that the direction and size of score differences varied across social groups and models, and that results for Asian and Hispanic candidates differed across models. To estimate how scores might translate into hiring, the authors applied assumed score cutoffs. At an 80-point cutoff, GPT-3.5 Turbo’s scores corresponded to estimated hiring-probability differences for otherwise similar groups. These are estimates under the study’s rule, not observed hiring outcomes. The researchers used randomized resumes with characteristics drawn from real-world distributions, but tested English-language, entry-level applications in a US setting, using names to signal identity. The authors say further research is needed to identify the causes of the patterns and how they may change over time.","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The experiment used fictitious resumes and names to signal gender and racial identity; it does not assess identity information beyond those names. The authors caution that the findings are specific to an English-speaking US context and may not extend to other linguistic or cultural settings. The study covers entry-level positions and standardized resumes, so the authors say its results may not extend to high-skill or management hiring. The hiring-probability estimates depend on an assumed score cutoff; they are not observed hiring outcomes. The experiment was conducted at one snapshot in time, and the authors note that model behavior may evolve.","speaker":{"name":"Jiafu An, Difang Huang, Chen Lin, Mingzhu Tai","roleAtSource":"Article author"},"source":{"title":"Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation","publisher":"PubMed Central","format":"Article","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","publishedAt":"2025-03-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"In a randomized resume-scoring experiment, the models generally assigned higher scores to female candidates and most assigned lower scores to black male candidates than to comparable white male candidates.","excerpt":"the LLMs award higher assessment scores for female candidates with similar work experience, education, and skills, but lower scores for black male candidates with comparable qualifications","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"The authors found that aggregate comparisons can conceal different patterns at the intersection of gender and race.","excerpt":"the higher scores for minorities are driven by those for female candidates (both black and white females), but the scores for black males are in fact significantly lower","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"At an 80-point cutoff, the authors estimate score-based hiring-probability differences for GPT-3.5 Turbo; these are estimates under an assumed rule, not observed hiring outcomes.","excerpt":"with an 80-point cutoff, which implies an average hiring probability of ∼35%, black female applicants could expect a 1.7 percentage-point greater probability of being hired","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"The authors say their results may not extend beyond English-speaking US settings or entry-level hiring, and identity was inferred from names.","excerpt":"our findings are relevant only to an English-speaking context, specifically within the United States, and may not extend to other linguistic or cultural settings","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","checkedAt":"2026-11-17T13:27:32.155Z","items":[{"type":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","attribution":"PubMed Central","basis":"publisher-embed","availability":"verified","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents the regression coefficients that compare the score differen…","verifiedAt":"2026-11-17T13:27:32.439Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the score differences persist when real applications are assessed with professional recruiters’ prompts?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"PubMed Central: An and colleagues find intersecting biases in LLM resume scores","summary":"Jiafu An and colleagues report that five large language models gave different resume scores to fictitious applicants whose qualifications were otherwise similar but whose names signaled different gender and racial identities. In their randomized experiment, the models generally gave female candidates higher scores, while most gave black male candidates lower scores than comparable white male candidates. The authors emphasize that broad group averages can hide these opposing patterns: a model could favor female candidates and still disadvantage black men. They also found that the direction and size of score differences varied across social groups and models, and that results for Asian and Hispanic candidates differed across models. To estimate how scores might translate into hiring, the authors applied assumed score cutoffs. At an 80-point cutoff, GPT-3.5 Turbo’s scores corresponded to estimated hiring-probability differences for otherwise similar groups. These are estimates under the study’s rule, not observed hiring outcomes. The researchers used randomized resumes with characteristics drawn from real-world distributions, but tested English-language, entry-level applications in a US setting, using names to signal identity. The authors say further research is needed to identify the causes of the patterns and how they may change over time.","question":"Would the score differences persist when real applications are assessed with professional recruiters’ prompts?","claims":[{"text":"In a randomized resume-scoring experiment, the models generally assigned higher scores to female candidates and most assigned lower scores to black male candidates than to comparable white male candidates.","excerpt":"the LLMs award higher assessment scores for female candidates with similar work experience, education, and skills, but lower scores for black male candidates with comparable qualifications","support":"source-stated"},{"text":"The authors found that aggregate comparisons can conceal different patterns at the intersection of gender and race.","excerpt":"the higher scores for minorities are driven by those for female candidates (both black and white females), but the scores for black males are in fact significantly lower","support":"source-stated"},{"text":"At an 80-point cutoff, the authors estimate score-based hiring-probability differences for GPT-3.5 Turbo; these are estimates under an assumed rule, not observed hiring outcomes.","excerpt":"with an 80-point cutoff, which implies an average hiring probability of ∼35%, black female applicants could expect a 1.7 percentage-point greater probability of being hired","support":"source-stated"},{"text":"The authors say their results may not extend beyond English-speaking US settings or entry-level hiring, and identity was inferred from names.","excerpt":"our findings are relevant only to an English-speaking context, specifically within the United States, and may not extend to other linguistic or cultural settings","support":"source-stated"}],"limitations":["The experiment used fictitious resumes and names to signal gender and racial identity; it does not assess identity information beyond those names.","The authors caution that the findings are specific to an English-speaking US context and may not extend to other linguistic or cultural settings.","The study covers entry-level positions and standardized resumes, so the authors say its results may not extend to high-skill or management hiring.","The hiring-probability estimates depend on an assumed score cutoff; they are not observed hiring outcomes.","The experiment was conducted at one snapshot in time, and the authors note that model behavior may evolve."],"mediaId":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","correctionReason":null,"id":"0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f","publicationId":"c9669bb2-5895-4399-8b9c-61b443227576","version":1,"sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","sourceTitle":"Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation","publisher":"PubMed Central","publishedAt":null,"originalPublished":{"value":"2025-03-12","precision":"day","basis":"stated_with_named_work"},"firstObservedAt":"2026-11-16T22:56:25.147Z","createdAt":"2026-11-17T13:28:28.417Z","historical":true,"entityIds":["pubmed-central"],"topicIds":["work-and-agency"],"media":[{"id":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","kind":"article","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:27:32.439Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"fea5259f571f307fe33ddd327c07e1856fed21a2a74d19d3e76b4776458beffd","kind":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents ","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-17T13:27:32.439Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1794922352439},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","checkedAt":"2026-11-17T13:27:32.155Z","items":[{"type":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","attribution":"PubMed Central","basis":"publisher-embed","availability":"verified","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents the regression coefficients that compare the score differen…","verifiedAt":"2026-11-17T13:27:32.439Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","confidence":0.88,"provider":"typesafe","model":"jev-1.13.0","inputHash":"066845928c374b3a2db977a4faf163d15a6a9ce21b16f06c02181f53454a6643","decidedAt":"2026-11-17T13:27:33.679Z"},"provenance":{"textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observationId":"6d9d1da4e5d32591a63c2640581b4eef96da6680f806cc5850a6220cd4b4094f","retrievedAt":"2026-11-17T13:27:32.155Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"db979f46-9edc-4f35-86ed-352fc95c9547"},"reviewer":{"model":"gpt-6-luna","runId":"986154d2-41d5-4670-80d7-cf2edbe51373"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:28:28.417Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Jiafu An","url":null,"kind":"unknown"},{"name":"Difang Huang","url":null,"kind":"unknown"},{"name":"Chen Lin","url":null,"kind":"unknown"},{"name":"Mingzhu Tai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Jiafu An","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiafu An","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Difang Huang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Difang Huang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Chen Lin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen Lin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Mingzhu Tai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mingzhu Tai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z","basis":"publisher-page-metadata","sourceLinks":186,"linksTruncated":true,"metadataUrl":"/api/pipeline/stream/0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f/source"}},"canonicalUrl":"https://escapemeridian.com/readings/pubmed-central-an-and-colleagues-find-intersecting-biases-in-03834176","formats":{"html":"/readings/pubmed-central-an-and-colleagues-find-intersecting-biases-in-03834176","markdown":"/readings/pubmed-central-an-and-colleagues-find-intersecting-biases-in-03834176.md","json":"/readings/pubmed-central-an-and-colleagues-find-intersecting-biases-in-03834176.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"pubmed-central","name":"PubMed Central","kind":"organization","context":"PubMed Central is a US National Library of Medicine archive providing full-text biomedical and life sciences research articles.","referenceUrls":["https://pmc.ncbi.nlm.nih.gov/"],"path":"/entities/pubmed-central","json":"/entities/pubmed-central.json","markdown":"/entities/pubmed-central.md"},{"id":"time","name":"TIME","kind":"organization","context":"TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.","referenceUrls":["https://time.com/"],"path":"/entities/time","json":"/entities/time.json","markdown":"/entities/time.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f","revision":"c9669bb2-5895-4399-8b9c-61b443227576","revisionKind":"publication-id","title":"PubMed Central: An and colleagues find intersecting biases in LLM resume scores","url":"https://escapemeridian.com/readings/pubmed-central-an-and-colleagues-find-intersecting-biases-in-03834176"},"source":{"type":"source","id":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","revision":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","revisionKind":"sha256-source-text","title":"Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f","title":"PubMed Central: An and colleagues find intersecting biases in LLM resume scores","argument":"Jiafu An and colleagues report that five large language models gave different resume scores to fictitious applicants whose qualifications were otherwise similar but whose names signaled different gender and racial identities. In their randomized experiment, the models generally gave female candidates higher scores, while most gave black male candidates lower scores than comparable white male candidates. The authors emphasize that broad group averages can hide these opposing patterns: a model could favor female candidates and still disadvantage black men. They also found that the direction and size of score differences varied across social groups and models, and that results for Asian and Hispanic candidates differed across models. To estimate how scores might translate into hiring, the authors applied assumed score cutoffs. At an 80-point cutoff, GPT-3.5 Turbo’s scores corresponded to estimated hiring-probability differences for otherwise similar groups. These are estimates under the study’s rule, not observed hiring outcomes. The researchers used randomized resumes with characteristics drawn from real-world distributions, but tested English-language, entry-level applications in a US setting, using names to signal identity. The authors say further research is needed to identify the causes of the patterns and how they may change over time.","topicIds":["work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"The experiment used fictitious resumes and names to signal gender and racial identity; it does not assess identity information beyond those names. The authors caution that the findings are specific to an English-speaking US context and may not extend to other linguistic or cultural settings. The study covers entry-level positions and standardized resumes, so the authors say its results may not extend to high-skill or management hiring. The hiring-probability estimates depend on an assumed score cutoff; they are not observed hiring outcomes. The experiment was conducted at one snapshot in time, and the authors note that model behavior may evolve.","speaker":{"name":"Jiafu An, Difang Huang, Chen Lin, Mingzhu Tai","roleAtSource":"Article author"},"source":{"title":"Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation","publisher":"PubMed Central","format":"Article","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","publishedAt":"2025-03-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"In a randomized resume-scoring experiment, the models generally assigned higher scores to female candidates and most assigned lower scores to black male candidates than to comparable white male candidates.","excerpt":"the LLMs award higher assessment scores for female candidates with similar work experience, education, and skills, but lower scores for black male candidates with comparable qualifications","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"The authors found that aggregate comparisons can conceal different patterns at the intersection of gender and race.","excerpt":"the higher scores for minorities are driven by those for female candidates (both black and white females), but the scores for black males are in fact significantly lower","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"At an 80-point cutoff, the authors estimate score-based hiring-probability differences for GPT-3.5 Turbo; these are estimates under an assumed rule, not observed hiring outcomes.","excerpt":"with an 80-point cutoff, which implies an average hiring probability of ∼35%, black female applicants could expect a 1.7 percentage-point greater probability of being hired","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"},{"text":"The authors say their results may not extend beyond English-speaking US settings or entry-level hiring, and identity was inferred from names.","excerpt":"our findings are relevant only to an English-speaking context, specifically within the United States, and may not extend to other linguistic or cultural settings","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","relationship":"Source-stated"}],"sourceMedia":{"status":"found","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","checkedAt":"2026-11-17T13:27:32.155Z","items":[{"type":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","attribution":"PubMed Central","basis":"publisher-embed","availability":"verified","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents the regression coefficients that compare the score differen…","verifiedAt":"2026-11-17T13:27:32.439Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the score differences persist when real applications are assessed with professional recruiters’ prompts?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"PubMed Central: An and colleagues find intersecting biases in LLM resume scores","summary":"Jiafu An and colleagues report that five large language models gave different resume scores to fictitious applicants whose qualifications were otherwise similar but whose names signaled different gender and racial identities. In their randomized experiment, the models generally gave female candidates higher scores, while most gave black male candidates lower scores than comparable white male candidates. The authors emphasize that broad group averages can hide these opposing patterns: a model could favor female candidates and still disadvantage black men. They also found that the direction and size of score differences varied across social groups and models, and that results for Asian and Hispanic candidates differed across models. To estimate how scores might translate into hiring, the authors applied assumed score cutoffs. At an 80-point cutoff, GPT-3.5 Turbo’s scores corresponded to estimated hiring-probability differences for otherwise similar groups. These are estimates under the study’s rule, not observed hiring outcomes. The researchers used randomized resumes with characteristics drawn from real-world distributions, but tested English-language, entry-level applications in a US setting, using names to signal identity. The authors say further research is needed to identify the causes of the patterns and how they may change over time.","question":"Would the score differences persist when real applications are assessed with professional recruiters’ prompts?","claims":[{"text":"In a randomized resume-scoring experiment, the models generally assigned higher scores to female candidates and most assigned lower scores to black male candidates than to comparable white male candidates.","excerpt":"the LLMs award higher assessment scores for female candidates with similar work experience, education, and skills, but lower scores for black male candidates with comparable qualifications","support":"source-stated"},{"text":"The authors found that aggregate comparisons can conceal different patterns at the intersection of gender and race.","excerpt":"the higher scores for minorities are driven by those for female candidates (both black and white females), but the scores for black males are in fact significantly lower","support":"source-stated"},{"text":"At an 80-point cutoff, the authors estimate score-based hiring-probability differences for GPT-3.5 Turbo; these are estimates under an assumed rule, not observed hiring outcomes.","excerpt":"with an 80-point cutoff, which implies an average hiring probability of ∼35%, black female applicants could expect a 1.7 percentage-point greater probability of being hired","support":"source-stated"},{"text":"The authors say their results may not extend beyond English-speaking US settings or entry-level hiring, and identity was inferred from names.","excerpt":"our findings are relevant only to an English-speaking context, specifically within the United States, and may not extend to other linguistic or cultural settings","support":"source-stated"}],"limitations":["The experiment used fictitious resumes and names to signal gender and racial identity; it does not assess identity information beyond those names.","The authors caution that the findings are specific to an English-speaking US context and may not extend to other linguistic or cultural settings.","The study covers entry-level positions and standardized resumes, so the authors say its results may not extend to high-skill or management hiring.","The hiring-probability estimates depend on an assumed score cutoff; they are not observed hiring outcomes.","The experiment was conducted at one snapshot in time, and the authors note that model behavior may evolve."],"mediaId":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","correctionReason":null,"id":"0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f","publicationId":"c9669bb2-5895-4399-8b9c-61b443227576","version":1,"sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","sourceTitle":"Measuring gender and racial biases in large language models: Intersectional evidence from automated resume evaluation","publisher":"PubMed Central","publishedAt":null,"originalPublished":{"value":"2025-03-12","precision":"day","basis":"stated_with_named_work"},"firstObservedAt":"2026-11-16T22:56:25.147Z","createdAt":"2026-11-17T13:28:28.417Z","historical":true,"entityIds":["pubmed-central"],"topicIds":["work-and-agency"],"media":[{"id":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","kind":"article","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:27:32.439Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"fea5259f571f307fe33ddd327c07e1856fed21a2a74d19d3e76b4776458beffd","kind":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents ","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-11-17T13:27:32.439Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1794922352439},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","checkedAt":"2026-11-17T13:27:32.155Z","items":[{"type":"image","url":"https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1cee/11937954/1b031d780666/pgaf089f1.jpg","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","attribution":"PubMed Central","basis":"publisher-embed","availability":"verified","label":"Regression coefficients: GPT-3.5 Turbo score differences across social groups. This figure presents the regression coefficients that compare the score differen…","verifiedAt":"2026-11-17T13:27:32.439Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"e9c75903f059c3afe1e7066bebe11876bf89a5859805499e2763d4a8f384c743","confidence":0.88,"provider":"typesafe","model":"jev-1.13.0","inputHash":"066845928c374b3a2db977a4faf163d15a6a9ce21b16f06c02181f53454a6643","decidedAt":"2026-11-17T13:27:33.679Z"},"provenance":{"textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observationId":"6d9d1da4e5d32591a63c2640581b4eef96da6680f806cc5850a6220cd4b4094f","retrievedAt":"2026-11-17T13:27:32.155Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"db979f46-9edc-4f35-86ed-352fc95c9547"},"reviewer":{"model":"gpt-6-luna","runId":"986154d2-41d5-4670-80d7-cf2edbe51373"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:28:28.417Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Jiafu An","url":null,"kind":"unknown"},{"name":"Difang Huang","url":null,"kind":"unknown"},{"name":"Chen Lin","url":null,"kind":"unknown"},{"name":"Mingzhu Tai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Jiafu An","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Jiafu An","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Difang Huang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Difang Huang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Chen Lin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen Lin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}},{"actor":{"name":"Mingzhu Tai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Mingzhu Tai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","locator":"head/meta[name=author|citation_author]"},"assertionId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:27:32.155Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC11937954/","snapshotId":"a898304c803b0517218cd138d517c9301eae9feee48edd1c3718e8886288b43c","contentSha256":"04e79796064c027a1d2eaf23c91d097c28f09277b69508475bd524917f461ce5","textHash":"ca7ae3ffcf047d449d45d6b8bfc7d99454c99427ea6cedf21c427e1a2644102e","observedAt":"2026-11-17T13:27:32.155Z","basis":"publisher-page-metadata","sourceLinks":186,"linksTruncated":true,"metadataUrl":"/api/pipeline/stream/0383417639bc229d88a95329385189a38ca2b7a0b30e143744bf9a2873f0d03f/source"}}}],"audits":[{"publicationId":"c9669bb2-5895-4399-8b9c-61b443227576","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the study to Jiafu An and colleagues, accessed via PubMed Central (PNAS Nexus article). Findings, cautions and estimates are framed as the authors' claims, not as established facts.","excerpt":"Jiafu An\n1, Difang Huang\n2,2,✉, Chen Lin\n3,✉, Mingzhu Tai"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question faithfully convey the randomized design, the pro-female and anti-black-male pattern, the cross-model variation, the cutoff-based estimates and the scope limits. A general reader can follow it. The question is fair: the authors used brief baseline prompts and fictitious resumes. Optional repairs: state the roughly 1–3 percentage-point magnitude, and note the authors' conjecture that the debiasing stage likely drives the female advantage. Neither omission distorts the reading.","excerpt":"These biases may result in ∼1–3 percentage-point differences in hiring probabilities for otherwise similar candidates at a certain threshold"},{"dimension":"date","status":"uncertain","explanation":"The displayed date, 2025-03-12, matches the PNAS Nexus publication. However, the source says the manuscript was first posted as an arXiv preprint. The ID prefix 2403 suggests March 2024, but the printed ID appears truncated, so the exact first-posting date cannot be confirmed. The displayed date may therefore reflect a later journal version rather than the work's first public release.","excerpt":"This manuscript was posted on a preprint: http://arxiv.org/abs/2403.1528."},{"dimension":"support","status":"pass","explanation":"Each claim's excerpt is verbatim and supports it. The reading correctly describes the hiring-probability figures as estimates under an assumed cutoff rule, not observed hiring outcomes. The listed limitations (names as identity signals, US English-speaking context, entry-level jobs, a single point in time) all match the authors' stated caveats. No unsupported benefits, harms or forecasts are added.","excerpt":"Lastly, our experiment is only conducted at one snapshot of time. As AIs continue to evolve and learn, the way they consider social identities in decision-making can also evolve."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original article on PubMed Central. This is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-17T13:28:28.417Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}