{"id":"3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32","title":"arXiv paper reports hiring-model decisions sensitive to small resume changes","argument":"In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether LLM-based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's arXiv abstract, so it does not provide detailed methods or results beyond the abstract's summary.","speaker":{"name":"Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina","roleAtSource":"Article author"},"source":{"title":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","publisher":"arXiv","format":"Article","url":"https://arxiv.org/abs/2501.04316","publishedAt":"2025-01-08","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.","excerpt":"through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.","excerpt":"generated summaries exhibit meaningful differences more frequently for race than for gender perturbations","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.","excerpt":"non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.","excerpt":"retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.","excerpt":"can exhibit notable biases that lead to discriminatory outcomes in real-world contexts","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2501.04316","checkedAt":"2026-11-17T13:47:00.709Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv paper reports hiring-model decisions sensitive to small resume changes","summary":"In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether LLM-based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.","question":"Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?","claims":[{"text":"The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.","excerpt":"through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings","support":"source-stated"},{"text":"The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.","excerpt":"generated summaries exhibit meaningful differences more frequently for race than for gender perturbations","support":"source-stated"},{"text":"The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.","excerpt":"non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations","support":"source-stated"},{"text":"The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.","excerpt":"retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness","support":"source-stated"},{"text":"The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.","excerpt":"can exhibit notable biases that lead to discriminatory outcomes in real-world contexts","support":"source-stated"}],"limitations":["The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes.","The supplied evidence is the paper's arXiv abstract, so it does not provide detailed methods or results beyond the abstract's summary."],"mediaId":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","correctionReason":null,"id":"3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32","publicationId":"8f083368-6715-45ad-89cf-2ae0151a7f68","version":1,"sourceUrl":"https://arxiv.org/abs/2501.04316","sourceTitle":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","publisher":"arXiv","publishedAt":null,"originalPublished":{"value":"2025-01-08","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-16T22:56:25.147Z","createdAt":"2026-11-17T13:31:15.156Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","kind":"article","url":"https://arxiv.org/abs/2501.04316","sourceUrl":"https://arxiv.org/abs/2501.04316","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:30:22.784Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2501.04316","checkedAt":"2026-11-17T13:47:00.709Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3ec64e03142587127152c870b0acfc5cfbed2adca0c17e973ff6fb79ed99f1b2","decidedAt":"2026-11-17T13:30:23.516Z"},"provenance":{"textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observationId":"81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61","retrievedAt":"2026-11-17T13:30:22.653Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"f1e61324-9572-42ea-875b-315e3e8ecb8a"},"reviewer":{"model":"gpt-6-luna","runId":"f229ccca-c793-415a-8748-1940c9418d30"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:31:15.156Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Seshadri, Preethi","url":null,"kind":"unknown"},{"name":"Chen, Hongyu","url":null,"kind":"unknown"},{"name":"Singh, Sameer","url":null,"kind":"unknown"},{"name":"Goldfarb-Tarrant, Seraphina","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Seshadri, Preethi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Seshadri, Preethi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Chen, Hongyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Hongyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Singh, Sameer","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Singh, Sameer","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Goldfarb-Tarrant, Seraphina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Goldfarb-Tarrant, Seraphina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2501.04316","snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-paper-reports-hiring-model-decisions-sensitive-to-small-3e3c462b","formats":{"html":"/readings/arxiv-paper-reports-hiring-model-decisions-sensitive-to-small-3e3c462b","markdown":"/readings/arxiv-paper-reports-hiring-model-decisions-sensitive-to-small-3e3c462b.md","json":"/readings/arxiv-paper-reports-hiring-model-decisions-sensitive-to-small-3e3c462b.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32","revision":"8f083368-6715-45ad-89cf-2ae0151a7f68","revisionKind":"publication-id","title":"arXiv paper reports hiring-model decisions sensitive to small resume changes","url":"https://escapemeridian.com/readings/arxiv-paper-reports-hiring-model-decisions-sensitive-to-small-3e3c462b"},"source":{"type":"source","id":"https://arxiv.org/abs/2501.04316","revision":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","revisionKind":"sha256-source-text","title":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","url":"https://arxiv.org/abs/2501.04316"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32","title":"arXiv paper reports hiring-model decisions sensitive to small resume changes","argument":"In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether LLM-based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes. The supplied evidence is the paper's arXiv abstract, so it does not provide detailed methods or results beyond the abstract's summary.","speaker":{"name":"Seshadri, Preethi, Chen, Hongyu, Singh, Sameer, Goldfarb-Tarrant, Seraphina","roleAtSource":"Article author"},"source":{"title":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","publisher":"arXiv","format":"Article","url":"https://arxiv.org/abs/2501.04316","publishedAt":"2025-01-08","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.","excerpt":"through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.","excerpt":"generated summaries exhibit meaningful differences more frequently for race than for gender perturbations","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.","excerpt":"non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.","excerpt":"retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"},{"text":"The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.","excerpt":"can exhibit notable biases that lead to discriminatory outcomes in real-world contexts","url":"https://arxiv.org/abs/2501.04316","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2501.04316","checkedAt":"2026-11-17T13:47:00.709Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv paper reports hiring-model decisions sensitive to small resume changes","summary":"In their paper, Preethi Seshadri, Hongyu Chen, Sameer Singh and Seraphina Goldfarb-Tarrant examine whether LLM-based hiring systems treat applicants differently when resumes change. They test resume summarization and applicant ranking using a synthetic resume dataset with controlled perturbations and curated job postings. The authors report that generated summaries differ more often with race than gender changes, while retrieval selection varies across demographic groups and rankings are highly sensitive to both gender and race changes. They also find retrieval models can respond comparably to demographic and non-demographic changes, which they say suggests that fairness problems may reflect broader model brittleness. Their concern is not limited to what a system writes about an applicant: retrieval can affect which applicants are selected for ranking in the first place. The abstract says these biases can lead to discriminatory outcomes in real-world contexts, but the described tests use a synthetic dataset rather than reporting observed hiring outcomes. The findings therefore identify sensitivity in two tasks modeled on HR use; how those measured differences play out in actual hiring remains unresolved.","question":"Do the sensitivities measured in these tasks lead to discriminatory outcomes in actual hiring?","claims":[{"text":"The authors investigate fairness in resume summarization and applicant ranking using a synthetic dataset with controlled resume changes and curated job postings.","excerpt":"through two tasks that reflect actual HR usage: resume summarization and applicant ranking. By constructing a synthetic resume dataset with controlled perturbations and curating job postings","support":"source-stated"},{"text":"The authors report that generated summaries show meaningful differences more often after race changes than after gender changes.","excerpt":"generated summaries exhibit meaningful differences more frequently for race than for gender perturbations","support":"source-stated"},{"text":"The authors report that retrieval selection varies across demographic groups and rankings are highly sensitive to gender and race changes.","excerpt":"non-uniform retrieval selection patterns across demographic groups and exhibit high ranking sensitivity to both gender and race perturbations","support":"source-stated"},{"text":"The authors say comparable sensitivity to demographic and non-demographic changes in retrieval models suggests fairness issues may also stem from broader model brittleness.","excerpt":"retrieval models can show comparable sensitivity to both demographic and non-demographic changes, suggesting that fairness issues may stem from broader model brittleness","support":"source-stated"},{"text":"The abstract warns that the reported biases may lead to discriminatory outcomes in real-world contexts.","excerpt":"can exhibit notable biases that lead to discriminatory outcomes in real-world contexts","support":"source-stated"}],"limitations":["The described evaluation uses a synthetic resume dataset with controlled perturbations and curated job postings; the abstract does not report observed hiring outcomes.","The supplied evidence is the paper's arXiv abstract, so it does not provide detailed methods or results beyond the abstract's summary."],"mediaId":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","correctionReason":null,"id":"3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32","publicationId":"8f083368-6715-45ad-89cf-2ae0151a7f68","version":1,"sourceUrl":"https://arxiv.org/abs/2501.04316","sourceTitle":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","publisher":"arXiv","publishedAt":null,"originalPublished":{"value":"2025-01-08","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-16T22:56:25.147Z","createdAt":"2026-11-17T13:31:15.156Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","kind":"article","url":"https://arxiv.org/abs/2501.04316","sourceUrl":"https://arxiv.org/abs/2501.04316","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:30:22.784Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2501.04316","checkedAt":"2026-11-17T13:47:00.709Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"10b374879da6a712d063c2b99cf436886365bde352cbe26523b24b93c9de0028","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"3ec64e03142587127152c870b0acfc5cfbed2adca0c17e973ff6fb79ed99f1b2","decidedAt":"2026-11-17T13:30:23.516Z"},"provenance":{"textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observationId":"81030d77de4ddf12cb4b57d90bbf1cc9bc1e31812fde796960084e398680aa61","retrievedAt":"2026-11-17T13:30:22.653Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"f1e61324-9572-42ea-875b-315e3e8ecb8a"},"reviewer":{"model":"gpt-6-luna","runId":"f229ccca-c793-415a-8748-1940c9418d30"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:31:15.156Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Seshadri, Preethi","url":null,"kind":"unknown"},{"name":"Chen, Hongyu","url":null,"kind":"unknown"},{"name":"Singh, Sameer","url":null,"kind":"unknown"},{"name":"Goldfarb-Tarrant, Seraphina","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Seshadri, Preethi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Seshadri, Preethi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Chen, Hongyu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chen, Hongyu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Singh, Sameer","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Singh, Sameer","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}},{"actor":{"name":"Goldfarb-Tarrant, Seraphina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Goldfarb-Tarrant, Seraphina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2501.04316","locator":"head/meta[name=author|citation_author]"},"assertionId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T13:38:58.533Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","sourceUrl":"https://arxiv.org/abs/2501.04316","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2501.04316","snapshotId":"a89af6e9ccb90a6992a79b69b99c044d2ed32220b7eb4e11d6fa8b3c5e21c22c","contentSha256":"9da49e91f9e0310748ae0490c63d06a59d88ab5decdcfe2617e428c8a07c7058","textHash":"6302fa57923e59f72ed7539ee275519b3ea2892ac13e45227f095f4efb3d8a91","observedAt":"2026-11-17T13:38:58.533Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/3e3c462b5e1c3423e25bb5f2fb8e42ad25b9ffdc72e2eb6c295432316c5b0f32/source"}}}],"audits":[{"publicationId":"8f083368-6715-45ad-89cf-2ae0151a7f68","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading names the four listed authors and attributes findings and interpretations to them ('The authors report', 'they say', 'The abstract says'). Source assertions are not presented as established fact.","excerpt":"Authors:Preethi Seshadri, Hongyu Chen, Sameer Singh, Seraphina Goldfarb-Tarrant"},{"dimension":"summary","status":"pass","explanation":"The title and summary faithfully cover the two tasks, the synthetic dataset, the race/gender and retrieval findings, the brittleness interpretation and the real-world warning. The question follows from the gap between synthetic tests and actual hiring. The 'Surprisingly' framing is softened, but this is stylistic. 'Retrieval' and 'perturbations' could use term-library tooltips. Context such as 'resume changes' and 'selected for ranking' keeps the reading understandable to a general reader.","excerpt":"Surprisingly, retrieval models can show comparable sensitivity to both demographic and non-demographic changes"},{"dimension":"date","status":"pass","explanation":"originalPublished 2025-01-08 matches the v1 submission date. It is not the 4 Sep 2025 revision date.","excerpt":"Submitted on 8 Jan 2025 (v1), last revised 4 Sep 2025 (this version, v2)"},{"dimension":"support","status":"uncertain","explanation":"Most claims are directly supported. However, the sentence 'retrieval can affect which applicants are selected for ranking in the first place' describes a pipeline structure the abstract does not set out. The abstract only reports non-uniform retrieval selection patterns and stresses the retrieval stage. Smallest repair: attribute that framing to the abstract's emphasis on the retrieval stage, or label it as Escape Meridian interpretation. Separately, the claim adds 'also' ('may also stem'), which slightly alters the source's 'may stem from broader model brittleness'. Repair: remove 'also'.","excerpt":"Overall, our results indicate that LLM-based hiring systems, especially in the retrieval stage, can exhibit notable biases"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-17T13:31:15.156Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}