{"id":"5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c","title":"Radhika Shah’s study finds fact-checking LLMs vulnerable to corrupted multilingual evidence","argument":"Radhika Shah’s paper evaluates whether fact-checking LLMs remain accurate when evidence is corrupted or written in languages where models are weaker. The study builds gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then applies four corruption strategies at two severity levels. It reports that verdict accuracy is highly sensitive to both corruption and language: misleading edits cut Llama 3.1 8B’s English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases. Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap. Rubric-based LLM-as-a-judge scores decline more slowly than verdict accuracy, which the authors say suggests automated reasoning evaluation underestimates degradation. The paper cautions against deploying LLM fact-checkers on noisy multilingual evidence and says it releases evidence datasets and evaluation code for future work.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not identify the four corruption strategies or give results for each strategy and severity level. The abstract does not name the other tested LLMs or provide their individual results. The evidence provided is the paper’s abstract, so it does not include details of the rubric-based scoring method or the released datasets and evaluation code.","speaker":{"name":"Shah, Radhika","roleAtSource":"Article author"},"source":{"title":"Evaluating the Robustness of Fact-Checking LLMs on Multilingual Evidence","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.18623","publishedAt":"2026-09-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study evaluates fact-checking LLMs using evidence in English, German, Greek, and Romanian, and applies four corruption strategies at two severity levels.","excerpt":"we construct gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then apply four corruption strategies at two severity levels.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The paper reports that misleading edits reduced Llama 3.1 8B’s English verdict accuracy from 80.00% to 16.84%, with losses widening as language resource level decreases.","excerpt":"Misleading edit cut Llama 3.1 8B's English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The paper reports that translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","excerpt":"Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The authors say rubric-based LLM-as-a-judge scores decline more slowly than accuracy, suggesting automated reasoning evaluation underestimates degradation.","excerpt":"Judge scores decline more slowly than accuracy, suggesting that automated reasoning evaluation underestimates degradation.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The authors caution against deploying LLM fact-checkers on noisy multilingual evidence and say they release evidence datasets and evaluation code for future work.","excerpt":"These results caution against deploying LLM fact-checkers on noisy multilingual evidence, and we release our evidence datasets and evaluation code to support future work.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18623","checkedAt":"2026-11-17T11:46:08.588Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which of the four corruption strategies, and which severity levels, account for the largest accuracy losses across the tested languages?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Radhika Shah’s study finds fact-checking LLMs vulnerable to corrupted multilingual evidence","summary":"Radhika Shah’s paper evaluates whether fact-checking LLMs remain accurate when evidence is corrupted or written in languages where models are weaker. The study builds gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then applies four corruption strategies at two severity levels. It reports that verdict accuracy is highly sensitive to both corruption and language: misleading edits cut Llama 3.1 8B’s English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases. Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap. Rubric-based LLM-as-a-judge scores decline more slowly than verdict accuracy, which the authors say suggests automated reasoning evaluation underestimates degradation. The paper cautions against deploying LLM fact-checkers on noisy multilingual evidence and says it releases evidence datasets and evaluation code for future work.","question":"Which of the four corruption strategies, and which severity levels, account for the largest accuracy losses across the tested languages?","claims":[{"text":"The study evaluates fact-checking LLMs using evidence in English, German, Greek, and Romanian, and applies four corruption strategies at two severity levels.","excerpt":"we construct gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then apply four corruption strategies at two severity levels.","support":"source-stated"},{"text":"The paper reports that misleading edits reduced Llama 3.1 8B’s English verdict accuracy from 80.00% to 16.84%, with losses widening as language resource level decreases.","excerpt":"Misleading edit cut Llama 3.1 8B's English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases.","support":"source-stated"},{"text":"The paper reports that translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","excerpt":"Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","support":"source-stated"},{"text":"The authors say rubric-based LLM-as-a-judge scores decline more slowly than accuracy, suggesting automated reasoning evaluation underestimates degradation.","excerpt":"Judge scores decline more slowly than accuracy, suggesting that automated reasoning evaluation underestimates degradation.","support":"source-stated"},{"text":"The authors caution against deploying LLM fact-checkers on noisy multilingual evidence and say they release evidence datasets and evaluation code for future work.","excerpt":"These results caution against deploying LLM fact-checkers on noisy multilingual evidence, and we release our evidence datasets and evaluation code to support future work.","support":"source-stated"}],"limitations":["The abstract does not identify the four corruption strategies or give results for each strategy and severity level.","The abstract does not name the other tested LLMs or provide their individual results.","The evidence provided is the paper’s abstract, so it does not include details of the rubric-based scoring method or the released datasets and evaluation code."],"mediaId":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","correctionReason":null,"id":"5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c","publicationId":"de6870f3-d38e-4163-8bff-1e2907b8d3be","version":1,"sourceUrl":"https://arxiv.org/abs/2611.18623","sourceTitle":"Evaluating the Robustness of Fact-Checking LLMs on Multilingual Evidence","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-09-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:33:34.582Z","createdAt":"2026-11-17T11:31:09.358Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","kind":"article","url":"https://arxiv.org/abs/2611.18623","sourceUrl":"https://arxiv.org/abs/2611.18623","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T11:18:14.064Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18623","checkedAt":"2026-11-17T11:46:08.588Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e9c9c1338e5bbdcfeee63569d6a1730172b1934f0818bc6411d2795144b7820d","decidedAt":"2026-11-17T11:18:15.929Z"},"provenance":{"textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observationId":"fe3d7a4c3e23f77989c7b0ffdbab4f0e0c37bc5a53699aa5d4cad4905edf3c18","retrievedAt":"2026-11-17T11:18:13.779Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"31495a78-295f-40f9-838e-9f2195334ea5"},"reviewer":{"model":"gpt-6-luna","runId":"03b98489-9196-4fd7-847b-8d29c7d9aae3"}},"audit":{"status":"passed","reviewedAt":"2026-11-17T11:31:09.358Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shah, Radhika","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shah, Radhika","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shah, Radhika","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18623","locator":"head/meta[name=author|citation_author]"},"assertionId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T11:46:08.588Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96","sourceUrl":"https://arxiv.org/abs/2611.18623","contentSha256":"462feccd40a144180e865d13e8717d362a11ed3b2f695dc411c8bcc867fed62a","textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observedAt":"2026-11-17T11:46:08.588Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.18623","snapshotId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96","contentSha256":"462feccd40a144180e865d13e8717d362a11ed3b2f695dc411c8bcc867fed62a","textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observedAt":"2026-11-17T11:46:08.588Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/radhika-shah-s-study-finds-fact-checking-llms-vulnerable-to-5bb4fc4c","formats":{"html":"/readings/radhika-shah-s-study-finds-fact-checking-llms-vulnerable-to-5bb4fc4c","markdown":"/readings/radhika-shah-s-study-finds-fact-checking-llms-vulnerable-to-5bb4fc4c.md","json":"/readings/radhika-shah-s-study-finds-fact-checking-llms-vulnerable-to-5bb4fc4c.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c","revision":"de6870f3-d38e-4163-8bff-1e2907b8d3be","revisionKind":"publication-id","title":"Radhika Shah’s study finds fact-checking LLMs vulnerable to corrupted multilingual evidence","url":"https://escapemeridian.com/readings/radhika-shah-s-study-finds-fact-checking-llms-vulnerable-to-5bb4fc4c"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.18623","revision":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","revisionKind":"sha256-source-text","title":"Evaluating the Robustness of Fact-Checking LLMs on Multilingual Evidence","url":"https://arxiv.org/abs/2611.18623"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c","title":"Radhika Shah’s study finds fact-checking LLMs vulnerable to corrupted multilingual evidence","argument":"Radhika Shah’s paper evaluates whether fact-checking LLMs remain accurate when evidence is corrupted or written in languages where models are weaker. The study builds gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then applies four corruption strategies at two severity levels. It reports that verdict accuracy is highly sensitive to both corruption and language: misleading edits cut Llama 3.1 8B’s English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases. Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap. Rubric-based LLM-as-a-judge scores decline more slowly than verdict accuracy, which the authors say suggests automated reasoning evaluation underestimates degradation. The paper cautions against deploying LLM fact-checkers on noisy multilingual evidence and says it releases evidence datasets and evaluation code for future work.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The abstract does not identify the four corruption strategies or give results for each strategy and severity level. The abstract does not name the other tested LLMs or provide their individual results. The evidence provided is the paper’s abstract, so it does not include details of the rubric-based scoring method or the released datasets and evaluation code.","speaker":{"name":"Shah, Radhika","roleAtSource":"Article author"},"source":{"title":"Evaluating the Robustness of Fact-Checking LLMs on Multilingual Evidence","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.18623","publishedAt":"2026-09-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study evaluates fact-checking LLMs using evidence in English, German, Greek, and Romanian, and applies four corruption strategies at two severity levels.","excerpt":"we construct gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then apply four corruption strategies at two severity levels.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The paper reports that misleading edits reduced Llama 3.1 8B’s English verdict accuracy from 80.00% to 16.84%, with losses widening as language resource level decreases.","excerpt":"Misleading edit cut Llama 3.1 8B's English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The paper reports that translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","excerpt":"Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The authors say rubric-based LLM-as-a-judge scores decline more slowly than accuracy, suggesting automated reasoning evaluation underestimates degradation.","excerpt":"Judge scores decline more slowly than accuracy, suggesting that automated reasoning evaluation underestimates degradation.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"},{"text":"The authors caution against deploying LLM fact-checkers on noisy multilingual evidence and say they release evidence datasets and evaluation code for future work.","excerpt":"These results caution against deploying LLM fact-checkers on noisy multilingual evidence, and we release our evidence datasets and evaluation code to support future work.","url":"https://arxiv.org/abs/2611.18623","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18623","checkedAt":"2026-11-17T11:46:08.588Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which of the four corruption strategies, and which severity levels, account for the largest accuracy losses across the tested languages?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Radhika Shah’s study finds fact-checking LLMs vulnerable to corrupted multilingual evidence","summary":"Radhika Shah’s paper evaluates whether fact-checking LLMs remain accurate when evidence is corrupted or written in languages where models are weaker. The study builds gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then applies four corruption strategies at two severity levels. It reports that verdict accuracy is highly sensitive to both corruption and language: misleading edits cut Llama 3.1 8B’s English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases. Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap. Rubric-based LLM-as-a-judge scores decline more slowly than verdict accuracy, which the authors say suggests automated reasoning evaluation underestimates degradation. The paper cautions against deploying LLM fact-checkers on noisy multilingual evidence and says it releases evidence datasets and evaluation code for future work.","question":"Which of the four corruption strategies, and which severity levels, account for the largest accuracy losses across the tested languages?","claims":[{"text":"The study evaluates fact-checking LLMs using evidence in English, German, Greek, and Romanian, and applies four corruption strategies at two severity levels.","excerpt":"we construct gold evidence sets for 190 claims in each of English, German, Greek, and Romanian, then apply four corruption strategies at two severity levels.","support":"source-stated"},{"text":"The paper reports that misleading edits reduced Llama 3.1 8B’s English verdict accuracy from 80.00% to 16.84%, with losses widening as language resource level decreases.","excerpt":"Misleading edit cut Llama 3.1 8B's English accuracy from 80.00% to 16.84%, and losses widen as language resource level decreases.","support":"source-stated"},{"text":"The paper reports that translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","excerpt":"Machine-translating Greek and Romanian claims into English recovers much, but not all, of the low-resource gap.","support":"source-stated"},{"text":"The authors say rubric-based LLM-as-a-judge scores decline more slowly than accuracy, suggesting automated reasoning evaluation underestimates degradation.","excerpt":"Judge scores decline more slowly than accuracy, suggesting that automated reasoning evaluation underestimates degradation.","support":"source-stated"},{"text":"The authors caution against deploying LLM fact-checkers on noisy multilingual evidence and say they release evidence datasets and evaluation code for future work.","excerpt":"These results caution against deploying LLM fact-checkers on noisy multilingual evidence, and we release our evidence datasets and evaluation code to support future work.","support":"source-stated"}],"limitations":["The abstract does not identify the four corruption strategies or give results for each strategy and severity level.","The abstract does not name the other tested LLMs or provide their individual results.","The evidence provided is the paper’s abstract, so it does not include details of the rubric-based scoring method or the released datasets and evaluation code."],"mediaId":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","correctionReason":null,"id":"5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c","publicationId":"de6870f3-d38e-4163-8bff-1e2907b8d3be","version":1,"sourceUrl":"https://arxiv.org/abs/2611.18623","sourceTitle":"Evaluating the Robustness of Fact-Checking LLMs on Multilingual Evidence","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-09-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:33:34.582Z","createdAt":"2026-11-17T11:31:09.358Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","kind":"article","url":"https://arxiv.org/abs/2611.18623","sourceUrl":"https://arxiv.org/abs/2611.18623","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T11:18:14.064Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.18623","checkedAt":"2026-11-17T11:46:08.588Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d8df36b1eb09e1a69be9a06a4cb03a0d1f6e6cd9fb82f71c4399a32c394eac7e","confidence":0.65,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e9c9c1338e5bbdcfeee63569d6a1730172b1934f0818bc6411d2795144b7820d","decidedAt":"2026-11-17T11:18:15.929Z"},"provenance":{"textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observationId":"fe3d7a4c3e23f77989c7b0ffdbab4f0e0c37bc5a53699aa5d4cad4905edf3c18","retrievedAt":"2026-11-17T11:18:13.779Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"31495a78-295f-40f9-838e-9f2195334ea5"},"reviewer":{"model":"gpt-6-luna","runId":"03b98489-9196-4fd7-847b-8d29c7d9aae3"}},"audit":{"status":"passed","reviewedAt":"2026-11-17T11:31:09.358Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shah, Radhika","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shah, Radhika","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shah, Radhika","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.18623","locator":"head/meta[name=author|citation_author]"},"assertionId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T11:46:08.588Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96","sourceUrl":"https://arxiv.org/abs/2611.18623","contentSha256":"462feccd40a144180e865d13e8717d362a11ed3b2f695dc411c8bcc867fed62a","textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observedAt":"2026-11-17T11:46:08.588Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.18623","snapshotId":"0948760ebfa3b19fdc0fa1bba0c81da32ec960fd6960c73470057d7fdbbacd96","contentSha256":"462feccd40a144180e865d13e8717d362a11ed3b2f695dc411c8bcc867fed62a","textHash":"9895dfb6dc9e30684bbec2a91f9addafdee3e268667804f073a3d5cc7d589303","observedAt":"2026-11-17T11:46:08.588Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/5bb4fc4cd3a7a73d182bc2e43691a22d4245f13e45f9769059a806544b9ea62c/source"}}}],"audits":[{"publicationId":"de6870f3-d38e-4163-8bff-1e2907b8d3be","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper is correctly attributed to Radhika Shah, its only listed author, and published on arXiv. Findings are framed as what the paper reports or argues. The phrase 'the authors say' is slightly off for a single-author paper, but it does not misattribute any claim.","excerpt":"Authors:Radhika Shah"},{"dimension":"summary","status":"pass","explanation":"The title, summary and question match the abstract. They cover the four languages, the four corruption strategies at two severity levels, the Llama 3.1 8B drop, the partial recovery from translation, the judge-score lag and the deployment caution. The summary partly explains 'low-resource' as languages where models are weaker. Terms such as LLM-as-a-judge and gold evidence sets are kept exact and suit term-library tooltips. The question is an open issue the abstract leaves unresolved.","excerpt":"real-world evidence is often incomplete, misleading, or written in a language where models are weaker"},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-09-17 matches the v1 submission date, not the later feed date of 2026-11-17.","excerpt":"[Submitted on 17 Sep 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim quotes the abstract verbatim and keeps the source's own framing, including 'suggesting' for the judge-score interpretation. The caution against deployment is attributed to the paper, not stated as fact. The draft invents no benefits, costs or forecasts. Its listed limitations correctly identify what the abstract omits.","excerpt":"Judge scores decline more slowly than accuracy, suggesting that automated reasoning evaluation underestimates degradation."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page. It matches the source URL, which is the most direct access to the paper.","excerpt":null}],"createdAt":"2026-11-17T11:31:09.358Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}