# arXiv cs.AI: When Imperfect Automated Fact-Checking Backfires [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-when-imperfect-automated-fact-checking-backfires-9211ca01) Authors Zixuan Liu and Ming Cao study when free, imperfect automated fact-checking can make social learning about misinformation worse. In their model, people can observe an article’s reliability and earlier users’ likes or dislikes, and can pay to check the article manually; manual checks are perfectly accurate. They measure welfare as the probability of a correct cascade, where people’s decisions converge on a correct judgment. The tool creates competing effects: wider access can help people escape a wrong cascade, but errors can mislead people who otherwise would have checked accurately. The authors report a proof that adding the tool strictly lowers welfare for articles of intermediate reliability under specified conditions: truthful articles are not too informative and manual checking is sufficiently costly. Their simulations find the tool can help on either side of that range, and that it improves on manual-only checking on average only above a threshold accuracy. The argument is not that automated checking always harms or helps: its effect depends on reliability, checking costs, and tool accuracy. The abstract does not give the threshold’s value or establish how the model’s results translate to social platforms in practice. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 5, 2026 (2026-11-05). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-09T02:19:01.983Z. First observed: 2026-11-06T05:00:54.742Z. Retrieved: 2026-11-09T02:18:16.577Z. - [When Imperfect Automated Fact-Checking Backfires: Social Learning in the Presence of Misinformation](https://arxiv.org/abs/2611.08053) ## Limits The evidence is an abstract describing a sequential social learning model and simulations; it does not report empirical results from social platforms. The abstract does not state the threshold accuracy or provide details needed to assess the model’s assumptions and simulations. ## Open question What determines the threshold accuracy above which the tool improves on manual-only checking on average? ## Source-stated Liu and Cao analyze free, imperfect automated fact-checking in a sequential social learning model, alongside costly, perfectly accurate manual checks. > We study when such tools can backfire in a sequential social learning model of misinformation. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated They define welfare as the probability of a correct cascade and identify opposing effects of broader checking and tool errors. > Two opposing effects arise. Broader use of fact-checking helps agents escape wrong cascades. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated The authors prove that the tool strictly lowers welfare for intermediate-reliability articles under specified conditions on information and manual-checking costs. > We prove that adding the tool strictly lowers welfare for articles of intermediate reliability when truthful articles are not too informative and manual checking is sufficiently costly. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated In simulations, the tool can help on either side of the intermediate reliability range, and improves on manual-only checking on average only above a threshold accuracy. > Simulations show that the tool can help on either side of the intermediate range, and that it improves on manual-only checking on average only above a threshold accuracy. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source and contributor context Liu, Zixuan, Cao, Ming · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 24a0bbe0-d620-42bf-8576-93f6b0603e6b. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-09T02:19:01.983Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: 597851cfdd8bf3d0841695bab7bcd92cf226a8f1ef151672269384d056d3a0ac. Source text hash: 3158ef1b588d9629e0062ccf6265e844ad342dd0ba6eca092b9512fcdc8b4744. ## Revision and source-check history ### Version 1 — 2026-11-09T02:19:01.983Z Authors Zixuan Liu and Ming Cao study when free, imperfect automated fact-checking can make social learning about misinformation worse. In their model, people can observe an article’s reliability and earlier users’ likes or dislikes, and can pay to check the article manually; manual checks are perfectly accurate. They measure welfare as the probability of a correct cascade, where people’s decisions converge on a correct judgment. The tool creates competing effects: wider access can help people escape a wrong cascade, but errors can mislead people who otherwise would have checked accurately. The authors report a proof that adding the tool strictly lowers welfare for articles of intermediate reliability under specified conditions: truthful articles are not too informative and manual checking is sufficiently costly. Their simulations find the tool can help on either side of that range, and that it improves on manual-only checking on average only above a threshold accuracy. The argument is not that automated checking always harms or helps: its effect depends on reliability, checking costs, and tool accuracy. The abstract does not give the threshold’s value or establish how the model’s results translate to social platforms in practice. ## Original source arXiv cs.AI · Article Original source date: Nov 5, 2026 (2026-11-05). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-09T02:19:01.983Z. First observed: 2026-11-06T05:00:54.742Z. Retrieved: 2026-11-09T02:18:16.577Z. - [When Imperfect Automated Fact-Checking Backfires: Social Learning in the Presence of Misinformation](https://arxiv.org/abs/2611.08053) ## Limits The evidence is an abstract describing a sequential social learning model and simulations; it does not report empirical results from social platforms. The abstract does not state the threshold accuracy or provide details needed to assess the model’s assumptions and simulations. ## Open question What determines the threshold accuracy above which the tool improves on manual-only checking on average? ## Source-stated Liu and Cao analyze free, imperfect automated fact-checking in a sequential social learning model, alongside costly, perfectly accurate manual checks. > We study when such tools can backfire in a sequential social learning model of misinformation. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated They define welfare as the probability of a correct cascade and identify opposing effects of broader checking and tool errors. > Two opposing effects arise. Broader use of fact-checking helps agents escape wrong cascades. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated The authors prove that the tool strictly lowers welfare for intermediate-reliability articles under specified conditions on information and manual-checking costs. > We prove that adding the tool strictly lowers welfare for articles of intermediate reliability when truthful articles are not too informative and manual checking is sufficiently costly. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source-stated In simulations, the tool can help on either side of the intermediate reliability range, and improves on manual-only checking on average only above a threshold accuracy. > Simulations show that the tool can help on either side of the intermediate range, and that it improves on manual-only checking on average only above a threshold accuracy. - [Supporting source](https://arxiv.org/abs/2611.08053) ## Source and contributor context Liu, Zixuan, Cao, Ming · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 24a0bbe0-d620-42bf-8576-93f6b0603e6b. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-09T02:19:01.983Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: useful\_perspective. Observation: 597851cfdd8bf3d0841695bab7bcd92cf226a8f1ef151672269384d056d3a0ac. Source text hash: 3158ef1b588d9629e0062ccf6265e844ad342dd0ba6eca092b9512fcdc8b4744. ### passed — 2026-11-09T02:19:01.983Z — anthropic/claude-opus-5.5 Publication: 24a0bbe0-d620-42bf-8576-93f6b0603e6b attribution — pass: The reading correctly attributes the paper to Zixuan Liu and Ming Cao on arXiv cs.AI. It frames the proof and simulation results as the authors' reported findings, not as established facts. > Authors:Zixuan Liu, Ming Cao summary — pass: The summary leads with the paper's question and explains its model, the welfare measure and the two opposing effects. It states the conditional proof, the simulation results and what remains unknown. Correct cascade and welfare are glossed in plain language, and the conditions and scope are preserved. The question follows from the stated threshold result and is not a leading claim. > Two opposing effects arise. Broader use of fact-checking helps agents escape wrong cascades. date — pass: originalPublished 2026-11-05 matches the v1 submission date on the arXiv page. It is not the later feed date. > \[Submitted on 5 Nov 2026\] support — pass: Each claim matches the abstract, including the conditions on the proof and the average-only-above-threshold accuracy result. The closing synthesis that the effect depends on reliability, checking costs and tool accuracy follows directly from the stated conditions. The limitations correctly note that the work is model- and simulation-based and that the abstract gives no threshold value. > We prove that adding the tool strictly lowers welfare for articles of intermediate reliability when truthful articles are not too informative and manual checking is sufficiently costly. media — pass: The selected media is the verified direct link to the original arXiv abstract page. It is the most direct way to access the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/9211ca01c8fe2f725854519cff4b6c611d169fd38c2c17b896f13eccb3d933f8/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-when-imperfect-automated-fact-checking-backfires-9211ca01.json)