{"id":"baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c","title":"arXiv cs.AI: Expert disagreement can reduce LLM decision accuracy","argument":"Yupeng Tang and Mingfeng Lin argue that counting how often language models change their answers cannot show whether they corrected mistakes or abandoned correct decisions. Their study compares a model’s initial answer with its revision after neutral reflection, anonymous disagreement, or disagreement labeled as coming from a domain expert. For binary decisions, they say revision improves accuracy only when wrong answers are reversed often enough relative to correct ones; at 90% initial accuracy, the required ratio is nine to one. Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, none met that threshold under expert disagreement, and accuracy fell by as much as 16.1 points. Yet the expert label increased reversals for four models, while its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain. The authors also report that identical arguments can prompt more reversals when labeled as expert advice, and that models respond to stated source reliability. Their central warning is that reversal counts alone can mistake deference for sound revision. They recommend evaluating revision pipelines with paired, conditional metrics for each model and protocol.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract and does not identify the five models or provide the detailed protocols behind the reported results. The authors describe results across selected evidence-grounded decisions and domains; the abstract does not establish how the findings generalize beyond those evaluations.","speaker":{"name":"Tang, Yupeng, Lin, Mingfeng","roleAtSource":"Article author"},"source":{"title":"When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.16694","publishedAt":"2026-11-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce a controlled two-pass audit that varies the revision context while holding the question, evidence, and initial answer fixed.","excerpt":"holds the question, the evidence, and the model's initial answer fixed and varies only the revision context","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"For binary decisions, revision raises accuracy only if wrong answers are reversed more often than correct ones by a threshold based on initial accuracy; at 90% initial accuracy, the ratio is nine to one.","excerpt":"reversing wrong answers more than $a/(1-a)$ times as often as correct ones, where $a$ is initial accuracy (nine times at 90%).","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model met the authors’ threshold under expert disagreement, and accuracy fell by up to 16.1 points.","excerpt":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model clears this bar under expert disagreement, and accuracy falls by up to 16.1 points.","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"The expert label increased reversals for four models, but its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain.","excerpt":"The expert label, a prestige cue, adds reversals for four of the five models, yet its effect on accuracy ranges from a 5.2-point loss to a 2.4-point gain","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"The authors report that an expert label can increase reversals even when the arguments are identical, and recommend paired, conditional evaluation metrics for each model and protocol.","excerpt":"With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models. Models also respond to stated source reliability. Revision pipelines should therefore be evaluated with paired, conditional metrics, per model and","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16694","checkedAt":"2026-11-13T12:50:09.681Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which model and protocol conditions determine whether an expert label improves accuracy rather than merely increasing reversals?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Expert disagreement can reduce LLM decision accuracy","summary":"Yupeng Tang and Mingfeng Lin argue that counting how often language models change their answers cannot show whether they corrected mistakes or abandoned correct decisions. Their study compares a model’s initial answer with its revision after neutral reflection, anonymous disagreement, or disagreement labeled as coming from a domain expert. For binary decisions, they say revision improves accuracy only when wrong answers are reversed often enough relative to correct ones; at 90% initial accuracy, the required ratio is nine to one. Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, none met that threshold under expert disagreement, and accuracy fell by as much as 16.1 points. Yet the expert label increased reversals for four models, while its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain. The authors also report that identical arguments can prompt more reversals when labeled as expert advice, and that models respond to stated source reliability. Their central warning is that reversal counts alone can mistake deference for sound revision. They recommend evaluating revision pipelines with paired, conditional metrics for each model and protocol.","question":"Which model and protocol conditions determine whether an expert label improves accuracy rather than merely increasing reversals?","claims":[{"text":"The authors introduce a controlled two-pass audit that varies the revision context while holding the question, evidence, and initial answer fixed.","excerpt":"holds the question, the evidence, and the model's initial answer fixed and varies only the revision context","support":"source-stated"},{"text":"For binary decisions, revision raises accuracy only if wrong answers are reversed more often than correct ones by a threshold based on initial accuracy; at 90% initial accuracy, the ratio is nine to one.","excerpt":"reversing wrong answers more than $a/(1-a)$ times as often as correct ones, where $a$ is initial accuracy (nine times at 90%).","support":"source-stated"},{"text":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model met the authors’ threshold under expert disagreement, and accuracy fell by up to 16.1 points.","excerpt":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model clears this bar under expert disagreement, and accuracy falls by up to 16.1 points.","support":"source-stated"},{"text":"The expert label increased reversals for four models, but its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain.","excerpt":"The expert label, a prestige cue, adds reversals for four of the five models, yet its effect on accuracy ranges from a 5.2-point loss to a 2.4-point gain","support":"source-stated"},{"text":"The authors report that an expert label can increase reversals even when the arguments are identical, and recommend paired, conditional evaluation metrics for each model and protocol.","excerpt":"With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models. Models also respond to stated source reliability. Revision pipelines should therefore be evaluated with paired, conditional metrics, per model and","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract and does not identify the five models or provide the detailed protocols behind the reported results.","The authors describe results across selected evidence-grounded decisions and domains; the abstract does not establish how the findings generalize beyond those evaluations."],"mediaId":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","correctionReason":null,"id":"baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c","publicationId":"f2985812-e799-477f-8e7b-62324fb657ae","version":1,"sourceUrl":"https://arxiv.org/abs/2611.16694","sourceTitle":"When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-12","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:43:35.205Z","createdAt":"2026-11-13T11:47:39.774Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","kind":"article","url":"https://arxiv.org/abs/2611.16694","sourceUrl":"https://arxiv.org/abs/2611.16694","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T11:46:48.224Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16694","checkedAt":"2026-11-13T12:50:09.681Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"09ffd0827f9d9c9990230b276640a67b4658b73e3b412f2120bade70bada846a","decidedAt":"2026-11-13T11:46:48.947Z"},"provenance":{"textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observationId":"d747cd853b9c176531224f1de9833296ff273c36ee8a4b48bae927af8645aabe","retrievedAt":"2026-11-13T11:46:48.120Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"68447653-b5c2-4f92-86e6-a94cc700ac00"},"reviewer":{"model":"gpt-6-luna","runId":"101251c2-7fdc-4352-87fd-04f8ad866ce6"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T11:47:39.774Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Tang, Yupeng","url":null,"kind":"unknown"},{"name":"Lin, Mingfeng","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Tang, Yupeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Yupeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16694","locator":"head/meta[name=author|citation_author]"},"assertionId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:50:09.681Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","sourceUrl":"https://arxiv.org/abs/2611.16694","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z"}},{"actor":{"name":"Lin, Mingfeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lin, Mingfeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16694","locator":"head/meta[name=author|citation_author]"},"assertionId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:50:09.681Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","sourceUrl":"https://arxiv.org/abs/2611.16694","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.16694","snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-expert-disagreement-can-reduce-llm-decision-accuracy-baf19256","formats":{"html":"/readings/arxiv-cs-ai-expert-disagreement-can-reduce-llm-decision-accuracy-baf19256","markdown":"/readings/arxiv-cs-ai-expert-disagreement-can-reduce-llm-decision-accuracy-baf19256.md","json":"/readings/arxiv-cs-ai-expert-disagreement-can-reduce-llm-decision-accuracy-baf19256.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c","revision":"f2985812-e799-477f-8e7b-62324fb657ae","revisionKind":"publication-id","title":"arXiv cs.AI: Expert disagreement can reduce LLM decision accuracy","url":"https://escapemeridian.com/readings/arxiv-cs-ai-expert-disagreement-can-reduce-llm-decision-accuracy-baf19256"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.16694","revision":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","revisionKind":"sha256-source-text","title":"When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision","url":"https://arxiv.org/abs/2611.16694"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c","title":"arXiv cs.AI: Expert disagreement can reduce LLM decision accuracy","argument":"Yupeng Tang and Mingfeng Lin argue that counting how often language models change their answers cannot show whether they corrected mistakes or abandoned correct decisions. Their study compares a model’s initial answer with its revision after neutral reflection, anonymous disagreement, or disagreement labeled as coming from a domain expert. For binary decisions, they say revision improves accuracy only when wrong answers are reversed often enough relative to correct ones; at 90% initial accuracy, the required ratio is nine to one. Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, none met that threshold under expert disagreement, and accuracy fell by as much as 16.1 points. Yet the expert label increased reversals for four models, while its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain. The authors also report that identical arguments can prompt more reversals when labeled as expert advice, and that models respond to stated source reliability. Their central warning is that reversal counts alone can mistake deference for sound revision. They recommend evaluating revision pipelines with paired, conditional metrics for each model and protocol.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the paper’s abstract and does not identify the five models or provide the detailed protocols behind the reported results. The authors describe results across selected evidence-grounded decisions and domains; the abstract does not establish how the findings generalize beyond those evaluations.","speaker":{"name":"Tang, Yupeng, Lin, Mingfeng","roleAtSource":"Article author"},"source":{"title":"When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.16694","publishedAt":"2026-11-12","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce a controlled two-pass audit that varies the revision context while holding the question, evidence, and initial answer fixed.","excerpt":"holds the question, the evidence, and the model's initial answer fixed and varies only the revision context","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"For binary decisions, revision raises accuracy only if wrong answers are reversed more often than correct ones by a threshold based on initial accuracy; at 90% initial accuracy, the ratio is nine to one.","excerpt":"reversing wrong answers more than $a/(1-a)$ times as often as correct ones, where $a$ is initial accuracy (nine times at 90%).","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model met the authors’ threshold under expert disagreement, and accuracy fell by up to 16.1 points.","excerpt":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model clears this bar under expert disagreement, and accuracy falls by up to 16.1 points.","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"The expert label increased reversals for four models, but its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain.","excerpt":"The expert label, a prestige cue, adds reversals for four of the five models, yet its effect on accuracy ranges from a 5.2-point loss to a 2.4-point gain","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"},{"text":"The authors report that an expert label can increase reversals even when the arguments are identical, and recommend paired, conditional evaluation metrics for each model and protocol.","excerpt":"With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models. Models also respond to stated source reliability. Revision pipelines should therefore be evaluated with paired, conditional metrics, per model and","url":"https://arxiv.org/abs/2611.16694","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16694","checkedAt":"2026-11-13T12:50:09.681Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Which model and protocol conditions determine whether an expert label improves accuracy rather than merely increasing reversals?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Expert disagreement can reduce LLM decision accuracy","summary":"Yupeng Tang and Mingfeng Lin argue that counting how often language models change their answers cannot show whether they corrected mistakes or abandoned correct decisions. Their study compares a model’s initial answer with its revision after neutral reflection, anonymous disagreement, or disagreement labeled as coming from a domain expert. For binary decisions, they say revision improves accuracy only when wrong answers are reversed often enough relative to correct ones; at 90% initial accuracy, the required ratio is nine to one. Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, none met that threshold under expert disagreement, and accuracy fell by as much as 16.1 points. Yet the expert label increased reversals for four models, while its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain. The authors also report that identical arguments can prompt more reversals when labeled as expert advice, and that models respond to stated source reliability. Their central warning is that reversal counts alone can mistake deference for sound revision. They recommend evaluating revision pipelines with paired, conditional metrics for each model and protocol.","question":"Which model and protocol conditions determine whether an expert label improves accuracy rather than merely increasing reversals?","claims":[{"text":"The authors introduce a controlled two-pass audit that varies the revision context while holding the question, evidence, and initial answer fixed.","excerpt":"holds the question, the evidence, and the model's initial answer fixed and varies only the revision context","support":"source-stated"},{"text":"For binary decisions, revision raises accuracy only if wrong answers are reversed more often than correct ones by a threshold based on initial accuracy; at 90% initial accuracy, the ratio is nine to one.","excerpt":"reversing wrong answers more than $a/(1-a)$ times as often as correct ones, where $a$ is initial accuracy (nine times at 90%).","support":"source-stated"},{"text":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model met the authors’ threshold under expert disagreement, and accuracy fell by up to 16.1 points.","excerpt":"Across five models and 1,989 evidence-grounded decisions in medicine, science, and law, no model clears this bar under expert disagreement, and accuracy falls by up to 16.1 points.","support":"source-stated"},{"text":"The expert label increased reversals for four models, but its effect on accuracy ranged from a 5.2-point loss to a 2.4-point gain.","excerpt":"The expert label, a prestige cue, adds reversals for four of the five models, yet its effect on accuracy ranges from a 5.2-point loss to a 2.4-point gain","support":"source-stated"},{"text":"The authors report that an expert label can increase reversals even when the arguments are identical, and recommend paired, conditional evaluation metrics for each model and protocol.","excerpt":"With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models. Models also respond to stated source reliability. Revision pipelines should therefore be evaluated with paired, conditional metrics, per model and","support":"source-stated"}],"limitations":["The supplied evidence is the paper’s abstract and does not identify the five models or provide the detailed protocols behind the reported results.","The authors describe results across selected evidence-grounded decisions and domains; the abstract does not establish how the findings generalize beyond those evaluations."],"mediaId":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","correctionReason":null,"id":"baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c","publicationId":"f2985812-e799-477f-8e7b-62324fb657ae","version":1,"sourceUrl":"https://arxiv.org/abs/2611.16694","sourceTitle":"When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-12","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-13T07:43:35.205Z","createdAt":"2026-11-13T11:47:39.774Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","kind":"article","url":"https://arxiv.org/abs/2611.16694","sourceUrl":"https://arxiv.org/abs/2611.16694","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-13T11:46:48.224Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.16694","checkedAt":"2026-11-13T12:50:09.681Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v7","mediaId":"0556eb8bafc5c7584e57d9509bc6cf10cb285d93105f9d69e37c0cbdf65e6132","confidence":0.78,"provider":"typesafe","model":"jev-1.13.0","inputHash":"09ffd0827f9d9c9990230b276640a67b4658b73e3b412f2120bade70bada846a","decidedAt":"2026-11-13T11:46:48.947Z"},"provenance":{"textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observationId":"d747cd853b9c176531224f1de9833296ff273c36ee8a4b48bae927af8645aabe","retrievedAt":"2026-11-13T11:46:48.120Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"68447653-b5c2-4f92-86e6-a94cc700ac00"},"reviewer":{"model":"gpt-6-luna","runId":"101251c2-7fdc-4352-87fd-04f8ad866ce6"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-13T11:47:39.774Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Tang, Yupeng","url":null,"kind":"unknown"},{"name":"Lin, Mingfeng","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Tang, Yupeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tang, Yupeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16694","locator":"head/meta[name=author|citation_author]"},"assertionId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:50:09.681Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","sourceUrl":"https://arxiv.org/abs/2611.16694","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z"}},{"actor":{"name":"Lin, Mingfeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Lin, Mingfeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.16694","locator":"head/meta[name=author|citation_author]"},"assertionId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-13T12:50:09.681Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","sourceUrl":"https://arxiv.org/abs/2611.16694","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.16694","snapshotId":"186ae2f6500b6877ad25ac0e177d01f6827b8f9e03eb9f06fd82b092de01a964","contentSha256":"397fd7f719377e55bb75346f68a4de8d6b6ce402dcf8c864f4d5095df6050983","textHash":"2c34b81ec8724f9b29eef3b7b890af7da679ec6ce90474af6e32b37a2ea00dbb","observedAt":"2026-11-13T12:50:09.681Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/baf19256919f16f8cec1db06b71d7ce1858131fdfdd2e295124a783a0819e71c/source"}}}],"audits":[{"publicationId":"f2985812-e799-477f-8e7b-62324fb657ae","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading attributes the study and its claims to authors Yupeng Tang and Mingfeng Lin and frames the results as their reports. The arXiv cs.AI label correctly identifies the publisher context.","excerpt":"Authors:Yupeng Tang, Mingfeng Lin"},{"dimension":"summary","status":"uncertain","explanation":"Mostly faithful and readable, but two passages lose scope. First, the summary says identical arguments 'can prompt more reversals when labeled as expert advice.' The source limits this to three proprietary models and a pooled analysis of four newer models. Smallest repair: restore that scope. Second, 'can mistake deference for sound revision' recasts the source's point that reversal counts are a poor proxy for harm, since more reversals sometimes accompanied accuracy gains. Smallest repair: use the source's framing. 'Paired, conditional metrics' is left unexplained, but this is not central.","excerpt":"With identical arguments from both sources, the label still raises reversal for three proprietary models and in a pooled analysis of four newer models."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-12, matches the v1 submission date on the arXiv page. The later feed date of Nov 13 was correctly not used.","excerpt":"[Submitted on 12 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim and its excerpt matches the abstract: the two-pass audit design, the a/(1-a) threshold with nine-to-one at 90%, no model clearing the bar with up to a 16.1-point fall, and the label adding reversals for four models with effects from -5.2 to +2.4 points. Claim 5 is hedged with 'can'. The limitations accurately note that the abstract does not identify the five models.","excerpt":"so reversal counts are a poor proxy for harm"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified, direct arXiv abstract page for this paper, which matches the source URL.","excerpt":null}],"createdAt":"2026-11-13T11:47:39.774Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}