{"id":"32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081","title":"Haolin Guo: Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","argument":"Haolin Guo argues that a vision benchmark’s hardest examples may be hard partly because their labels are wrong. A failure screen collects images that classifiers get wrong; if the label is incorrect, a correct prediction can still be counted as a failure. On ImageNet’s twice-relabeled validation set, Guo reports that 61% of the 1,892 images all 66 supervised classifiers got wrong had a wrong label, compared with 11.1% overall. The paper finds that stricter screens generally contain more mislabeled images, and that a curve fitted on one model family predicts results for two held-out families with a mean error of 2.4 percentage points. But the pattern is not universal: on ImageNet-V2, human relabeling found 67% mislabeled among images all 66 classifiers got wrong, above the curve’s 46% prediction. Screens that restrict which classes models can choose fall below the curve. Guo also reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet. Escape Meridian interpretation: these findings make benchmark errors relevant to interpreting model failures; a reported failure can reflect the answer key as well as the classifier. The paper says its ScreenAudit tool and corrected answer sets will be released later.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported measurements concern specified benchmarks and classifier screens; the abstract does not establish that the same pattern holds across vision benchmarks generally. The paper says ScreenAudit, including its audit tool and corrected answer sets, will be released later.","speaker":{"name":"Guo, Haolin","roleAtSource":"Article author"},"source":{"title":"Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.19044","publishedAt":"2026-11-14","dateBasis":"Date basis not provided."},"evidence":[{"text":"Guo reports that 61% of images missed by all 66 supervised classifiers on ImageNet’s twice-relabeled validation set had a wrong label, compared with 11.1% overall.","excerpt":"Among the 1,892 images that all 66 supervised classifiers get wrong, 61% have a wrong label, versus 11.1% overall.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"A curve fitted on one model family predicted screens of two held-out model families with a mean error of 2.4 percentage points.","excerpt":"Fit on one model family, this curve predicts the screens of two held-out model families with a mean error of 2.4 percentage points","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"On ImageNet-V2, the strictest screen’s label-error enrichment was greater than the curve predicted.","excerpt":"on ImageNet-V2, by human relabeling, 67% of the images that all 66 classifiers get wrong are mislabeled, against 46% predicted.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"The findings mean a benchmark failure can reflect an incorrect label as well as a classifier’s prediction.","excerpt":"Since a classifier is also marked wrong when the label is wrong, such failure screens may collect label errors.","url":"https://arxiv.org/abs/2611.19044","relationship":"Escape Meridian interpretation"},{"text":"Guo reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet.","excerpt":"By ReImageNet, 32% of ImageNet-Hard's ImageNet images have no correct label.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.19044","checkedAt":"2026-11-18T06:34:10.270Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What accounts for the stronger-than-predicted label-error enrichment at the strictest screens on ImageNet-V2 and CIFAR-10?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Haolin Guo: Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","summary":"Haolin Guo argues that a vision benchmark’s hardest examples may be hard partly because their labels are wrong. A failure screen collects images that classifiers get wrong; if the label is incorrect, a correct prediction can still be counted as a failure. On ImageNet’s twice-relabeled validation set, Guo reports that 61% of the 1,892 images all 66 supervised classifiers got wrong had a wrong label, compared with 11.1% overall. The paper finds that stricter screens generally contain more mislabeled images, and that a curve fitted on one model family predicts results for two held-out families with a mean error of 2.4 percentage points. But the pattern is not universal: on ImageNet-V2, human relabeling found 67% mislabeled among images all 66 classifiers got wrong, above the curve’s 46% prediction. Screens that restrict which classes models can choose fall below the curve. Guo also reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet. Escape Meridian interpretation: these findings make benchmark errors relevant to interpreting model failures; a reported failure can reflect the answer key as well as the classifier. The paper says its ScreenAudit tool and corrected answer sets will be released later.","question":"What accounts for the stronger-than-predicted label-error enrichment at the strictest screens on ImageNet-V2 and CIFAR-10?","claims":[{"text":"Guo reports that 61% of images missed by all 66 supervised classifiers on ImageNet’s twice-relabeled validation set had a wrong label, compared with 11.1% overall.","excerpt":"Among the 1,892 images that all 66 supervised classifiers get wrong, 61% have a wrong label, versus 11.1% overall.","support":"source-stated"},{"text":"A curve fitted on one model family predicted screens of two held-out model families with a mean error of 2.4 percentage points.","excerpt":"Fit on one model family, this curve predicts the screens of two held-out model families with a mean error of 2.4 percentage points","support":"source-stated"},{"text":"On ImageNet-V2, the strictest screen’s label-error enrichment was greater than the curve predicted.","excerpt":"on ImageNet-V2, by human relabeling, 67% of the images that all 66 classifiers get wrong are mislabeled, against 46% predicted.","support":"source-stated"},{"text":"The findings mean a benchmark failure can reflect an incorrect label as well as a classifier’s prediction.","excerpt":"Since a classifier is also marked wrong when the label is wrong, such failure screens may collect label errors.","support":"interpretation"},{"text":"Guo reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet.","excerpt":"By ReImageNet, 32% of ImageNet-Hard's ImageNet images have no correct label.","support":"source-stated"}],"limitations":["The reported measurements concern specified benchmarks and classifier screens; the abstract does not establish that the same pattern holds across vision benchmarks generally.","The paper says ScreenAudit, including its audit tool and corrected answer sets, will be released later."],"mediaId":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","correctionReason":null,"id":"32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081","publicationId":"9ab121fe-7360-40e6-8dc0-da7b1ec2dcc8","version":1,"sourceUrl":"https://arxiv.org/abs/2611.19044","sourceTitle":"Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-14","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:28:57.279Z","createdAt":"2026-11-17T13:31:24.421Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","kind":"article","url":"https://arxiv.org/abs/2611.19044","sourceUrl":"https://arxiv.org/abs/2611.19044","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:20:19.165Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.19044","checkedAt":"2026-11-18T06:34:10.270Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","confidence":0.5700000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a4fffee04b9e8bcffaba1558fccd5d07d3cfa39cb8ba8789af12416d89feb141","decidedAt":"2026-11-17T13:20:21.220Z"},"provenance":{"textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observationId":"55db047f2fbe97de73fdecc793c9cce04c57d965e4bfb87a041af7fdfc9c8df4","retrievedAt":"2026-11-17T13:20:18.742Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"714422ec-fd1d-4818-8927-f402c66a0d36"},"reviewer":{"model":"gpt-6-luna","runId":"9016cf9c-1ff2-4acc-87db-94211c95f912"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:31:24.421Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Guo, Haolin","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Guo, Haolin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Guo, Haolin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.19044","locator":"head/meta[name=author|citation_author]"},"assertionId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T06:34:10.270Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84","sourceUrl":"https://arxiv.org/abs/2611.19044","contentSha256":"01d3c2327498801f9b06ecfdd9531643b7afcb87649aa0927cce0a4ad5d1829e","textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observedAt":"2026-11-18T06:34:10.270Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.19044","snapshotId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84","contentSha256":"01d3c2327498801f9b06ecfdd9531643b7afcb87649aa0927cce0a4ad5d1829e","textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observedAt":"2026-11-18T06:34:10.270Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081/source"}},"canonicalUrl":"https://escapemeridian.com/readings/haolin-guo-hard-or-mislabeled-failure-screens-enrich-vision-32cff05d","formats":{"html":"/readings/haolin-guo-hard-or-mislabeled-failure-screens-enrich-vision-32cff05d","markdown":"/readings/haolin-guo-hard-or-mislabeled-failure-screens-enrich-vision-32cff05d.md","json":"/readings/haolin-guo-hard-or-mislabeled-failure-screens-enrich-vision-32cff05d.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081","revision":"9ab121fe-7360-40e6-8dc0-da7b1ec2dcc8","revisionKind":"publication-id","title":"Haolin Guo: Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","url":"https://escapemeridian.com/readings/haolin-guo-hard-or-mislabeled-failure-screens-enrich-vision-32cff05d"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.19044","revision":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","revisionKind":"sha256-source-text","title":"Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","url":"https://arxiv.org/abs/2611.19044"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081","title":"Haolin Guo: Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","argument":"Haolin Guo argues that a vision benchmark’s hardest examples may be hard partly because their labels are wrong. A failure screen collects images that classifiers get wrong; if the label is incorrect, a correct prediction can still be counted as a failure. On ImageNet’s twice-relabeled validation set, Guo reports that 61% of the 1,892 images all 66 supervised classifiers got wrong had a wrong label, compared with 11.1% overall. The paper finds that stricter screens generally contain more mislabeled images, and that a curve fitted on one model family predicts results for two held-out families with a mean error of 2.4 percentage points. But the pattern is not universal: on ImageNet-V2, human relabeling found 67% mislabeled among images all 66 classifiers got wrong, above the curve’s 46% prediction. Screens that restrict which classes models can choose fall below the curve. Guo also reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet. Escape Meridian interpretation: these findings make benchmark errors relevant to interpreting model failures; a reported failure can reflect the answer key as well as the classifier. The paper says its ScreenAudit tool and corrected answer sets will be released later.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported measurements concern specified benchmarks and classifier screens; the abstract does not establish that the same pattern holds across vision benchmarks generally. The paper says ScreenAudit, including its audit tool and corrected answer sets, will be released later.","speaker":{"name":"Guo, Haolin","roleAtSource":"Article author"},"source":{"title":"Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.19044","publishedAt":"2026-11-14","dateBasis":"Date basis not provided."},"evidence":[{"text":"Guo reports that 61% of images missed by all 66 supervised classifiers on ImageNet’s twice-relabeled validation set had a wrong label, compared with 11.1% overall.","excerpt":"Among the 1,892 images that all 66 supervised classifiers get wrong, 61% have a wrong label, versus 11.1% overall.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"A curve fitted on one model family predicted screens of two held-out model families with a mean error of 2.4 percentage points.","excerpt":"Fit on one model family, this curve predicts the screens of two held-out model families with a mean error of 2.4 percentage points","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"On ImageNet-V2, the strictest screen’s label-error enrichment was greater than the curve predicted.","excerpt":"on ImageNet-V2, by human relabeling, 67% of the images that all 66 classifiers get wrong are mislabeled, against 46% predicted.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"},{"text":"The findings mean a benchmark failure can reflect an incorrect label as well as a classifier’s prediction.","excerpt":"Since a classifier is also marked wrong when the label is wrong, such failure screens may collect label errors.","url":"https://arxiv.org/abs/2611.19044","relationship":"Escape Meridian interpretation"},{"text":"Guo reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet.","excerpt":"By ReImageNet, 32% of ImageNet-Hard's ImageNet images have no correct label.","url":"https://arxiv.org/abs/2611.19044","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.19044","checkedAt":"2026-11-18T06:34:10.270Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What accounts for the stronger-than-predicted label-error enrichment at the strictest screens on ImageNet-V2 and CIFAR-10?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Haolin Guo: Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","summary":"Haolin Guo argues that a vision benchmark’s hardest examples may be hard partly because their labels are wrong. A failure screen collects images that classifiers get wrong; if the label is incorrect, a correct prediction can still be counted as a failure. On ImageNet’s twice-relabeled validation set, Guo reports that 61% of the 1,892 images all 66 supervised classifiers got wrong had a wrong label, compared with 11.1% overall. The paper finds that stricter screens generally contain more mislabeled images, and that a curve fitted on one model family predicts results for two held-out families with a mean error of 2.4 percentage points. But the pattern is not universal: on ImageNet-V2, human relabeling found 67% mislabeled among images all 66 classifiers got wrong, above the curve’s 46% prediction. Screens that restrict which classes models can choose fall below the curve. Guo also reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet. Escape Meridian interpretation: these findings make benchmark errors relevant to interpreting model failures; a reported failure can reflect the answer key as well as the classifier. The paper says its ScreenAudit tool and corrected answer sets will be released later.","question":"What accounts for the stronger-than-predicted label-error enrichment at the strictest screens on ImageNet-V2 and CIFAR-10?","claims":[{"text":"Guo reports that 61% of images missed by all 66 supervised classifiers on ImageNet’s twice-relabeled validation set had a wrong label, compared with 11.1% overall.","excerpt":"Among the 1,892 images that all 66 supervised classifiers get wrong, 61% have a wrong label, versus 11.1% overall.","support":"source-stated"},{"text":"A curve fitted on one model family predicted screens of two held-out model families with a mean error of 2.4 percentage points.","excerpt":"Fit on one model family, this curve predicts the screens of two held-out model families with a mean error of 2.4 percentage points","support":"source-stated"},{"text":"On ImageNet-V2, the strictest screen’s label-error enrichment was greater than the curve predicted.","excerpt":"on ImageNet-V2, by human relabeling, 67% of the images that all 66 classifiers get wrong are mislabeled, against 46% predicted.","support":"source-stated"},{"text":"The findings mean a benchmark failure can reflect an incorrect label as well as a classifier’s prediction.","excerpt":"Since a classifier is also marked wrong when the label is wrong, such failure screens may collect label errors.","support":"interpretation"},{"text":"Guo reports that 32% of ImageNet-Hard’s ImageNet images have no correct label according to ReImageNet.","excerpt":"By ReImageNet, 32% of ImageNet-Hard's ImageNet images have no correct label.","support":"source-stated"}],"limitations":["The reported measurements concern specified benchmarks and classifier screens; the abstract does not establish that the same pattern holds across vision benchmarks generally.","The paper says ScreenAudit, including its audit tool and corrected answer sets, will be released later."],"mediaId":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","correctionReason":null,"id":"32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081","publicationId":"9ab121fe-7360-40e6-8dc0-da7b1ec2dcc8","version":1,"sourceUrl":"https://arxiv.org/abs/2611.19044","sourceTitle":"Hard or Mislabeled? Failure Screens Enrich Vision Benchmarks for Label Errors","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-14","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:28:57.279Z","createdAt":"2026-11-17T13:31:24.421Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","kind":"article","url":"https://arxiv.org/abs/2611.19044","sourceUrl":"https://arxiv.org/abs/2611.19044","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:20:19.165Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.19044","checkedAt":"2026-11-18T06:34:10.270Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"cb66bcbe2c23f19af372ad253e436565d073792485cab5284fde828877f5adb3","confidence":0.5700000000000001,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a4fffee04b9e8bcffaba1558fccd5d07d3cfa39cb8ba8789af12416d89feb141","decidedAt":"2026-11-17T13:20:21.220Z"},"provenance":{"textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observationId":"55db047f2fbe97de73fdecc793c9cce04c57d965e4bfb87a041af7fdfc9c8df4","retrievedAt":"2026-11-17T13:20:18.742Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"714422ec-fd1d-4818-8927-f402c66a0d36"},"reviewer":{"model":"gpt-6-luna","runId":"9016cf9c-1ff2-4acc-87db-94211c95f912"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:31:24.421Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Guo, Haolin","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Guo, Haolin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Guo, Haolin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.19044","locator":"head/meta[name=author|citation_author]"},"assertionId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T06:34:10.270Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84","sourceUrl":"https://arxiv.org/abs/2611.19044","contentSha256":"01d3c2327498801f9b06ecfdd9531643b7afcb87649aa0927cce0a4ad5d1829e","textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observedAt":"2026-11-18T06:34:10.270Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.19044","snapshotId":"8abc0f7f3c6a237392647e2c4d71767abe1b20143735f1b04e2a2e6c09bfad84","contentSha256":"01d3c2327498801f9b06ecfdd9531643b7afcb87649aa0927cce0a4ad5d1829e","textHash":"ca7eebc87c2b15bdfa8a7301c59e412b3db840ec0c641f96a2af6569586d1105","observedAt":"2026-11-18T06:34:10.270Z","basis":"publisher-page-metadata","sourceLinks":41,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/32cff05debaae6e2c3da263933f3da7bcdc063be4af4765e428878d09eede081/source"}}}],"audits":[{"publicationId":"9ab121fe-7360-40e6-8dc0-da7b1ec2dcc8","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"Haolin Guo is the sole listed author of this arXiv paper. The reading attributes the findings to Guo or to the paper ('Guo reports', 'The paper finds') and labels its own inference as Escape Meridian interpretation.","excerpt":"Authors:Haolin Guo"},{"dimension":"summary","status":"uncertain","explanation":"The passage 'But the pattern is not universal' can mislead readers. On ImageNet-V2 and CIFAR-10, the source says enrichment at the strictest screens is stronger than predicted. The stricter-screens-hold-more-mislabels trend still holds; only the fitted curve underpredicts. Smallest repair: 'But on new pools (ImageNet-V2, CIFAR-10) the curve underpredicts.' The question mentions CIFAR-10, which the summary omits. 'Held-out model families' and 'supervised classifiers' are left unexplained but are not central enough to block understanding.","excerpt":"On new pools, ImageNet-V2 and CIFAR-10, enrichment at the strictest screens is stronger than the curve predicts"},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-14 matches the v1 submission date on arXiv. The feed date of Nov 17 is correctly not used.","excerpt":"[Submitted on 14 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each numeric claim (61% vs 11.1%, 2.4 points, 67% vs 46%, 32%) matches the abstract. The interpretation is labeled and rests on the abstract's own premise. The limitations correctly note the narrow scope and the deferred release. The question follows directly from the reported discrepancy and is not leading.","excerpt":"Since a classifier is also marked wrong when the label is wrong, such failure screens may collect label errors."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source.","excerpt":null}],"createdAt":"2026-11-17T13:31:24.421Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}