{"id":"ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5","title":"Language Models Make New Research Sound Old","argument":"Guy Zyskind argues that large language models (LLMs) can recognize that research questions remain unstudied yet fail to say so in ordinary answers, making new research sound partly studied. On 40 questions from newly accepted papers, GPT-6-Astra judged 98% unstudied but plainly reported that status in only 8% of ordinary answers. Zyskind says all six frontier systems had reporting gaps of 30–90 percentage points, while they identified studied questions correctly in 88–100% of ordinary answers when given the papers that answered them. The contrast matters for researchers using LLMs to assess whether a question is novel: a model’s judgment may be more accurate than its answer makes clear. The paper reports that combining a model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status to 95%, with improvements in all six systems. It also describes predicting reviewers’ novelty grades from models’ written ratings, without access to model weights or internal activations. The evidence here is the paper’s abstract; it does not include the underlying evaluation details.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract, not the paper’s full evaluation details; it does not provide enough information here to assess the study design or how the results extend beyond the tested questions.","speaker":{"name":"Zyskind, Guy","roleAtSource":"Article author"},"source":{"title":"Language Models Make New Research Sound Old","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23546","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"Zyskind reports that LLMs often fail to clearly state that a research question is unstudied, despite judging it to be so.","excerpt":"Models recognize most of these overstatements when asked to check the papers' full texts separately.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"For 40 questions, GPT-6-Astra judged 98% unstudied but plainly stated that status in only 8% of ordinary answers.","excerpt":"On 40 questions drawn from newly accepted papers, GPT-6-Astra correctly judges 98% to be unstudied, but states that status plainly in only 8% of ordinary answers.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"The paper reports reporting gaps of 30–90 percentage points across six frontier systems and higher ordinary-answer accuracy for studied questions when answering papers were supplied.","excerpt":"All six frontier systems show reporting gaps of 30-90 percentage points.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"Combining each model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status from 8% to 95%, with improvements across all six systems.","excerpt":"This raises Astra's clear reporting of open status from 8% to 95%, with improvements in all six systems.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"The paper also reports predicting reviewers’ novelty grades from models’ written ratings using a rule learned from graded examples, without access to model weights or internal activations.","excerpt":"Unlike TPR, our approach needs no access to model weights or internal activations, so it also works with closed-weight frontier models.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23546","checkedAt":"2026-11-19T09:04:09.987Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported judgment and reporting gaps vary across questions beyond the 40 newly accepted papers tested?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Language Models Make New Research Sound Old","summary":"Guy Zyskind argues that large language models (LLMs) can recognize that research questions remain unstudied yet fail to say so in ordinary answers, making new research sound partly studied. On 40 questions from newly accepted papers, GPT-6-Astra judged 98% unstudied but plainly reported that status in only 8% of ordinary answers. Zyskind says all six frontier systems had reporting gaps of 30–90 percentage points, while they identified studied questions correctly in 88–100% of ordinary answers when given the papers that answered them. The contrast matters for researchers using LLMs to assess whether a question is novel: a model’s judgment may be more accurate than its answer makes clear. The paper reports that combining a model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status to 95%, with improvements in all six systems. It also describes predicting reviewers’ novelty grades from models’ written ratings, without access to model weights or internal activations. The evidence here is the paper’s abstract; it does not include the underlying evaluation details.","question":"How do the reported judgment and reporting gaps vary across questions beyond the 40 newly accepted papers tested?","claims":[{"text":"Zyskind reports that LLMs often fail to clearly state that a research question is unstudied, despite judging it to be so.","excerpt":"Models recognize most of these overstatements when asked to check the papers' full texts separately.","support":"source-stated"},{"text":"For 40 questions, GPT-6-Astra judged 98% unstudied but plainly stated that status in only 8% of ordinary answers.","excerpt":"On 40 questions drawn from newly accepted papers, GPT-6-Astra correctly judges 98% to be unstudied, but states that status plainly in only 8% of ordinary answers.","support":"source-stated"},{"text":"The paper reports reporting gaps of 30–90 percentage points across six frontier systems and higher ordinary-answer accuracy for studied questions when answering papers were supplied.","excerpt":"All six frontier systems show reporting gaps of 30-90 percentage points.","support":"source-stated"},{"text":"Combining each model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status from 8% to 95%, with improvements across all six systems.","excerpt":"This raises Astra's clear reporting of open status from 8% to 95%, with improvements in all six systems.","support":"source-stated"},{"text":"The paper also reports predicting reviewers’ novelty grades from models’ written ratings using a rule learned from graded examples, without access to model weights or internal activations.","excerpt":"Unlike TPR, our approach needs no access to model weights or internal activations, so it also works with closed-weight frontier models.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract, not the paper’s full evaluation details; it does not provide enough information here to assess the study design or how the results extend beyond the tested questions."],"mediaId":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","correctionReason":null,"id":"ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5","publicationId":"9983001e-0576-4969-8fa4-c0c253902288","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23546","sourceTitle":"Language Models Make New Research Sound Old","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:01:39.299Z","createdAt":"2026-11-19T08:32:49.579Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","kind":"article","url":"https://arxiv.org/abs/2611.23546","sourceUrl":"https://arxiv.org/abs/2611.23546","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T08:31:56.698Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23546","checkedAt":"2026-11-19T09:04:09.987Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","confidence":0.84,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a7bb60777ac8c1320e8d4c83beffdeb7bd084b9258f436161a688a5c0b0c021c","decidedAt":"2026-11-19T08:31:58.043Z"},"provenance":{"textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observationId":"595d0ab77934eb9d01dfbfd9357b853c1dc39202add0cc6995f470ba43653a91","retrievedAt":"2026-11-19T08:31:56.519Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"34889912-5d85-439d-8cf2-dfc74c042829"},"reviewer":{"model":"gpt-6-luna","runId":"da9c4467-5f17-40c2-87c1-3f99132e29d8"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T08:32:49.579Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zyskind, Guy","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zyskind, Guy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zyskind, Guy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23546","locator":"head/meta[name=author|citation_author]"},"assertionId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T09:04:09.987Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e","sourceUrl":"https://arxiv.org/abs/2611.23546","contentSha256":"f2b9d4e5b86995a13004a443bcdefbf3906bacda6201a007507b8459cb888ee3","textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observedAt":"2026-11-19T09:04:09.987Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23546","snapshotId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e","contentSha256":"f2b9d4e5b86995a13004a443bcdefbf3906bacda6201a007507b8459cb888ee3","textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observedAt":"2026-11-19T09:04:09.987Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5/source"}},"canonicalUrl":"https://escapemeridian.com/readings/language-models-make-new-research-sound-old-ab7b315a","formats":{"html":"/readings/language-models-make-new-research-sound-old-ab7b315a","markdown":"/readings/language-models-make-new-research-sound-old-ab7b315a.md","json":"/readings/language-models-make-new-research-sound-old-ab7b315a.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"},{"id":"term-model-weights","name":"Model weights","explanation":"The learned numbers that make up a trained model; publishing them lets others run it.","referenceUrl":"https://developers.google.com/machine-learning/glossary#weight"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5","revision":"9983001e-0576-4969-8fa4-c0c253902288","revisionKind":"publication-id","title":"Language Models Make New Research Sound Old","url":"https://escapemeridian.com/readings/language-models-make-new-research-sound-old-ab7b315a"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.23546","revision":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","revisionKind":"sha256-source-text","title":"Language Models Make New Research Sound Old","url":"https://arxiv.org/abs/2611.23546"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5","title":"Language Models Make New Research Sound Old","argument":"Guy Zyskind argues that large language models (LLMs) can recognize that research questions remain unstudied yet fail to say so in ordinary answers, making new research sound partly studied. On 40 questions from newly accepted papers, GPT-6-Astra judged 98% unstudied but plainly reported that status in only 8% of ordinary answers. Zyskind says all six frontier systems had reporting gaps of 30–90 percentage points, while they identified studied questions correctly in 88–100% of ordinary answers when given the papers that answered them. The contrast matters for researchers using LLMs to assess whether a question is novel: a model’s judgment may be more accurate than its answer makes clear. The paper reports that combining a model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status to 95%, with improvements in all six systems. It also describes predicting reviewers’ novelty grades from models’ written ratings, without access to model weights or internal activations. The evidence here is the paper’s abstract; it does not include the underlying evaluation details.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract, not the paper’s full evaluation details; it does not provide enough information here to assess the study design or how the results extend beyond the tested questions.","speaker":{"name":"Zyskind, Guy","roleAtSource":"Article author"},"source":{"title":"Language Models Make New Research Sound Old","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.23546","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"Zyskind reports that LLMs often fail to clearly state that a research question is unstudied, despite judging it to be so.","excerpt":"Models recognize most of these overstatements when asked to check the papers' full texts separately.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"For 40 questions, GPT-6-Astra judged 98% unstudied but plainly stated that status in only 8% of ordinary answers.","excerpt":"On 40 questions drawn from newly accepted papers, GPT-6-Astra correctly judges 98% to be unstudied, but states that status plainly in only 8% of ordinary answers.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"The paper reports reporting gaps of 30–90 percentage points across six frontier systems and higher ordinary-answer accuracy for studied questions when answering papers were supplied.","excerpt":"All six frontier systems show reporting gaps of 30-90 percentage points.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"Combining each model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status from 8% to 95%, with improvements across all six systems.","excerpt":"This raises Astra's clear reporting of open status from 8% to 95%, with improvements in all six systems.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"},{"text":"The paper also reports predicting reviewers’ novelty grades from models’ written ratings using a rule learned from graded examples, without access to model weights or internal activations.","excerpt":"Unlike TPR, our approach needs no access to model weights or internal activations, so it also works with closed-weight frontier models.","url":"https://arxiv.org/abs/2611.23546","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23546","checkedAt":"2026-11-19T09:04:09.987Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How do the reported judgment and reporting gaps vary across questions beyond the 40 newly accepted papers tested?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Language Models Make New Research Sound Old","summary":"Guy Zyskind argues that large language models (LLMs) can recognize that research questions remain unstudied yet fail to say so in ordinary answers, making new research sound partly studied. On 40 questions from newly accepted papers, GPT-6-Astra judged 98% unstudied but plainly reported that status in only 8% of ordinary answers. Zyskind says all six frontier systems had reporting gaps of 30–90 percentage points, while they identified studied questions correctly in 88–100% of ordinary answers when given the papers that answered them. The contrast matters for researchers using LLMs to assess whether a question is novel: a model’s judgment may be more accurate than its answer makes clear. The paper reports that combining a model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status to 95%, with improvements in all six systems. It also describes predicting reviewers’ novelty grades from models’ written ratings, without access to model weights or internal activations. The evidence here is the paper’s abstract; it does not include the underlying evaluation details.","question":"How do the reported judgment and reporting gaps vary across questions beyond the 40 newly accepted papers tested?","claims":[{"text":"Zyskind reports that LLMs often fail to clearly state that a research question is unstudied, despite judging it to be so.","excerpt":"Models recognize most of these overstatements when asked to check the papers' full texts separately.","support":"source-stated"},{"text":"For 40 questions, GPT-6-Astra judged 98% unstudied but plainly stated that status in only 8% of ordinary answers.","excerpt":"On 40 questions drawn from newly accepted papers, GPT-6-Astra correctly judges 98% to be unstudied, but states that status plainly in only 8% of ordinary answers.","support":"source-stated"},{"text":"The paper reports reporting gaps of 30–90 percentage points across six frontier systems and higher ordinary-answer accuracy for studied questions when answering papers were supplied.","excerpt":"All six frontier systems show reporting gaps of 30-90 percentage points.","support":"source-stated"},{"text":"Combining each model’s judgment with separate checks of cited papers raised Astra’s clear reporting of open status from 8% to 95%, with improvements across all six systems.","excerpt":"This raises Astra's clear reporting of open status from 8% to 95%, with improvements in all six systems.","support":"source-stated"},{"text":"The paper also reports predicting reviewers’ novelty grades from models’ written ratings using a rule learned from graded examples, without access to model weights or internal activations.","excerpt":"Unlike TPR, our approach needs no access to model weights or internal activations, so it also works with closed-weight frontier models.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract, not the paper’s full evaluation details; it does not provide enough information here to assess the study design or how the results extend beyond the tested questions."],"mediaId":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","correctionReason":null,"id":"ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5","publicationId":"9983001e-0576-4969-8fa4-c0c253902288","version":1,"sourceUrl":"https://arxiv.org/abs/2611.23546","sourceTitle":"Language Models Make New Research Sound Old","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-19T05:01:39.299Z","createdAt":"2026-11-19T08:32:49.579Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","kind":"article","url":"https://arxiv.org/abs/2611.23546","sourceUrl":"https://arxiv.org/abs/2611.23546","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-19T08:31:56.698Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.23546","checkedAt":"2026-11-19T09:04:09.987Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"b69acce908a1db77eaf2e368810c588fe1fccd756b713baeced68f0c2990dc8e","confidence":0.84,"provider":"typesafe","model":"jev-1.13.0","inputHash":"a7bb60777ac8c1320e8d4c83beffdeb7bd084b9258f436161a688a5c0b0c021c","decidedAt":"2026-11-19T08:31:58.043Z"},"provenance":{"textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observationId":"595d0ab77934eb9d01dfbfd9357b853c1dc39202add0cc6995f470ba43653a91","retrievedAt":"2026-11-19T08:31:56.519Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"34889912-5d85-439d-8cf2-dfc74c042829"},"reviewer":{"model":"gpt-6-luna","runId":"da9c4467-5f17-40c2-87c1-3f99132e29d8"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-19T08:32:49.579Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Zyskind, Guy","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Zyskind, Guy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zyskind, Guy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.23546","locator":"head/meta[name=author|citation_author]"},"assertionId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-19T09:04:09.987Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e","sourceUrl":"https://arxiv.org/abs/2611.23546","contentSha256":"f2b9d4e5b86995a13004a443bcdefbf3906bacda6201a007507b8459cb888ee3","textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observedAt":"2026-11-19T09:04:09.987Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.23546","snapshotId":"1bdd812b926209ac99aa21966371ca4551ec16b2876990796013169d243d4e1e","contentSha256":"f2b9d4e5b86995a13004a443bcdefbf3906bacda6201a007507b8459cb888ee3","textHash":"832f7656c860c110e3502fbb5504e10ad4eeef0b70a72d80c4173da62f857a7d","observedAt":"2026-11-19T09:04:09.987Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/ab7b315a0ca43cfcdaca1142e0fde466c33fb7e0745d19ba79ef30dc872b68e5/source"}}}],"audits":[{"publicationId":"9983001e-0576-4969-8fa4-c0c253902288","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"Guy Zyskind is the sole listed author, and the findings are consistently attributed to him or to the paper rather than presented as established fact.","excerpt":"Authors:Guy Zyskind"},{"dimension":"summary","status":"uncertain","explanation":"The reading is accurate but omits two parts of the abstract's argument. It drops that models 'overstate what related papers establish', which is the mechanism behind the title. It also drops the 22-model finding that higher capability goes with more accurate judgments and larger reporting gaps, a central, counterintuitive result. 'Frontier systems' and 'model weights or internal activations' also go unexplained. Smallest repair: add one sentence on overstating related papers and one on the 22-model capability/gap association, and add term tooltips.","excerpt":"Across 22 models given identical papers, higher capability is associated with more accurate judgments and larger reporting gaps."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-11-17, matches the arXiv v1 submission date. The feed date of 2026-11-19 is later and was correctly not used.","excerpt":"[Submitted on 17 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"The figures (98% vs 8%, 30–90 points, 88–100%, 8% to 95%) and the novelty-grade method match the abstract. The inference that a model's judgment may be more accurate than its answer shows is hedged and follows from the reported gap. Minor issue: claim 1's excerpt concerns recognizing overstatements, not failing to state open status; the Astra 98%/8% excerpt would fit better. The source still supports the claim.","excerpt":"GPT-6-Astra correctly judges 98% to be unstudied, but states that status plainly in only 8% of ordinary answers"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source.","excerpt":null}],"createdAt":"2026-11-19T08:32:49.579Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}