{"id":"4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b","title":"arXiv cs.AI paper introduces ClaimNov to assess novelty claim by claim","argument":"Miri Liu, Xiayu Zhao, Encheng Xie, and ChengXiang Zhai introduce ClaimNov, a module that assesses whether individual claims in AI-generated research proposals are new, rather than rejecting a proposal as a whole. Their paper argues that existing novelty checks can flag ideas later realized by human researchers as non-novel, and may discard an entire proposal when only one claim has prior art.\n\nThe authors evaluate novelty checks using four datasets containing 1,060 proposals, including generated ideas that matched work later published by researchers. They report that ClaimNov catches 97% of disguised papers with a 1.5% false-alarm rate. Adding its claim-level novelty profile to an LLM judge reduces reported false alarms from 11.8% to 1.5%. The authors also report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeps 91 of 100 novel proposals containing one spliced prior contribution, compared with 76 for the strongest existing check.\n\nThese results concern the paper’s evaluation datasets; the evidence does not establish how ClaimNov performs across scientific fields or in research practice. How well would its claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results come from four evaluation datasets; the source does not establish performance in routine research practice or across other scientific fields. The source provides no detail here on how the datasets were assembled beyond describing their sources, or on the evaluation’s limitations. The source identifies the authors by name but does not provide evidence about their affiliations or independent replication.","speaker":{"name":"Liu, Miri, Zhao, Xiayu, Xie, Encheng, Zhai, ChengXiang","roleAtSource":"Article author"},"source":{"title":"Do AI Scientists Know What's New?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36511","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce ClaimNov, a module that evaluates novelty at the level of individual claims in proposals.","excerpt":"We therefore introduce ClaimNov, a fine-grained, interpretable claim-level novelty module.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors evaluate novelty checks using four datasets with 1,060 proposals drawn from published papers, reviewer disputes, and generated ideas matching work later published.","excerpt":"using four datasets of 1,060 proposals built from published papers, reviewer disputes, and generated ideas matching ones the field went on to publish.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate.","excerpt":"ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov’s claim-level profile reduces an LLM judge’s false alarms from 11.8% to 1.5%.","excerpt":"its claim-level novelty profile cuts the LLM judge's false alarms from 11.8% to 1.5%.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and retains 91 of 100 novel proposals with one spliced prior contribution; the strongest existing check retains 76.","excerpt":"rejecting only 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeping 91 of 100 novel proposals with one spliced prior contribution, against 76 for the strongest existing check.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36511","checkedAt":"2026-11-06T14:24:06.639Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would ClaimNov’s claim-level judgments transfer to real proposals and disciplines beyond those evaluated?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper introduces ClaimNov to assess novelty claim by claim","summary":"Miri Liu, Xiayu Zhao, Encheng Xie, and ChengXiang Zhai introduce ClaimNov, a module that assesses whether individual claims in AI-generated research proposals are new, rather than rejecting a proposal as a whole. Their paper argues that existing novelty checks can flag ideas later realized by human researchers as non-novel, and may discard an entire proposal when only one claim has prior art.\n\nThe authors evaluate novelty checks using four datasets containing 1,060 proposals, including generated ideas that matched work later published by researchers. They report that ClaimNov catches 97% of disguised papers with a 1.5% false-alarm rate. Adding its claim-level novelty profile to an LLM judge reduces reported false alarms from 11.8% to 1.5%. The authors also report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeps 91 of 100 novel proposals containing one spliced prior contribution, compared with 76 for the strongest existing check.\n\nThese results concern the paper’s evaluation datasets; the evidence does not establish how ClaimNov performs across scientific fields or in research practice. How well would its claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","question":"How well would ClaimNov’s claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","claims":[{"text":"The authors introduce ClaimNov, a module that evaluates novelty at the level of individual claims in proposals.","excerpt":"We therefore introduce ClaimNov, a fine-grained, interpretable claim-level novelty module.","support":"source-stated"},{"text":"The authors evaluate novelty checks using four datasets with 1,060 proposals drawn from published papers, reviewer disputes, and generated ideas matching work later published.","excerpt":"using four datasets of 1,060 proposals built from published papers, reviewer disputes, and generated ideas matching ones the field went on to publish.","support":"source-stated"},{"text":"The authors report that ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate.","excerpt":"ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate","support":"source-stated"},{"text":"The authors report that ClaimNov’s claim-level profile reduces an LLM judge’s false alarms from 11.8% to 1.5%.","excerpt":"its claim-level novelty profile cuts the LLM judge's false alarms from 11.8% to 1.5%.","support":"source-stated"},{"text":"The authors report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and retains 91 of 100 novel proposals with one spliced prior contribution; the strongest existing check retains 76.","excerpt":"rejecting only 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeping 91 of 100 novel proposals with one spliced prior contribution, against 76 for the strongest existing check.","support":"source-stated"}],"limitations":["The reported results come from four evaluation datasets; the source does not establish performance in routine research practice or across other scientific fields.","The source provides no detail here on how the datasets were assembled beyond describing their sources, or on the evaluation’s limitations.","The source identifies the authors by name but does not provide evidence about their affiliations or independent replication."],"mediaId":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","correctionReason":null,"id":"4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b","publicationId":"8b3e91f7-3fd7-4c4e-8008-5ae6fcc4d4f2","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36511","sourceTitle":"Do AI Scientists Know What's New?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T07:48:40.829Z","createdAt":"2026-11-06T12:17:02.402Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","kind":"article","url":"https://arxiv.org/abs/2610.36511","sourceUrl":"https://arxiv.org/abs/2610.36511","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T00:03:26.228Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36511","checkedAt":"2026-11-06T14:24:06.639Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","confidence":0.85,"provider":"typesafe","model":"jev-1.13.0","inputHash":"edcbc8264f871e3a36a92b3094889f0992d1ae72818a588c06d56ab0c06046c1","decidedAt":"2026-10-30T00:03:28.238Z"},"provenance":{"textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observationId":"d754a9fe17bc4449d777fb60dad78247831037f3b50b67586546fa1f25732ecf","retrievedAt":"2026-10-30T00:03:25.956Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"6f3f9e53-b5f4-4273-8856-d90b9abe6769"},"reviewer":{"model":"gpt-6-luna","runId":"0091b95e-2947-4765-804b-824d6c9aed46"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-06T12:17:02.402Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liu, Miri","url":null,"kind":"unknown"},{"name":"Zhao, Xiayu","url":null,"kind":"unknown"},{"name":"Xie, Encheng","url":null,"kind":"unknown"},{"name":"Zhai, ChengXiang","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liu, Miri","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Miri","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Zhao, Xiayu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Xiayu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Xie, Encheng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Encheng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Zhai, ChengXiang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhai, ChengXiang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36511","snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-introduces-claimnov-to-assess-novelty-claim-4db180c0","formats":{"html":"/readings/arxiv-cs-ai-paper-introduces-claimnov-to-assess-novelty-claim-4db180c0","markdown":"/readings/arxiv-cs-ai-paper-introduces-claimnov-to-assess-novelty-claim-4db180c0.md","json":"/readings/arxiv-cs-ai-paper-introduces-claimnov-to-assess-novelty-claim-4db180c0.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-llm","name":"Large language model","explanation":"A language model with many learned numerical settings, used to process and generate language.","referenceUrl":"https://developers.google.com/machine-learning/glossary#large-language-model"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"},{"id":"miri","name":"Machine Intelligence Research Institute","kind":"organization","context":"Explicit institutional argument for restricting superintelligence; useful strong opposing thesis.","referenceUrls":["https://lexfridman.com/roman-yampolskiy-transcript","https://www.dwarkesh.com/p/eliezer-yudkowsky","https://www.dwarkesh.com/p/holden-karnofsky","https://intelligence.org/2026/09/23/miris-position-on-the-ban-artificial-superintelligence-act-of-2026/","https://intelligence.org/"],"path":"/entities/miri","json":"/entities/miri.json","markdown":"/entities/miri.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b","revision":"8b3e91f7-3fd7-4c4e-8008-5ae6fcc4d4f2","revisionKind":"publication-id","title":"arXiv cs.AI paper introduces ClaimNov to assess novelty claim by claim","url":"https://escapemeridian.com/readings/arxiv-cs-ai-paper-introduces-claimnov-to-assess-novelty-claim-4db180c0"},"source":{"type":"source","id":"https://arxiv.org/abs/2610.36511","revision":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","revisionKind":"sha256-source-text","title":"Do AI Scientists Know What's New?","url":"https://arxiv.org/abs/2610.36511"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b","title":"arXiv cs.AI paper introduces ClaimNov to assess novelty claim by claim","argument":"Miri Liu, Xiayu Zhao, Encheng Xie, and ChengXiang Zhai introduce ClaimNov, a module that assesses whether individual claims in AI-generated research proposals are new, rather than rejecting a proposal as a whole. Their paper argues that existing novelty checks can flag ideas later realized by human researchers as non-novel, and may discard an entire proposal when only one claim has prior art.\n\nThe authors evaluate novelty checks using four datasets containing 1,060 proposals, including generated ideas that matched work later published by researchers. They report that ClaimNov catches 97% of disguised papers with a 1.5% false-alarm rate. Adding its claim-level novelty profile to an LLM judge reduces reported false alarms from 11.8% to 1.5%. The authors also report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeps 91 of 100 novel proposals containing one spliced prior contribution, compared with 76 for the strongest existing check.\n\nThese results concern the paper’s evaluation datasets; the evidence does not establish how ClaimNov performs across scientific fields or in research practice. How well would its claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported results come from four evaluation datasets; the source does not establish performance in routine research practice or across other scientific fields. The source provides no detail here on how the datasets were assembled beyond describing their sources, or on the evaluation’s limitations. The source identifies the authors by name but does not provide evidence about their affiliations or independent replication.","speaker":{"name":"Liu, Miri, Zhao, Xiayu, Xie, Encheng, Zhai, ChengXiang","roleAtSource":"Article author"},"source":{"title":"Do AI Scientists Know What's New?","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2610.36511","publishedAt":"2026-10-27","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce ClaimNov, a module that evaluates novelty at the level of individual claims in proposals.","excerpt":"We therefore introduce ClaimNov, a fine-grained, interpretable claim-level novelty module.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors evaluate novelty checks using four datasets with 1,060 proposals drawn from published papers, reviewer disputes, and generated ideas matching work later published.","excerpt":"using four datasets of 1,060 proposals built from published papers, reviewer disputes, and generated ideas matching ones the field went on to publish.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate.","excerpt":"ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov’s claim-level profile reduces an LLM judge’s false alarms from 11.8% to 1.5%.","excerpt":"its claim-level novelty profile cuts the LLM judge's false alarms from 11.8% to 1.5%.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"},{"text":"The authors report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and retains 91 of 100 novel proposals with one spliced prior contribution; the strongest existing check retains 76.","excerpt":"rejecting only 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeping 91 of 100 novel proposals with one spliced prior contribution, against 76 for the strongest existing check.","url":"https://arxiv.org/abs/2610.36511","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36511","checkedAt":"2026-11-06T14:24:06.639Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well would ClaimNov’s claim-level judgments transfer to real proposals and disciplines beyond those evaluated?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI paper introduces ClaimNov to assess novelty claim by claim","summary":"Miri Liu, Xiayu Zhao, Encheng Xie, and ChengXiang Zhai introduce ClaimNov, a module that assesses whether individual claims in AI-generated research proposals are new, rather than rejecting a proposal as a whole. Their paper argues that existing novelty checks can flag ideas later realized by human researchers as non-novel, and may discard an entire proposal when only one claim has prior art.\n\nThe authors evaluate novelty checks using four datasets containing 1,060 proposals, including generated ideas that matched work later published by researchers. They report that ClaimNov catches 97% of disguised papers with a 1.5% false-alarm rate. Adding its claim-level novelty profile to an LLM judge reduces reported false alarms from 11.8% to 1.5%. The authors also report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeps 91 of 100 novel proposals containing one spliced prior contribution, compared with 76 for the strongest existing check.\n\nThese results concern the paper’s evaluation datasets; the evidence does not establish how ClaimNov performs across scientific fields or in research practice. How well would its claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","question":"How well would ClaimNov’s claim-level judgments transfer to real proposals and disciplines beyond those evaluated?","claims":[{"text":"The authors introduce ClaimNov, a module that evaluates novelty at the level of individual claims in proposals.","excerpt":"We therefore introduce ClaimNov, a fine-grained, interpretable claim-level novelty module.","support":"source-stated"},{"text":"The authors evaluate novelty checks using four datasets with 1,060 proposals drawn from published papers, reviewer disputes, and generated ideas matching work later published.","excerpt":"using four datasets of 1,060 proposals built from published papers, reviewer disputes, and generated ideas matching ones the field went on to publish.","support":"source-stated"},{"text":"The authors report that ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate.","excerpt":"ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate","support":"source-stated"},{"text":"The authors report that ClaimNov’s claim-level profile reduces an LLM judge’s false alarms from 11.8% to 1.5%.","excerpt":"its claim-level novelty profile cuts the LLM judge's false alarms from 11.8% to 1.5%.","support":"source-stated"},{"text":"The authors report that ClaimNov rejects 3% of ICLR-accepted proposals with a reviewer-disputed contribution and retains 91 of 100 novel proposals with one spliced prior contribution; the strongest existing check retains 76.","excerpt":"rejecting only 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeping 91 of 100 novel proposals with one spliced prior contribution, against 76 for the strongest existing check.","support":"source-stated"}],"limitations":["The reported results come from four evaluation datasets; the source does not establish performance in routine research practice or across other scientific fields.","The source provides no detail here on how the datasets were assembled beyond describing their sources, or on the evaluation’s limitations.","The source identifies the authors by name but does not provide evidence about their affiliations or independent replication."],"mediaId":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","correctionReason":null,"id":"4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b","publicationId":"8b3e91f7-3fd7-4c4e-8008-5ae6fcc4d4f2","version":1,"sourceUrl":"https://arxiv.org/abs/2610.36511","sourceTitle":"Do AI Scientists Know What's New?","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-10-27","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-10-28T07:48:40.829Z","createdAt":"2026-11-06T12:17:02.402Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","kind":"article","url":"https://arxiv.org/abs/2610.36511","sourceUrl":"https://arxiv.org/abs/2610.36511","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-30T00:03:26.228Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2610.36511","checkedAt":"2026-11-06T14:24:06.639Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"9b37a0eba72ea3b05160b1ed5f7941e7c29f5badcadf94b631f8abcd5bc41bc6","confidence":0.85,"provider":"typesafe","model":"jev-1.13.0","inputHash":"edcbc8264f871e3a36a92b3094889f0992d1ae72818a588c06d56ab0c06046c1","decidedAt":"2026-10-30T00:03:28.238Z"},"provenance":{"textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observationId":"d754a9fe17bc4449d777fb60dad78247831037f3b50b67586546fa1f25732ecf","retrievedAt":"2026-10-30T00:03:25.956Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"6f3f9e53-b5f4-4273-8856-d90b9abe6769"},"reviewer":{"model":"gpt-6-luna","runId":"0091b95e-2947-4765-804b-824d6c9aed46"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-06T12:17:02.402Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Liu, Miri","url":null,"kind":"unknown"},{"name":"Zhao, Xiayu","url":null,"kind":"unknown"},{"name":"Xie, Encheng","url":null,"kind":"unknown"},{"name":"Zhai, ChengXiang","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Liu, Miri","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Miri","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Zhao, Xiayu","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhao, Xiayu","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Xie, Encheng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xie, Encheng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}},{"actor":{"name":"Zhai, ChengXiang","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhai, ChengXiang","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2610.36511","locator":"head/meta[name=author|citation_author]"},"assertionId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-06T14:24:06.639Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","sourceUrl":"https://arxiv.org/abs/2610.36511","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2610.36511","snapshotId":"3cc802d186b977108c2b52ab31f52b1ab4ae02e09dc2dd4b49f0bebe320679f5","contentSha256":"db434db4218d95410a782384167e02c711758b444d545d6f631f91186738ab03","textHash":"9ae96d058a59195c1806b582d9d7f795b2323358452b46bb8819a0f2f4cd25b4","observedAt":"2026-11-06T14:24:06.639Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4db180c0a9568bcba29801a17c1bdfd8f0b912a6dbd8d20ca6229511a3c60a3b/source"}}}],"audits":[{"publicationId":"8b3e91f7-3fd7-4c4e-8008-5ae6fcc4d4f2","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly names the four authors and frames the findings as their reports. Calling it an 'arXiv cs.AI paper' is acceptable: the paper is cross-listed in cs.AI, though its primary category is cs.CL.","excerpt":"Authors:Miri Liu, Xiayu Zhao, Encheng Xie, ChengXiang Zhai"},{"dimension":"summary","status":"uncertain","explanation":"The draft is faithful but leaves central terms unexplained for a general reader. Repairs: 'disguised papers' (the basis of the 97% figure) and 'spliced prior contribution' need plain wording or a tooltip; LLM judge and ICLR need brief glosses. It should also say novelty checks filter ideas inside automated AI science pipelines. The draft drops the paper's central tradeoff: checks that reject more non-novel work also flag more later-realized ideas. Restoring that point keeps the authors' argument intact.","excerpt":"checks with high rejection rates on non-novel work also tend to have high false alarms on ideas that are later realized by human researchers"},{"dimension":"date","status":"pass","explanation":"The original publication date of 2026-10-27 matches the arXiv v1 submission date. It is not the later feed date.","excerpt":"[Submitted on 27 Oct 2026]"},{"dimension":"support","status":"pass","explanation":"Every numeric claim matches the abstract and is attributed to the authors. The limitations and the closing question stay conditional and do not overstate real-world reliability.","excerpt":"ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page. No other media was available.","excerpt":null}],"createdAt":"2026-11-06T12:17:02.402Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}