{"id":"6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329","title":"arXiv cs.AI: Authors’ response to AI-based reviews—useful suggestions, less trust","argument":"In “Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study,” César Leblanc and Lukas Picek examine how authors judged AI reviews sent alongside human reviews in three computer-science cohorts. Of 92 questionnaire responses about 71 papers, 89% rated the AI review useful and the same share said they used at least some suggestions in revisions. Yet 63% reported incorrect or misleading comments, and 48% trusted AI feedback less than human feedback. The authors describe a practical tension: AI comments could help clarify papers and improve reproducibility, but authors also reported overlooked evidence, inappropriate demands and difficulty finding useful comments in lengthy reviews. Their findings suggest that usefulness did not mean uncritical trust. Authors emphasized checking feedback and retaining control over manuscript processing; most supported future reviews by humans and AI, advance notice and explicit consent. The authors favor AI as a supplement under human oversight, with disclosure and consent. They stress that this exploratory study does not establish that AI can replace human reviewers or improve manuscript quality.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study is described as exploratory and covers three computer-science cohorts: LifeCLEF 2025, LifeCLEF 2026 and CVWW 2026. The evidence comes from 92 post-review questionnaire responses concerning 71 papers; the abstract does not establish that the findings generalize beyond these cohorts. The authors state that the study does not establish that AI can replace human reviewers or improve manuscript quality.","speaker":{"name":"Leblanc, César, Picek, Lukas","roleAtSource":"Article author"},"source":{"title":"Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2605.16623","publishedAt":"2026-05-15","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors surveyed experiences of receiving an auxiliary AI review alongside human reviews in three computer-science cohorts, using questionnaires about 71 papers.","excerpt":"Post-review questionnaires yielded 92 responses concerning 71 papers.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Most questionnaire responses rated the AI review useful, and the same share reported using at least some suggestions in revision.","excerpt":"Most responses rated the AI review useful (82/92 (89%), and 82/92 (89%) reported using at least some of its suggestions in revision.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Many respondents reported incorrect or misleading comments, and nearly half trusted AI feedback less than human feedback.","excerpt":"44/92 (48%) trusted AI feedback less than human feedback, and 58/92 (63%) reported incorrect or misleading comments.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Authors valued suggestions about clarity and reproducibility but also described overlooked evidence, inappropriate demands and difficulty locating useful comments in lengthy reviews.","excerpt":"Authors valued suggestions that improved clarity and reproducibility, but also described overlooked evidence, inappropriate demands, and difficulty finding useful comments within lengthy reviews.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Authors emphasized checking AI feedback and retaining control over manuscript processing; most supported human-and-AI review, advance notice and explicit consent.","excerpt":"They emphasized the need to check AI feedback and retain control over how their manuscripts were processed. Future review by both humans and AI was supported by 85/92 (92%); 83/92 (90%) preferred advance notice and 73/92 (79%) supported explicit consent.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"The authors favor AI as a supplement with human oversight, disclosure and consent, while saying the study does not establish replacement of human reviewers or improved manuscript quality.","excerpt":"These exploratory findings favor a supplementary role for AI, with human oversight, clear disclosure, and author consent. They do not establish that AI can replace human reviewers or improve manuscript quality.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.16623","checkedAt":"2026-11-21T02:36:09.416Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How could AI reviews make useful comments easier to find within lengthy reviews, a difficulty authors reported?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Authors’ response to AI-based reviews—useful suggestions, less trust","summary":"In “Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study,” César Leblanc and Lukas Picek examine how authors judged AI reviews sent alongside human reviews in three computer-science cohorts. Of 92 questionnaire responses about 71 papers, 89% rated the AI review useful and the same share said they used at least some suggestions in revisions. Yet 63% reported incorrect or misleading comments, and 48% trusted AI feedback less than human feedback. The authors describe a practical tension: AI comments could help clarify papers and improve reproducibility, but authors also reported overlooked evidence, inappropriate demands and difficulty finding useful comments in lengthy reviews. Their findings suggest that usefulness did not mean uncritical trust. Authors emphasized checking feedback and retaining control over manuscript processing; most supported future reviews by humans and AI, advance notice and explicit consent. The authors favor AI as a supplement under human oversight, with disclosure and consent. They stress that this exploratory study does not establish that AI can replace human reviewers or improve manuscript quality.","question":"How could AI reviews make useful comments easier to find within lengthy reviews, a difficulty authors reported?","claims":[{"text":"The authors surveyed experiences of receiving an auxiliary AI review alongside human reviews in three computer-science cohorts, using questionnaires about 71 papers.","excerpt":"Post-review questionnaires yielded 92 responses concerning 71 papers.","support":"source-stated"},{"text":"Most questionnaire responses rated the AI review useful, and the same share reported using at least some suggestions in revision.","excerpt":"Most responses rated the AI review useful (82/92 (89%), and 82/92 (89%) reported using at least some of its suggestions in revision.","support":"source-stated"},{"text":"Many respondents reported incorrect or misleading comments, and nearly half trusted AI feedback less than human feedback.","excerpt":"44/92 (48%) trusted AI feedback less than human feedback, and 58/92 (63%) reported incorrect or misleading comments.","support":"source-stated"},{"text":"Authors valued suggestions about clarity and reproducibility but also described overlooked evidence, inappropriate demands and difficulty locating useful comments in lengthy reviews.","excerpt":"Authors valued suggestions that improved clarity and reproducibility, but also described overlooked evidence, inappropriate demands, and difficulty finding useful comments within lengthy reviews.","support":"source-stated"},{"text":"Authors emphasized checking AI feedback and retaining control over manuscript processing; most supported human-and-AI review, advance notice and explicit consent.","excerpt":"They emphasized the need to check AI feedback and retain control over how their manuscripts were processed. Future review by both humans and AI was supported by 85/92 (92%); 83/92 (90%) preferred advance notice and 73/92 (79%) supported explicit consent.","support":"source-stated"},{"text":"The authors favor AI as a supplement with human oversight, disclosure and consent, while saying the study does not establish replacement of human reviewers or improved manuscript quality.","excerpt":"These exploratory findings favor a supplementary role for AI, with human oversight, clear disclosure, and author consent. They do not establish that AI can replace human reviewers or improve manuscript quality.","support":"source-stated"}],"limitations":["The study is described as exploratory and covers three computer-science cohorts: LifeCLEF 2025, LifeCLEF 2026 and CVWW 2026.","The evidence comes from 92 post-review questionnaire responses concerning 71 papers; the abstract does not establish that the findings generalize beyond these cohorts.","The authors state that the study does not establish that AI can replace human reviewers or improve manuscript quality."],"mediaId":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","correctionReason":null,"id":"6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329","publicationId":"80fd0863-d3cb-4a3d-8556-aa644cfd0208","version":1,"sourceUrl":"https://arxiv.org/abs/2605.16623","sourceTitle":"Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-05-15","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:38.159Z","createdAt":"2026-11-20T09:32:28.906Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","kind":"article","url":"https://arxiv.org/abs/2605.16623","sourceUrl":"https://arxiv.org/abs/2605.16623","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T09:31:38.504Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.16623","checkedAt":"2026-11-21T02:36:09.416Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","confidence":0.76,"provider":"typesafe","model":"jev-1.13.0","inputHash":"285b48446370bcbbf8de5ac9c5bf8ca4d471fa718b8952dfc72387e730704409","decidedAt":"2026-11-20T09:31:40.410Z"},"provenance":{"textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observationId":"4ad95e26d26b5eb60cbaad8b69c9158664d96c02a571683dc42f5810d3e84cc6","retrievedAt":"2026-11-20T09:31:38.223Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"70a0897a-08cc-458f-8579-c0403ff842d7"},"reviewer":{"model":"gpt-6-luna","runId":"678c1430-d168-4cec-88c5-6054f1a75a99"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T09:32:28.906Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Leblanc, César","url":null,"kind":"unknown"},{"name":"Picek, Lukas","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Leblanc, César","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Leblanc, César","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.16623","locator":"head/meta[name=author|citation_author]"},"assertionId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:36:09.416Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","sourceUrl":"https://arxiv.org/abs/2605.16623","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z"}},{"actor":{"name":"Picek, Lukas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Picek, Lukas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.16623","locator":"head/meta[name=author|citation_author]"},"assertionId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:36:09.416Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","sourceUrl":"https://arxiv.org/abs/2605.16623","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2605.16623","snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-authors-response-to-ai-based-reviews-useful-6e44bcea","formats":{"html":"/readings/arxiv-cs-ai-authors-response-to-ai-based-reviews-useful-6e44bcea","markdown":"/readings/arxiv-cs-ai-authors-response-to-ai-based-reviews-useful-6e44bcea.md","json":"/readings/arxiv-cs-ai-authors-response-to-ai-based-reviews-useful-6e44bcea.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329","revision":"80fd0863-d3cb-4a3d-8556-aa644cfd0208","revisionKind":"publication-id","title":"arXiv cs.AI: Authors’ response to AI-based reviews—useful suggestions, less trust","url":"https://escapemeridian.com/readings/arxiv-cs-ai-authors-response-to-ai-based-reviews-useful-6e44bcea"},"source":{"type":"source","id":"https://arxiv.org/abs/2605.16623","revision":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","revisionKind":"sha256-source-text","title":"Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study","url":"https://arxiv.org/abs/2605.16623"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329","title":"arXiv cs.AI: Authors’ response to AI-based reviews—useful suggestions, less trust","argument":"In “Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study,” César Leblanc and Lukas Picek examine how authors judged AI reviews sent alongside human reviews in three computer-science cohorts. Of 92 questionnaire responses about 71 papers, 89% rated the AI review useful and the same share said they used at least some suggestions in revisions. Yet 63% reported incorrect or misleading comments, and 48% trusted AI feedback less than human feedback. The authors describe a practical tension: AI comments could help clarify papers and improve reproducibility, but authors also reported overlooked evidence, inappropriate demands and difficulty finding useful comments in lengthy reviews. Their findings suggest that usefulness did not mean uncritical trust. Authors emphasized checking feedback and retaining control over manuscript processing; most supported future reviews by humans and AI, advance notice and explicit consent. The authors favor AI as a supplement under human oversight, with disclosure and consent. They stress that this exploratory study does not establish that AI can replace human reviewers or improve manuscript quality.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The study is described as exploratory and covers three computer-science cohorts: LifeCLEF 2025, LifeCLEF 2026 and CVWW 2026. The evidence comes from 92 post-review questionnaire responses concerning 71 papers; the abstract does not establish that the findings generalize beyond these cohorts. The authors state that the study does not establish that AI can replace human reviewers or improve manuscript quality.","speaker":{"name":"Leblanc, César, Picek, Lukas","roleAtSource":"Article author"},"source":{"title":"Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2605.16623","publishedAt":"2026-05-15","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors surveyed experiences of receiving an auxiliary AI review alongside human reviews in three computer-science cohorts, using questionnaires about 71 papers.","excerpt":"Post-review questionnaires yielded 92 responses concerning 71 papers.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Most questionnaire responses rated the AI review useful, and the same share reported using at least some suggestions in revision.","excerpt":"Most responses rated the AI review useful (82/92 (89%), and 82/92 (89%) reported using at least some of its suggestions in revision.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Many respondents reported incorrect or misleading comments, and nearly half trusted AI feedback less than human feedback.","excerpt":"44/92 (48%) trusted AI feedback less than human feedback, and 58/92 (63%) reported incorrect or misleading comments.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Authors valued suggestions about clarity and reproducibility but also described overlooked evidence, inappropriate demands and difficulty locating useful comments in lengthy reviews.","excerpt":"Authors valued suggestions that improved clarity and reproducibility, but also described overlooked evidence, inappropriate demands, and difficulty finding useful comments within lengthy reviews.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"Authors emphasized checking AI feedback and retaining control over manuscript processing; most supported human-and-AI review, advance notice and explicit consent.","excerpt":"They emphasized the need to check AI feedback and retain control over how their manuscripts were processed. Future review by both humans and AI was supported by 85/92 (92%); 83/92 (90%) preferred advance notice and 73/92 (79%) supported explicit consent.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"},{"text":"The authors favor AI as a supplement with human oversight, disclosure and consent, while saying the study does not establish replacement of human reviewers or improved manuscript quality.","excerpt":"These exploratory findings favor a supplementary role for AI, with human oversight, clear disclosure, and author consent. They do not establish that AI can replace human reviewers or improve manuscript quality.","url":"https://arxiv.org/abs/2605.16623","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.16623","checkedAt":"2026-11-21T02:36:09.416Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How could AI reviews make useful comments easier to find within lengthy reviews, a difficulty authors reported?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Authors’ response to AI-based reviews—useful suggestions, less trust","summary":"In “Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study,” César Leblanc and Lukas Picek examine how authors judged AI reviews sent alongside human reviews in three computer-science cohorts. Of 92 questionnaire responses about 71 papers, 89% rated the AI review useful and the same share said they used at least some suggestions in revisions. Yet 63% reported incorrect or misleading comments, and 48% trusted AI feedback less than human feedback. The authors describe a practical tension: AI comments could help clarify papers and improve reproducibility, but authors also reported overlooked evidence, inappropriate demands and difficulty finding useful comments in lengthy reviews. Their findings suggest that usefulness did not mean uncritical trust. Authors emphasized checking feedback and retaining control over manuscript processing; most supported future reviews by humans and AI, advance notice and explicit consent. The authors favor AI as a supplement under human oversight, with disclosure and consent. They stress that this exploratory study does not establish that AI can replace human reviewers or improve manuscript quality.","question":"How could AI reviews make useful comments easier to find within lengthy reviews, a difficulty authors reported?","claims":[{"text":"The authors surveyed experiences of receiving an auxiliary AI review alongside human reviews in three computer-science cohorts, using questionnaires about 71 papers.","excerpt":"Post-review questionnaires yielded 92 responses concerning 71 papers.","support":"source-stated"},{"text":"Most questionnaire responses rated the AI review useful, and the same share reported using at least some suggestions in revision.","excerpt":"Most responses rated the AI review useful (82/92 (89%), and 82/92 (89%) reported using at least some of its suggestions in revision.","support":"source-stated"},{"text":"Many respondents reported incorrect or misleading comments, and nearly half trusted AI feedback less than human feedback.","excerpt":"44/92 (48%) trusted AI feedback less than human feedback, and 58/92 (63%) reported incorrect or misleading comments.","support":"source-stated"},{"text":"Authors valued suggestions about clarity and reproducibility but also described overlooked evidence, inappropriate demands and difficulty locating useful comments in lengthy reviews.","excerpt":"Authors valued suggestions that improved clarity and reproducibility, but also described overlooked evidence, inappropriate demands, and difficulty finding useful comments within lengthy reviews.","support":"source-stated"},{"text":"Authors emphasized checking AI feedback and retaining control over manuscript processing; most supported human-and-AI review, advance notice and explicit consent.","excerpt":"They emphasized the need to check AI feedback and retain control over how their manuscripts were processed. Future review by both humans and AI was supported by 85/92 (92%); 83/92 (90%) preferred advance notice and 73/92 (79%) supported explicit consent.","support":"source-stated"},{"text":"The authors favor AI as a supplement with human oversight, disclosure and consent, while saying the study does not establish replacement of human reviewers or improved manuscript quality.","excerpt":"These exploratory findings favor a supplementary role for AI, with human oversight, clear disclosure, and author consent. They do not establish that AI can replace human reviewers or improve manuscript quality.","support":"source-stated"}],"limitations":["The study is described as exploratory and covers three computer-science cohorts: LifeCLEF 2025, LifeCLEF 2026 and CVWW 2026.","The evidence comes from 92 post-review questionnaire responses concerning 71 papers; the abstract does not establish that the findings generalize beyond these cohorts.","The authors state that the study does not establish that AI can replace human reviewers or improve manuscript quality."],"mediaId":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","correctionReason":null,"id":"6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329","publicationId":"80fd0863-d3cb-4a3d-8556-aa644cfd0208","version":1,"sourceUrl":"https://arxiv.org/abs/2605.16623","sourceTitle":"Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-05-15","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:01:38.159Z","createdAt":"2026-11-20T09:32:28.906Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","kind":"article","url":"https://arxiv.org/abs/2605.16623","sourceUrl":"https://arxiv.org/abs/2605.16623","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T09:31:38.504Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2605.16623","checkedAt":"2026-11-21T02:36:09.416Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v9","mediaId":"3b05295eaef713596342c5cc4173074403292f7c720776872d141a10b2601d9f","confidence":0.76,"provider":"typesafe","model":"jev-1.13.0","inputHash":"285b48446370bcbbf8de5ac9c5bf8ca4d471fa718b8952dfc72387e730704409","decidedAt":"2026-11-20T09:31:40.410Z"},"provenance":{"textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observationId":"4ad95e26d26b5eb60cbaad8b69c9158664d96c02a571683dc42f5810d3e84cc6","retrievedAt":"2026-11-20T09:31:38.223Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"70a0897a-08cc-458f-8579-c0403ff842d7"},"reviewer":{"model":"gpt-6-luna","runId":"678c1430-d168-4cec-88c5-6054f1a75a99"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T09:32:28.906Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Leblanc, César","url":null,"kind":"unknown"},{"name":"Picek, Lukas","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Leblanc, César","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Leblanc, César","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.16623","locator":"head/meta[name=author|citation_author]"},"assertionId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:36:09.416Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","sourceUrl":"https://arxiv.org/abs/2605.16623","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z"}},{"actor":{"name":"Picek, Lukas","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Picek, Lukas","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2605.16623","locator":"head/meta[name=author|citation_author]"},"assertionId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T02:36:09.416Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","sourceUrl":"https://arxiv.org/abs/2605.16623","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2605.16623","snapshotId":"b0e6c3101386b86a4a9ec4f77628d460ac9e8b95385f14e670a974732e29bf5d","contentSha256":"40b9d26bd0408a2688fcbf461ec428c296f183dc97b83b9298b2d40be7fd2f9b","textHash":"aeef239a0798e90199fbb942b43f520ce81cc462e8f5439088e4882cf299bd12","observedAt":"2026-11-21T02:36:09.416Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/6e44bcea09af6298aa7e2ae27877d8b712ff21121db666d83d609d0df5a1d329/source"}}}],"audits":[{"publicationId":"80fd0863-d3cb-4a3d-8556-aa644cfd0208","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes the study to César Leblanc and Lukas Picek on arXiv and keeps findings and recommendations attributed to the authors and respondents. The cs.AI label in the title is acceptable because the paper is cross-listed in cs.AI, although its primary category is cs.CY.","excerpt":"Authors:César Leblanc, Lukas Picek"},{"dimension":"summary","status":"pass","explanation":"The summary is clear for non-specialists and preserves the core tension: authors found the AI review useful but trusted it less. It also keeps the authors' cautious conclusion. One notable finding is left out: 83% said AI caught issues human reviewers missed. The smallest repair is one added sentence; this is not a fidelity failure. The question follows from the reported problem of lengthy reviews.","excerpt":"Authors reported that AI identified issues missed by human reviewers ((76/92 (83%)."},{"dimension":"date","status":"pass","explanation":"The originalPublished date, 2026-05-15, matches the v1 submission date. It does not use the v2 revision date of 18 Nov 2026 or the feed date.","excerpt":"Submitted on 15 May 2026 (v1), last revised 18 Nov 2026"},{"dimension":"support","status":"pass","explanation":"All claims and percentages match the abstract, and each excerpt is verbatim. The limitations accurately reflect the exploratory scope and the stated non-conclusions. No unsupported benefits, costs or forecasts are added, and the source's caveat about replacement and manuscript quality is preserved.","excerpt":"They do not establish that AI can replace human reviewers or improve manuscript quality."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to reach the source.","excerpt":null}],"createdAt":"2026-11-20T09:32:28.906Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}