{"id":"4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94","title":"Benjamin Skuse tested whether AI could fake a scientific paper. Here’s what happened","argument":"IEEE Spectrum’s Benjamin Skuse describes an experiment in which he used free ChatGPT and Gemini to create a paper about research that had never happened, then asked IEEE Access to screen it. The journal’s checks flagged fabricated and unverifiable references. Skuse then used FARS, an autonomous research system, to conduct a computational experiment and write a paper. IEEE Access flagged its heavy reliance on preprints, and an editor noticed errors in its figures. Neither paper was accepted for publication.\n\nSkuse argues that these tests show both the reach and limits of current safeguards: the papers looked plausible, but checks found problems. He also warns that automated research systems may make it harder to distinguish legitimate science from fabrication. His account presents competing views of what should follow. Analemma’s Xiwen Su envisions AI doing more research, with people reviewing key outputs; IEEE Access managing editor Jenny Mahoney argues that human judgment remains necessary to assess whether work can be trusted and reproduced. The experiment does not establish how often such systems produce reliable research or whether publishers can detect problems as the systems change. What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","topicIds":["power-and-infrastructure","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"This is one author’s experiment conducted with IEEE Access’s cooperation; it does not establish how common AI-generated research or publication failures are. Neither paper was peer reviewed, and their scientific claims have not been independently validated. The first paper was made with free versions of ChatGPT and Gemini, and the second with FARS; the results do not establish how other tools or workflows would perform. The article reports that IEEE Access screened the papers; neither was accepted for publication.","speaker":{"name":"Benjamin Skuse","roleAtSource":"Article author"},"source":{"title":"I Tried to Fool a Scientific Publisher With AI","publisher":"IEEE Spectrum","format":"Article","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","publishedAt":"2026-10-27T13:00:03+00:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"Benjamin Skuse used free ChatGPT and Gemini to produce a paper describing research that had never happened, then submitted it to IEEE Access for screening.","excerpt":"free ChatGPT (at the time, GPT-5.3/5.2 Mini) and Gemini (3 Flash).","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"IEEE Access’s checks flagged fabricated and unverifiable references in Skuse’s first paper.","excerpt":"IEEE’s integrity checks flag fabricated and unverifiable references.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"Skuse used FARS to conduct a computational experiment and generate a submission-ready paper; IEEE Access objected to its heavy reliance on preprints, and an editor noticed figure errors.","excerpt":"our team would have rejected this paper because it did have a huge percentage of references to preprints","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"Skuse argues that AI research systems may make it harder to distinguish legitimate science from fabrication, while the article presents different views on the future role of human judgment.","excerpt":"deciding what counts as legitimate scientific work may become even harder than detecting outright fraud.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"The experiment suggests that publisher checks can catch some problems in these papers, but it does not establish how well they will work against changing systems.","excerpt":"My homemade forgery had failed for reasons that today’s publishers know how to spot.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"found","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","checkedAt":"2026-10-29T16:17:27.795Z","items":[{"type":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","attribution":"IEEE Spectrum","basis":"publisher-embed","availability":"verified","label":"Man in glasses at night, his face reflected in a window beside him","verifiedAt":"2026-10-29T16:17:28.512Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would let publishers and researchers trust that AI-conducted research is reproducible?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Benjamin Skuse tested whether AI could fake a scientific paper. Here’s what happened","summary":"IEEE Spectrum’s Benjamin Skuse describes an experiment in which he used free ChatGPT and Gemini to create a paper about research that had never happened, then asked IEEE Access to screen it. The journal’s checks flagged fabricated and unverifiable references. Skuse then used FARS, an autonomous research system, to conduct a computational experiment and write a paper. IEEE Access flagged its heavy reliance on preprints, and an editor noticed errors in its figures. Neither paper was accepted for publication.\n\nSkuse argues that these tests show both the reach and limits of current safeguards: the papers looked plausible, but checks found problems. He also warns that automated research systems may make it harder to distinguish legitimate science from fabrication. His account presents competing views of what should follow. Analemma’s Xiwen Su envisions AI doing more research, with people reviewing key outputs; IEEE Access managing editor Jenny Mahoney argues that human judgment remains necessary to assess whether work can be trusted and reproduced. The experiment does not establish how often such systems produce reliable research or whether publishers can detect problems as the systems change. What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","question":"What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","claims":[{"text":"Benjamin Skuse used free ChatGPT and Gemini to produce a paper describing research that had never happened, then submitted it to IEEE Access for screening.","excerpt":"free ChatGPT (at the time, GPT-5.3/5.2 Mini) and Gemini (3 Flash).","support":"source-stated"},{"text":"IEEE Access’s checks flagged fabricated and unverifiable references in Skuse’s first paper.","excerpt":"IEEE’s integrity checks flag fabricated and unverifiable references.","support":"source-stated"},{"text":"Skuse used FARS to conduct a computational experiment and generate a submission-ready paper; IEEE Access objected to its heavy reliance on preprints, and an editor noticed figure errors.","excerpt":"our team would have rejected this paper because it did have a huge percentage of references to preprints","support":"source-stated"},{"text":"Skuse argues that AI research systems may make it harder to distinguish legitimate science from fabrication, while the article presents different views on the future role of human judgment.","excerpt":"deciding what counts as legitimate scientific work may become even harder than detecting outright fraud.","support":"source-stated"},{"text":"The experiment suggests that publisher checks can catch some problems in these papers, but it does not establish how well they will work against changing systems.","excerpt":"My homemade forgery had failed for reasons that today’s publishers know how to spot.","support":"interpretation"}],"limitations":["This is one author’s experiment conducted with IEEE Access’s cooperation; it does not establish how common AI-generated research or publication failures are.","Neither paper was peer reviewed, and their scientific claims have not been independently validated.","The first paper was made with free versions of ChatGPT and Gemini, and the second with FARS; the results do not establish how other tools or workflows would perform.","The article reports that IEEE Access screened the papers; neither was accepted for publication."],"mediaId":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","correctionReason":null,"id":"4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94","publicationId":"d7447a88-2519-4f17-86f1-9df1821eb97d","version":1,"sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","sourceTitle":"I Tried to Fool a Scientific Publisher With AI","publisher":"IEEE Spectrum","publishedAt":"2026-10-27T13:00:03+00:00","originalPublished":{"value":"2026-10-27T13:00:03+00:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-10-27T13:07:13.110Z","createdAt":"2026-11-10T20:46:47.918Z","historical":true,"entityIds":["ieee-spectrum"],"topicIds":["power-and-infrastructure","work-and-agency"],"media":[{"id":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","kind":"article","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-29T16:17:28.512Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"8abb87ab2d3c4db039b087b1ed47722b82a4b6fe0493e8451bbf392bc87ce98b","kind":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","label":"Man in glasses at night, his face reflected in a window beside him","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-10-29T16:17:28.512Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1793290948512},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","checkedAt":"2026-10-29T16:17:27.795Z","items":[{"type":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","attribution":"IEEE Spectrum","basis":"publisher-embed","availability":"verified","label":"Man in glasses at night, his face reflected in a window beside him","verifiedAt":"2026-10-29T16:17:28.512Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","confidence":0.94,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c3a90e8273307f76c034ef0bcad1d6782dfec29679e0e68af881468c90b8f50e","decidedAt":"2026-10-29T16:17:30.596Z"},"provenance":{"textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observationId":"06627f95436033daa58739e33c8108a8e24be3ec340e94313fcfb0b4c327887d","retrievedAt":"2026-10-29T16:17:27.795Z","kind":"publisher-page","preparer":{"model":"server-excerpt-repair/stream-excerpt-repair-v1 (original draft: gpt-6-luna)","runId":"96ab0203-f72b-4d9d-8085-ca03adf42553"},"reviewer":{"model":"gpt-6-luna","runId":"20c9f0c2-6615-4f79-802b-ea04283cc882"}},"audit":{"status":"passed","reviewedAt":"2026-11-10T20:46:47.918Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Benjamin Skuse","url":"https://spectrum.ieee.org/u/benjamin_skuse","kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Benjamin Skuse","url":"https://spectrum.ieee.org/u/benjamin_skuse","kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Benjamin Skuse","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","locator":"document/html[2]/head[0]/script[0]@163.author"},"assertionId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-29T16:17:27.795Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z"}},{"actor":{"name":"IEEE Spectrum","url":null,"kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"IEEE Spectrum","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","locator":"document/html[2]/head[0]/script[0]@163.publisher"},"assertionId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-29T16:17:27.795Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"IEEE Spectrum","url":null},"sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94/source"}},"canonicalUrl":"https://escapemeridian.com/readings/benjamin-skuse-tested-whether-ai-could-fake-a-scientific-paper-4a76aa6b","formats":{"html":"/readings/benjamin-skuse-tested-whether-ai-could-fake-a-scientific-paper-4a76aa6b","markdown":"/readings/benjamin-skuse-tested-whether-ai-could-fake-a-scientific-paper-4a76aa6b.md","json":"/readings/benjamin-skuse-tested-whether-ai-could-fake-a-scientific-paper-4a76aa6b.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[],"entities":[{"id":"ieee-spectrum","name":"IEEE Spectrum","kind":"organization","context":"IEEE Spectrum reports on engineering practice, research, and the industries around it.","referenceUrls":["https://spectrum.ieee.org/","https://spectrum.ieee.org/feeds/feed.rss"],"path":"/entities/ieee-spectrum","json":"/entities/ieee-spectrum.json","markdown":"/entities/ieee-spectrum.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94","revision":"d7447a88-2519-4f17-86f1-9df1821eb97d","revisionKind":"publication-id","title":"Benjamin Skuse tested whether AI could fake a scientific paper. Here’s what happened","url":"https://escapemeridian.com/readings/benjamin-skuse-tested-whether-ai-could-fake-a-scientific-paper-4a76aa6b"},"source":{"type":"source","id":"https://spectrum.ieee.org/ai-generated-scientific-papers","revision":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","revisionKind":"sha256-source-text","title":"I Tried to Fool a Scientific Publisher With AI","url":"https://spectrum.ieee.org/ai-generated-scientific-papers"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94","title":"Benjamin Skuse tested whether AI could fake a scientific paper. Here’s what happened","argument":"IEEE Spectrum’s Benjamin Skuse describes an experiment in which he used free ChatGPT and Gemini to create a paper about research that had never happened, then asked IEEE Access to screen it. The journal’s checks flagged fabricated and unverifiable references. Skuse then used FARS, an autonomous research system, to conduct a computational experiment and write a paper. IEEE Access flagged its heavy reliance on preprints, and an editor noticed errors in its figures. Neither paper was accepted for publication.\n\nSkuse argues that these tests show both the reach and limits of current safeguards: the papers looked plausible, but checks found problems. He also warns that automated research systems may make it harder to distinguish legitimate science from fabrication. His account presents competing views of what should follow. Analemma’s Xiwen Su envisions AI doing more research, with people reviewing key outputs; IEEE Access managing editor Jenny Mahoney argues that human judgment remains necessary to assess whether work can be trusted and reproduced. The experiment does not establish how often such systems produce reliable research or whether publishers can detect problems as the systems change. What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","topicIds":["power-and-infrastructure","work-and-agency"],"domain":"work","claimType":"attributed reading","limits":"This is one author’s experiment conducted with IEEE Access’s cooperation; it does not establish how common AI-generated research or publication failures are. Neither paper was peer reviewed, and their scientific claims have not been independently validated. The first paper was made with free versions of ChatGPT and Gemini, and the second with FARS; the results do not establish how other tools or workflows would perform. The article reports that IEEE Access screened the papers; neither was accepted for publication.","speaker":{"name":"Benjamin Skuse","roleAtSource":"Article author"},"source":{"title":"I Tried to Fool a Scientific Publisher With AI","publisher":"IEEE Spectrum","format":"Article","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","publishedAt":"2026-10-27T13:00:03+00:00","dateBasis":"Date stated by the publisher."},"evidence":[{"text":"Benjamin Skuse used free ChatGPT and Gemini to produce a paper describing research that had never happened, then submitted it to IEEE Access for screening.","excerpt":"free ChatGPT (at the time, GPT-5.3/5.2 Mini) and Gemini (3 Flash).","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"IEEE Access’s checks flagged fabricated and unverifiable references in Skuse’s first paper.","excerpt":"IEEE’s integrity checks flag fabricated and unverifiable references.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"Skuse used FARS to conduct a computational experiment and generate a submission-ready paper; IEEE Access objected to its heavy reliance on preprints, and an editor noticed figure errors.","excerpt":"our team would have rejected this paper because it did have a huge percentage of references to preprints","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"Skuse argues that AI research systems may make it harder to distinguish legitimate science from fabrication, while the article presents different views on the future role of human judgment.","excerpt":"deciding what counts as legitimate scientific work may become even harder than detecting outright fraud.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Source-stated"},{"text":"The experiment suggests that publisher checks can catch some problems in these papers, but it does not establish how well they will work against changing systems.","excerpt":"My homemade forgery had failed for reasons that today’s publishers know how to spot.","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","relationship":"Escape Meridian interpretation"}],"sourceMedia":{"status":"found","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","checkedAt":"2026-10-29T16:17:27.795Z","items":[{"type":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","attribution":"IEEE Spectrum","basis":"publisher-embed","availability":"verified","label":"Man in glasses at night, his face reflected in a window beside him","verifiedAt":"2026-10-29T16:17:28.512Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would let publishers and researchers trust that AI-conducted research is reproducible?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"Benjamin Skuse tested whether AI could fake a scientific paper. Here’s what happened","summary":"IEEE Spectrum’s Benjamin Skuse describes an experiment in which he used free ChatGPT and Gemini to create a paper about research that had never happened, then asked IEEE Access to screen it. The journal’s checks flagged fabricated and unverifiable references. Skuse then used FARS, an autonomous research system, to conduct a computational experiment and write a paper. IEEE Access flagged its heavy reliance on preprints, and an editor noticed errors in its figures. Neither paper was accepted for publication.\n\nSkuse argues that these tests show both the reach and limits of current safeguards: the papers looked plausible, but checks found problems. He also warns that automated research systems may make it harder to distinguish legitimate science from fabrication. His account presents competing views of what should follow. Analemma’s Xiwen Su envisions AI doing more research, with people reviewing key outputs; IEEE Access managing editor Jenny Mahoney argues that human judgment remains necessary to assess whether work can be trusted and reproduced. The experiment does not establish how often such systems produce reliable research or whether publishers can detect problems as the systems change. What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","question":"What evidence would let publishers and researchers trust that AI-conducted research is reproducible?","claims":[{"text":"Benjamin Skuse used free ChatGPT and Gemini to produce a paper describing research that had never happened, then submitted it to IEEE Access for screening.","excerpt":"free ChatGPT (at the time, GPT-5.3/5.2 Mini) and Gemini (3 Flash).","support":"source-stated"},{"text":"IEEE Access’s checks flagged fabricated and unverifiable references in Skuse’s first paper.","excerpt":"IEEE’s integrity checks flag fabricated and unverifiable references.","support":"source-stated"},{"text":"Skuse used FARS to conduct a computational experiment and generate a submission-ready paper; IEEE Access objected to its heavy reliance on preprints, and an editor noticed figure errors.","excerpt":"our team would have rejected this paper because it did have a huge percentage of references to preprints","support":"source-stated"},{"text":"Skuse argues that AI research systems may make it harder to distinguish legitimate science from fabrication, while the article presents different views on the future role of human judgment.","excerpt":"deciding what counts as legitimate scientific work may become even harder than detecting outright fraud.","support":"source-stated"},{"text":"The experiment suggests that publisher checks can catch some problems in these papers, but it does not establish how well they will work against changing systems.","excerpt":"My homemade forgery had failed for reasons that today’s publishers know how to spot.","support":"interpretation"}],"limitations":["This is one author’s experiment conducted with IEEE Access’s cooperation; it does not establish how common AI-generated research or publication failures are.","Neither paper was peer reviewed, and their scientific claims have not been independently validated.","The first paper was made with free versions of ChatGPT and Gemini, and the second with FARS; the results do not establish how other tools or workflows would perform.","The article reports that IEEE Access screened the papers; neither was accepted for publication."],"mediaId":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","correctionReason":null,"id":"4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94","publicationId":"d7447a88-2519-4f17-86f1-9df1821eb97d","version":1,"sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","sourceTitle":"I Tried to Fool a Scientific Publisher With AI","publisher":"IEEE Spectrum","publishedAt":"2026-10-27T13:00:03+00:00","originalPublished":{"value":"2026-10-27T13:00:03+00:00","precision":"instant","basis":"publisher_page"},"firstObservedAt":"2026-10-27T13:07:13.110Z","createdAt":"2026-11-10T20:46:47.918Z","historical":true,"entityIds":["ieee-spectrum"],"topicIds":["power-and-infrastructure","work-and-agency"],"media":[{"id":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","kind":"article","url":"https://spectrum.ieee.org/ai-generated-scientific-papers","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-10-29T16:17:28.512Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."},{"id":"8abb87ab2d3c4db039b087b1ed47722b82a4b6fe0493e8451bbf392bc87ce98b","kind":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","label":"Man in glasses at night, his face reflected in a window beside him","provenance":"publisher_page","verification":{"status":"verified","checkedAt":"2026-10-29T16:17:28.512Z","method":"publisher_association_and_head","contentType":"image/jpeg","cacheUntil":1793290948512},"recommendationReason":"Observed on the acquired publisher source; availability checked."}],"sourceMedia":{"status":"found","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","checkedAt":"2026-10-29T16:17:27.795Z","items":[{"type":"image","url":"https://spectrum.ieee.org/media-library/man-in-glasses-at-night-his-face-reflected-in-a-window-beside-him.jpg?id=68515605&width=1200&height=1600","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","attribution":"IEEE Spectrum","basis":"publisher-embed","availability":"verified","label":"Man in glasses at night, his face reflected in a window beside him","verifiedAt":"2026-10-29T16:17:28.512Z"}],"note":"Media declared by the original publisher; availability checked separately from the editorial reading."},"editorialDecision":{"outcome":"accept","reasonCodes":["useful_perspective"],"rubricVersion":"stream-admission-v5","mediaId":"562ada87341186dc7d5bb788717e9ab687d6b0afa2d69dfa57486bb09e3a2f33","confidence":0.94,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c3a90e8273307f76c034ef0bcad1d6782dfec29679e0e68af881468c90b8f50e","decidedAt":"2026-10-29T16:17:30.596Z"},"provenance":{"textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observationId":"06627f95436033daa58739e33c8108a8e24be3ec340e94313fcfb0b4c327887d","retrievedAt":"2026-10-29T16:17:27.795Z","kind":"publisher-page","preparer":{"model":"server-excerpt-repair/stream-excerpt-repair-v1 (original draft: gpt-6-luna)","runId":"96ab0203-f72b-4d9d-8085-ca03adf42553"},"reviewer":{"model":"gpt-6-luna","runId":"20c9f0c2-6615-4f79-802b-ea04283cc882"}},"audit":{"status":"passed","reviewedAt":"2026-11-10T20:46:47.918Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Benjamin Skuse","url":"https://spectrum.ieee.org/u/benjamin_skuse","kind":"Person"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Benjamin Skuse","url":"https://spectrum.ieee.org/u/benjamin_skuse","kind":"Person","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Benjamin Skuse","status":"stated","provenance":{"basis":"article-jsonld","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","locator":"document/html[2]/head[0]/script[0]@163.author"},"assertionId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-29T16:17:27.795Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z"}},{"actor":{"name":"IEEE Spectrum","url":null,"kind":"unknown","actorId":null},"role":"publisher","scope":{"kind":"publication","locator":null},"literalCredit":"IEEE Spectrum","status":"stated","provenance":{"basis":"article-publisher","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","locator":"document/html[2]/head[0]/script[0]@163.publisher"},"assertionId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-10-29T16:17:27.795Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z"}}],"participationCoverage":{"total":2,"returned":2,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":{"name":"IEEE Spectrum","url":null},"sourceUrl":"https://spectrum.ieee.org/ai-generated-scientific-papers","snapshotId":"50ec71e65b0b67bcf70d2ff07326665c5658c4ce655b20cdada3d35956afe229","contentSha256":"d6628f3dd11dd414cabd94a3068c7882bcad1eb6544980b068e0606c754c768e","textHash":"3982307f54df2310442ff4ea967c082419e0ca561bdf66659c3ab8c488effcc2","observedAt":"2026-10-29T16:17:27.795Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/4a76aa6bf884f38e9d9296787ce60bc22b139d7a2ea7703bbf72443b82bf1b94/source"}}}],"audits":[{"publicationId":"d7447a88-2519-4f17-86f1-9df1821eb97d","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft correctly attributes the experiment and article to Benjamin Skuse in IEEE Spectrum. It also correctly identifies Xiwen Su of Analemma and Jenny Mahoney as managing editor of IEEE Access, and keeps their views attributed to them.","excerpt":"Benjamin Skuse set out to test whether AI-generated research could pass for the real thing."},{"dimension":"summary","status":"pass","explanation":"The summary faithfully covers both rounds: free chatbots caught on ghost references, then FARS caught on preprint reliance and figure oddities, with neither paper accepted. It also preserves the contrasting views of Su and Mahoney and the author's warning about legitimacy. FARS is explained in plain terms. Optional repair: briefly gloss 'preprints' as papers not yet peer reviewed, since that explains why IEEE objected.","excerpt":"Because preprints haven’t yet undergone peer review, IEEE Access considers heavy reliance on them a problem."},{"dimension":"date","status":"pass","explanation":"The originalPublished value of 2026-10-27 matches the byline date in the article text.","excerpt":"Benjamin Skuse\n27 Oct 2026"},{"dimension":"support","status":"pass","explanation":"Each claim is grounded in the source. The interpretive claim is labeled and stays conditional. The source supports the limit on future detection through Longobardi's remark that today's detection tools may not work tomorrow. The question follows from Mahoney's emphasis on trust and reproducibility. No benefits or costs are invented.","excerpt":"It feels like building a detection tool today may not be effective with the AI-created paper of tomorrow"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original IEEE Spectrum article, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-10T20:46:47.918Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}