{"id":"8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f","title":"arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","argument":"The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.\n\nThe authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage. The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details.","speaker":{"name":"Shenoy, Keshav, Zang, Anthony, Gan, Eric, Tay, Jacqueline, Ngo, Amy, Prasanna, Sebastian, Stastny, Julian, Hebbar, Vivek","roleAtSource":"Article author"},"source":{"title":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21832","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.","excerpt":"we use a human expert as a proxy saboteur on AI safety research","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.","excerpt":"human auditors mostly fail to distinguish sabotaged from benign research","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.","excerpt":"they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.","excerpt":"the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.","excerpt":"When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.","excerpt":"Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21832","checkedAt":"2026-11-18T15:46:09.803Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","summary":"The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.\n\nThe authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.","question":"How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?","claims":[{"text":"The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.","excerpt":"we use a human expert as a proxy saboteur on AI safety research","support":"source-stated"},{"text":"Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.","excerpt":"human auditors mostly fail to distinguish sabotaged from benign research","support":"source-stated"},{"text":"Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.","excerpt":"they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases","support":"source-stated"},{"text":"The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.","excerpt":"the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably","support":"source-stated"},{"text":"Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.","excerpt":"When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.","support":"source-stated"},{"text":"The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.","excerpt":"Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.","support":"source-stated"}],"limitations":["The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage.","The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details."],"mediaId":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","correctionReason":null,"id":"8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f","publicationId":"81c77640-fb5e-45bb-850a-0ea047a451a2","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21832","sourceTitle":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:04:15.619Z","createdAt":"2026-11-18T15:31:48.407Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","kind":"article","url":"https://arxiv.org/abs/2611.21832","sourceUrl":"https://arxiv.org/abs/2611.21832","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:19:20.068Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21832","checkedAt":"2026-11-18T15:46:09.803Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c3ba0483257bc0526ab096a58f0a3e368377b9565cc2f6db07d35bfc5005bcf6","decidedAt":"2026-11-18T15:19:21.319Z"},"provenance":{"textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observationId":"2cd1b5a1582adc1f4cea8a24222b8db8acd93ee409183defc5da2f1798b9d626","retrievedAt":"2026-11-18T15:19:19.899Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"b448691a-58a0-4581-8932-1de230b8aa85"},"reviewer":{"model":"gpt-6-luna","runId":"291fa3df-a719-4881-83c1-950109f59dee"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:31:48.407Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shenoy, Keshav","url":null,"kind":"unknown"},{"name":"Zang, Anthony","url":null,"kind":"unknown"},{"name":"Gan, Eric","url":null,"kind":"unknown"},{"name":"Tay, Jacqueline","url":null,"kind":"unknown"},{"name":"Ngo, Amy","url":null,"kind":"unknown"},{"name":"Prasanna, Sebastian","url":null,"kind":"unknown"},{"name":"Stastny, Julian","url":null,"kind":"unknown"},{"name":"Hebbar, Vivek","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shenoy, Keshav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shenoy, Keshav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Zang, Anthony","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zang, Anthony","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Gan, Eric","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gan, Eric","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Tay, Jacqueline","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tay, Jacqueline","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Ngo, Amy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ngo, Amy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Prasanna, Sebastian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Prasanna, Sebastian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Stastny, Julian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stastny, Julian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Hebbar, Vivek","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hebbar, Vivek","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21832","snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd","formats":{"html":"/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd","markdown":"/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd.md","json":"/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-frontier-model","name":"Frontier model","explanation":"One of the most capable AI models available at a given time; the set shifts as models improve.","referenceUrl":"https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper"},{"id":"term-red-teaming","name":"Red-teaming","explanation":"Deliberately attacking or tricking a system to find its weaknesses before others do.","referenceUrl":"https://en.wikipedia.org/wiki/Red_team"},{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f","revision":"81c77640-fb5e-45bb-850a-0ea047a451a2","revisionKind":"publication-id","title":"arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","url":"https://escapemeridian.com/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.21832","revision":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","revisionKind":"sha256-source-text","title":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","url":"https://arxiv.org/abs/2611.21832"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f","title":"arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","argument":"The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.\n\nThe authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage. The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details.","speaker":{"name":"Shenoy, Keshav, Zang, Anthony, Gan, Eric, Tay, Jacqueline, Ngo, Amy, Prasanna, Sebastian, Stastny, Julian, Hebbar, Vivek","roleAtSource":"Article author"},"source":{"title":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21832","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.","excerpt":"we use a human expert as a proxy saboteur on AI safety research","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.","excerpt":"human auditors mostly fail to distinguish sabotaged from benign research","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.","excerpt":"they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.","excerpt":"the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.","excerpt":"When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"},{"text":"The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.","excerpt":"Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.","url":"https://arxiv.org/abs/2611.21832","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21832","checkedAt":"2026-11-18T15:46:09.803Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","summary":"The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.\n\nThe authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.","question":"How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?","claims":[{"text":"The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.","excerpt":"we use a human expert as a proxy saboteur on AI safety research","support":"source-stated"},{"text":"Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.","excerpt":"human auditors mostly fail to distinguish sabotaged from benign research","support":"source-stated"},{"text":"Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.","excerpt":"they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases","support":"source-stated"},{"text":"The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.","excerpt":"the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably","support":"source-stated"},{"text":"Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.","excerpt":"When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.","support":"source-stated"},{"text":"The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.","excerpt":"Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.","support":"source-stated"}],"limitations":["The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage.","The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details."],"mediaId":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","correctionReason":null,"id":"8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f","publicationId":"81c77640-fb5e-45bb-850a-0ea047a451a2","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21832","sourceTitle":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:04:15.619Z","createdAt":"2026-11-18T15:31:48.407Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","kind":"article","url":"https://arxiv.org/abs/2611.21832","sourceUrl":"https://arxiv.org/abs/2611.21832","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:19:20.068Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21832","checkedAt":"2026-11-18T15:46:09.803Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"c60bbdbf2963b32b5840d5284686edf333aee05a32a21ad15df783deb910dc2b","confidence":0.93,"provider":"typesafe","model":"jev-1.13.0","inputHash":"c3ba0483257bc0526ab096a58f0a3e368377b9565cc2f6db07d35bfc5005bcf6","decidedAt":"2026-11-18T15:19:21.319Z"},"provenance":{"textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observationId":"2cd1b5a1582adc1f4cea8a24222b8db8acd93ee409183defc5da2f1798b9d626","retrievedAt":"2026-11-18T15:19:19.899Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"b448691a-58a0-4581-8932-1de230b8aa85"},"reviewer":{"model":"gpt-6-luna","runId":"291fa3df-a719-4881-83c1-950109f59dee"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:31:48.407Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Shenoy, Keshav","url":null,"kind":"unknown"},{"name":"Zang, Anthony","url":null,"kind":"unknown"},{"name":"Gan, Eric","url":null,"kind":"unknown"},{"name":"Tay, Jacqueline","url":null,"kind":"unknown"},{"name":"Ngo, Amy","url":null,"kind":"unknown"},{"name":"Prasanna, Sebastian","url":null,"kind":"unknown"},{"name":"Stastny, Julian","url":null,"kind":"unknown"},{"name":"Hebbar, Vivek","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Shenoy, Keshav","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Shenoy, Keshav","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Zang, Anthony","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zang, Anthony","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Gan, Eric","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gan, Eric","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Tay, Jacqueline","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Tay, Jacqueline","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Ngo, Amy","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ngo, Amy","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Prasanna, Sebastian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Prasanna, Sebastian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Stastny, Julian","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Stastny, Julian","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}},{"actor":{"name":"Hebbar, Vivek","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Hebbar, Vivek","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21832","locator":"head/meta[name=author|citation_author]"},"assertionId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818:participation:7","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T15:46:09.803Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","sourceUrl":"https://arxiv.org/abs/2611.21832","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z"}}],"participationCoverage":{"total":8,"returned":8,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21832","snapshotId":"53f1de2d34085418be113fbb38ef50f82a92766b8fe08e0b841e433487924818","contentSha256":"7ce948e2343d17a160ae7f1783ee38af38c15d3e3abe66e1b47e6af39badd61b","textHash":"f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c","observedAt":"2026-11-18T15:46:09.803Z","basis":"publisher-page-metadata","sourceLinks":46,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f/source"}}}],"audits":[{"publicationId":"81c77640-fb5e-45bb-850a-0ea047a451a2","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The findings and conclusion are attributed to the paper's authors on arXiv cs.AI. The title matches the source title. Results are framed as reported, not as established fact.","excerpt":"Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research"},{"dimension":"summary","status":"uncertain","explanation":"The draft leaves out why the study exists: as AI systems are used to automate AI research, misaligned systems could sabotage safety research. That stake is central to the meaning. Smallest repair: add one sentence attributing this motivation to the authors. 'Frontier models', 'red-team/blue-team' and the hedge 'within noise' are also left unexplained for lay readers. The draft omits the reported best-model figures (Fable 5.1: AUROC 0.73, 32% full identification), so readers cannot judge 'outperformed within noise'. Calling the auditors 'other human researchers' slightly exceeds the source's 'human auditors'.","excerpt":"As AI systems are increasingly used to automate AI R&D, misaligned systems could sabotage research intended to improve model safety and alignment."},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-16 matches the arXiv v1 submission date. It is not the later feed date of 2026-11-18.","excerpt":"[Submitted on 16 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract verbatim in substance. The 'within noise' qualifier is preserved, and the reading notes this was a test, not evidence of real AI sabotage. The question follows from the proxy-saboteur design without assuming an answer. The limitations accurately note what the abstract does not report.","excerpt":"Despite not being allowed to run experiments, the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-18T15:31:48.407Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}