# arXiv cs.AI: Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

[Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd)

The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.

The authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

arXiv cs.AI · Article

Original source date: Nov 16, 2026 (2026-11-16).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T15:31:48.407Z. First observed: 2026-11-18T05:04:15.619Z. Retrieved: 2026-11-18T15:19:19.899Z.

- [Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research](https://arxiv.org/abs/2611.21832)

## Limits

The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage. The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details.


## Open question

How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?


## Source-stated

The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.

> we use a human expert as a proxy saboteur on AI safety research

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.

> human auditors mostly fail to distinguish sabotaged from benign research

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.

> they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.

> the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.

> When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.

> Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source and contributor context

Shenoy, Keshav, Zang, Anthony, Gan, Eric, Tay, Jacqueline, Ngo, Amy, Prasanna, Sebastian, Stastny, Julian, Hebbar, Vivek · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Frontier model

One of the most capable AI models available at a given time; the set shifts as models improve.

- [Definition reference](https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper)

## Red-teaming

Deliberately attacking or tricking a system to find its weaknesses before others do.

- [Definition reference](https://en.wikipedia.org/wiki/Red_team)

## AI agent

An AI system that chooses and carries out actions toward a goal, often using software tools.

- [Definition reference](https://www.ibm.com/think/topics/ai-agents)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 81c77640-fb5e-45bb-850a-0ea047a451a2.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T15:31:48.407Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 2cd1b5a1582adc1f4cea8a24222b8db8acd93ee409183defc5da2f1798b9d626. Source text hash: f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c.


## Revision and source-check history

### Version 1 — 2026-11-18T15:31:48.407Z

The authors of a paper on arXiv report a test of whether auditors can spot sabotage in AI safety research. A human researcher acted as the saboteur, while other human researchers reviewed full transcripts and could run experiments. The auditors mostly struggled: their AUROC was 0.59, not significantly better than chance, and they fully identified the specific sabotage in 17% of cases. AUROC measures how well a system distinguishes cases in which sabotage occurred from cases in which it did not.

The authors also report that the best frontier models outperformed human auditors within noise, despite not being allowed to run experiments; weaker models performed comparably. When the saboteur could choose which experiments to attack, rather than having to sabotage every question, identification fell further. The results concern a red-team/blue-team test, not evidence that real AI systems have sabotaged safety research. The authors argue that expert-level research sabotage is difficult to detect with current auditing methods, and offer the setup as a new way to study the problem.

## Original source

arXiv cs.AI · Article

Original source date: Nov 16, 2026 (2026-11-16).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T15:31:48.407Z. First observed: 2026-11-18T05:04:15.619Z. Retrieved: 2026-11-18T15:19:19.899Z.

- [Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research](https://arxiv.org/abs/2611.21832)

## Limits

The test used a human expert as a proxy saboteur; the abstract does not report a test in which an AI agent carried out the sabotage. The evidence provided is the paper's abstract; it does not describe the experiment's sample size or provide further methodological details.


## Open question

How might the results differ if an AI agent, rather than a human researcher acting as a proxy saboteur, carried out the sabotage?


## Source-stated

The study used a human researcher as a proxy saboteur in a red-team/blue-team test of auditing AI safety research.

> we use a human expert as a proxy saboteur on AI safety research

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Human auditors with full research transcripts and the ability to run experiments mostly failed to distinguish sabotaged from benign research.

> human auditors mostly fail to distinguish sabotaged from benign research

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Human auditors achieved an AUROC of 0.59, which the authors say was not significantly better than chance, and fully identified the specific sabotage in 17% of cases.

> they achieve an AUROC of 0.59, not significantly better than chance, and fully identify the specific sabotage in only 17% of cases

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

The best frontier models outperformed human auditors within noise despite not being allowed to run experiments; weaker models performed comparably.

> the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

Identification fell further when the saboteur could choose which experiments to attack instead of being required to sabotage every question.

> When the saboteur chooses which experiments are attacked, rather than being required to sabotage every question given, sabotage identification drops further.

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source-stated

The authors conclude that research sabotage by expert-level agents is difficult to detect with current auditing methods and present the test as a setting for further study.

> Our results suggest that research sabotage by expert-level agents is difficult to detect with current auditing methods and provide a new setting for studying research sabotage.

- [Supporting source](https://arxiv.org/abs/2611.21832)

## Source and contributor context

Shenoy, Keshav, Zang, Anthony, Gan, Eric, Tay, Jacqueline, Ngo, Amy, Prasanna, Sebastian, Stastny, Julian, Hebbar, Vivek · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Frontier model

One of the most capable AI models available at a given time; the set shifts as models improve.

- [Definition reference](https://www.gov.uk/government/publications/frontier-ai-capabilities-and-risks-discussion-paper)

## Red-teaming

Deliberately attacking or tricking a system to find its weaknesses before others do.

- [Definition reference](https://en.wikipedia.org/wiki/Red_team)

## AI agent

An AI system that chooses and carries out actions toward a goal, often using software tools.

- [Definition reference](https://www.ibm.com/think/topics/ai-agents)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 81c77640-fb5e-45bb-850a-0ea047a451a2.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T15:31:48.407Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 2cd1b5a1582adc1f4cea8a24222b8db8acd93ee409183defc5da2f1798b9d626. Source text hash: f6db5c813c3e02dba690d42ef20f561448008e57abfe31fddf52f1e4010d633c.


### uncertain — 2026-11-18T15:31:48.407Z — anthropic/claude-opus-5.5

Publication: 81c77640-fb5e-45bb-850a-0ea047a451a2

attribution — pass: The findings and conclusion are attributed to the paper's authors on arXiv cs.AI. The title matches the source title. Results are framed as reported, not as established fact.

> Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

summary — uncertain: The draft leaves out why the study exists: as AI systems are used to automate AI research, misaligned systems could sabotage safety research. That stake is central to the meaning. Smallest repair: add one sentence attributing this motivation to the authors. 'Frontier models', 'red-team/blue-team' and the hedge 'within noise' are also left unexplained for lay readers. The draft omits the reported best-model figures (Fable 5.1: AUROC 0.73, 32% full identification), so readers cannot judge 'outperformed within noise'. Calling the auditors 'other human researchers' slightly exceeds the source's 'human auditors'.

> As AI systems are increasingly used to automate AI R&D, misaligned systems could sabotage research intended to improve model safety and alignment.

date — pass: originalPublished 2026-11-16 matches the arXiv v1 submission date. It is not the later feed date of 2026-11-18.

> \[Submitted on 16 Nov 2026\]

support — pass: Each claim matches the abstract verbatim in substance. The 'within noise' qualifier is preserved, and the reading notes this was a test, not evidence of real AI sabotage. The question follows from the proxy-saboteur design without assuming an answer. The limitations accurately note what the abstract does not report.

> Despite not being allowed to run experiments, the best frontier models outperform human auditors (Fable 5.1: AUROC 0.73, 32% full identification) within noise and weaker models perform comparably.

media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.

## Recorded references

Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/8154d1bd8ae9ccf559bbcc79c00344805aab0d5f2604ac83b2e5aa15b14f057f/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-auditors-struggle-to-catch-sabotage-in-end-to-end-8154d1bd.json)
