{"id":"a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25","title":"arXiv cs.AI: ROGUE-AI tests whether reported agent failures can be reproduced","argument":"Mengxiao Wang, Mahbub Alam, Kalyan Nakka and Nitesh Saxena present ROGUE-AI, a multi-agent framework that rebuilds reported incidents offline and compares agents’ behavior with a matched control lacking the blamed cause. They argue this can help investigate whether a reported cause produced the harm, rather than merely test whether an agent can fail. The authors report reproducing reported harm in 89% of 108 attempted replications. Across five models, agents made the reported mistake in 18% to 33% of runs with the blamed cause, compared with at most 1% without it. Of 72 incidents with real-world harm, they report, 62 had no underlying attacker. In those cases, agents followed their task but missed an ordinary hazard, such as a database shared with the live site. Replications without an attacker caused more harm than prompt injection replications for all five models, so defenses looking for injected instructions would not address these cases. The authors also report that warnings naming a hazard and its consequence after each tool output lowered harm for all five models; equally long notes without that information left most harm in place. They propose ROGUE-AI as a reusable audit framework vendors can rerun before each new release.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"This reading is based on the publisher page’s abstract, not the paper’s full methods or results; the abstract does not provide enough detail to assess how the incidents were selected or how broadly the findings generalize.","speaker":{"name":"Wang, Mengxiao, Alam, Mahbub, Nakka, Kalyan, Saxena, Nitesh","roleAtSource":"Article author"},"source":{"title":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.26553","publishedAt":"2026-11-19","dateBasis":"Original submission date in the publisher’s citation record."},"evidence":[{"text":"The authors introduce ROGUE-AI to recreate reported incidents offline and compare agent behavior with a control that removes the reported cause.","excerpt":"rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report reproducing reported harm in 89% of 108 attempted replications.","excerpt":"ROGUE-AI is able to reproduce the reported harm in 89% of its 108 attempted replications.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"For five named model families, the reported mistake occurred more often when the blamed cause was present than in the matched condition without it.","excerpt":"made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report that most of the incidents with real-world harm had no underlying attacker, and that agents in these cases missed ordinary hazards while doing the requested task.","excerpt":"Of the 72 incidents with real-world harm, 62 had no underlying attacker, and in these, agents did what their task asked for but missed an ordinary hazard","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report that warnings naming the hazard reduced harm across all five models, while equally long notes without that information left most harm in place.","excerpt":"a warning after each tool output that names the hazard and its consequence lowered harm for all five models, whereas a note of the same length that does not mention the hazard left most of the harm in place.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26553","checkedAt":"2026-11-21T18:56:10.810Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the 108 attempted replications represent reported incidents beyond the cases used to build ROGUE-AI?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: ROGUE-AI tests whether reported agent failures can be reproduced","summary":"Mengxiao Wang, Mahbub Alam, Kalyan Nakka and Nitesh Saxena present ROGUE-AI, a multi-agent framework that rebuilds reported incidents offline and compares agents’ behavior with a matched control lacking the blamed cause. They argue this can help investigate whether a reported cause produced the harm, rather than merely test whether an agent can fail. The authors report reproducing reported harm in 89% of 108 attempted replications. Across five models, agents made the reported mistake in 18% to 33% of runs with the blamed cause, compared with at most 1% without it. Of 72 incidents with real-world harm, they report, 62 had no underlying attacker. In those cases, agents followed their task but missed an ordinary hazard, such as a database shared with the live site. Replications without an attacker caused more harm than prompt injection replications for all five models, so defenses looking for injected instructions would not address these cases. The authors also report that warnings naming a hazard and its consequence after each tool output lowered harm for all five models; equally long notes without that information left most harm in place. They propose ROGUE-AI as a reusable audit framework vendors can rerun before each new release.","question":"How well do the 108 attempted replications represent reported incidents beyond the cases used to build ROGUE-AI?","claims":[{"text":"The authors introduce ROGUE-AI to recreate reported incidents offline and compare agent behavior with a control that removes the reported cause.","excerpt":"rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both.","support":"source-stated"},{"text":"The authors report reproducing reported harm in 89% of 108 attempted replications.","excerpt":"ROGUE-AI is able to reproduce the reported harm in 89% of its 108 attempted replications.","support":"source-stated"},{"text":"For five named model families, the reported mistake occurred more often when the blamed cause was present than in the matched condition without it.","excerpt":"made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause.","support":"source-stated"},{"text":"The authors report that most of the incidents with real-world harm had no underlying attacker, and that agents in these cases missed ordinary hazards while doing the requested task.","excerpt":"Of the 72 incidents with real-world harm, 62 had no underlying attacker, and in these, agents did what their task asked for but missed an ordinary hazard","support":"source-stated"},{"text":"The authors report that warnings naming the hazard reduced harm across all five models, while equally long notes without that information left most harm in place.","excerpt":"a warning after each tool output that names the hazard and its consequence lowered harm for all five models, whereas a note of the same length that does not mention the hazard left most of the harm in place.","support":"source-stated"}],"limitations":["This reading is based on the publisher page’s abstract, not the paper’s full methods or results; the abstract does not provide enough detail to assess how the incidents were selected or how broadly the findings generalize."],"mediaId":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","correctionReason":null,"id":"a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25","publicationId":"b0947ed1-4809-4d64-8b3c-b3f53ab0e8c0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.26553","sourceTitle":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:24.448Z","createdAt":"2026-11-20T08:48:43.238Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","kind":"article","url":"https://arxiv.org/abs/2611.26553","sourceUrl":"https://arxiv.org/abs/2611.26553","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:47:49.152Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26553","checkedAt":"2026-11-21T18:56:10.810Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e0444bb8aeb4138c550682e8b4272fe2654bbfbc12e8e817a607fa96401deabd","decidedAt":"2026-11-20T08:47:49.942Z"},"provenance":{"textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observationId":"1c2c6587aaffe768c0e96f017d4e08101fe4734f0c13f0a1d3e76e3122fe73d2","retrievedAt":"2026-11-20T08:47:49.060Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"321b44b1-da4d-434b-8993-cd37a98c8816"},"reviewer":{"model":"gpt-6-luna","runId":"1ff033aa-0cac-4388-844c-9e190829937c"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T08:48:43.238Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wang, Mengxiao","url":null,"kind":"unknown"},{"name":"Alam, Mahbub","url":null,"kind":"unknown"},{"name":"Nakka, Kalyan","url":null,"kind":"unknown"},{"name":"Saxena, Nitesh","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wang, Mengxiao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Mengxiao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Alam, Mahbub","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Alam, Mahbub","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Nakka, Kalyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nakka, Kalyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Saxena, Nitesh","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Saxena, Nitesh","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.26553","snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-rogue-ai-tests-whether-reported-agent-failures-can-a3382f42","formats":{"html":"/readings/arxiv-cs-ai-rogue-ai-tests-whether-reported-agent-failures-can-a3382f42","markdown":"/readings/arxiv-cs-ai-rogue-ai-tests-whether-reported-agent-failures-can-a3382f42.md","json":"/readings/arxiv-cs-ai-rogue-ai-tests-whether-reported-agent-failures-can-a3382f42.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-prompt-injection","name":"Prompt injection","explanation":"Hidden instructions placed in a document, email or web page that try to take control of an AI system reading it.","referenceUrl":"https://en.wikipedia.org/wiki/Prompt_injection"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25","revision":"b0947ed1-4809-4d64-8b3c-b3f53ab0e8c0","revisionKind":"publication-id","title":"arXiv cs.AI: ROGUE-AI tests whether reported agent failures can be reproduced","url":"https://escapemeridian.com/readings/arxiv-cs-ai-rogue-ai-tests-whether-reported-agent-failures-can-a3382f42"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.26553","revision":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","revisionKind":"sha256-source-text","title":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","url":"https://arxiv.org/abs/2611.26553"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25","title":"arXiv cs.AI: ROGUE-AI tests whether reported agent failures can be reproduced","argument":"Mengxiao Wang, Mahbub Alam, Kalyan Nakka and Nitesh Saxena present ROGUE-AI, a multi-agent framework that rebuilds reported incidents offline and compares agents’ behavior with a matched control lacking the blamed cause. They argue this can help investigate whether a reported cause produced the harm, rather than merely test whether an agent can fail. The authors report reproducing reported harm in 89% of 108 attempted replications. Across five models, agents made the reported mistake in 18% to 33% of runs with the blamed cause, compared with at most 1% without it. Of 72 incidents with real-world harm, they report, 62 had no underlying attacker. In those cases, agents followed their task but missed an ordinary hazard, such as a database shared with the live site. Replications without an attacker caused more harm than prompt injection replications for all five models, so defenses looking for injected instructions would not address these cases. The authors also report that warnings naming a hazard and its consequence after each tool output lowered harm for all five models; equally long notes without that information left most harm in place. They propose ROGUE-AI as a reusable audit framework vendors can rerun before each new release.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"This reading is based on the publisher page’s abstract, not the paper’s full methods or results; the abstract does not provide enough detail to assess how the incidents were selected or how broadly the findings generalize.","speaker":{"name":"Wang, Mengxiao, Alam, Mahbub, Nakka, Kalyan, Saxena, Nitesh","roleAtSource":"Article author"},"source":{"title":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.26553","publishedAt":"2026-11-19","dateBasis":"Original submission date in the publisher’s citation record."},"evidence":[{"text":"The authors introduce ROGUE-AI to recreate reported incidents offline and compare agent behavior with a control that removes the reported cause.","excerpt":"rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report reproducing reported harm in 89% of 108 attempted replications.","excerpt":"ROGUE-AI is able to reproduce the reported harm in 89% of its 108 attempted replications.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"For five named model families, the reported mistake occurred more often when the blamed cause was present than in the matched condition without it.","excerpt":"made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report that most of the incidents with real-world harm had no underlying attacker, and that agents in these cases missed ordinary hazards while doing the requested task.","excerpt":"Of the 72 incidents with real-world harm, 62 had no underlying attacker, and in these, agents did what their task asked for but missed an ordinary hazard","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"},{"text":"The authors report that warnings naming the hazard reduced harm across all five models, while equally long notes without that information left most harm in place.","excerpt":"a warning after each tool output that names the hazard and its consequence lowered harm for all five models, whereas a note of the same length that does not mention the hazard left most of the harm in place.","url":"https://arxiv.org/abs/2611.26553","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26553","checkedAt":"2026-11-21T18:56:10.810Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"How well do the 108 attempted replications represent reported incidents beyond the cases used to build ROGUE-AI?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: ROGUE-AI tests whether reported agent failures can be reproduced","summary":"Mengxiao Wang, Mahbub Alam, Kalyan Nakka and Nitesh Saxena present ROGUE-AI, a multi-agent framework that rebuilds reported incidents offline and compares agents’ behavior with a matched control lacking the blamed cause. They argue this can help investigate whether a reported cause produced the harm, rather than merely test whether an agent can fail. The authors report reproducing reported harm in 89% of 108 attempted replications. Across five models, agents made the reported mistake in 18% to 33% of runs with the blamed cause, compared with at most 1% without it. Of 72 incidents with real-world harm, they report, 62 had no underlying attacker. In those cases, agents followed their task but missed an ordinary hazard, such as a database shared with the live site. Replications without an attacker caused more harm than prompt injection replications for all five models, so defenses looking for injected instructions would not address these cases. The authors also report that warnings naming a hazard and its consequence after each tool output lowered harm for all five models; equally long notes without that information left most harm in place. They propose ROGUE-AI as a reusable audit framework vendors can rerun before each new release.","question":"How well do the 108 attempted replications represent reported incidents beyond the cases used to build ROGUE-AI?","claims":[{"text":"The authors introduce ROGUE-AI to recreate reported incidents offline and compare agent behavior with a control that removes the reported cause.","excerpt":"rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both.","support":"source-stated"},{"text":"The authors report reproducing reported harm in 89% of 108 attempted replications.","excerpt":"ROGUE-AI is able to reproduce the reported harm in 89% of its 108 attempted replications.","support":"source-stated"},{"text":"For five named model families, the reported mistake occurred more often when the blamed cause was present than in the matched condition without it.","excerpt":"made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause.","support":"source-stated"},{"text":"The authors report that most of the incidents with real-world harm had no underlying attacker, and that agents in these cases missed ordinary hazards while doing the requested task.","excerpt":"Of the 72 incidents with real-world harm, 62 had no underlying attacker, and in these, agents did what their task asked for but missed an ordinary hazard","support":"source-stated"},{"text":"The authors report that warnings naming the hazard reduced harm across all five models, while equally long notes without that information left most harm in place.","excerpt":"a warning after each tool output that names the hazard and its consequence lowered harm for all five models, whereas a note of the same length that does not mention the hazard left most of the harm in place.","support":"source-stated"}],"limitations":["This reading is based on the publisher page’s abstract, not the paper’s full methods or results; the abstract does not provide enough detail to assess how the incidents were selected or how broadly the findings generalize."],"mediaId":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","correctionReason":null,"id":"a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25","publicationId":"b0947ed1-4809-4d64-8b3c-b3f53ab0e8c0","version":1,"sourceUrl":"https://arxiv.org/abs/2611.26553","sourceTitle":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-19","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-20T05:07:24.448Z","createdAt":"2026-11-20T08:48:43.238Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","kind":"article","url":"https://arxiv.org/abs/2611.26553","sourceUrl":"https://arxiv.org/abs/2611.26553","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-20T08:47:49.152Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.26553","checkedAt":"2026-11-21T18:56:10.810Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"d8936dff35f46b41a481dd5df2e8019f4f39a684ab51baaea6efe0ba965b62ac","confidence":0.91,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e0444bb8aeb4138c550682e8b4272fe2654bbfbc12e8e817a607fa96401deabd","decidedAt":"2026-11-20T08:47:49.942Z"},"provenance":{"textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observationId":"1c2c6587aaffe768c0e96f017d4e08101fe4734f0c13f0a1d3e76e3122fe73d2","retrievedAt":"2026-11-20T08:47:49.060Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"321b44b1-da4d-434b-8993-cd37a98c8816"},"reviewer":{"model":"gpt-6-luna","runId":"1ff033aa-0cac-4388-844c-9e190829937c"}},"audit":{"status":"passed","reviewedAt":"2026-11-20T08:48:43.238Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Wang, Mengxiao","url":null,"kind":"unknown"},{"name":"Alam, Mahbub","url":null,"kind":"unknown"},{"name":"Nakka, Kalyan","url":null,"kind":"unknown"},{"name":"Saxena, Nitesh","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Wang, Mengxiao","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Wang, Mengxiao","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Alam, Mahbub","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Alam, Mahbub","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Nakka, Kalyan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Nakka, Kalyan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}},{"actor":{"name":"Saxena, Nitesh","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Saxena, Nitesh","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.26553","locator":"head/meta[name=author|citation_author]"},"assertionId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-21T18:56:10.810Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","sourceUrl":"https://arxiv.org/abs/2611.26553","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.26553","snapshotId":"6bca017ac2d3b85eefcae1b778ffd02ce21e936b53a96a71a4bec88ad9f42b2c","contentSha256":"1527fc700cb60db2118efc4c7ae347aa62f5f63ea0bbbbdebf1399e0032855e8","textHash":"03b0308866aae20dcd78c59fc0091b2387c8fb16c566673459931668e065b011","observedAt":"2026-11-21T18:56:10.810Z","basis":"publisher-page-metadata","sourceLinks":44,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/a3382f4253e66fc5ca8bc7ad8e7f030ae8bfe19a6706e809dc739c5958e15e25/source"}}}],"audits":[{"publicationId":"b0947ed1-4809-4d64-8b3c-b3f53ab0e8c0","verdict":"passed","findings":[{"dimension":"attribution","status":"pass","explanation":"The draft names the four listed authors and the arXiv cs.AI publisher. Results are framed as author reports ('The authors report', 'they report'), and the claims about ROGUE-AI and vendor audits are attributed to the authors rather than presented as established fact.","excerpt":"Authors:Mengxiao Wang, Mahbub Alam, Kalyan Nakka, Nitesh Saxena"},{"dimension":"summary","status":"pass","explanation":"The summary faithfully covers the abstract: offline rebuilding with matched controls, 89% of 108 replications, 18–33% versus at most 1%, 62 of 72 incidents without an attacker, warning versus same-length-note results, and the proposed vendor audit use. The title and the question about representativeness follow from the evidence. 'Prompt injection' is not explained in plain language; per the Spock Test this suits a term-library tooltip rather than a paraphrase, and it does not block understanding of the central finding.","excerpt":"rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both."},{"dimension":"date","status":"pass","explanation":"The originalPublished date of 2026-11-19 matches the v1 submission date on the arXiv page. It is not the later feed entry date of Nov 20.","excerpt":"[Submitted on 19 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All claim excerpts are exact and support their claims. The statement that defenses looking for injected instructions would not address the no-attacker cases is a close restatement of the abstract's own point. The limitation correctly notes the reading rests only on the abstract.","excerpt":"Defenses against prompt injection look for injected instructions, but these replications contain none."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the original arXiv abstract page. It matches the source URL and is the most direct access point.","excerpt":null}],"createdAt":"2026-11-20T08:48:43.238Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}