{"id":"f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c","title":"arXiv cs.AI: Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","argument":"Charles Xiao argues that text-similarity guardrails can confuse injected instructions that keep affecting AI agents after their wording changes with legitimate quotation and template reuse. In a controlled three-agent email relay, DonkeyRail’s default threshold missed 8 of 19 functional outputs and flagged 70 of 192 legitimate replies; every completed quotation and template-reuse reply triggered a false alert. Calibration for low false positives on one template set did not transfer to new templates: the recalibrated threshold detected only one functional output and still produced 15 false alerts. Xiao also reports an operating-point error in all 21 published classifier configurations: ROC interpolation replaced direct threshold application. More broadly, high AUC against a surface-level text criterion provides no distribution-free guarantee of high AUC against the behavioral target, and existing evaluation labels lack the joint observations needed to estimate that gap. The paper also finds that identical visible transcripts can call for different safety decisions under different governing policies, a distinction no observation-only classifier can resolve. Xiao argues for behavioral and policy-grounded evaluation over text-similarity guardrails.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported classifier results are from a controlled three-agent email relay using DonkeyRail; the abstract does not establish how they transfer to other settings. The abstract says existing evaluation labels lack the joint observations needed to estimate the gap between the surface-level text criterion and the behavioral target.","speaker":{"name":"Xiao, Charles","roleAtSource":"Article author"},"source":{"title":"Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21520","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"Xiao argues that text-similarity guardrails risk confusing injected instructions that retain their effect after rewording with legitimate quotation and template reuse.","excerpt":"an output can preserve an injected instruction's effect on downstream agents even after its wording changes, yet legitimate quotation and template reuse can produce high textual overlap with the source","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"In the controlled three-agent email relay, DonkeyRail’s default threshold missed 8 functional outputs and flagged 70 legitimate replies.","excerpt":"At its default threshold the classifier misses 8 of 19 functional outputs while flagging 70 of 192 legitimate replies","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"The paper reports that recalibration on one template set did not transfer to new templates, and that the existing evaluation labels cannot estimate the gap between the surface-level text criterion and behavioral target.","excerpt":"the recalibrated threshold detects only one functional output and still produces 15 false alerts on new templates","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"Xiao argues that identical visible transcripts can require different safety decisions under governing policies, beyond the reach of observation-only classifiers.","excerpt":"identical visible transcripts can require different safety decisions depending on the governing policy, a distinction no observation-only classifier can resolve","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21520","checkedAt":"2026-11-17T14:51:00.824Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What joint observations would be needed to estimate the gap between performance against a surface-level text criterion and performance against the behavioral target?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","summary":"Charles Xiao argues that text-similarity guardrails can confuse injected instructions that keep affecting AI agents after their wording changes with legitimate quotation and template reuse. In a controlled three-agent email relay, DonkeyRail’s default threshold missed 8 of 19 functional outputs and flagged 70 of 192 legitimate replies; every completed quotation and template-reuse reply triggered a false alert. Calibration for low false positives on one template set did not transfer to new templates: the recalibrated threshold detected only one functional output and still produced 15 false alerts. Xiao also reports an operating-point error in all 21 published classifier configurations: ROC interpolation replaced direct threshold application. More broadly, high AUC against a surface-level text criterion provides no distribution-free guarantee of high AUC against the behavioral target, and existing evaluation labels lack the joint observations needed to estimate that gap. The paper also finds that identical visible transcripts can call for different safety decisions under different governing policies, a distinction no observation-only classifier can resolve. Xiao argues for behavioral and policy-grounded evaluation over text-similarity guardrails.","question":"What joint observations would be needed to estimate the gap between performance against a surface-level text criterion and performance against the behavioral target?","claims":[{"text":"Xiao argues that text-similarity guardrails risk confusing injected instructions that retain their effect after rewording with legitimate quotation and template reuse.","excerpt":"an output can preserve an injected instruction's effect on downstream agents even after its wording changes, yet legitimate quotation and template reuse can produce high textual overlap with the source","support":"source-stated"},{"text":"In the controlled three-agent email relay, DonkeyRail’s default threshold missed 8 functional outputs and flagged 70 legitimate replies.","excerpt":"At its default threshold the classifier misses 8 of 19 functional outputs while flagging 70 of 192 legitimate replies","support":"source-stated"},{"text":"The paper reports that recalibration on one template set did not transfer to new templates, and that the existing evaluation labels cannot estimate the gap between the surface-level text criterion and behavioral target.","excerpt":"the recalibrated threshold detects only one functional output and still produces 15 false alerts on new templates","support":"source-stated"},{"text":"Xiao argues that identical visible transcripts can require different safety decisions under governing policies, beyond the reach of observation-only classifiers.","excerpt":"identical visible transcripts can require different safety decisions depending on the governing policy, a distinction no observation-only classifier can resolve","support":"source-stated"}],"limitations":["The reported classifier results are from a controlled three-agent email relay using DonkeyRail; the abstract does not establish how they transfer to other settings.","The abstract says existing evaluation labels lack the joint observations needed to estimate the gap between the surface-level text criterion and the behavioral target."],"mediaId":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","correctionReason":"Restored that calibration for low false positives on one template set did not transfer, clarifying the scope of the reported result.","id":"f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c","publicationId":"47b63d03-acff-45ca-8bcb-c8cbf7c33220","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21520","sourceTitle":"Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:27:46.537Z","createdAt":"2026-11-17T13:47:12.534Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","kind":"article","url":"https://arxiv.org/abs/2611.21520","sourceUrl":"https://arxiv.org/abs/2611.21520","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:34:47.983Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21520","checkedAt":"2026-11-17T14:51:00.824Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"1493047e195f0f7b64d4e665ad691ce41f7861bc78514e9e548ef0730b204036","decidedAt":"2026-11-17T13:34:49.299Z"},"provenance":{"textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observationId":"06b56ee55a2e3773d04a679282a2db0530d48c65f78526599e3193786f71df61","retrievedAt":"2026-11-17T13:34:47.814Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"84938b93-6fd5-4ccb-8b56-20f2b6aae4f8"},"reviewer":{"model":"gpt-6-luna","runId":"3976a389-b0d7-4a6c-89ff-cd07b4929967"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:47:12.534Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Xiao, Charles","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Xiao, Charles","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xiao, Charles","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21520","locator":"head/meta[name=author|citation_author]"},"assertionId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T14:51:00.824Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d","sourceUrl":"https://arxiv.org/abs/2611.21520","contentSha256":"30a66087a002b42d356c58e0f13ddc33e4a401f2e4c0ff4129688346eb8d5cc8","textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observedAt":"2026-11-17T14:51:00.824Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21520","snapshotId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d","contentSha256":"30a66087a002b42d356c58e0f13ddc33e4a401f2e4c0ff4129688346eb8d5cc8","textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observedAt":"2026-11-17T14:51:00.824Z","basis":"publisher-page-metadata","sourceLinks":39,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-safe-resemblance-silent-propagation-limits-of-text-f3b7fd77","formats":{"html":"/readings/arxiv-cs-ai-safe-resemblance-silent-propagation-limits-of-text-f3b7fd77","markdown":"/readings/arxiv-cs-ai-safe-resemblance-silent-propagation-limits-of-text-f3b7fd77.md","json":"/readings/arxiv-cs-ai-safe-resemblance-silent-propagation-limits-of-text-f3b7fd77.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-ai-agent","name":"AI agent","explanation":"An AI system that chooses and carries out actions toward a goal, often using software tools.","referenceUrl":"https://www.ibm.com/think/topics/ai-agents"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c","revision":"47b63d03-acff-45ca-8bcb-c8cbf7c33220","revisionKind":"publication-id","title":"arXiv cs.AI: Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","url":"https://escapemeridian.com/readings/arxiv-cs-ai-safe-resemblance-silent-propagation-limits-of-text-f3b7fd77"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.21520","revision":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","revisionKind":"sha256-source-text","title":"Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","url":"https://arxiv.org/abs/2611.21520"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c","title":"arXiv cs.AI: Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","argument":"Charles Xiao argues that text-similarity guardrails can confuse injected instructions that keep affecting AI agents after their wording changes with legitimate quotation and template reuse. In a controlled three-agent email relay, DonkeyRail’s default threshold missed 8 of 19 functional outputs and flagged 70 of 192 legitimate replies; every completed quotation and template-reuse reply triggered a false alert. Calibration for low false positives on one template set did not transfer to new templates: the recalibrated threshold detected only one functional output and still produced 15 false alerts. Xiao also reports an operating-point error in all 21 published classifier configurations: ROC interpolation replaced direct threshold application. More broadly, high AUC against a surface-level text criterion provides no distribution-free guarantee of high AUC against the behavioral target, and existing evaluation labels lack the joint observations needed to estimate that gap. The paper also finds that identical visible transcripts can call for different safety decisions under different governing policies, a distinction no observation-only classifier can resolve. Xiao argues for behavioral and policy-grounded evaluation over text-similarity guardrails.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported classifier results are from a controlled three-agent email relay using DonkeyRail; the abstract does not establish how they transfer to other settings. The abstract says existing evaluation labels lack the joint observations needed to estimate the gap between the surface-level text criterion and the behavioral target.","speaker":{"name":"Xiao, Charles","roleAtSource":"Article author"},"source":{"title":"Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.21520","publishedAt":"2026-11-16","dateBasis":"Date basis not provided."},"evidence":[{"text":"Xiao argues that text-similarity guardrails risk confusing injected instructions that retain their effect after rewording with legitimate quotation and template reuse.","excerpt":"an output can preserve an injected instruction's effect on downstream agents even after its wording changes, yet legitimate quotation and template reuse can produce high textual overlap with the source","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"In the controlled three-agent email relay, DonkeyRail’s default threshold missed 8 functional outputs and flagged 70 legitimate replies.","excerpt":"At its default threshold the classifier misses 8 of 19 functional outputs while flagging 70 of 192 legitimate replies","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"The paper reports that recalibration on one template set did not transfer to new templates, and that the existing evaluation labels cannot estimate the gap between the surface-level text criterion and behavioral target.","excerpt":"the recalibrated threshold detects only one functional output and still produces 15 false alerts on new templates","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"},{"text":"Xiao argues that identical visible transcripts can require different safety decisions under governing policies, beyond the reach of observation-only classifiers.","excerpt":"identical visible transcripts can require different safety decisions depending on the governing policy, a distinction no observation-only classifier can resolve","url":"https://arxiv.org/abs/2611.21520","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21520","checkedAt":"2026-11-17T14:51:00.824Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What joint observations would be needed to estimate the gap between performance against a surface-level text criterion and performance against the behavioral target?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","summary":"Charles Xiao argues that text-similarity guardrails can confuse injected instructions that keep affecting AI agents after their wording changes with legitimate quotation and template reuse. In a controlled three-agent email relay, DonkeyRail’s default threshold missed 8 of 19 functional outputs and flagged 70 of 192 legitimate replies; every completed quotation and template-reuse reply triggered a false alert. Calibration for low false positives on one template set did not transfer to new templates: the recalibrated threshold detected only one functional output and still produced 15 false alerts. Xiao also reports an operating-point error in all 21 published classifier configurations: ROC interpolation replaced direct threshold application. More broadly, high AUC against a surface-level text criterion provides no distribution-free guarantee of high AUC against the behavioral target, and existing evaluation labels lack the joint observations needed to estimate that gap. The paper also finds that identical visible transcripts can call for different safety decisions under different governing policies, a distinction no observation-only classifier can resolve. Xiao argues for behavioral and policy-grounded evaluation over text-similarity guardrails.","question":"What joint observations would be needed to estimate the gap between performance against a surface-level text criterion and performance against the behavioral target?","claims":[{"text":"Xiao argues that text-similarity guardrails risk confusing injected instructions that retain their effect after rewording with legitimate quotation and template reuse.","excerpt":"an output can preserve an injected instruction's effect on downstream agents even after its wording changes, yet legitimate quotation and template reuse can produce high textual overlap with the source","support":"source-stated"},{"text":"In the controlled three-agent email relay, DonkeyRail’s default threshold missed 8 functional outputs and flagged 70 legitimate replies.","excerpt":"At its default threshold the classifier misses 8 of 19 functional outputs while flagging 70 of 192 legitimate replies","support":"source-stated"},{"text":"The paper reports that recalibration on one template set did not transfer to new templates, and that the existing evaluation labels cannot estimate the gap between the surface-level text criterion and behavioral target.","excerpt":"the recalibrated threshold detects only one functional output and still produces 15 false alerts on new templates","support":"source-stated"},{"text":"Xiao argues that identical visible transcripts can require different safety decisions under governing policies, beyond the reach of observation-only classifiers.","excerpt":"identical visible transcripts can require different safety decisions depending on the governing policy, a distinction no observation-only classifier can resolve","support":"source-stated"}],"limitations":["The reported classifier results are from a controlled three-agent email relay using DonkeyRail; the abstract does not establish how they transfer to other settings.","The abstract says existing evaluation labels lack the joint observations needed to estimate the gap between the surface-level text criterion and the behavioral target."],"mediaId":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","correctionReason":"Restored that calibration for low false positives on one template set did not transfer, clarifying the scope of the reported result.","id":"f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c","publicationId":"47b63d03-acff-45ca-8bcb-c8cbf7c33220","version":1,"sourceUrl":"https://arxiv.org/abs/2611.21520","sourceTitle":"Safe Resemblance, Silent Propagation: Limits of Text-Similarity Guardrails for AI Agent Safety","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-16","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-17T08:27:46.537Z","createdAt":"2026-11-17T13:47:12.534Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","kind":"article","url":"https://arxiv.org/abs/2611.21520","sourceUrl":"https://arxiv.org/abs/2611.21520","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-17T13:34:47.983Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.21520","checkedAt":"2026-11-17T14:51:00.824Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"ad36ee68279ca2a5af22056ce441d6a6e3a179d863ae73ac223f95aebacb7b7f","confidence":0.86,"provider":"typesafe","model":"jev-1.13.0","inputHash":"1493047e195f0f7b64d4e665ad691ce41f7861bc78514e9e548ef0730b204036","decidedAt":"2026-11-17T13:34:49.299Z"},"provenance":{"textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observationId":"06b56ee55a2e3773d04a679282a2db0530d48c65f78526599e3193786f71df61","retrievedAt":"2026-11-17T13:34:47.814Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"84938b93-6fd5-4ccb-8b56-20f2b6aae4f8"},"reviewer":{"model":"gpt-6-luna","runId":"3976a389-b0d7-4a6c-89ff-cd07b4929967"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-17T13:47:12.534Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Xiao, Charles","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Xiao, Charles","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Xiao, Charles","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.21520","locator":"head/meta[name=author|citation_author]"},"assertionId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-17T14:51:00.824Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d","sourceUrl":"https://arxiv.org/abs/2611.21520","contentSha256":"30a66087a002b42d356c58e0f13ddc33e4a401f2e4c0ff4129688346eb8d5cc8","textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observedAt":"2026-11-17T14:51:00.824Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.21520","snapshotId":"1f5b7dc553b31cacc5620703eb775b96045ef0aa88b21059dd179f573556209d","contentSha256":"30a66087a002b42d356c58e0f13ddc33e4a401f2e4c0ff4129688346eb8d5cc8","textHash":"76289b5d3bf9d5c0e073beb36000310050320680273d5736bc963b884214fa1e","observedAt":"2026-11-17T14:51:00.824Z","basis":"publisher-page-metadata","sourceLinks":39,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/f3b7fd77a8a137b64d13dcb1121b44be7632fb4fa3765ad68a93de75859c014c/source"}}}],"audits":[{"publicationId":"47b63d03-acff-45ca-8bcb-c8cbf7c33220","verdict":"uncertain","findings":[{"dimension":"attribution","status":"uncertain","explanation":"The reading correctly credits Charles Xiao and arXiv cs.AI. However, the sentence beginning 'More broadly, high AUC against a surface-level text criterion provides no distribution-free guarantee...' is written as an established fact. In the source, it is the author's formal argument. Smallest repair: 'Xiao argues formally that high AUC...'","excerpt":"show formally that high AUC against a surface-level text criterion provides no distribution-free guarantee of high AUC against the behavioral target"},{"dimension":"summary","status":"uncertain","explanation":"The numbers are faithful, but a general reader cannot follow the central meaning. 'Functional outputs' is the key measure and is never explained; the paper defines it as an injected procedure that makes two later agents run fresh computations. Several other terms are also left unexplained, including injected instruction, AUC, ROC interpolation, operating-point error and distribution-free guarantee. The reading never states plainly why the results matter: a guardrail that relies on text overlap can let a reworded attack through while flagging legitimate quoting. The title simply repeats the source title. Smallest repair: add a plain-language definition of functional outputs and a one-line significance sentence.","excerpt":"an output counts as functional (the injected procedure induces fresh computations in two subsequent agents) independent of the detector's score"},{"dimension":"date","status":"pass","explanation":"The originalPublished value, 2026-11-16, matches the v1 submission date shown on the arXiv page. It is not the later feed date.","excerpt":"[Submitted on 16 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"All figures match the abstract: 8 of 19 missed, 70 of 192 flagged, 15 false alerts, one detection after recalibration, and 21 configurations. The policy-transcript claim and the conclusion are also supported. The question follows directly from the stated gap in evaluation labels and does not presuppose an answer. The limitations are appropriately scoped.","excerpt":"the existing evaluation labels lack the joint observations needed to estimate the gap"},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the source itself.","excerpt":null}],"createdAt":"2026-11-17T13:47:12.534Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}