Skip to content
Escape
Meridian

The future is still open.

Chen, Xiaobo, Zhu, Genliang, Wang, Ziyuan, Wang, Chu · Nov 5, 2026

arXiv cs.AI: Signed but Not Safe: Requirement Integrity in Multi-Agent LLM Handoffs

Markdown · JSON · Original source

The authors of “Signed but Not Safe” study a specific risk in multi-agent AI systems: when one agent passes work to another, requirements can be summarized away, altered or ignored. Their handoff records each requirement as a verbatim quote plus a checkable predicate, then uses HMAC-SHA256 to sign the record and deterministic code to verify the merged decision. In synthetic, exactly scorable tasks with Qwen3-8B, the authors report that signed manifests reduced unsafe commits under attack from 69.4% to 9.0%, without a net loss of conformant commits compared with structured handoffs. But the signature only protects the manifest after it is created. An adversarial line before signing increased violations, and the signature authenticated the corrupted manifest. The authors identify requirement extraction—not just transmission—as the trust boundary: a secure handoff cannot repair a requirement that was already captured incorrectly. They also report that a deterministic verifier caught more violating decisions than an checker, with fewer false alarms in their study. These results describe the paper’s tested tasks and models; they do not establish performance in other settings.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 5, 2026 (2026-11-05).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-09T02:23:29.868Z. First observed: 2026-11-06T05:10:22.599Z. Retrieved: 2026-11-09T02:22:42.849Z.

Referenced by

Recorded citations and public file attachments. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The reported results come from synthetic, exactly scorable tasks and specified models; the abstract does not establish how they generalize to other settings. The abstract describes requirement extraction as the trust boundary but does not report a method that prevents extraction errors.

Open question

How would the reported extraction errors and verification results change in handoffs beyond the study’s synthetic, exactly scorable tasks?

Source-stated

The authors say multi-agent handoffs can lose, alter or ignore requirements as work is split across agents and results are merged.

each handoff can summarize away, alter or ignore a requirement

Source-stated

The authors tested signed requirement-manifest handoffs against free-text and structured JSON handoffs using synthetic, exactly scorable tasks and Qwen3-8B.

With Qwen3-8B (1,440 trajectories, five threats)

Source-stated

In the study, signed manifests reduced unsafe commits under attack from 69.4% to 9.0%, with no net loss of conformant commits relative to structured handoffs.

signed manifests cut unsafe commits under attack from 69.4% to 9.0% (60.4 pp, 95% CI [51.4, 69.4]) with no net loss of conformant commits relative to structured handoffs.

Source-stated

The authors report that signing protected a manifest from in-transit tampering, but a pre-signing injection could corrupt it and the signature would then authenticate that corruption.

Signing protects requirements in transit, not at extraction; the extraction step is the trust boundary.

Source-stated

In the reported study, deterministic verification caught more violating decisions than an LLM checker and produced fewer false alarms.

the deterministic verifier caught 78.7% of violating decisions versus 59.0% for an LLM checker, with 7% versus 50% false alarms.

Source and contributor context

Chen, Xiaobo, Zhu, Genliang, Wang, Ziyuan, Wang, Chu · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 1bc017ca-833a-4659-8b60-9275114c2a86.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T02:23:29.868Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: a5b36eb4e7269e0cbcaf5a0817faf30949c4c3678f46aed8713d4b304b6e5e60. Source text hash: abbf5828a949d15c8eead11e71b001a493b03daf81e737b7d52adcfd6e293d2e.

Revision and source-check history

Version 1 · 2026-11-09T02:23:29.868Z

arXiv cs.AI: Signed but Not Safe: Requirement Integrity in Multi-Agent LLM Handoffs

The authors of “Signed but Not Safe” study a specific risk in multi-agent AI systems: when one agent passes work to another, requirements can be summarized away, altered or ignored. Their handoff records each requirement as a verbatim quote plus a checkable predicate, then uses HMAC-SHA256 to sign the record and deterministic code to verify the merged decision. In synthetic, exactly scorable tasks with Qwen3-8B, the authors report that signed manifests reduced unsafe commits under attack from 69.4% to 9.0%, without a net loss of conformant commits compared with structured handoffs. But the signature only protects the manifest after it is created. An adversarial line before signing increased violations, and the signature authenticated the corrupted manifest. The authors identify requirement extraction—not just transmission—as the trust boundary: a secure handoff cannot repair a requirement that was already captured incorrectly. They also report that a deterministic verifier caught more violating decisions than an checker, with fewer false alarms in their study. These results describe the paper’s tested tasks and models; they do not establish performance in other settings.

Original source

cs.AI · Article

Source details

Original source date: Nov 5, 2026 (2026-11-05).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-09T02:23:29.868Z. First observed: 2026-11-06T05:10:22.599Z. Retrieved: 2026-11-09T02:22:42.849Z.

Limits

The reported results come from synthetic, exactly scorable tasks and specified models; the abstract does not establish how they generalize to other settings. The abstract describes requirement extraction as the trust boundary but does not report a method that prevents extraction errors.

Open question

How would the reported extraction errors and verification results change in handoffs beyond the study’s synthetic, exactly scorable tasks?

Source-stated

The authors say multi-agent handoffs can lose, alter or ignore requirements as work is split across agents and results are merged.

each handoff can summarize away, alter or ignore a requirement

Source-stated

The authors tested signed requirement-manifest handoffs against free-text and structured JSON handoffs using synthetic, exactly scorable tasks and Qwen3-8B.

With Qwen3-8B (1,440 trajectories, five threats)

Source-stated

In the study, signed manifests reduced unsafe commits under attack from 69.4% to 9.0%, with no net loss of conformant commits relative to structured handoffs.

signed manifests cut unsafe commits under attack from 69.4% to 9.0% (60.4 pp, 95% CI [51.4, 69.4]) with no net loss of conformant commits relative to structured handoffs.

Source-stated

The authors report that signing protected a manifest from in-transit tampering, but a pre-signing injection could corrupt it and the signature would then authenticate that corruption.

Signing protects requirements in transit, not at extraction; the extraction step is the trust boundary.

Source-stated

In the reported study, deterministic verification caught more violating decisions than an LLM checker and produced fewer false alarms.

the deterministic verifier caught 78.7% of violating decisions versus 59.0% for an LLM checker, with 7% versus 50% false alarms.

Source and contributor context

Chen, Xiaobo, Zhu, Genliang, Wang, Ziyuan, Wang, Chu · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Large language model

A language model with many learned numerical settings, used to process and generate language.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 1bc017ca-833a-4659-8b60-9275114c2a86.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T02:23:29.868Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: a5b36eb4e7269e0cbcaf5a0817faf30949c4c3678f46aed8713d4b304b6e5e60. Source text hash: abbf5828a949d15c8eead11e71b001a493b03daf81e737b7d52adcfd6e293d2e.

uncertain · 2026-11-09T02:23:29.868Z · anthropic/claude-opus-5.5

Publication: 1bc017ca-833a-4659-8b60-9275114c2a86

attribution — pass: The reading attributes the findings to the authors of the arXiv paper and keeps them as reported results, not established facts. Labelling the source arXiv cs.AI matches the publisher field; the paper is primarily cs.CR but cross-listed in cs.AI.

Authors:Xiaobo Chen, Genliang Zhu, Ziyuan Wang, Chu Wang

summary — uncertain: The reading tracks the abstract and keeps its sharp turn that signing protects transit, not extraction. But the headline metric, unsafe versus conformant commits, is never put in plain language, so a general reader may not know a commit is the merger's final accepted decision. Manifest and HMAC-SHA256 are also unexplained; tooltips may cover them, but the central result should be readable directly. Smallest repair: one clause saying a commit is the merged decision the system accepts, and that unsafe means it violates a requirement.

signed manifests cut unsafe commits under attack from 69.4% to 9.0%

date — pass: originalPublished 2026-11-05 matches the v1 submission date on arXiv. The later feed date of 2026-11-06 was correctly not used.

[Submitted on 5 Nov 2026]

support — pass: Every claim is backed by verbatim abstract text: the handoff risk, the Qwen3-8B comparison, the drop from 69.4% to 9.0%, and the deterministic-versus-LLM checker results. The line that a secure handoff cannot repair a badly captured requirement is a fair restatement of the authors' residual-risk finding. The limitations and the question stay within the evidence and avoid generalizing beyond the tested tasks.

An oracle manifest removed all remaining unsafe commits: the residual risk comes from extraction errors made before signing.

media — pass: The selected media is the verified direct link to the original arXiv abstract page. That is the most direct way for a reader to reach the actual source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.