# arXiv eess.SY: ShadowBench-MCP measures riskier tool routes that preserve the task [Canonical reading](https://escapemeridian.com/readings/arxiv-eess-sy-shadowbench-mcp-measures-riskier-tool-routes-that-6fbbd234) Authors Eyhab Al-Masri and Wenjun Yang introduce ShadowBench-MCP, a benchmark for “shadow invocation”: a task-preserving request variant that leads an LLM router toward a riskier execution path, potentially skipping security controls. The paper treats the route an agent selects—not just the text it generates—as a security-relevant output. In a focused policy-ablation study, the authors report that efficiency-first routing produced a 29.2% shadow-invocation rate and a 26.7% safety-tool skip rate. Policy-aware routing reduced shadow invocations by 85.7% relative to efficiency-first routing. Pre-execution signals distinguished shadow routes with ROC AUC up to 0.94. The authors describe these results as early, single-router evidence of a policy-dependent security effect in the routing layer, not a claim of universal vulnerability. The study uses one Groq-hosted qwen/qwen3-32b router across six security-sensitive workflows; whether the reported effects extend to other routers or workflows remains untested. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv eess.SY · Article Original source date: Nov 9, 2026 (2026-11-09). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T11:32:06.771Z. First observed: 2026-11-10T08:34:18.567Z. Retrieved: 2026-11-12T11:18:40.499Z. - [ShadowBench-MCP: Measuring Shadow Invocations in MCP-Style Tool Routing](https://arxiv.org/abs/2611.11720) ## Limits The study is described as a focused policy-ablation study using one Groq-hosted qwen/qwen3-32b router, with 120 routing decisions and 96 original-versus-variant comparisons across six security-sensitive workflows. The source characterizes the results as early, single-router evidence; it does not establish whether the reported effects hold for other routers or workflows. ## Open question Do the reported routing effects hold when tested with other routers and workflows? ## Source-stated The authors define shadow invocation as a task-preserving request variant that leads an LLM router to choose a riskier execution path, potentially bypassing security controls. > We study shadow invocation: a task-preserving request variant that causes an LLM router to select a riskier execution path, potentially skipping validation, provenance, staging, redaction, or audit controls - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated In the focused policy-ablation study, efficiency-first routing had a 29.2% shadow-invocation rate and a 26.7% safety-tool skip rate. > Efficiency-first routing produces a 29.2% shadow-invocation rate and 26.7% safety-tool skip rate. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated The authors report that policy-aware routing reduced shadow invocations by 85.7% relative to efficiency-first routing. > corresponding to an 85.7% relative reduction in shadow invocations. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated Pre-execution signals distinguished shadow routes with ROC AUC up to 0.94 in the study. > Pre-execution signals distinguish shadow routes with ROC AUC up to 0.94. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated The authors characterize the findings as early, single-router evidence, not a claim of universal vulnerability. > These results are early, single-router evidence of a policy-dependent routing-layer security effect, not a claim of universal vulnerability. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source and contributor context Al-Masri, Eyhab, Yang, Wenjun · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: fd2bf8ad-b5a3-4693-8ca9-de1c00d62219. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T11:32:06.771Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 317baa6c4f429646457b3406076c78635159504e8b30be6c393437bd7ed7b970. Source text hash: a6e080635015a0f62755a28b7b3d8467d18f0fc433ad7a06fbcc243a9c338183. ## Revision and source-check history ### Version 1 — 2026-11-12T11:32:06.771Z Authors Eyhab Al-Masri and Wenjun Yang introduce ShadowBench-MCP, a benchmark for “shadow invocation”: a task-preserving request variant that leads an LLM router toward a riskier execution path, potentially skipping security controls. The paper treats the route an agent selects—not just the text it generates—as a security-relevant output. In a focused policy-ablation study, the authors report that efficiency-first routing produced a 29.2% shadow-invocation rate and a 26.7% safety-tool skip rate. Policy-aware routing reduced shadow invocations by 85.7% relative to efficiency-first routing. Pre-execution signals distinguished shadow routes with ROC AUC up to 0.94. The authors describe these results as early, single-router evidence of a policy-dependent security effect in the routing layer, not a claim of universal vulnerability. The study uses one Groq-hosted qwen/qwen3-32b router across six security-sensitive workflows; whether the reported effects extend to other routers or workflows remains untested. ## Original source arXiv eess.SY · Article Original source date: Nov 9, 2026 (2026-11-09). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T11:32:06.771Z. First observed: 2026-11-10T08:34:18.567Z. Retrieved: 2026-11-12T11:18:40.499Z. - [ShadowBench-MCP: Measuring Shadow Invocations in MCP-Style Tool Routing](https://arxiv.org/abs/2611.11720) ## Limits The study is described as a focused policy-ablation study using one Groq-hosted qwen/qwen3-32b router, with 120 routing decisions and 96 original-versus-variant comparisons across six security-sensitive workflows. The source characterizes the results as early, single-router evidence; it does not establish whether the reported effects hold for other routers or workflows. ## Open question Do the reported routing effects hold when tested with other routers and workflows? ## Source-stated The authors define shadow invocation as a task-preserving request variant that leads an LLM router to choose a riskier execution path, potentially bypassing security controls. > We study shadow invocation: a task-preserving request variant that causes an LLM router to select a riskier execution path, potentially skipping validation, provenance, staging, redaction, or audit controls - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated In the focused policy-ablation study, efficiency-first routing had a 29.2% shadow-invocation rate and a 26.7% safety-tool skip rate. > Efficiency-first routing produces a 29.2% shadow-invocation rate and 26.7% safety-tool skip rate. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated The authors report that policy-aware routing reduced shadow invocations by 85.7% relative to efficiency-first routing. > corresponding to an 85.7% relative reduction in shadow invocations. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated Pre-execution signals distinguished shadow routes with ROC AUC up to 0.94 in the study. > Pre-execution signals distinguish shadow routes with ROC AUC up to 0.94. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source-stated The authors characterize the findings as early, single-router evidence, not a claim of universal vulnerability. > These results are early, single-router evidence of a policy-dependent routing-layer security effect, not a claim of universal vulnerability. - [Supporting source](https://arxiv.org/abs/2611.11720) ## Source and contributor context Al-Masri, Eyhab, Yang, Wenjun · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## Large language model A language model with many learned numerical settings, used to process and generate language. - [Definition reference](https://developers.google.com/machine-learning/glossary#large-language-model) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: fd2bf8ad-b5a3-4693-8ca9-de1c00d62219. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T11:32:06.771Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 317baa6c4f429646457b3406076c78635159504e8b30be6c393437bd7ed7b970. Source text hash: a6e080635015a0f62755a28b7b3d8467d18f0fc433ad7a06fbcc243a9c338183. ### passed — 2026-11-12T11:32:06.771Z — anthropic/claude-opus-5.5 Publication: fd2bf8ad-b5a3-4693-8ca9-de1c00d62219 attribution — pass: The reading correctly names Eyhab Al-Masri and Wenjun Yang as the authors and frames the findings as their reported results. The title's 'arXiv eess.SY' label matches the feed publisher. The paper's primary category is cs.CR, with eess.SY as a cross-list, but this does not misattribute the work. > Authors:Eyhab Al-Masri, Wenjun Yang summary — pass: The summary leads with the actor and the development. It explains shadow invocation and the idea that an agent's chosen route is a security-relevant output. It keeps the authors' scope caveat. Terms such as MCP, ROC AUC and policy-ablation stay exact for term-library tooltips. They do not block understanding of the central finding: efficiency-first routing skipped safety steps more often than policy-aware routing. The question follows from the source's single-router limitation. > making an execution path - rather than generated text alone - a security-relevant model output date — pass: The originalPublished value of 2026-11-09 matches the arXiv v1 submission date. The later feed timestamp of 2026-11-10 is correctly not used. > \[Submitted on 9 Nov 2026\] support — pass: Each figure is stated in the abstract: 29.2%, 26.7%, the 85.7% relative reduction and ROC AUC up to 0.94. The router, the six workflows and the 120/96 decision counts are also stated. The statement that extension to other routers remains untested follows from the authors' single-router caveat. The reading implies no unsupported benefits or real-world reliability. > These results are early, single-router evidence of a policy-dependent routing-layer security effect, not a claim of universal vulnerability. media — pass: The selected media is the verified direct arXiv abstract page for this paper. It is the original source and the most direct access point. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/6fbbd23493774252da7266c892638b92f67e2328e0bf10c0452431e36d4d43ca/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-eess-sy-shadowbench-mcp-measures-riskier-tool-routes-that-6fbbd234.json)