# arXiv cs.AI: RECAP for Multimodal Speculative Decoding [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-recap-for-multimodal-speculative-decoding-ef89d679) The authors of RECAP argue that recycling a model’s own predictions can speed up multimodal speculative decoding, but reusing predictions based only on the last token can fail when an image or prefix changes what the model should predict. Their method stores predictions under one-, two-, and three-token keys: some memories last only for the current request, while token-level memory persists across requests. It combines retrieved predictions using entropy-confidence weighting, builds a candidate tree, and has the target model verify that tree under greedy decoding. Across seven single-turn benchmarks, the authors report mean speedups over autoregressive decoding of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B, exceeding the training-free Token Recycling baseline on those benchmarks. They describe the method as requiring neither training nor an auxiliary draft model. These are benchmark measurements; the abstract does not establish how the speedups would carry over to other models or settings. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T00:10:11.362Z. First observed: 2026-11-05T05:06:41.445Z. Retrieved: 2026-11-09T15:32:32.963Z. - [RECAP: Context-Aware Prediction Recycling with Request-Local and Persistent Memories for Multimodal Speculative Decoding](https://arxiv.org/abs/2611.05894) ## Limits The reported speedups cover seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B; this evidence does not establish performance on other models or settings. ## Open question How would RECAP’s reported speedups compare with Token Recycling on models or settings beyond the seven single-turn benchmarks? ## Source-stated The authors say that recycling predictions based only on the last token can fail when predictions come from different images and prefixes, especially at image-sensitive decoding states. > existing recycling indexes predictions by the last token alone, conflating predictions computed under different images and prefixes; we find that such reuse fails most often at image-sensitive decoding states - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated RECAP stores target predictions under one-, two-, and three-token keys, with request-local contextual memories and token-level memory that persists across requests. > stores target predictions under one-, two-, and three-token keys: contextual memories live only for the current request and are thus implicitly conditioned on its image, while token-level memory persists across requests - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated The authors report mean speedups of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B across seven single-turn benchmarks, exceeding Token Recycling on those benchmarks. > achieves mean speedups over autoregressive decoding of $1.66\\speed$ and $1.56\\speed$ across seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B, exceeding the strongest training-free baseline, Token Recycling ($1.51\\speed$ and $1.37\\speed$) - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated The authors say RECAP uses neither training nor an auxiliary draft model. > Without training or an auxiliary draft model - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source and contributor context Zhu, Hengjie, Wu, Dayan, Liu, Xinze, Fu, Peng, Lin, Zheng, Wang, Weiping · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 752c252e-af5e-41ea-8be7-ccdf22003a7e. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T00:10:11.362Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: c4c8d3b6bac980e61ed0daf417fb3e8b5c009278cb7e557aacc5283c3af3572a. Source text hash: 60d554ca19471f5c7ecda72124609e22a5ce186bf9bc36cecc25d2e88a60220a. ## Revision and source-check history ### Version 1 — 2026-11-10T00:10:11.362Z The authors of RECAP argue that recycling a model’s own predictions can speed up multimodal speculative decoding, but reusing predictions based only on the last token can fail when an image or prefix changes what the model should predict. Their method stores predictions under one-, two-, and three-token keys: some memories last only for the current request, while token-level memory persists across requests. It combines retrieved predictions using entropy-confidence weighting, builds a candidate tree, and has the target model verify that tree under greedy decoding. Across seven single-turn benchmarks, the authors report mean speedups over autoregressive decoding of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B, exceeding the training-free Token Recycling baseline on those benchmarks. They describe the method as requiring neither training nor an auxiliary draft model. These are benchmark measurements; the abstract does not establish how the speedups would carry over to other models or settings. ## Original source arXiv cs.AI · Article Original source date: Nov 4, 2026 (2026-11-04). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-10T00:10:11.362Z. First observed: 2026-11-05T05:06:41.445Z. Retrieved: 2026-11-09T15:32:32.963Z. - [RECAP: Context-Aware Prediction Recycling with Request-Local and Persistent Memories for Multimodal Speculative Decoding](https://arxiv.org/abs/2611.05894) ## Limits The reported speedups cover seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B; this evidence does not establish performance on other models or settings. ## Open question How would RECAP’s reported speedups compare with Token Recycling on models or settings beyond the seven single-turn benchmarks? ## Source-stated The authors say that recycling predictions based only on the last token can fail when predictions come from different images and prefixes, especially at image-sensitive decoding states. > existing recycling indexes predictions by the last token alone, conflating predictions computed under different images and prefixes; we find that such reuse fails most often at image-sensitive decoding states - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated RECAP stores target predictions under one-, two-, and three-token keys, with request-local contextual memories and token-level memory that persists across requests. > stores target predictions under one-, two-, and three-token keys: contextual memories live only for the current request and are thus implicitly conditioned on its image, while token-level memory persists across requests - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated The authors report mean speedups of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B across seven single-turn benchmarks, exceeding Token Recycling on those benchmarks. > achieves mean speedups over autoregressive decoding of $1.66\\speed$ and $1.56\\speed$ across seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B, exceeding the strongest training-free baseline, Token Recycling ($1.51\\speed$ and $1.37\\speed$) - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source-stated The authors say RECAP uses neither training nor an auxiliary draft model. > Without training or an auxiliary draft model - [Supporting source](https://arxiv.org/abs/2611.05894) ## Source and contributor context Zhu, Hengjie, Wu, Dayan, Liu, Xinze, Fu, Peng, Lin, Zheng, Wang, Weiping · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Multimodal model A model that works with more than one kind of input or output, such as text, images and audio. - [Definition reference](https://developers.google.com/machine-learning/glossary#multimodal-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 752c252e-af5e-41ea-8be7-ccdf22003a7e. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T00:10:11.362Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: c4c8d3b6bac980e61ed0daf417fb3e8b5c009278cb7e557aacc5283c3af3572a. Source text hash: 60d554ca19471f5c7ecda72124609e22a5ce186bf9bc36cecc25d2e88a60220a. ### uncertain — 2026-11-10T00:10:11.362Z — anthropic/claude-opus-5.5 Publication: 752c252e-af5e-41ea-8be7-ccdf22003a7e attribution — pass: The claims are attributed to the paper's authors ("the authors report", "they describe"), and the arXiv cs.AI posting is correctly identified. Method claims and benchmark results stay as the authors' assertions, not established facts. > Authors:Hengjie Zhu, Dayan Wu, Xinze Liu, Peng Fu, Zheng Lin, Weiping Wang summary — uncertain: The summary is faithful but hard for a non-specialist to follow. It never says in plain words what speculative decoding is: cheap proposals of upcoming tokens that the main (target) model checks in one pass, so text generates faster. It also does not say that vision-language models read images. Speedups appear as bare numbers (1.66, 1.56), not as "1.66x" faster than normal token-by-token generation. Smallest repair: add one plain sentence explaining speculative decoding, write the speedups as multiples, and add tooltips for speculative decoding, autoregressive decoding, greedy decoding and entropy-confidence weighting. > Recycling a target model's own predictions offers a training-free source of proposals for speculative decoding. date — pass: The originalPublished date of 2026-11-04 matches the v1 submission date on the arXiv page. It is not the later feed date. > \[Submitted on 4 Nov 2026\] support — pass: Every claim matches the abstract. This covers the last-token aliasing problem, the one-, two- and three-token keys, request-local and persistent memories, entropy-confidence weighting, the candidate tree verified under greedy decoding, the 1.66x and 1.56x mean speedups beating Token Recycling, and the absence of training or a draft model. The limitation and the question are appropriately conditional and do not overreach. > exceeding the strongest training-free baseline, Token Recycling ($1.51\\speed$ and $1.37\\speed$) media — pass: The selected media is the verified, direct arXiv abstract page for this paper, which is the most direct way to access the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/ef89d6792ff4d3def0d50eb8692b9793a39b4854caaef89c34f1a076794869a9/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-recap-for-multimodal-speculative-decoding-ef89d679.json)