Zhu, Hengjie, Wu, Dayan, Liu, Xinze, Fu, Peng, Lin, Zheng, Wang, Weiping · Nov 4, 2026
arXiv cs.AI: RECAP for Multimodal Speculative Decoding
Markdown · JSON · Original source
The authors of RECAP argue that recycling a model’s own predictions can speed up speculative decoding, but reusing predictions based only on the last token can fail when an image or prefix changes what the model should predict. Their method stores predictions under one-, two-, and three-token keys: some memories last only for the current request, while token-level memory persists across requests. It combines retrieved predictions using entropy-confidence weighting, builds a candidate tree, and has the target model verify that tree under greedy decoding. Across seven single-turn , the authors report mean speedups over autoregressive decoding of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B, exceeding the training-free Token Recycling baseline on those benchmarks. They describe the method as requiring neither training nor an auxiliary draft model. These are benchmark measurements; the abstract does not establish how the speedups would carry over to other models or settings.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T00:10:11.362Z. First observed: 2026-11-05T05:06:41.445Z. Retrieved: 2026-11-09T15:32:32.963Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported speedups cover seven single-turn on Qwen2.5-VL-7B and LLaVA-1.6-7B; this evidence does not establish performance on other models or settings.
Open question
How would RECAP’s reported speedups compare with Token Recycling on models or settings beyond the seven single-turn ?
Source-stated
The authors say that recycling predictions based only on the last token can fail when predictions come from different images and prefixes, especially at image-sensitive decoding states.
existing recycling indexes predictions by the last token alone, conflating predictions computed under different images and prefixes; we find that such reuse fails most often at image-sensitive decoding states
Source-stated
RECAP stores target predictions under one-, two-, and three-token keys, with request-local contextual memories and token-level memory that persists across requests.
stores target predictions under one-, two-, and three-token keys: contextual memories live only for the current request and are thus implicitly conditioned on its image, while token-level memory persists across requests
Source-stated
The authors report mean speedups of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B across seven single-turn benchmarks, exceeding Token Recycling on those benchmarks.
achieves mean speedups over autoregressive decoding of $1.66\speed$ and $1.56\speed$ across seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B, exceeding the strongest training-free baseline, Token Recycling ($1.51\speed$ and $1.37\speed$)
Source-stated
The authors say RECAP uses neither training nor an auxiliary draft model.
Without training or an auxiliary draft model
Source and contributor context
Zhu, Hengjie, Wu, Dayan, Liu, Xinze, Fu, Peng, Lin, Zheng, Wang, Weiping · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Multimodal model
A model that works with more than one kind of input or output, such as text, images and audio.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 752c252e-af5e-41ea-8be7-ccdf22003a7e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T00:10:11.362Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: c4c8d3b6bac980e61ed0daf417fb3e8b5c009278cb7e557aacc5283c3af3572a. Source text hash: 60d554ca19471f5c7ecda72124609e22a5ce186bf9bc36cecc25d2e88a60220a.
Revision and source-check history
Version 1 · 2026-11-10T00:10:11.362Z
arXiv cs.AI: RECAP for Multimodal Speculative Decoding
The authors of RECAP argue that recycling a model’s own predictions can speed up speculative decoding, but reusing predictions based only on the last token can fail when an image or prefix changes what the model should predict. Their method stores predictions under one-, two-, and three-token keys: some memories last only for the current request, while token-level memory persists across requests. It combines retrieved predictions using entropy-confidence weighting, builds a candidate tree, and has the target model verify that tree under greedy decoding. Across seven single-turn , the authors report mean speedups over autoregressive decoding of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B, exceeding the training-free Token Recycling baseline on those benchmarks. They describe the method as requiring neither training nor an auxiliary draft model. These are benchmark measurements; the abstract does not establish how the speedups would carry over to other models or settings.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-10T00:10:11.362Z. First observed: 2026-11-05T05:06:41.445Z. Retrieved: 2026-11-09T15:32:32.963Z.
Limits
The reported speedups cover seven single-turn on Qwen2.5-VL-7B and LLaVA-1.6-7B; this evidence does not establish performance on other models or settings.
Open question
How would RECAP’s reported speedups compare with Token Recycling on models or settings beyond the seven single-turn ?
Source-stated
The authors say that recycling predictions based only on the last token can fail when predictions come from different images and prefixes, especially at image-sensitive decoding states.
existing recycling indexes predictions by the last token alone, conflating predictions computed under different images and prefixes; we find that such reuse fails most often at image-sensitive decoding states
Source-stated
RECAP stores target predictions under one-, two-, and three-token keys, with request-local contextual memories and token-level memory that persists across requests.
stores target predictions under one-, two-, and three-token keys: contextual memories live only for the current request and are thus implicitly conditioned on its image, while token-level memory persists across requests
Source-stated
The authors report mean speedups of 1.66 on Qwen2.5-VL-7B and 1.56 on LLaVA-1.6-7B across seven single-turn benchmarks, exceeding Token Recycling on those benchmarks.
achieves mean speedups over autoregressive decoding of $1.66\speed$ and $1.56\speed$ across seven single-turn benchmarks on Qwen2.5-VL-7B and LLaVA-1.6-7B, exceeding the strongest training-free baseline, Token Recycling ($1.51\speed$ and $1.37\speed$)
Source-stated
The authors say RECAP uses neither training nor an auxiliary draft model.
Without training or an auxiliary draft model
Source and contributor context
Zhu, Hengjie, Wu, Dayan, Liu, Xinze, Fu, Peng, Lin, Zheng, Wang, Weiping · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Multimodal model
A model that works with more than one kind of input or output, such as text, images and audio.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 752c252e-af5e-41ea-8be7-ccdf22003a7e.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-10T00:10:11.362Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: c4c8d3b6bac980e61ed0daf417fb3e8b5c009278cb7e557aacc5283c3af3572a. Source text hash: 60d554ca19471f5c7ecda72124609e22a5ce186bf9bc36cecc25d2e88a60220a.
uncertain · 2026-11-10T00:10:11.362Z · anthropic/claude-opus-5.5
Publication: 752c252e-af5e-41ea-8be7-ccdf22003a7e
attribution — pass: The claims are attributed to the paper's authors ("the authors report", "they describe"), and the arXiv cs.AI posting is correctly identified. Method claims and benchmark results stay as the authors' assertions, not established facts.
Authors:Hengjie Zhu, Dayan Wu, Xinze Liu, Peng Fu, Zheng Lin, Weiping Wang
summary — uncertain: The summary is faithful but hard for a non-specialist to follow. It never says in plain words what speculative decoding is: cheap proposals of upcoming tokens that the main (target) model checks in one pass, so text generates faster. It also does not say that vision-language models read images. Speedups appear as bare numbers (1.66, 1.56), not as "1.66x" faster than normal token-by-token generation. Smallest repair: add one plain sentence explaining speculative decoding, write the speedups as multiples, and add tooltips for speculative decoding, autoregressive decoding, greedy decoding and entropy-confidence weighting.
Recycling a target model's own predictions offers a training-free source of proposals for speculative decoding.
date — pass: The originalPublished date of 2026-11-04 matches the v1 submission date on the arXiv page. It is not the later feed date.
[Submitted on 4 Nov 2026]
support — pass: Every claim matches the abstract. This covers the last-token aliasing problem, the one-, two- and three-token keys, request-local and persistent memories, entropy-confidence weighting, the candidate tree verified under greedy decoding, the 1.66x and 1.56x mean speedups beating Token Recycling, and the absence of training or a draft model. The limitation and the question are appropriately conditional and do not overreach.
exceeding the strongest training-free baseline, Token Recycling ($1.51\speed$ and $1.37\speed$)
media — pass: The selected media is the verified, direct arXiv abstract page for this paper, which is the most direct way to access the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model that works with more than one kind of input or output, such as text, images and audio.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model that works with more than one kind of input or output, such as text, images and audio.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference