Choi, Miso, Kim, Daekeun, Kim, Eunji, Lee, Jungbeom · Oct 27, 2026
arXiv cs.AI: V-LUMEN: Visual Lookup Memory for Embedding Scaling in Vision-Language Models
Markdown · JSON · Original source
Miso Choi, Daekeun Kim, Eunji Kim and Jungbeom Lee introduce V-LUMEN, a visual lookup memory designed to add capacity to vision-language models without increasing model depth, width or dense computation. Their system discretizes visual features with a frozen codebook, forms spatially aware memory keys, uses text-conditioned relevance signals, and fuses retrieved into the model through a gated residual pathway. The authors report that V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone on five reasoning-intensive , and transfers to three benchmarks with images disjoint from training data. They also report that, at a matched parameter budget, moving some LoRA or adapter capacity into V-LUMEN preserves accuracy on two backbones. They interpret this as evidence that external visual memory can provide a separate capacity axis, rather than simply a stronger adaptation method. The proposed tradeoff is to grow capacity through storage: the authors say lookup cost is constant in table size and incurred only once at prefill. The abstract does not provide benchmark names, effect sizes, or details needed to assess the reported results independently. How large are the gains, and how do they vary across the benchmarks and backbones tested?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-14T02:48:08.076Z. First observed: 2026-10-28T06:36:35.975Z. Retrieved: 2026-10-29T21:03:02.261Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied source is the paper's abstract and does not include names, effect sizes, or detailed experimental methods. The abstract reports results but does not provide enough detail here to independently assess their magnitude or variation across tasks and backbones.
Open question
How large are the gains, and how do they vary across the and backbones tested?
Source-stated
The authors introduce V-LUMEN as a lookup-based memory approach for adding capacity to vision-language models without increasing depth, width or dense computation.
Embedding-level scaling expands the capacity of language models through lookup-based memory rather than by increasing model depth, width, or dense computation.
Source-stated
V-LUMEN discretizes visual features, builds spatially aware memory keys, uses text-conditioned relevance signals and fuses retrieved embeddings through a gated residual pathway.
V-LUMEN discretizes visual features with a frozen codebook, builds spatially aware memory keys through spatial aggregation-based hashing
Source-stated
The authors report substantial improvements on five reasoning-intensive benchmarks for a frozen Qwen3-VL-2B backbone, and zero-shot transfer to three benchmarks with images disjoint from training data.
On five reasoning-intensive benchmarks, V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone and transfers zero-shot to three benchmarks whose images are disjoint from the training data.
Source-stated
At a matched parameter budget, the authors report that shifting some LoRA or MoE adapter capacity into V-LUMEN preserves accuracy on two backbones.
At a matched parameter budget, moving part of a LoRA or MoE adapter's capacity into V-LUMEN preserves accuracy on two backbones
Source-stated
The authors say V-LUMEN's lookup cost is constant in table size and occurs only once at prefill, so the added capacity grows in storage rather than per-token compute.
Because lookup cost is constant in table size and incurred only once at prefill, this capacity grows in storage rather than in per-token compute.
Source and contributor context
Choi, Miso, Kim, Daekeun, Kim, Eunji, Lee, Jungbeom · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Embedding vector
A list of numbers that represents a piece of text, an image or another item so software can compare meanings.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Mixture of experts
A model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 174bfe57-2712-407f-8a9d-648d0d934e85.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-14T02:48:08.076Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ce8f85ea07fb295650137d50a2d15446d496de1b8a59e5e44f429b7d8d724ab3. Source text hash: 8942caa15df4c6bc94fbaf419887170e39e402fe0510fc99004770e8405e2850.
Revision and source-check history
Version 1 · 2026-11-14T02:48:08.076Z
arXiv cs.AI: V-LUMEN: Visual Lookup Memory for Embedding Scaling in Vision-Language Models
Miso Choi, Daekeun Kim, Eunji Kim and Jungbeom Lee introduce V-LUMEN, a visual lookup memory designed to add capacity to vision-language models without increasing model depth, width or dense computation. Their system discretizes visual features with a frozen codebook, forms spatially aware memory keys, uses text-conditioned relevance signals, and fuses retrieved into the model through a gated residual pathway. The authors report that V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone on five reasoning-intensive , and transfers to three benchmarks with images disjoint from training data. They also report that, at a matched parameter budget, moving some LoRA or adapter capacity into V-LUMEN preserves accuracy on two backbones. They interpret this as evidence that external visual memory can provide a separate capacity axis, rather than simply a stronger adaptation method. The proposed tradeoff is to grow capacity through storage: the authors say lookup cost is constant in table size and incurred only once at prefill. The abstract does not provide benchmark names, effect sizes, or details needed to assess the reported results independently. How large are the gains, and how do they vary across the benchmarks and backbones tested?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-14T02:48:08.076Z. First observed: 2026-10-28T06:36:35.975Z. Retrieved: 2026-10-29T21:03:02.261Z.
Limits
The supplied source is the paper's abstract and does not include names, effect sizes, or detailed experimental methods. The abstract reports results but does not provide enough detail here to independently assess their magnitude or variation across tasks and backbones.
Open question
How large are the gains, and how do they vary across the and backbones tested?
Source-stated
The authors introduce V-LUMEN as a lookup-based memory approach for adding capacity to vision-language models without increasing depth, width or dense computation.
Embedding-level scaling expands the capacity of language models through lookup-based memory rather than by increasing model depth, width, or dense computation.
Source-stated
V-LUMEN discretizes visual features, builds spatially aware memory keys, uses text-conditioned relevance signals and fuses retrieved embeddings through a gated residual pathway.
V-LUMEN discretizes visual features with a frozen codebook, builds spatially aware memory keys through spatial aggregation-based hashing
Source-stated
The authors report substantial improvements on five reasoning-intensive benchmarks for a frozen Qwen3-VL-2B backbone, and zero-shot transfer to three benchmarks with images disjoint from training data.
On five reasoning-intensive benchmarks, V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone and transfers zero-shot to three benchmarks whose images are disjoint from the training data.
Source-stated
At a matched parameter budget, the authors report that shifting some LoRA or MoE adapter capacity into V-LUMEN preserves accuracy on two backbones.
At a matched parameter budget, moving part of a LoRA or MoE adapter's capacity into V-LUMEN preserves accuracy on two backbones
Source-stated
The authors say V-LUMEN's lookup cost is constant in table size and occurs only once at prefill, so the added capacity grows in storage rather than per-token compute.
Because lookup cost is constant in table size and incurred only once at prefill, this capacity grows in storage rather than in per-token compute.
Source and contributor context
Choi, Miso, Kim, Daekeun, Kim, Eunji, Lee, Jungbeom · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Embedding vector
A list of numbers that represents a piece of text, an image or another item so software can compare meanings.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Mixture of experts
A model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 174bfe57-2712-407f-8a9d-648d0d934e85.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-14T02:48:08.076Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: ce8f85ea07fb295650137d50a2d15446d496de1b8a59e5e44f429b7d8d724ab3. Source text hash: 8942caa15df4c6bc94fbaf419887170e39e402fe0510fc99004770e8405e2850.
uncertain · 2026-11-14T02:48:08.076Z · anthropic/claude-opus-5.5
Publication: 174bfe57-2712-407f-8a9d-648d0d934e85
attribution — pass: The reading correctly names the four listed authors and attributes the method, results and interpretation to them using phrasing such as 'the authors report' and 'they interpret'. The title correctly identifies arXiv as the venue.
Authors:Miso Choi, Daekeun Kim, Eunji Kim, Jungbeom Lee
summary — uncertain: The reading is faithful, but a reader without specialist background may not follow its central point. It strings together unexplained terms such as frozen codebook, gated residual pathway, frozen backbone, zero-shot, LoRA, MoE adapter, prefill and per-token compute. It never says plainly what a vision-language model is or why growing capacity in storage rather than per-token compute matters. Smallest repair: add one plain sentence on the storage-versus-compute idea, still attributed to the authors, and add term-library tooltips for prefill, LoRA, MoE and frozen codebook. The question repeated at the end of the summary is a minor redundancy.
this capacity grows in storage rather than in per-token compute
date — pass: The originalPublished date of 2026-10-27 matches the v1 submission date. It does not use the later feed date of 2026-10-29.
[Submitted on 27 Oct 2026]
support — pass: Each claim matches the abstract and is framed as the authors' report. The reading keeps the authors' 'independent capacity axis' interpretation attributed to them. It does not turn benchmark gains into real-world reliability or add unsupported benefits. Its limitations accurately note that the abstract gives no benchmark names or effect sizes.
indicating that external visual memory is an independent capacity axis rather than a stronger adaptation method
media — pass: The selected media is the verified arXiv abstract page for this paper. It is the direct original source, and no better candidate was supplied.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A list of numbers that represents a piece of text, an image or another item so software can compare meanings.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referenceA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA list of numbers that represents a piece of text, an image or another item so software can compare meanings.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referenceA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference