Solombrino, Daniele, Gargiulo, Antonio Andrea, Zirilli, Alessandro, Zhou, Luca, Minut, Adrian Robert, Rodolà, Emanuele · Apr 3, 2026
arXiv cs.AI: Zero-Shot Quantization via Weight-Space Arithmetic
Markdown · JSON · Original source
Authors Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut and Emanuele Rodolà argue that a model’s robustness to post-training (PTQ) can be transferred through a “quantization vector.” They extract this vector from a donor task using weight-space arithmetic, then use it to patch a receiver model. The authors report improved PTQ Top-1 accuracy of up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). They describe the method as a , low-cost alternative to QAT when no receiver validation data is used. Across multiple vision and language models and more than 30 tasks, they say donor vectors often yield substantial gains even when the tasks differ markedly. The central idea is that some robustness to quantization may be isolated in and reused, rather than learned anew for each receiver. The abstract reports a maximum improvement, but does not give the underlying task-level results or specify how often that maximum occurred.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Apr 3, 2026 (2026-04-03).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T02:32:24.411Z. First observed: 2026-11-06T05:03:27.710Z. Retrieved: 2026-11-08T02:18:32.257Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the paper’s abstract and does not provide task-level results, baselines, or details behind the reported maximum improvement. The abstract describes gains as occurring “often” and “substantial,” but does not quantify how frequently gains occur or their distribution across tasks.
Open question
Which tasks and models produced the reported 60% improvement, and how often did donor vectors improve accuracy across the reported evaluations?
Source-stated
The authors argue that robustness to post-training quantization can be transferred as a direction in weight space, which they call the quantization vector.
We show that robustness to post-training quantization (PTQ) is a transferable direction in weight space. We call this direction the quantization vector
Source-stated
The authors say a donor-task quantization vector can patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting without receiver-side QAT.
it can be used to patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT).
Source-stated
The authors describe the approach as a zero-shot, low-cost alternative to QAT when no receiver validation data is used.
When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment.
Source-stated
The authors report gains across multiple vision and language models and more than 30 tasks, including cases where donor and receiver tasks differ markedly.
Across multiple vision and language models and more than 30 tasks, donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly.
Source-stated
The abstract presents quantization robustness as something that can be partially isolated, reused and transferred through weight-space arithmetic.
Together, these results suggest that quantization robustness can be partially isolated, reused, and transferred through simple weight-space algebra.
Source and contributor context
Solombrino, Daniele, Gargiulo, Antonio Andrea, Zirilli, Alessandro, Zhou, Luca, Minut, Adrian Robert, Rodolà, Emanuele · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Quantization
Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 05b89360-8385-43aa-87d6-0ae580fa4cb8.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T02:32:24.411Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 30bc7201220ca153a68b37572bb74eb087b97068cfbc9527e8a2c380523befd0. Source text hash: 75389c3510107e491362077038e345c3e1a33b8366c7156fb42bb04fb3f75fd3.
Revision and source-check history
Version 1 · 2026-11-08T02:32:24.411Z
arXiv cs.AI: Zero-Shot Quantization via Weight-Space Arithmetic
Authors Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut and Emanuele Rodolà argue that a model’s robustness to post-training (PTQ) can be transferred through a “quantization vector.” They extract this vector from a donor task using weight-space arithmetic, then use it to patch a receiver model. The authors report improved PTQ Top-1 accuracy of up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). They describe the method as a , low-cost alternative to QAT when no receiver validation data is used. Across multiple vision and language models and more than 30 tasks, they say donor vectors often yield substantial gains even when the tasks differ markedly. The central idea is that some robustness to quantization may be isolated in and reused, rather than learned anew for each receiver. The abstract reports a maximum improvement, but does not give the underlying task-level results or specify how often that maximum occurred.
Original source
cs.AI · Article
Source details
Original source date: Apr 3, 2026 (2026-04-03).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T02:32:24.411Z. First observed: 2026-11-06T05:03:27.710Z. Retrieved: 2026-11-08T02:18:32.257Z.
Limits
The supplied evidence is the paper’s abstract and does not provide task-level results, baselines, or details behind the reported maximum improvement. The abstract describes gains as occurring “often” and “substantial,” but does not quantify how frequently gains occur or their distribution across tasks.
Open question
Which tasks and models produced the reported 60% improvement, and how often did donor vectors improve accuracy across the reported evaluations?
Source-stated
The authors argue that robustness to post-training quantization can be transferred as a direction in weight space, which they call the quantization vector.
We show that robustness to post-training quantization (PTQ) is a transferable direction in weight space. We call this direction the quantization vector
Source-stated
The authors say a donor-task quantization vector can patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting without receiver-side QAT.
it can be used to patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT).
Source-stated
The authors describe the approach as a zero-shot, low-cost alternative to QAT when no receiver validation data is used.
When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment.
Source-stated
The authors report gains across multiple vision and language models and more than 30 tasks, including cases where donor and receiver tasks differ markedly.
Across multiple vision and language models and more than 30 tasks, donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly.
Source-stated
The abstract presents quantization robustness as something that can be partially isolated, reused and transferred through weight-space arithmetic.
Together, these results suggest that quantization robustness can be partially isolated, reused, and transferred through simple weight-space algebra.
Source and contributor context
Solombrino, Daniele, Gargiulo, Antonio Andrea, Zirilli, Alessandro, Zhou, Luca, Minut, Adrian Robert, Rodolà, Emanuele · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Quantization
Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 05b89360-8385-43aa-87d6-0ae580fa4cb8.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T02:32:24.411Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 30bc7201220ca153a68b37572bb74eb087b97068cfbc9527e8a2c380523befd0. Source text hash: 75389c3510107e491362077038e345c3e1a33b8366c7156fb42bb04fb3f75fd3.
uncertain · 2026-11-08T02:32:24.411Z · anthropic/claude-opus-5.5
Publication: 05b89360-8385-43aa-87d6-0ae580fa4cb8
attribution — pass: All six authors are listed correctly. Each claim is attributed to them as their assertion, not stated as established fact. The arXiv cs.AI label matches the supplied publisher; the paper's primary listing is cs.CV, but it is cross-listed in cs.AI.
Authors:Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut, Emanuele Rodolà
summary — uncertain: The summary is faithful, but the central concepts remain opaque to a non-specialist. It never explains in plain language what quantization is or why 3-bit deployment matters, so the cost and deployment stakes are not stated. Smallest repair: one plain sentence on quantization, plus term-library tooltips for PTQ, QAT, Top-1 accuracy, weight space and zero-shot. Two smaller fidelity points: the reading drops the scope condition 'for extremely low-bit deployment' and omits the claimed proof that quantization vectors are well-defined despite reparameterization symmetries. It also softens the authors' 'We show' to 'argue'.
When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment.
date — pass: The displayed original publication date of 2026-04-03 matches the v1 submission date. The v4 revision of 5 Nov 2026 and the November feed date are correctly not used.
[Submitted on 3 Apr 2026 (v1), last revised 5 Nov 2026 (this version, v4)]
support — pass: Each claim matches its verbatim abstract excerpt and is framed as the authors' report. The limitations correctly note that the abstract gives no task-level results or frequency for 'often'. The question follows from that gap without implying an answer. No unsupported benefits or costs are asserted. This grounding does not independently verify the paper's results.
donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly
media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the source itself.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivStoring a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Definition referenceStoring a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivStoring a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy.
Definition reference