# arXiv cs.AI: Zero-Shot Quantization via Weight-Space Arithmetic [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-zero-shot-quantization-via-weight-space-arithmetic-20282c0c) Authors Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut and Emanuele Rodolà argue that a model’s robustness to post-training quantization (PTQ) can be transferred through a “quantization vector.” They extract this vector from a donor task using weight-space arithmetic, then use it to patch a receiver model. The authors report improved PTQ Top-1 accuracy of up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). They describe the method as a zero-shot, low-cost alternative to QAT when no receiver validation data is used. Across multiple vision and language models and more than 30 tasks, they say donor vectors often yield substantial gains even when the tasks differ markedly. The central idea is that some robustness to quantization may be isolated in model weights and reused, rather than learned anew for each receiver. The abstract reports a maximum improvement, but does not give the underlying task-level results or specify how often that maximum occurred. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Apr 3, 2026 (2026-04-03). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-08T02:32:24.411Z. First observed: 2026-11-06T05:03:27.710Z. Retrieved: 2026-11-08T02:18:32.257Z. - [Zero-Shot Quantization via Weight-Space Arithmetic](https://arxiv.org/abs/2604.03420) ## Limits The supplied evidence is the paper’s abstract and does not provide task-level results, baselines, or details behind the reported maximum improvement. The abstract describes gains as occurring “often” and “substantial,” but does not quantify how frequently gains occur or their distribution across tasks. ## Open question Which tasks and models produced the reported 60% improvement, and how often did donor quantization vectors improve accuracy across the reported evaluations? ## Source-stated The authors argue that robustness to post-training quantization can be transferred as a direction in weight space, which they call the quantization vector. > We show that robustness to post-training quantization (PTQ) is a transferable direction in weight space. We call this direction the quantization vector - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors say a donor-task quantization vector can patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting without receiver-side QAT. > it can be used to patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors describe the approach as a zero-shot, low-cost alternative to QAT when no receiver validation data is used. > When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors report gains across multiple vision and language models and more than 30 tasks, including cases where donor and receiver tasks differ markedly. > Across multiple vision and language models and more than 30 tasks, donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The abstract presents quantization robustness as something that can be partially isolated, reused and transferred through weight-space arithmetic. > Together, these results suggest that quantization robustness can be partially isolated, reused, and transferred through simple weight-space algebra. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source and contributor context Solombrino, Daniele, Gargiulo, Antonio Andrea, Zirilli, Alessandro, Zhou, Luca, Minut, Adrian Robert, Rodolà, Emanuele · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## Quantization Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy. - [Definition reference](https://developers.google.com/machine-learning/glossary#quantization) ## Model weights The learned numbers that make up a trained model; publishing them lets others run it. - [Definition reference](https://developers.google.com/machine-learning/glossary#weight) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 05b89360-8385-43aa-87d6-0ae580fa4cb8. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T02:32:24.411Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 30bc7201220ca153a68b37572bb74eb087b97068cfbc9527e8a2c380523befd0. Source text hash: 75389c3510107e491362077038e345c3e1a33b8366c7156fb42bb04fb3f75fd3. ## Revision and source-check history ### Version 1 — 2026-11-08T02:32:24.411Z Authors Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut and Emanuele Rodolà argue that a model’s robustness to post-training quantization (PTQ) can be transferred through a “quantization vector.” They extract this vector from a donor task using weight-space arithmetic, then use it to patch a receiver model. The authors report improved PTQ Top-1 accuracy of up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). They describe the method as a zero-shot, low-cost alternative to QAT when no receiver validation data is used. Across multiple vision and language models and more than 30 tasks, they say donor vectors often yield substantial gains even when the tasks differ markedly. The central idea is that some robustness to quantization may be isolated in model weights and reused, rather than learned anew for each receiver. The abstract reports a maximum improvement, but does not give the underlying task-level results or specify how often that maximum occurred. ## Original source arXiv cs.AI · Article Original source date: Apr 3, 2026 (2026-04-03). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-08T02:32:24.411Z. First observed: 2026-11-06T05:03:27.710Z. Retrieved: 2026-11-08T02:18:32.257Z. - [Zero-Shot Quantization via Weight-Space Arithmetic](https://arxiv.org/abs/2604.03420) ## Limits The supplied evidence is the paper’s abstract and does not provide task-level results, baselines, or details behind the reported maximum improvement. The abstract describes gains as occurring “often” and “substantial,” but does not quantify how frequently gains occur or their distribution across tasks. ## Open question Which tasks and models produced the reported 60% improvement, and how often did donor quantization vectors improve accuracy across the reported evaluations? ## Source-stated The authors argue that robustness to post-training quantization can be transferred as a direction in weight space, which they call the quantization vector. > We show that robustness to post-training quantization (PTQ) is a transferable direction in weight space. We call this direction the quantization vector - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors say a donor-task quantization vector can patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting without receiver-side QAT. > it can be used to patch a receiver model and improve PTQ Top-1 accuracy by up to 60% in a 3-bit setting, without receiver-side quantization-aware training (QAT). - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors describe the approach as a zero-shot, low-cost alternative to QAT when no receiver validation data is used. > When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The authors report gains across multiple vision and language models and more than 30 tasks, including cases where donor and receiver tasks differ markedly. > Across multiple vision and language models and more than 30 tasks, donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source-stated The abstract presents quantization robustness as something that can be partially isolated, reused and transferred through weight-space arithmetic. > Together, these results suggest that quantization robustness can be partially isolated, reused, and transferred through simple weight-space algebra. - [Supporting source](https://arxiv.org/abs/2604.03420) ## Source and contributor context Solombrino, Daniele, Gargiulo, Antonio Andrea, Zirilli, Alessandro, Zhou, Luca, Minut, Adrian Robert, Rodolà, Emanuele · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## Quantization Storing a model's numbers at lower precision so it uses less memory and runs faster, sometimes at a cost in accuracy. - [Definition reference](https://developers.google.com/machine-learning/glossary#quantization) ## Model weights The learned numbers that make up a trained model; publishing them lets others run it. - [Definition reference](https://developers.google.com/machine-learning/glossary#weight) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 05b89360-8385-43aa-87d6-0ae580fa4cb8. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T02:32:24.411Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 30bc7201220ca153a68b37572bb74eb087b97068cfbc9527e8a2c380523befd0. Source text hash: 75389c3510107e491362077038e345c3e1a33b8366c7156fb42bb04fb3f75fd3. ### uncertain — 2026-11-08T02:32:24.411Z — anthropic/claude-opus-5.5 Publication: 05b89360-8385-43aa-87d6-0ae580fa4cb8 attribution — pass: All six authors are listed correctly. Each claim is attributed to them as their assertion, not stated as established fact. The arXiv cs.AI label matches the supplied publisher; the paper's primary listing is cs.CV, but it is cross-listed in cs.AI. > Authors:Daniele Solombrino, Antonio Andrea Gargiulo, Alessandro Zirilli, Luca Zhou, Adrian Robert Minut, Emanuele Rodolà summary — uncertain: The summary is faithful, but the central concepts remain opaque to a non-specialist. It never explains in plain language what quantization is or why 3-bit deployment matters, so the cost and deployment stakes are not stated. Smallest repair: one plain sentence on quantization, plus term-library tooltips for PTQ, QAT, Top-1 accuracy, weight space and zero-shot. Two smaller fidelity points: the reading drops the scope condition 'for extremely low-bit deployment' and omits the claimed proof that quantization vectors are well-defined despite reparameterization symmetries. It also softens the authors' 'We show' to 'argue'. > When using no receiver validation data, the method provides a zero-shot, low-cost alternative to QAT for extremely low-bit deployment. date — pass: The displayed original publication date of 2026-04-03 matches the v1 submission date. The v4 revision of 5 Nov 2026 and the November feed date are correctly not used. > \[Submitted on 3 Apr 2026 (v1), last revised 5 Nov 2026 (this version, v4)\] support — pass: Each claim matches its verbatim abstract excerpt and is framed as the authors' report. The limitations correctly note that the abstract gives no task-level results or frequency for 'often'. The question follows from that gap without implying an answer. No unsupported benefits or costs are asserted. This grounding does not independently verify the paper's results. > donor quantization vectors often yield substantial gains even when donor and receiver tasks differ markedly media — pass: The selected media is the verified direct link to the original arXiv abstract page, which is the source itself. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/20282c0c79de95663239677ee6cb30098cd0ee604b8bee1aca23c6e88eda668e/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-zero-shot-quantization-via-weight-space-arithmetic-20282c0c.json)