Glocker, Kevin, Kukk, Kätriin, Oji, Romina, Bollmann, Marcel, Kuhlmann, Marco, Kunz, Jenny · Dec 11, 2025
arXiv cs.AI: Outgrowing the Curse of Multilinguality
Markdown · JSON · Original source
The paper’s authors argue that scaling models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training , controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Dec 11, 2025 (2025-12-11).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T05:48:24.785Z. First observed: 2026-11-09T05:00:43.330Z. Retrieved: 2026-11-09T05:47:33.452Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training stated there. The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings.
Open question
Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?
Source-stated
The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.
Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.
Source-stated
The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.
We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.
Source-stated
The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.
An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.
Source-stated
For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.
For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.
Source and contributor context
Glocker, Kevin, Kukk, Kätriin, Oji, Romina, Bollmann, Marcel, Kuhlmann, Marco, Kunz, Jenny · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Floating-point operations
A count of basic arithmetic steps; used to measure how much computation went into training a model.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 7f05afb5-54f0-4f5c-81aa-9cc102862176.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T05:48:24.785Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 1b2cbca87c6f30c6f25e6cb98745143ddfe4a34716ba5db3d6762d6ea60bddea. Source text hash: f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2.
Revision and source-check history
Version 1 · 2026-11-09T05:48:24.785Z
arXiv cs.AI: Outgrowing the Curse of Multilinguality
The paper’s authors argue that scaling models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training , controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.
Original source
cs.AI · Article
Source details
Original source date: Dec 11, 2025 (2025-12-11).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T05:48:24.785Z. First observed: 2026-11-09T05:00:43.330Z. Retrieved: 2026-11-09T05:47:33.452Z.
Limits
The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training stated there. The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings.
Open question
Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?
Source-stated
The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.
Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.
Source-stated
The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.
We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.
Source-stated
The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.
An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.
Source-stated
For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.
For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.
Source and contributor context
Glocker, Kevin, Kukk, Kätriin, Oji, Romina, Bollmann, Marcel, Kuhlmann, Marco, Kunz, Jenny · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Pre-training
A model's initial training on a large dataset, before further adaptation for particular uses.
Floating-point operations
A count of basic arithmetic steps; used to measure how much computation went into training a model.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 7f05afb5-54f0-4f5c-81aa-9cc102862176.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T05:48:24.785Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 1b2cbca87c6f30c6f25e6cb98745143ddfe4a34716ba5db3d6762d6ea60bddea. Source text hash: f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2.
uncertain · 2026-11-09T05:48:24.785Z · anthropic/claude-opus-5.5
Publication: 7f05afb5-54f0-4f5c-81aa-9cc102862176
attribution — pass: The findings are attributed to the paper's authors, and the arXiv cs.AI listing is identified as the venue. The authors are not named in the draft, but the attribution is still correct. No source claim is presented as established fact or as Escape Meridian's opinion.
Authors:Kevin Glocker, Kätriin Kukk, Romina Oji, Marcel Bollmann, Marco Kuhlmann, Jenny Kunz
summary — uncertain: The reading is faithful but hard for a nonspecialist to follow. Central terms are never explained: curse of multilinguality, upscaling (growing a pretrained model's size), continued pretraining, low- and higher-resource languages, and English forgetting. The motivating problem is also missing: multilingual models underperform language-specific ones, especially small models. Smallest repair: add one sentence stating that problem and add tooltips for these terms. The lead also swaps the source's 'especially for higher-resourced languages' for a capacity-constraint condition, which should be restored.
Massively multilingual models still underperform language-specific adaptations, especially at smaller scales, due to the curse of multilinguality.
date — pass: The originalPublished value of 2025-12-11 matches the v1 submission date. It is correctly preferred over the v2 revision of 6 Nov 2026 and over the feed date.
Submitted on 11 Dec 2025 (v1), last revised 6 Nov 2026 (this version, v2)
support — pass: All four claims match the abstract verbatim and stay attributed to the authors. The limitations accurately describe what the abstract leaves out. The question about which languages and model sizes the results cover follows from the evidence without being leading. No benefits or costs are invented. The lead's phrasing about capacity constraints is a loose paraphrase but not a contradiction.
We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.
media — pass: The selected media is the verified, direct arXiv abstract page for this paper, which is the most relevant link available.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceA count of basic arithmetic steps; used to measure how much computation went into training a model.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA count of basic arithmetic steps; used to measure how much computation went into training a model.
Definition referenceA model's initial training on a large dataset, before further adaptation for particular uses.
Definition referenceA count of basic arithmetic steps; used to measure how much computation went into training a model.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA count of basic arithmetic steps; used to measure how much computation went into training a model.
Definition reference