{"id":"507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5","title":"arXiv cs.AI: Outgrowing the Curse of Multilinguality","argument":"The paper’s authors argue that scaling pretrained models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training FLOPs, controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training FLOPs stated there. The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings.","speaker":{"name":"Glocker, Kevin, Kukk, Kätriin, Oji, Romina, Bollmann, Marcel, Kuhlmann, Marco, Kunz, Jenny","roleAtSource":"Article author"},"source":{"title":"Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2512.10772","publishedAt":"2025-12-11","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.","excerpt":"Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.","excerpt":"We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.","excerpt":"An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.","excerpt":"For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2512.10772","checkedAt":"2026-11-09T22:52:08.630Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Outgrowing the Curse of Multilinguality","summary":"The paper’s authors argue that scaling pretrained models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training FLOPs, controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.","question":"Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?","claims":[{"text":"The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.","excerpt":"Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.","support":"source-stated"},{"text":"The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.","excerpt":"We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.","support":"source-stated"},{"text":"The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.","excerpt":"An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.","support":"source-stated"},{"text":"For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.","excerpt":"For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training FLOPs stated there.","The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings."],"mediaId":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","correctionReason":null,"id":"507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5","publicationId":"7f05afb5-54f0-4f5c-81aa-9cc102862176","version":1,"sourceUrl":"https://arxiv.org/abs/2512.10772","sourceTitle":"Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-12-11","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:00:43.330Z","createdAt":"2026-11-09T05:48:24.785Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","kind":"article","url":"https://arxiv.org/abs/2512.10772","sourceUrl":"https://arxiv.org/abs/2512.10772","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T05:47:33.733Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2512.10772","checkedAt":"2026-11-09T22:52:08.630Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","confidence":0.76,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5aa092cff260894c530e9c76eb4b92e54c92459db530806a8f37d01438c295a4","decidedAt":"2026-11-09T05:47:35.513Z"},"provenance":{"textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observationId":"1b2cbca87c6f30c6f25e6cb98745143ddfe4a34716ba5db3d6762d6ea60bddea","retrievedAt":"2026-11-09T05:47:33.452Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"8ca03277-9922-4243-80dc-fe4674d6273c"},"reviewer":{"model":"gpt-6-luna","runId":"b4d79309-a3b7-4d21-8070-ed1747ce3d05"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T05:48:24.785Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Glocker, Kevin","url":null,"kind":"unknown"},{"name":"Kukk, Kätriin","url":null,"kind":"unknown"},{"name":"Oji, Romina","url":null,"kind":"unknown"},{"name":"Bollmann, Marcel","url":null,"kind":"unknown"},{"name":"Kuhlmann, Marco","url":null,"kind":"unknown"},{"name":"Kunz, Jenny","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Glocker, Kevin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Glocker, Kevin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kukk, Kätriin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kukk, Kätriin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Oji, Romina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Oji, Romina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Bollmann, Marcel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bollmann, Marcel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kuhlmann, Marco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kuhlmann, Marco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kunz, Jenny","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kunz, Jenny","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}}],"participationCoverage":{"total":6,"returned":6,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2512.10772","snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-outgrowing-the-curse-of-multilinguality-507d1aed","formats":{"html":"/readings/arxiv-cs-ai-outgrowing-the-curse-of-multilinguality-507d1aed","markdown":"/readings/arxiv-cs-ai-outgrowing-the-curse-of-multilinguality-507d1aed.md","json":"/readings/arxiv-cs-ai-outgrowing-the-curse-of-multilinguality-507d1aed.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-pre-training","name":"Pre-training","explanation":"A model's initial training on a large dataset, before further adaptation for particular uses.","referenceUrl":"https://developers.google.com/machine-learning/glossary#pre-training"},{"id":"term-flops","name":"Floating-point operations","explanation":"A count of basic arithmetic steps; used to measure how much computation went into training a model.","referenceUrl":"https://en.wikipedia.org/wiki/FLOPS"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5","revision":"7f05afb5-54f0-4f5c-81aa-9cc102862176","revisionKind":"publication-id","title":"arXiv cs.AI: Outgrowing the Curse of Multilinguality","url":"https://escapemeridian.com/readings/arxiv-cs-ai-outgrowing-the-curse-of-multilinguality-507d1aed"},"source":{"type":"source","id":"https://arxiv.org/abs/2512.10772","revision":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","revisionKind":"sha256-source-text","title":"Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation","url":"https://arxiv.org/abs/2512.10772"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5","title":"arXiv cs.AI: Outgrowing the Curse of Multilinguality","argument":"The paper’s authors argue that scaling pretrained models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training FLOPs, controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training FLOPs stated there. The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings.","speaker":{"name":"Glocker, Kevin, Kukk, Kätriin, Oji, Romina, Bollmann, Marcel, Kuhlmann, Marco, Kunz, Jenny","roleAtSource":"Article author"},"source":{"title":"Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2512.10772","publishedAt":"2025-12-11","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.","excerpt":"Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.","excerpt":"We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.","excerpt":"An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"},{"text":"For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.","excerpt":"For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.","url":"https://arxiv.org/abs/2512.10772","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2512.10772","checkedAt":"2026-11-09T22:52:08.630Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Outgrowing the Curse of Multilinguality","summary":"The paper’s authors argue that scaling pretrained models can make language adaptation more effective than standard continued pretraining, especially when models would otherwise face capacity constraints. They compare approaches using matched data and training FLOPs, controlling for the amount of data and computing used. Their findings distinguish between language-resource settings: an initial upscaling step in English helps low-resource languages, while directly scaling up on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages. For multilingual continued pre-training, they identify scaling directly with target-language data as the best setup for data efficiency and reduced English forgetting. The abstract does not establish how these results transfer beyond the tested settings; the paper’s detailed experimental scope and language-level results would help assess that reach.","question":"Across which languages and model sizes do the authors find that scaling directly on target-language data is more compute-efficient in higher-resource scenarios?","claims":[{"text":"The authors compare upscaling from English base models with standard continued pretraining, matching data and training FLOPs.","excerpt":"Through comprehensive ablations matched for data and training FLOPs, we test whether upscaling from English base models enables more effective and resource-efficient adaptation than standard continued pretraining.","support":"source-stated"},{"text":"The authors find that upscaling can improve target-language performance by relieving capacity constraints, especially for higher-resourced languages.","excerpt":"We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages.","support":"source-stated"},{"text":"The authors report that an initial English upscaling step benefits low-resource languages, while direct scaling on the target language is more compute-efficient in higher-resource scenarios, with a slight data-efficiency tradeoff for most languages.","excerpt":"An initial upscaling step in English is beneficial for low-resource languages. However, in higher-resource scenarios it is more compute-efficient to directly scale up on the target language, albeit slightly compromising data efficiency for most languages.","support":"source-stated"},{"text":"For multilingual continued pre-training, the authors identify direct scaling with target data as optimal for data efficiency and reduced English forgetting.","excerpt":"For multilingual continued pre-training, we identify directly scaling up using the target data as the optimal setup for both data efficiency and reduced English forgetting.","support":"source-stated"}],"limitations":["The supplied evidence is the abstract and does not give the tested languages, model sizes, detailed results, or experimental setup beyond the matched data and training FLOPs stated there.","The findings are reported by the paper’s authors; the supplied abstract does not establish how well they generalize beyond the tested settings."],"mediaId":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","correctionReason":null,"id":"507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5","publicationId":"7f05afb5-54f0-4f5c-81aa-9cc102862176","version":1,"sourceUrl":"https://arxiv.org/abs/2512.10772","sourceTitle":"Outgrowing the Curse of Multilinguality: Scaling Strategies for Efficient Language Adaptation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2025-12-11","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-09T05:00:43.330Z","createdAt":"2026-11-09T05:48:24.785Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","kind":"article","url":"https://arxiv.org/abs/2512.10772","sourceUrl":"https://arxiv.org/abs/2512.10772","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-09T05:47:33.733Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2512.10772","checkedAt":"2026-11-09T22:52:08.630Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"752d9393c13754db0d9461b4480c2337e9f4a8449ca9e91dad538395e3fe73af","confidence":0.76,"provider":"typesafe","model":"jev-1.13.0","inputHash":"5aa092cff260894c530e9c76eb4b92e54c92459db530806a8f37d01438c295a4","decidedAt":"2026-11-09T05:47:35.513Z"},"provenance":{"textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observationId":"1b2cbca87c6f30c6f25e6cb98745143ddfe4a34716ba5db3d6762d6ea60bddea","retrievedAt":"2026-11-09T05:47:33.452Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"8ca03277-9922-4243-80dc-fe4674d6273c"},"reviewer":{"model":"gpt-6-luna","runId":"b4d79309-a3b7-4d21-8070-ed1747ce3d05"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-09T05:48:24.785Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Glocker, Kevin","url":null,"kind":"unknown"},{"name":"Kukk, Kätriin","url":null,"kind":"unknown"},{"name":"Oji, Romina","url":null,"kind":"unknown"},{"name":"Bollmann, Marcel","url":null,"kind":"unknown"},{"name":"Kuhlmann, Marco","url":null,"kind":"unknown"},{"name":"Kunz, Jenny","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Glocker, Kevin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Glocker, Kevin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kukk, Kätriin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kukk, Kätriin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Oji, Romina","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Oji, Romina","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Bollmann, Marcel","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Bollmann, Marcel","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kuhlmann, Marco","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kuhlmann, Marco","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}},{"actor":{"name":"Kunz, Jenny","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kunz, Jenny","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2512.10772","locator":"head/meta[name=author|citation_author]"},"assertionId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-09T22:52:08.630Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","sourceUrl":"https://arxiv.org/abs/2512.10772","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z"}}],"participationCoverage":{"total":6,"returned":6,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2512.10772","snapshotId":"299464ecd014cd6f46e4f89c2fc5de4bcd00fde4a47052093287a21b0ce63b1e","contentSha256":"5ff88a432a2c8982a9bc16b00a3d7de0137b3b2ef4ceae2eca200a0f83e556c6","textHash":"f7f61ae1925937e2d9a995c5d70539ae4cdfdbac21237145eaecdd5e9d09d7d2","observedAt":"2026-11-09T22:52:08.630Z","basis":"publisher-page-metadata","sourceLinks":48,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/507d1aed1e339413c5c44f3f4bbe5f6c9c166d265d51825f19b16449e3165bc5/source"}}}],"audits":[{"publicationId":"7f05afb5-54f0-4f5c-81aa-9cc102862176","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The findings are attributed to the paper's authors, and the arXiv cs.AI listing is identified as the venue. The authors are not named in the draft, but the attribution is still correct. No source claim is presented as established fact or as Escape Meridian's opinion.","excerpt":"Authors:Kevin Glocker, Kätriin Kukk, Romina Oji, Marcel Bollmann, Marco Kuhlmann, Jenny Kunz"},{"dimension":"summary","status":"uncertain","explanation":"The reading is faithful but hard for a nonspecialist to follow. Central terms are never explained: curse of multilinguality, upscaling (growing a pretrained model's size), continued pretraining, low- and higher-resource languages, and English forgetting. The motivating problem is also missing: multilingual models underperform language-specific ones, especially small models. Smallest repair: add one sentence stating that problem and add tooltips for these terms. The lead also swaps the source's 'especially for higher-resourced languages' for a capacity-constraint condition, which should be restored.","excerpt":"Massively multilingual models still underperform language-specific adaptations, especially at smaller scales, due to the curse of multilinguality."},{"dimension":"date","status":"pass","explanation":"The originalPublished value of 2025-12-11 matches the v1 submission date. It is correctly preferred over the v2 revision of 6 Nov 2026 and over the feed date.","excerpt":"Submitted on 11 Dec 2025 (v1), last revised 6 Nov 2026 (this version, v2)"},{"dimension":"support","status":"pass","explanation":"All four claims match the abstract verbatim and stay attributed to the authors. The limitations accurately describe what the abstract leaves out. The question about which languages and model sizes the results cover follows from the evidence without being leading. No benefits or costs are invented. The lead's phrasing about capacity constraints is a loose paraphrase but not a contradiction.","excerpt":"We find that upscaling is an efficient strategy for improving target-language performance by relieving capacity constraints, especially for higher-resourced languages."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified, direct arXiv abstract page for this paper, which is the most relevant link available.","excerpt":null}],"createdAt":"2026-11-09T05:48:24.785Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}