# arXiv cs.AI: Paulo Camara on inherited weights and language-model costs for the Global South

[Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-paulo-camara-on-inherited-weights-and-language-e4dac9f1)

Paulo Camara argues that fine-tuning does not erase decisive properties inherited from a model’s base, including its vocabulary, knowledge, cultural alignment, memorized data and license. His paper measures the tokenization premium across 31 languages, 7 tokenizers and 27 articles of the Universal Declaration of Human Rights. In older tokenizers, the reported premium for Amharic reaches 10x; it is 6.8x in the newest commercial tokenizer. Indigenous South American languages show premiums of 1.6x to 2.7x under global tokenizers. Camara reports that a vocabulary built from Portuguese lowers the premium for 11 of 13 Latin-script Global South languages compared with every global tokenizer tested, including by about 24% for Guarani and Quechua. He also proposes an eight-test black-box sovereignty audit that buyers can run without access to weights. More broadly, he argues that energy and liability constraints call for accuracy per joule, calibration and selective risk to replace raw accuracy as design objectives, with metrics that abstention cannot inflate. The paper includes preliminary internal measurements from a proprietary architecture, but the abstract does not give their results.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

arXiv cs.AI · Article

Original source date: Nov 10, 2026 (2026-11-10).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-12T03:04:48.072Z. First observed: 2026-11-11T05:01:42.017Z. Retrieved: 2026-11-12T03:03:36.474Z.

- [Inherited Weights: Measuring the Tokenization Premium and the Sovereignty Cost of Language Models for the Global South](https://arxiv.org/abs/2611.13441)

## Limits

The supplied evidence is the arXiv abstract, not the full paper; it does not give the eight audit tests or the methods and detailed results behind the measurements. The abstract describes the proprietary architecture's internal measurements as preliminary and says they are reported with limitations, but does not provide their results or those limitations. The reported tokenizer comparisons cover the stated languages, tokenizers and 27 articles; the abstract does not establish whether the results generalize to other text or settings.


## Open question

Does the reported advantage of a Portuguese-built vocabulary hold when measured on text beyond the 27 articles of the Universal Declaration of Human Rights?


## Source-stated

Camara argues that fine-tuned models retain decisive properties of their pretrained base, including vocabulary, knowledge, cultural alignment, memorized data and license.

> fine-tuning leaves the decisive properties of a model inherited from its base: vocabulary, knowledge, cultural alignment, memorized data and license.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The paper measures the tokenization premium across 31 languages and 7 tokenizers using 27 articles of the Universal Declaration of Human Rights, with correction for unknown-token collapse.

> across 31 languages and 7 tokenizers released in 2023-2024, on 27 articles of the Universal Declaration of Human Rights, with explicit correction for unknown-token collapse.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The reported premium reaches 10x for Amharic in older tokenizers and remains 6.8x in the newest commercial tokenizer; Indigenous South American languages show 1.6x to 2.7x under global tokenizers.

> Premiums reach 10x for Amharic in older tokenizers and remain at 6.8x in the newest commercial one; Indigenous South American languages pay between 1.6x and 2.7x under global tokenizers.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

Camara reports that a Portuguese-built vocabulary lowers the premium for 11 of 13 Latin-script Global South languages relative to every global tokenizer tested, by about 24% for Guarani and Quechua.

> A vocabulary built from Portuguese lowers the premium for 11 of 13 Latin-script Global South languages relative to every global tokenizer tested, by about 24% for Guarani and Quechua.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The paper proposes an eight-test black-box sovereignty audit that buyers can run without access to model weights.

> An eight-test black-box sovereignty audit that a buyer can run without access to weights.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

Camara argues that energy and liability constraints call for accuracy per joule, calibration and selective risk to replace raw accuracy as design objectives, with metrics that abstention cannot inflate.

> under energy and liability constraints, accuracy per joule, calibration and selective risk should replace raw accuracy as design objectives, with metrics that abstention cannot inflate.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source and contributor context

Camara, Paulo · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

- [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning)

## Model tokens

Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens.

- [Definition reference](https://developers.google.com/machine-learning/glossary#token)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 9ee6634e-3980-4b07-8bd7-45d2b2333e12.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T03:04:48.072Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 0e5ce00e777964767d1d5558dfacb11a74dab23a5c637e5664b50d32e7136d31. Source text hash: abec8ad1d2da40b67c22e0bff4b6200f54164db3cecdfcd1cba1b31da3bd6a0e.


## Revision and source-check history

### Version 1 — 2026-11-12T03:04:48.072Z

Paulo Camara argues that fine-tuning does not erase decisive properties inherited from a model’s base, including its vocabulary, knowledge, cultural alignment, memorized data and license. His paper measures the tokenization premium across 31 languages, 7 tokenizers and 27 articles of the Universal Declaration of Human Rights. In older tokenizers, the reported premium for Amharic reaches 10x; it is 6.8x in the newest commercial tokenizer. Indigenous South American languages show premiums of 1.6x to 2.7x under global tokenizers. Camara reports that a vocabulary built from Portuguese lowers the premium for 11 of 13 Latin-script Global South languages compared with every global tokenizer tested, including by about 24% for Guarani and Quechua. He also proposes an eight-test black-box sovereignty audit that buyers can run without access to weights. More broadly, he argues that energy and liability constraints call for accuracy per joule, calibration and selective risk to replace raw accuracy as design objectives, with metrics that abstention cannot inflate. The paper includes preliminary internal measurements from a proprietary architecture, but the abstract does not give their results.

## Original source

arXiv cs.AI · Article

Original source date: Nov 10, 2026 (2026-11-10).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-12T03:04:48.072Z. First observed: 2026-11-11T05:01:42.017Z. Retrieved: 2026-11-12T03:03:36.474Z.

- [Inherited Weights: Measuring the Tokenization Premium and the Sovereignty Cost of Language Models for the Global South](https://arxiv.org/abs/2611.13441)

## Limits

The supplied evidence is the arXiv abstract, not the full paper; it does not give the eight audit tests or the methods and detailed results behind the measurements. The abstract describes the proprietary architecture's internal measurements as preliminary and says they are reported with limitations, but does not provide their results or those limitations. The reported tokenizer comparisons cover the stated languages, tokenizers and 27 articles; the abstract does not establish whether the results generalize to other text or settings.


## Open question

Does the reported advantage of a Portuguese-built vocabulary hold when measured on text beyond the 27 articles of the Universal Declaration of Human Rights?


## Source-stated

Camara argues that fine-tuned models retain decisive properties of their pretrained base, including vocabulary, knowledge, cultural alignment, memorized data and license.

> fine-tuning leaves the decisive properties of a model inherited from its base: vocabulary, knowledge, cultural alignment, memorized data and license.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The paper measures the tokenization premium across 31 languages and 7 tokenizers using 27 articles of the Universal Declaration of Human Rights, with correction for unknown-token collapse.

> across 31 languages and 7 tokenizers released in 2023-2024, on 27 articles of the Universal Declaration of Human Rights, with explicit correction for unknown-token collapse.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The reported premium reaches 10x for Amharic in older tokenizers and remains 6.8x in the newest commercial tokenizer; Indigenous South American languages show 1.6x to 2.7x under global tokenizers.

> Premiums reach 10x for Amharic in older tokenizers and remain at 6.8x in the newest commercial one; Indigenous South American languages pay between 1.6x and 2.7x under global tokenizers.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

Camara reports that a Portuguese-built vocabulary lowers the premium for 11 of 13 Latin-script Global South languages relative to every global tokenizer tested, by about 24% for Guarani and Quechua.

> A vocabulary built from Portuguese lowers the premium for 11 of 13 Latin-script Global South languages relative to every global tokenizer tested, by about 24% for Guarani and Quechua.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

The paper proposes an eight-test black-box sovereignty audit that buyers can run without access to model weights.

> An eight-test black-box sovereignty audit that a buyer can run without access to weights.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source-stated

Camara argues that energy and liability constraints call for accuracy per joule, calibration and selective risk to replace raw accuracy as design objectives, with metrics that abstention cannot inflate.

> under energy and liability constraints, accuracy per joule, calibration and selective risk should replace raw accuracy as design objectives, with metrics that abstention cannot inflate.

- [Supporting source](https://arxiv.org/abs/2611.13441)

## Source and contributor context

Camara, Paulo · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

- [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning)

## Model tokens

Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens.

- [Definition reference](https://developers.google.com/machine-learning/glossary#token)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 9ee6634e-3980-4b07-8bd7-45d2b2333e12.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T03:04:48.072Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 0e5ce00e777964767d1d5558dfacb11a74dab23a5c637e5664b50d32e7136d31. Source text hash: abec8ad1d2da40b67c22e0bff4b6200f54164db3cecdfcd1cba1b31da3bd6a0e.


### uncertain — 2026-11-12T03:04:48.072Z — anthropic/claude-opus-5.5

Publication: 9ee6634e-3980-4b07-8bd7-45d2b2333e12

attribution — pass: The paper is correctly attributed to Paulo Camara (LUA Vision) on arXiv. Its arguments and measurements are consistently framed as his claims rather than established facts.

> Authors:Paulo Camara (LUA Vision)

summary — uncertain: The figures are faithful, but the central term 'tokenization premium' is never explained. A general reader cannot tell what a 10x or 6.8x premium means, for example more tokens and therefore more cost or compute for the same text. 'Black-box sovereignty audit', 'accuracy per joule', 'calibration', 'selective risk' and 'abstention' are also unexplained. Smallest repair: add a plain-language gloss or term-library tooltips for these terms, and one source-supported sentence on why the premium matters, without inventing stakes.

> Premiums reach 10x for Amharic in older tokenizers and remain at 6.8x in the newest commercial one

date — pass: originalPublished 2026-11-10 matches the v1 submission date. The later feed date of Nov 11 is correctly not used.

> \[Submitted on 10 Nov 2026\]

support — pass: Every claim matches the abstract verbatim in substance. The draft rightly notes that results for the proprietary architecture are not given and limits generalization to the tested text. The question follows from the stated 27-article scope and adds no unsupported benefits or costs.

> We close with preliminary internal measurements from a proprietary architecture built around these objectives, reported with their limitations.

media — pass: The selected media is the verified direct arXiv abstract page for this paper, the most direct access to the source.

## Recorded references

Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/e4dac9f1b23aea105a7e0de924328216ec3905cf16c8892cbafe930745a3c1db/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-paulo-camara-on-inherited-weights-and-language-e4dac9f1.json)
