Escape Meridian

Fan, Jiajun, He, Neil, Yang, Changyi, Mao, Andy, Zhu, Xi, Cheng, Chaoran, Liang, Kaiqu, Shen, Shuaike, Li, Zetian, Guo, Ruihan, Liu, Ge · Nov 16, 2026

arXiv: Language Models Can Rewrite Their Own Weights

Markdown · JSON · Original source

The paper’s authors argue that a language model can improve itself by editing its own weights: the values that shape its responses. They call this process “self-rewriting.” In their account, a 27B model used its own reasoning, graded answers and ability to run itself to diagnose a failure and edit its weights, without gradients or training. The authors report that the edit raised accuracy by 6.6 points on 490 problems the model had not seen, with the test fixed in advance. They also report that the model accepted edits only when its own tests supported them, and that accuracy rose over its first eight sessions. The authors distinguish this approach from test- scaling, where extra computation is used while answering, and from training: they say self-rewriting’s gains persist in the weights and add no cost per answer. In another experiment, the model repaired a damaged copy without reading the undamaged weights; the repair improved results on six unseen image from 7% to 70% accuracy. The authors say this ability depends on scale: smaller models either made no edit or damaged themselves, while the 27B model altered a direction in hidden states associated with answers that finish versus answers that run out of tokens. They suggest that improving a language model may come to take a conversation rather than a training run.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 16, 2026 (2026-11-16).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T13:04:16.368Z. First observed: 2026-11-18T05:19:00.060Z. Retrieved: 2026-11-18T13:03:23.059Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The supplied evidence is the paper’s abstract; it does not include the detailed methods or results needed to assess the reported experiments beyond the summary provided there.

Open question

How does self-rewriting perform beyond the reported 490-problem test and the model’s first eight sessions?

Source-stated

The authors call a model editing its own weights to improve itself “self-rewriting,” and report that a 27B model did so without gradients or training.

we call this self-rewriting. Given its weights, graded answers and the ability to run itself, a 27B model diagnoses its failure and edits the weights behind it.

Source-stated

The authors report a 6.6-point accuracy gain on 490 problems the model had not seen, in a test fixed in advance.

its own edit makes it 6.6 points more accurate on 490 problems it never saw, in a test fixed in advance

Source-stated

The authors report that accuracy rose over the model’s first eight sessions, with each edit submitted only when its own tests supported it.

it submits an edit only when its own tests support it, each edit replacing the last, and over its first eight such sessions its accuracy only rises.

Source-stated

The authors report that repairing a damaged copy raised accuracy on six unseen image benchmarks from 7% to 70%, without reading the undamaged weights.

it locates the corrupted matrix and rewrites it with values of its own, never reading the undamaged weights; found on text math problems alone, the repair lifts the copy on six image benchmarks it never saw from 7% to 70% accuracy

Source-stated

The authors report that only the 27B model in the tested family successfully edited itself; the 2B model made no edit, while the 4B and 9B models damaged themselves.

across four sizes of one family, the 2B model makes no edit and the 4B and 9B models break themselves; only the 27B model works on itself as a human would

Source and contributor context

Fan, Jiajun, He, Neil, Yang, Changyi, Mao, Andy, Zhu, Xi, Cheng, Chaoran, Liang, Kaiqu, Shen, Shuaike, Li, Zetian, Guo, Ruihan, Liu, Ge · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

Editorial provenance

Version 1. Publication ID: 6d0affa4-a2f5-4fc1-85c5-4e04b28c59aa.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:04:16.368Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: c598f6d8aab3219985e4dcc194ebfed1e5ed7d6f9f1a1bf941938b34394cbe6e. Source text hash: f9ed88084572d3a3e9bbaa33f5d3f094f3b982a52d2c6eb55094f5b54f0f7872.

Revision and source-check history

Version 1 · 2026-11-18T13:04:16.368Z

arXiv: Language Models Can Rewrite Their Own Weights

The paper’s authors argue that a language model can improve itself by editing its own weights: the values that shape its responses. They call this process “self-rewriting.” In their account, a 27B model used its own reasoning, graded answers and ability to run itself to diagnose a failure and edit its weights, without gradients or training. The authors report that the edit raised accuracy by 6.6 points on 490 problems the model had not seen, with the test fixed in advance. They also report that the model accepted edits only when its own tests supported them, and that accuracy rose over its first eight sessions. The authors distinguish this approach from test- scaling, where extra computation is used while answering, and from training: they say self-rewriting’s gains persist in the weights and add no cost per answer. In another experiment, the model repaired a damaged copy without reading the undamaged weights; the repair improved results on six unseen image from 7% to 70% accuracy. The authors say this ability depends on scale: smaller models either made no edit or damaged themselves, while the 27B model altered a direction in hidden states associated with answers that finish versus answers that run out of tokens. They suggest that improving a language model may come to take a conversation rather than a training run.

Original source

cs.AI · Article

Source details

Original source date: Nov 16, 2026 (2026-11-16).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-18T13:04:16.368Z. First observed: 2026-11-18T05:19:00.060Z. Retrieved: 2026-11-18T13:03:23.059Z.

Limits

The supplied evidence is the paper’s abstract; it does not include the detailed methods or results needed to assess the reported experiments beyond the summary provided there.

Open question

How does self-rewriting perform beyond the reported 490-problem test and the model’s first eight sessions?

Source-stated

The authors call a model editing its own weights to improve itself “self-rewriting,” and report that a 27B model did so without gradients or training.

we call this self-rewriting. Given its weights, graded answers and the ability to run itself, a 27B model diagnoses its failure and edits the weights behind it.

Source-stated

The authors report a 6.6-point accuracy gain on 490 problems the model had not seen, in a test fixed in advance.

its own edit makes it 6.6 points more accurate on 490 problems it never saw, in a test fixed in advance

Source-stated

The authors report that accuracy rose over the model’s first eight sessions, with each edit submitted only when its own tests supported it.

it submits an edit only when its own tests support it, each edit replacing the last, and over its first eight such sessions its accuracy only rises.

Source-stated

The authors report that repairing a damaged copy raised accuracy on six unseen image benchmarks from 7% to 70%, without reading the undamaged weights.

it locates the corrupted matrix and rewrites it with values of its own, never reading the undamaged weights; found on text math problems alone, the repair lifts the copy on six image benchmarks it never saw from 7% to 70% accuracy

Source-stated

The authors report that only the 27B model in the tested family successfully edited itself; the 2B model made no edit, while the 4B and 9B models damaged themselves.

across four sizes of one family, the 2B model makes no edit and the 4B and 9B models break themselves; only the 27B model works on itself as a human would

Source and contributor context

Fan, Jiajun, He, Neil, Yang, Changyi, Mao, Andy, Zhu, Xi, Cheng, Chaoran, Liang, Kaiqu, Shen, Shuaike, Li, Zetian, Guo, Ruihan, Liu, Ge · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Benchmark

A defined set of tests used to compare systems. Results depend on the tasks and measures selected.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

TIME

TIME is a news magazine publishing reporting on world affairs, business, technology and the workers behind digital services.

Editorial provenance

Version 1. Publication ID: 6d0affa4-a2f5-4fc1-85c5-4e04b28c59aa.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-18T13:04:16.368Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: c598f6d8aab3219985e4dcc194ebfed1e5ed7d6f9f1a1bf941938b34394cbe6e. Source text hash: f9ed88084572d3a3e9bbaa33f5d3f094f3b982a52d2c6eb55094f5b54f0f7872.

uncertain · 2026-11-18T13:04:16.368Z · anthropic/claude-opus-5.5

Publication: 6d0affa4-a2f5-4fc1-85c5-4e04b28c59aa

attribution — pass: The reading attributes the claims to the paper's authors and keeps reported results as their assertions. The arXiv source and the author list match the evidence.

Authors:Jiajun Fan, Neil He, Changyi Yang, Andy Mao, Xi Zhu, Chaoran Cheng, Kaiqu Liang, Shuaike Shen, Zetian Li, Ruihan Guo, Ge Liu

summary — uncertain: The reading is mostly faithful but drops parts of the argument's force. The contrast with training is misassigned: persistence and no per-answer cost contrast with test-time scaling, while the training contrast is needing only an open model and hours on one GPU, which is omitted. Repair: add that point. The reading also omits that the repair was found on text math problems alone and reached 83% of the undamaged model's accuracy, and it skips the second session's edit result. '27B', 'gradients' and 'hidden states' are central terms left unexplained for general readers and need tooltips.

unlike training, it needs no pre- or post-training infrastructure, only an open model and hours on one GPU

date — pass: The originalPublished date, 2026-11-16, matches the v1 submission date. The later feed date is not used.

[Submitted on 16 Nov 2026]

support — pass: Each claim's excerpt is exact and supports it. The question follows from the evidence without leading. The limitation correctly notes that only the abstract is available. The reading adds no unsupported benefits or costs.

its own edit makes it 6.6 points more accurate on 490 problems it never saw, in a test fixed in advance

media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.