De Schamphelaere, Celeste, Vazquez, Juan J., Spiesberger, Ari, Gavenčiak, Tomáš, Leech, Gavin, Ong, Euan, Feng, Jiahai · Nov 5, 2026
arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion
Markdown · JSON · Original source
The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free objective to scale training across diverse sources of directions. The authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T05:03:23.667Z. First observed: 2026-11-06T05:03:34.349Z. Retrieved: 2026-11-08T05:02:38.403Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
Evidence is the abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons. The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative. The reported findings are the authors’ claims, not an independent assessment.
Open question
What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?
Source-stated
The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.
We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.
Source-stated
The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.
Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective
Source-stated
The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.
a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains
Source-stated
The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.
activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs
Source-stated
The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.
recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.
Source-stated
The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.
MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.
Source and contributor context
De Schamphelaere, Celeste, Vazquez, Juan J., Spiesberger, Ari, Gavenčiak, Tomáš, Leech, Gavin, Ong, Euan, Feng, Jiahai · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Reinforcement learning
Training by trial and error, in which a system is rewarded for the outcomes its designers want.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: c3f91f90-d177-4864-8f56-b7d74794379c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T05:03:23.667Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 4528a98321a3db9521e4392886917607b2a34b2e6cdbbc8083ee010f4d9af4a2. Source text hash: 20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3.
Revision and source-check history
Version 1 · 2026-11-08T05:03:23.667Z
arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion
The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free objective to scale training across diverse sources of directions. The authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T05:03:23.667Z. First observed: 2026-11-06T05:03:34.349Z. Retrieved: 2026-11-08T05:02:38.403Z.
Limits
Evidence is the abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons. The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative. The reported findings are the authors’ claims, not an independent assessment.
Open question
What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?
Source-stated
The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.
We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.
Source-stated
The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.
Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective
Source-stated
The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.
a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains
Source-stated
The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.
activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs
Source-stated
The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.
recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.
Source-stated
The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.
MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.
Source and contributor context
De Schamphelaere, Celeste, Vazquez, Juan J., Spiesberger, Ari, Gavenčiak, Tomáš, Leech, Gavin, Ong, Euan, Feng, Jiahai · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Reinforcement learning
Training by trial and error, in which a system is rewarded for the outcomes its designers want.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: c3f91f90-d177-4864-8f56-b7d74794379c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-08T05:03:23.667Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 4528a98321a3db9521e4392886917607b2a34b2e6cdbbc8083ee010f4d9af4a2. Source text hash: 20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3.
uncertain · 2026-11-08T05:03:23.667Z · anthropic/claude-opus-5.5
Publication: c3f91f90-d177-4864-8f56-b7d74794379c
attribution — uncertain: The paper and its authors are correctly identified, and most results are framed as what the authors report. One sentence breaks that framing: 'It can verbalise some model workspace inner monologue.' Read alone, it sounds like an established fact. Smallest repair: 'The authors also report it can even verbalise...'.
and can even verbalise some model workspace inner monologue.
summary — uncertain: The summary follows the abstract faithfully, but a reader without specialist background cannot follow it. Central terms are used without plain explanation: residual stream direction, cosine similarity, label-free RL objective, SAE features, steering vectors, LoRA backdoor payloads and forward pass. It never says in plain language that this is a method for interpreting what a model's internal signals represent, or why that matters. Add brief explanations or tooltips, plus a source-supported line on significance, such as the verifiability of exemplars.
To interpret a direction in a language model's residual stream, we can look for text that strongly activates it.
date — pass: originalPublished is 2026-11-05. This matches the arXiv v1 submission date of 5 Nov 2026, not the later feed entry.
[Submitted on 5 Nov 2026]
support — pass: Each claim matches the abstract and carries an exact excerpt. The limitations correctly note that the evidence is abstract-only. The question follows from the authors' central 'grounded alternative' claim without asserting an unsupported conclusion. No invented benefits or costs.
MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
Training by trial and error, in which a system is rewarded for the outcomes its designers want.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivTraining by trial and error, in which a system is rewarded for the outcomes its designers want.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivarXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv