{"id":"65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173","title":"arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion","argument":"The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free RL objective to scale training across diverse sources of directions.\n\nThe authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"Evidence is the arXiv abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons. The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative. The reported findings are the authors’ claims, not an independent assessment.","speaker":{"name":"De Schamphelaere, Celeste, Vazquez, Juan J., Spiesberger, Ari, Gavenčiak, Tomáš, Leech, Gavin, Ong, Euan, Feng, Jiahai","roleAtSource":"Article author"},"source":{"title":"Towards interpreting any residual stream direction by scaling activation inversion","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08465","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.","excerpt":"We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.","excerpt":"Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.","excerpt":"a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.","excerpt":"activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.","excerpt":"recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.","excerpt":"MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08465","checkedAt":"2026-11-08T05:34:08.209Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion","summary":"The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free RL objective to scale training across diverse sources of directions.\n\nThe authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.","question":"What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?","claims":[{"text":"The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.","excerpt":"We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.","support":"source-stated"},{"text":"The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.","excerpt":"Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective","support":"source-stated"},{"text":"The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.","excerpt":"a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains","support":"source-stated"},{"text":"The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.","excerpt":"activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs","support":"source-stated"},{"text":"The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.","excerpt":"recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.","support":"source-stated"},{"text":"The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.","excerpt":"MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.","support":"source-stated"}],"limitations":["Evidence is the arXiv abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons.","The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative.","The reported findings are the authors’ claims, not an independent assessment."],"mediaId":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","correctionReason":null,"id":"65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173","publicationId":"c3f91f90-d177-4864-8f56-b7d74794379c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08465","sourceTitle":"Towards interpreting any residual stream direction by scaling activation inversion","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:03:34.349Z","createdAt":"2026-11-08T05:03:23.667Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","kind":"article","url":"https://arxiv.org/abs/2611.08465","sourceUrl":"https://arxiv.org/abs/2611.08465","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T05:02:38.504Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08465","checkedAt":"2026-11-08T05:34:08.209Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","confidence":0.89,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4a672ec4de731c7847fb836bd9062c2f0837ff726efdfd64f6dd57c250e8792c","decidedAt":"2026-11-08T05:02:39.066Z"},"provenance":{"textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observationId":"4528a98321a3db9521e4392886917607b2a34b2e6cdbbc8083ee010f4d9af4a2","retrievedAt":"2026-11-08T05:02:38.403Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"98bacf54-1fe8-4695-8ff2-5e76e13840d2"},"reviewer":{"model":"gpt-6-luna","runId":"3acc74f1-653e-420e-8281-b6c0a3f62cd2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T05:03:23.667Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"De Schamphelaere, Celeste","url":null,"kind":"unknown"},{"name":"Vazquez, Juan J.","url":null,"kind":"unknown"},{"name":"Spiesberger, Ari","url":null,"kind":"unknown"},{"name":"Gavenčiak, Tomáš","url":null,"kind":"unknown"},{"name":"Leech, Gavin","url":null,"kind":"unknown"},{"name":"Ong, Euan","url":null,"kind":"unknown"},{"name":"Feng, Jiahai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"De Schamphelaere, Celeste","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"De Schamphelaere, Celeste","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Vazquez, Juan J.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Vazquez, Juan J.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Spiesberger, Ari","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Spiesberger, Ari","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Gavenčiak, Tomáš","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gavenčiak, Tomáš","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Leech, Gavin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Leech, Gavin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Ong, Euan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ong, Euan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Feng, Jiahai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Feng, Jiahai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08465","snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-towards-interpreting-any-residual-stream-direction-65fa3140","formats":{"html":"/readings/arxiv-cs-ai-towards-interpreting-any-residual-stream-direction-65fa3140","markdown":"/readings/arxiv-cs-ai-towards-interpreting-any-residual-stream-direction-65fa3140.md","json":"/readings/arxiv-cs-ai-towards-interpreting-any-residual-stream-direction-65fa3140.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-reinforcement-learning","name":"Reinforcement learning","explanation":"Training by trial and error, in which a system is rewarded for the outcomes its designers want.","referenceUrl":"https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173","revision":"c3f91f90-d177-4864-8f56-b7d74794379c","revisionKind":"publication-id","title":"arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion","url":"https://escapemeridian.com/readings/arxiv-cs-ai-towards-interpreting-any-residual-stream-direction-65fa3140"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.08465","revision":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","revisionKind":"sha256-source-text","title":"Towards interpreting any residual stream direction by scaling activation inversion","url":"https://arxiv.org/abs/2611.08465"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173","title":"arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion","argument":"The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free RL objective to scale training across diverse sources of directions.\n\nThe authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"Evidence is the arXiv abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons. The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative. The reported findings are the authors’ claims, not an independent assessment.","speaker":{"name":"De Schamphelaere, Celeste, Vazquez, Juan J., Spiesberger, Ari, Gavenčiak, Tomáš, Leech, Gavin, Ong, Euan, Feng, Jiahai","roleAtSource":"Article author"},"source":{"title":"Towards interpreting any residual stream direction by scaling activation inversion","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.08465","publishedAt":"2026-11-05","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.","excerpt":"We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.","excerpt":"Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.","excerpt":"a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.","excerpt":"activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.","excerpt":"recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"},{"text":"The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.","excerpt":"MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.","url":"https://arxiv.org/abs/2611.08465","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08465","checkedAt":"2026-11-08T05:34:08.209Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Towards interpreting any residual stream direction by scaling activation inversion","summary":"The authors introduce Maximally-Activating Example Metamodels (MAEMs), language models that generate text intended to strongly activate a supplied residual stream direction. They argue this addresses a limit of corpus search: its examples are restricted to text in the corpus. The MAEM objective maximises cosine similarity between the supplied direction and activations of generated text, using a label-free RL objective to scale training across diverse sources of directions.\n\nThe authors report that a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), and beats corpus search at 10M tokens on a majority of held-out languages and domains. They also report that it activates 89% of held-out SAE features, identifies concepts behind steering vectors about as well as NLAs, and recovers LoRA backdoor payloads more often than corpus search. It can verbalise some model workspace inner monologue. The authors’ central distinction is that a MAEM exemplar can be checked by running it through the subject model, which they present as a grounded alternative for scaling metamodel training. The abstract reports these results but does not give evaluation details.","question":"What evidence shows that forward-pass verification makes MAEM exemplars a grounded alternative for scaling metamodel training?","claims":[{"text":"The authors propose MAEMs, language models that generate text exemplars intended to strongly activate supplied residual stream directions.","excerpt":"We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions from a subject model to text exemplars that strongly activate those directions.","support":"source-stated"},{"text":"The MAEM training objective maximises cosine similarity between a supplied residual stream direction and activations of generated text, using a label-free RL objective.","excerpt":"Our objective is to maximise the cosine similarity of a supplied residual stream direction with the activations of the text generated by the MAEM. This label-free RL objective","support":"source-stated"},{"text":"The authors report that their Qwen3.6-27B MAEM inverts held-out activations better than corpus search or an NLA, and beats corpus search at 10M tokens on a majority of held-out languages and domains.","excerpt":"a Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder (NLA), beats corpus search (at 10M tokens) on a majority of held-out languages/domains","support":"source-stated"},{"text":"The authors report that the MAEM activates 89% of held-out SAE features and performs about as well as NLAs at identifying concepts behind steering vectors.","excerpt":"activates 89% of held-out SAE features. It also identifies concepts behind steering vectors about as well as NLAs","support":"source-stated"},{"text":"The authors report that the MAEM recovers LoRA backdoor payloads more often than corpus search and can verbalise some model workspace inner monologue.","excerpt":"recovers the payloads of LoRA backdoors more often than corpus search, and can even verbalise some model workspace inner monologue.","support":"source-stated"},{"text":"The authors say MAEM exemplars can be verified with a forward pass on the subject model, and present the objective as a grounded alternative for scaling metamodel training.","excerpt":"MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels.","support":"source-stated"}],"limitations":["Evidence is the arXiv abstract; it does not provide evaluation methods, detailed results, or the evidence behind the reported comparisons.","The abstract reports that exemplars can be verified with a forward pass, but does not explain how that verification establishes the proposed objective as a grounded alternative.","The reported findings are the authors’ claims, not an independent assessment."],"mediaId":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","correctionReason":null,"id":"65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173","publicationId":"c3f91f90-d177-4864-8f56-b7d74794379c","version":1,"sourceUrl":"https://arxiv.org/abs/2611.08465","sourceTitle":"Towards interpreting any residual stream direction by scaling activation inversion","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-05","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-06T05:03:34.349Z","createdAt":"2026-11-08T05:03:23.667Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","kind":"article","url":"https://arxiv.org/abs/2611.08465","sourceUrl":"https://arxiv.org/abs/2611.08465","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-08T05:02:38.504Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.08465","checkedAt":"2026-11-08T05:34:08.209Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v5","mediaId":"bb3e84fcd20900068257a5f95d1960fb1f0465871ee7c71f63d7beda4b1e2340","confidence":0.89,"provider":"typesafe","model":"jev-1.13.0","inputHash":"4a672ec4de731c7847fb836bd9062c2f0837ff726efdfd64f6dd57c250e8792c","decidedAt":"2026-11-08T05:02:39.066Z"},"provenance":{"textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observationId":"4528a98321a3db9521e4392886917607b2a34b2e6cdbbc8083ee010f4d9af4a2","retrievedAt":"2026-11-08T05:02:38.403Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"98bacf54-1fe8-4695-8ff2-5e76e13840d2"},"reviewer":{"model":"gpt-6-luna","runId":"3acc74f1-653e-420e-8281-b6c0a3f62cd2"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-08T05:03:23.667Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"De Schamphelaere, Celeste","url":null,"kind":"unknown"},{"name":"Vazquez, Juan J.","url":null,"kind":"unknown"},{"name":"Spiesberger, Ari","url":null,"kind":"unknown"},{"name":"Gavenčiak, Tomáš","url":null,"kind":"unknown"},{"name":"Leech, Gavin","url":null,"kind":"unknown"},{"name":"Ong, Euan","url":null,"kind":"unknown"},{"name":"Feng, Jiahai","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"De Schamphelaere, Celeste","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"De Schamphelaere, Celeste","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Vazquez, Juan J.","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Vazquez, Juan J.","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Spiesberger, Ari","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Spiesberger, Ari","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Gavenčiak, Tomáš","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Gavenčiak, Tomáš","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Leech, Gavin","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Leech, Gavin","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:4","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Ong, Euan","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Ong, Euan","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:5","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}},{"actor":{"name":"Feng, Jiahai","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Feng, Jiahai","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.08465","locator":"head/meta[name=author|citation_author]"},"assertionId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142:participation:6","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-08T05:34:08.209Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","sourceUrl":"https://arxiv.org/abs/2611.08465","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z"}}],"participationCoverage":{"total":7,"returned":7,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.08465","snapshotId":"6f80cf8716d052a7f80fca35c4baa4a2841f009a1a46a58930281fad1a4cd142","contentSha256":"29dfe360abb7d14f20d1d851c4fe7f043a9e51e90f0fcc45a863cc4e00a3deb2","textHash":"20b473820640c486c0ed6e3fa46028c253c0e257dea259c42c4ffd38d48971d3","observedAt":"2026-11-08T05:34:08.209Z","basis":"publisher-page-metadata","sourceLinks":47,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/65fa3140ba81afa51a095577a628625fea29fefd7ceb57722e4b4f120d932173/source"}}}],"audits":[{"publicationId":"c3f91f90-d177-4864-8f56-b7d74794379c","verdict":"uncertain","findings":[{"dimension":"attribution","status":"uncertain","explanation":"The paper and its authors are correctly identified, and most results are framed as what the authors report. One sentence breaks that framing: 'It can verbalise some model workspace inner monologue.' Read alone, it sounds like an established fact. Smallest repair: 'The authors also report it can even verbalise...'.","excerpt":"and can even verbalise some model workspace inner monologue."},{"dimension":"summary","status":"uncertain","explanation":"The summary follows the abstract faithfully, but a reader without specialist background cannot follow it. Central terms are used without plain explanation: residual stream direction, cosine similarity, label-free RL objective, SAE features, steering vectors, LoRA backdoor payloads and forward pass. It never says in plain language that this is a method for interpreting what a model's internal signals represent, or why that matters. Add brief explanations or tooltips, plus a source-supported line on significance, such as the verifiability of exemplars.","excerpt":"To interpret a direction in a language model's residual stream, we can look for text that strongly activates it."},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-05. This matches the arXiv v1 submission date of 5 Nov 2026, not the later feed entry.","excerpt":"[Submitted on 5 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim matches the abstract and carries an exact excerpt. The limitations correctly note that the evidence is abstract-only. The question follows from the authors' central 'grounded alternative' claim without asserting an unsupported conclusion. No invented benefits or costs.","excerpt":"MAEM exemplars can be verified with a forward pass on the subject model, making the MAEM objective a grounded alternative for scaling the training of metamodels."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.","excerpt":null}],"createdAt":"2026-11-08T05:03:23.667Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}