# arXiv cs.AI: From LoRA to Language: Recovering Skill Documents from Adapters [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-from-lora-to-language-recovering-skill-documents-e1b8a04b) The authors ask whether a skill document can be recovered from a LoRA adapter and its frozen base model. Skill documents teach a language model to handle a class of tasks; compiling them into adapters preserves behaviour but makes the text hard to read, edit, audit or move to another model. The authors report that reading adapter weights alone recovered little, while running the adapter worked better. Their Executing Writer recovered 39–44% of key instructions from held-out skills, compared with 1.3–1.5% using another skill’s adapter. On adapters fitted to 41 external skills, its documents restored 85–91% of the original task gain. These strongest results concern adapters whose training stored the document; adapters trained on behaviour alone were harder for trained writers, which recovered 1–2% of instructions. For those adapters, the authors tested an agent that writes a skill from differences between the base and adapted models. On ALFWorld, those skills recovered 58–71% of a LoRA’s gain and transferred to models unable to load the LoRA; the authors report Llama-3.1-8B rising from 5% to 55%. They conclude that whether a recovered skill comes from the adapter depends on what it learned: when behaviour cannot be guessed, the adapter is the source; when it can, a reward loop without the adapter does as well. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T14:34:42.271Z. First observed: 2026-11-09T05:07:38.087Z. Retrieved: 2026-11-12T14:33:30.832Z. - [From LoRA to Language: Recovering Skill Documents from Adapters](https://arxiv.org/abs/2611.09454) ## Limits The evidence supplied is the paper’s abstract, so it does not provide the detailed experimental methods or results needed to assess how the reported comparisons were conducted. The abstract says the strongest Executing Writer results are on adapters whose training stored the document; it reports much lower instruction recovery for adapters trained on behaviour alone. ## Open question How can one tell, for a given adapter, whether its behaviour can be guessed well enough for a reward loop without the adapter to do as well? ## Source-stated The authors investigate recovering a skill document from a LoRA adapter and its frozen base model, because compiling a document into an adapter preserves behaviour but makes the text difficult to access and transfer. > an adapter is hard to read, edit, audit or move to another model. We ask whether the skill document can be written back from the adapter and its frozen base model - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors say methods that read weights alone recovered little, while running the adapter worked better. > Reading the weights alone recovered little with the methods we tried; a learned map from weights to text passed on about one bit of the document. Running the adapter worked much better. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated For held-out skills, the Executing Writer recovered 39–44% of key instructions; using another skill’s adapter recovered 1.3–1.5%. > recovers 39-44% of the key instructions of held-out skills, against 1.3-1.5% with another skill's adapter - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated On adapters fitted to 41 external skills, the authors report that the generated documents restored 85–91% of the original task gain. > on adapters fitted to 41 external skills its documents restore 85-91% of the original's task gain - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors qualify the stronger results: adapters trained on behaviour alone were harder for trained writers, which recovered 1–2% of instructions. > These strongest results are on adapters whose training stored the document; adapters trained on behaviour alone are much harder for trained writers (1-2% of instructions). - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated For behaviour-only adapters, the tested agent recovered 58–71% of a LoRA’s gain on ALFWorld; the authors report transfer to a model that cannot load the LoRA, with Llama-3.1-8B rising from 5% to 55%. > On ALFWorld its skills recover 58-71% of a LoRA's gain and carry over to models that cannot load the LoRA, lifting Llama-3.1-8B from 5% to 55%. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors say the adapter’s role depends on whether its behaviour can be guessed: when it can, a reward loop without the adapter performs as well. > when its behaviour cannot be guessed, the adapter is the source; when it can, a reward loop without the adapter does as well. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source and contributor context Swadha, Saranya Dintakurthy, Shekar, Pavan C, Jain, Arpit, Krishnan, Aswanth · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6f4a3836-1dd3-483e-8f99-07996f25a699. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T14:34:42.271Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: f8c20b48c51257e1378eede2d02673fb3aba279c6aea2ab6df4addae3a80e3ac. Source text hash: cd1c0dfb9a75497748ad0bf1e7c6fe56bc0282df261392014b7d266e194823b2. ## Revision and source-check history ### Version 1 — 2026-11-12T14:34:42.271Z The authors ask whether a skill document can be recovered from a LoRA adapter and its frozen base model. Skill documents teach a language model to handle a class of tasks; compiling them into adapters preserves behaviour but makes the text hard to read, edit, audit or move to another model. The authors report that reading adapter weights alone recovered little, while running the adapter worked better. Their Executing Writer recovered 39–44% of key instructions from held-out skills, compared with 1.3–1.5% using another skill’s adapter. On adapters fitted to 41 external skills, its documents restored 85–91% of the original task gain. These strongest results concern adapters whose training stored the document; adapters trained on behaviour alone were harder for trained writers, which recovered 1–2% of instructions. For those adapters, the authors tested an agent that writes a skill from differences between the base and adapted models. On ALFWorld, those skills recovered 58–71% of a LoRA’s gain and transferred to models unable to load the LoRA; the authors report Llama-3.1-8B rising from 5% to 55%. They conclude that whether a recovered skill comes from the adapter depends on what it learned: when behaviour cannot be guessed, the adapter is the source; when it can, a reward loop without the adapter does as well. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T14:34:42.271Z. First observed: 2026-11-09T05:07:38.087Z. Retrieved: 2026-11-12T14:33:30.832Z. - [From LoRA to Language: Recovering Skill Documents from Adapters](https://arxiv.org/abs/2611.09454) ## Limits The evidence supplied is the paper’s abstract, so it does not provide the detailed experimental methods or results needed to assess how the reported comparisons were conducted. The abstract says the strongest Executing Writer results are on adapters whose training stored the document; it reports much lower instruction recovery for adapters trained on behaviour alone. ## Open question How can one tell, for a given adapter, whether its behaviour can be guessed well enough for a reward loop without the adapter to do as well? ## Source-stated The authors investigate recovering a skill document from a LoRA adapter and its frozen base model, because compiling a document into an adapter preserves behaviour but makes the text difficult to access and transfer. > an adapter is hard to read, edit, audit or move to another model. We ask whether the skill document can be written back from the adapter and its frozen base model - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors say methods that read weights alone recovered little, while running the adapter worked better. > Reading the weights alone recovered little with the methods we tried; a learned map from weights to text passed on about one bit of the document. Running the adapter worked much better. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated For held-out skills, the Executing Writer recovered 39–44% of key instructions; using another skill’s adapter recovered 1.3–1.5%. > recovers 39-44% of the key instructions of held-out skills, against 1.3-1.5% with another skill's adapter - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated On adapters fitted to 41 external skills, the authors report that the generated documents restored 85–91% of the original task gain. > on adapters fitted to 41 external skills its documents restore 85-91% of the original's task gain - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors qualify the stronger results: adapters trained on behaviour alone were harder for trained writers, which recovered 1–2% of instructions. > These strongest results are on adapters whose training stored the document; adapters trained on behaviour alone are much harder for trained writers (1-2% of instructions). - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated For behaviour-only adapters, the tested agent recovered 58–71% of a LoRA’s gain on ALFWorld; the authors report transfer to a model that cannot load the LoRA, with Llama-3.1-8B rising from 5% to 55%. > On ALFWorld its skills recover 58-71% of a LoRA's gain and carry over to models that cannot load the LoRA, lifting Llama-3.1-8B from 5% to 55%. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source-stated The authors say the adapter’s role depends on whether its behaviour can be guessed: when it can, a reward loop without the adapter performs as well. > when its behaviour cannot be guessed, the adapter is the source; when it can, a reward loop without the adapter does as well. - [Supporting source](https://arxiv.org/abs/2611.09454) ## Source and contributor context Swadha, Saranya Dintakurthy, Shekar, Pavan C, Jain, Arpit, Krishnan, Aswanth · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6f4a3836-1dd3-483e-8f99-07996f25a699. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: passed by anthropic/claude-opus-5.5 on 2026-11-12T14:34:42.271Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: f8c20b48c51257e1378eede2d02673fb3aba279c6aea2ab6df4addae3a80e3ac. Source text hash: cd1c0dfb9a75497748ad0bf1e7c6fe56bc0282df261392014b7d266e194823b2. ### passed — 2026-11-12T14:34:42.271Z — anthropic/claude-opus-5.5 Publication: 6f4a3836-1dd3-483e-8f99-07996f25a699 attribution — pass: The findings are consistently attributed to the paper's authors (Swadha, Shekar, Jain and Krishnan) via the arXiv abstract. They are framed as reported results, not established facts. The title prefix correctly names the arXiv cs.AI feed as publisher. > Authors:Saranya Dintakurthy Swadha, Pavan C Shekar, Arpit Jain, Aswanth Krishnan summary — pass: The summary faithfully tracks the abstract. It covers the motivation (adapters are hard to read, edit, audit or move), the weights-versus-running contrast, the key figures, the caveat about behaviour-only adapters, the ALFWorld transfer result and the authors' conclusion. The question follows from the evidence. One small repair: the source says running the adapter worked "much better", but the summary says only "better", which slightly flattens the authors' force. ALFWorld and reward loop are not glossed, but tooltips can cover them and the core idea stays readable. > Running the adapter worked much better. date — pass: originalPublished is 2026-11-06, which matches the v1 submission date on the arXiv page. The 2026-11-09 feed date is a later announcement and is correctly not used. > \[Submitted on 6 Nov 2026\] support — pass: Every claim's excerpt is a verbatim match and supports its claim, including the figures 39-44%, 1.3-1.5%, 85-91%, 1-2%, 58-71% and 5% to 55%. The limitations properly note that only the abstract is available and that the strongest results are conditional. The reading makes no unsupported benefit, cost or real-world reliability inference. > These strongest results are on adapters whose training stored the document; adapters trained on behaviour alone are much harder for trained writers (1-2% of instructions). media — pass: The selected media is the verified direct link to the arXiv abstract page for this paper, which is the original source and the most direct access point. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/e1b8a04bd9467b4d11cbfc0af09b8c986133106d1e033ffff80f7ed2f97aa41c/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-from-lora-to-language-recovering-skill-documents-e1b8a04b.json)