# arXiv: Episodic looking: using reinforcement learning to bias perception [Canonical reading](https://escapemeridian.com/readings/arxiv-episodic-looking-using-reinforcement-learning-to-bias-bfa16a4e) David Rawlinson and Gideon Kowadlo propose a model based on the Complementary Learning System architecture (CLS), separating recent memories from generalization. A Short-Term Memory (STM) stores recent input, while a slow, statistical Long-Term Memory (LTM) supplies robust, generalized perceptions. The authors argue this division can let a model adapt to new input while avoiding interference between memories. On an image classification task, they report that their model was more resistant to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting, and generalized more effectively in a few-shot setting than other continual learners. The trade-off matters: they also report slightly worse overall accuracy than existing continual learning models in the continual setting, with a different mix of performance characteristics. Their analysis suggests that the LTM’s representations and representational plasticity limit the model. The authors say future work will seek to address this by replaying STM memories to the LTM; the abstract does not report whether that approach improves results. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T03:38:28.817Z. First observed: 2026-10-30T06:42:57.851Z. Retrieved: 2026-10-31T10:17:05.208Z. - [Episodic looking - using reinforcement learning to bias perception enhances few-shot and continual learning with protection from forgetting](https://arxiv.org/abs/2610.38577) ## Limits The reported results are for an image classification task; the abstract does not establish performance in other tasks. The abstract reports slightly worse overall accuracy in the continual setting, despite greater resistance to forgetting than the baseline ResNet LTM. The authors' analysis suggests that LTM representations and representational plasticity limit the model; the abstract does not report results from replaying STM memories to the LTM. ## Open question Would replaying STM memories to the LTM address the reported limits in its representations and representational plasticity? ## Source-stated The authors propose a Complementary Learning System architecture that separates recent input memory from generalization through the LTM. > a Short-Term Memory (STM) delegates generalization to a slow, statistical Long-Term Memory (LTM). - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated On an image classification task, the authors report greater resistance to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting. > the resulting CLS model is more resistant to forgetting in a domain-incremental continual learning setting than a baseline ResNet LTM - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors report better generalization in a few-shot setting than other continual learners. > generalizes more effectively in a few-shot setting than other continual learners. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors report slightly worse overall accuracy than existing continual learning models in the continual setting, and identify LTM representations and representational plasticity as likely limits. > overall accuracy is slightly worse than existing continual learning models, but with a different mix of performance characteristics. Results analysis suggests that the model is limited by the representations and representational plasticity of the LTM. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors say future work will investigate replaying STM memories to the LTM. > In future work, we will seek to address this by replaying STM memories to the LTM. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source and contributor context Rawlinson, David, Kowadlo, Gideon · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Reinforcement learning Training by trial and error, in which a system is rewarded for the outcomes its designers want. - [Definition reference](https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl) ## Continual learning A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining. - [Definition reference](https://en.wikipedia.org/wiki/Incremental_learning) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6b297810-872b-4089-87e2-6aec5570c70f. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:38:28.817Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: cc4f4547e83bfe49dc69fb1e8467b7d28f9a74abb03035412e2956dff0778b3e. Source text hash: 562a22b0d92cdb0668f35d962f62b870bdddc985a4b92af320067b8386af07d9. ## Revision and source-check history ### Version 1 — 2026-11-11T03:38:28.817Z David Rawlinson and Gideon Kowadlo propose a model based on the Complementary Learning System architecture (CLS), separating recent memories from generalization. A Short-Term Memory (STM) stores recent input, while a slow, statistical Long-Term Memory (LTM) supplies robust, generalized perceptions. The authors argue this division can let a model adapt to new input while avoiding interference between memories. On an image classification task, they report that their model was more resistant to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting, and generalized more effectively in a few-shot setting than other continual learners. The trade-off matters: they also report slightly worse overall accuracy than existing continual learning models in the continual setting, with a different mix of performance characteristics. Their analysis suggests that the LTM’s representations and representational plasticity limit the model. The authors say future work will seek to address this by replaying STM memories to the LTM; the abstract does not report whether that approach improves results. ## Original source arXiv cs.AI · Article Original source date: Oct 28, 2026 (2026-10-28). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-11T03:38:28.817Z. First observed: 2026-10-30T06:42:57.851Z. Retrieved: 2026-10-31T10:17:05.208Z. - [Episodic looking - using reinforcement learning to bias perception enhances few-shot and continual learning with protection from forgetting](https://arxiv.org/abs/2610.38577) ## Limits The reported results are for an image classification task; the abstract does not establish performance in other tasks. The abstract reports slightly worse overall accuracy in the continual setting, despite greater resistance to forgetting than the baseline ResNet LTM. The authors' analysis suggests that LTM representations and representational plasticity limit the model; the abstract does not report results from replaying STM memories to the LTM. ## Open question Would replaying STM memories to the LTM address the reported limits in its representations and representational plasticity? ## Source-stated The authors propose a Complementary Learning System architecture that separates recent input memory from generalization through the LTM. > a Short-Term Memory (STM) delegates generalization to a slow, statistical Long-Term Memory (LTM). - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated On an image classification task, the authors report greater resistance to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting. > the resulting CLS model is more resistant to forgetting in a domain-incremental continual learning setting than a baseline ResNet LTM - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors report better generalization in a few-shot setting than other continual learners. > generalizes more effectively in a few-shot setting than other continual learners. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors report slightly worse overall accuracy than existing continual learning models in the continual setting, and identify LTM representations and representational plasticity as likely limits. > overall accuracy is slightly worse than existing continual learning models, but with a different mix of performance characteristics. Results analysis suggests that the model is limited by the representations and representational plasticity of the LTM. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source-stated The authors say future work will investigate replaying STM memories to the LTM. > In future work, we will seek to address this by replaying STM memories to the LTM. - [Supporting source](https://arxiv.org/abs/2610.38577) ## Source and contributor context Rawlinson, David, Kowadlo, Gideon · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Reinforcement learning Training by trial and error, in which a system is rewarded for the outcomes its designers want. - [Definition reference](https://developers.google.com/machine-learning/glossary#reinforcement-learning-rl) ## Continual learning A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining. - [Definition reference](https://en.wikipedia.org/wiki/Incremental_learning) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: 6b297810-872b-4089-87e2-6aec5570c70f. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:38:28.817Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: cc4f4547e83bfe49dc69fb1e8467b7d28f9a74abb03035412e2956dff0778b3e. Source text hash: 562a22b0d92cdb0668f35d962f62b870bdddc985a4b92af320067b8386af07d9. ### uncertain — 2026-11-11T03:38:28.817Z — anthropic/claude-opus-5.5 Publication: 6b297810-872b-4089-87e2-6aec5570c70f attribution — pass: The reading correctly attributes the proposal, results and future-work plan to authors David Rawlinson and Gideon Kowadlo. It frames results as what they report rather than as established fact. > Authors:David Rawlinson, Gideon Kowadlo summary — uncertain: Several central terms are left unexplained for a non-specialist: few-shot, continual learning, domain-incremental, ResNet, forgetting and representational plasticity. The summary also omits the paper's motivating claim of a contradiction between generalizing and continuously adapting. The title highlights reinforcement learning, but neither the summary nor the abstract explains it. Smallest repair: add one plain-language sentence on the generalize-versus-adapt tension, and attach tooltips for few-shot, continual learning, ResNet and plasticity. > There is a fundamental contradiction between the desire for models that can generalize, and models that can continuously adapt to recent input with changing statistics. date — pass: The originalPublished value, 2026-10-28, matches the arXiv v1 submission date. The later feed date was correctly not used. > \[Submitted on 28 Oct 2026\] support — pass: Each claim matches the abstract, and the trade-off of slightly worse overall accuracy is preserved. The reading correctly notes that replay results are not reported. The question follows from the stated future work without assuming an outcome, and it adds no unsupported benefits or costs. > In future work, we will seek to address this by replaying STM memories to the LTM. media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/bfa16a4e0bd209f5eb3c9c423f69d85fcca1d6c3126602dd28ff9f8dc3d060b3/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-episodic-looking-using-reinforcement-learning-to-bias-bfa16a4e.json)