Rawlinson, David, Kowadlo, Gideon · Oct 28, 2026
arXiv: Episodic looking: using reinforcement learning to bias perception
Markdown · JSON · Original source
David Rawlinson and Gideon Kowadlo propose a model based on the Complementary Learning System architecture (CLS), separating recent memories from generalization. A Short-Term Memory (STM) stores recent input, while a slow, statistical Long-Term Memory (LTM) supplies robust, generalized perceptions. The authors argue this division can let a model adapt to new input while avoiding interference between memories. On an image classification task, they report that their model was more resistant to forgetting than a baseline ResNet LTM in a domain-incremental setting, and generalized more effectively in a setting than other continual learners. The trade-off matters: they also report slightly worse overall accuracy than existing continual learning models in the continual setting, with a different mix of performance characteristics. Their analysis suggests that the LTM’s representations and representational plasticity limit the model. The authors say future work will seek to address this by replaying STM memories to the LTM; the abstract does not report whether that approach improves results.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 28, 2026 (2026-10-28).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-11T03:38:28.817Z. First observed: 2026-10-30T06:42:57.851Z. Retrieved: 2026-10-31T10:17:05.208Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported results are for an image classification task; the abstract does not establish performance in other tasks. The abstract reports slightly worse overall accuracy in the continual setting, despite greater resistance to forgetting than the baseline ResNet LTM. The authors' analysis suggests that LTM representations and representational plasticity limit the model; the abstract does not report results from replaying STM memories to the LTM.
Open question
Would replaying STM memories to the LTM address the reported limits in its representations and representational plasticity?
Source-stated
The authors propose a Complementary Learning System architecture that separates recent input memory from generalization through the LTM.
a Short-Term Memory (STM) delegates generalization to a slow, statistical Long-Term Memory (LTM).
Source-stated
On an image classification task, the authors report greater resistance to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting.
the resulting CLS model is more resistant to forgetting in a domain-incremental continual learning setting than a baseline ResNet LTM
Source-stated
The authors report better generalization in a few-shot setting than other continual learners.
generalizes more effectively in a few-shot setting than other continual learners.
Source-stated
The authors report slightly worse overall accuracy than existing continual learning models in the continual setting, and identify LTM representations and representational plasticity as likely limits.
overall accuracy is slightly worse than existing continual learning models, but with a different mix of performance characteristics. Results analysis suggests that the model is limited by the representations and representational plasticity of the LTM.
Source-stated
The authors say future work will investigate replaying STM memories to the LTM.
In future work, we will seek to address this by replaying STM memories to the LTM.
Source and contributor context
Rawlinson, David, Kowadlo, Gideon · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Reinforcement learning
Training by trial and error, in which a system is rewarded for the outcomes its designers want.
Continual learning
A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6b297810-872b-4089-87e2-6aec5570c70f.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:38:28.817Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: cc4f4547e83bfe49dc69fb1e8467b7d28f9a74abb03035412e2956dff0778b3e. Source text hash: 562a22b0d92cdb0668f35d962f62b870bdddc985a4b92af320067b8386af07d9.
Revision and source-check history
Version 1 · 2026-11-11T03:38:28.817Z
arXiv: Episodic looking: using reinforcement learning to bias perception
David Rawlinson and Gideon Kowadlo propose a model based on the Complementary Learning System architecture (CLS), separating recent memories from generalization. A Short-Term Memory (STM) stores recent input, while a slow, statistical Long-Term Memory (LTM) supplies robust, generalized perceptions. The authors argue this division can let a model adapt to new input while avoiding interference between memories. On an image classification task, they report that their model was more resistant to forgetting than a baseline ResNet LTM in a domain-incremental setting, and generalized more effectively in a setting than other continual learners. The trade-off matters: they also report slightly worse overall accuracy than existing continual learning models in the continual setting, with a different mix of performance characteristics. Their analysis suggests that the LTM’s representations and representational plasticity limit the model. The authors say future work will seek to address this by replaying STM memories to the LTM; the abstract does not report whether that approach improves results.
Original source
cs.AI · Article
Source details
Original source date: Oct 28, 2026 (2026-10-28).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-11T03:38:28.817Z. First observed: 2026-10-30T06:42:57.851Z. Retrieved: 2026-10-31T10:17:05.208Z.
Limits
The reported results are for an image classification task; the abstract does not establish performance in other tasks. The abstract reports slightly worse overall accuracy in the continual setting, despite greater resistance to forgetting than the baseline ResNet LTM. The authors' analysis suggests that LTM representations and representational plasticity limit the model; the abstract does not report results from replaying STM memories to the LTM.
Open question
Would replaying STM memories to the LTM address the reported limits in its representations and representational plasticity?
Source-stated
The authors propose a Complementary Learning System architecture that separates recent input memory from generalization through the LTM.
a Short-Term Memory (STM) delegates generalization to a slow, statistical Long-Term Memory (LTM).
Source-stated
On an image classification task, the authors report greater resistance to forgetting than a baseline ResNet LTM in a domain-incremental continual learning setting.
the resulting CLS model is more resistant to forgetting in a domain-incremental continual learning setting than a baseline ResNet LTM
Source-stated
The authors report better generalization in a few-shot setting than other continual learners.
generalizes more effectively in a few-shot setting than other continual learners.
Source-stated
The authors report slightly worse overall accuracy than existing continual learning models in the continual setting, and identify LTM representations and representational plasticity as likely limits.
overall accuracy is slightly worse than existing continual learning models, but with a different mix of performance characteristics. Results analysis suggests that the model is limited by the representations and representational plasticity of the LTM.
Source-stated
The authors say future work will investigate replaying STM memories to the LTM.
In future work, we will seek to address this by replaying STM memories to the LTM.
Source and contributor context
Rawlinson, David, Kowadlo, Gideon · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Reinforcement learning
Training by trial and error, in which a system is rewarded for the outcomes its designers want.
Continual learning
A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.
Zero-shot
Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6b297810-872b-4089-87e2-6aec5570c70f.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-11T03:38:28.817Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: cc4f4547e83bfe49dc69fb1e8467b7d28f9a74abb03035412e2956dff0778b3e. Source text hash: 562a22b0d92cdb0668f35d962f62b870bdddc985a4b92af320067b8386af07d9.
uncertain · 2026-11-11T03:38:28.817Z · anthropic/claude-opus-5.5
Publication: 6b297810-872b-4089-87e2-6aec5570c70f
attribution — pass: The reading correctly attributes the proposal, results and future-work plan to authors David Rawlinson and Gideon Kowadlo. It frames results as what they report rather than as established fact.
Authors:David Rawlinson, Gideon Kowadlo
summary — uncertain: Several central terms are left unexplained for a non-specialist: few-shot, continual learning, domain-incremental, ResNet, forgetting and representational plasticity. The summary also omits the paper's motivating claim of a contradiction between generalizing and continuously adapting. The title highlights reinforcement learning, but neither the summary nor the abstract explains it. Smallest repair: add one plain-language sentence on the generalize-versus-adapt tension, and attach tooltips for few-shot, continual learning, ResNet and plasticity.
There is a fundamental contradiction between the desire for models that can generalize, and models that can continuously adapt to recent input with changing statistics.
date — pass: The originalPublished value, 2026-10-28, matches the arXiv v1 submission date. The later feed date was correctly not used.
[Submitted on 28 Oct 2026]
support — pass: Each claim matches the abstract, and the trade-off of slightly worse overall accuracy is preserved. The reading correctly notes that replay results are not reported. The question follows from the stated future work without assuming an outcome, and it adds no unsupported benefits or costs.
In future work, we will seek to address this by replaying STM memories to the LTM.
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model improving from new experience after deployment, the way a new employee learns on the job, without full retraining.
Definition referenceDoing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot).
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv