arXiv cs.AI: Drift-adaptive Representation Preservation for Domain-Incremental Learning

arXiv cs.AI: Drift-adaptive Representation Preservation for Domain-Incremental Learning

Hyunmin Kong, Gyutae Oh and Jitae Shin propose tracking how much each previously learned domain-class concept changes during Domain-Incremental Learning (DIL), where the input distribution changes sequentially. They call this change representation drift and use it as a measurable surrogate for forgetting risk. Their method gives stronger preservation to pairs with high drift and reduces the influence of highly drifted domains when constructing class prototypes. To measure drift during training without storing past raw data, the authors repurpose a Joint-Embedding Predictive Architecture (JEPA), storing a compact context summary for each domain-class pair and comparing its representation with a fixed anchor. The authors report a strong accuracy-forgetting balance across DomainNet, Office-Home, CORe50 and CDDB-Hard, alongside substantially less training memory than accuracy-competitive methods and the smallest storage among compared methods. The abstract does not provide the benchmark results or comparisons in detail, so the size and conditions of those reported advantages cannot be assessed from this evidence alone.

Publication: dbc63c58-1d97-40e0-85dc-b3c069ecdb8d

attribution — pass: The reading correctly attributes the method and results to authors Hyunmin Kong, Gyutae Oh and Jitae Shin in an arXiv paper. Reported results are framed as the authors' claims, not established fact.

Authors:Hyunmin Kong, Gyutae Oh, Jitae Shin

summary — uncertain: The summary is faithful but hard for a non-specialist to follow. It never says the work concerns pretrained vision (image) models, so the setting is unclear. It does not explain in plain terms that forgetting means losing accuracy on earlier domains after adapting to new ones. Domain-class concept, class prototypes, consolidation and JEPA are left unexplained, and no supported significance is stated (adapting without storing past raw data, lower memory). Smallest repair: one opening sentence naming the vision-model setting and plainly defining forgetting, plus term-library tooltips. The title only repeats the source title.

Pretrained vision models provide strong general-purpose representations, but in Domain-Incremental Learning (DIL), where the input distribution changes sequentially, adapting to new domains often degrades performance on previously learned ones.

date — pass: originalPublished 2026-11-04 matches the v1 submission date on the arXiv page.

[Submitted on 4 Nov 2026]

support — uncertain: Claims 1–3 and the summary match the abstract. Claim 4 broadens the scope by saying lower training memory than 'comparison methods' generally. The source says substantially less training memory only than accuracy-competitive methods, and smallest storage among compared methods. Claim 4's excerpt also omits the memory and storage clause. Smallest repair: restore the exact scope and extend the excerpt. The question and limitations are appropriately framed.

using substantially less training memory than accuracy-competitive methods and the smallest storage among compared methods

media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.