Kongsilp, Sirisilp · Nov 18, 2026
arXiv cs.AI: Learning through Discernment and feedback-driven model decay
Markdown · JSON · Original source
Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 18, 2026 (2026-11-18).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.
Referenced by
Recorded citations in public readings. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.
Open question
What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?
Source-stated
The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.
fine-tuned each night on the attempts a judge accepts
Source-stated
The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.
kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.
Source-stated
When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.
80% of its lessons were failures the customer had thanked
Source-stated
Across 97 lives, the share of failed attempts among lessons predicted the outcome.
Across 97 lives, the share of failed attempts among the lessons predicted the outcome
Source-stated
The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.
learning from users held up only where the judge kept failures out and the user could see the outcome
Source-stated
The paper cautions that lopsided lessons may narrow the model.
lopsided lessons may also narrow the model.
Source and contributor context
Kongsilp, Sirisilp · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.
Revision and source-check history
Version 1 · 2026-11-19T08:49:18.953Z
arXiv cs.AI: Learning through Discernment and feedback-driven model decay
Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.
Original source
cs.AI · Article
Source details
Original source date: Nov 18, 2026 (2026-11-18).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.
Limits
The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.
Open question
What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?
Source-stated
The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.
fine-tuned each night on the attempts a judge accepts
Source-stated
The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.
kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.
Source-stated
When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.
80% of its lessons were failures the customer had thanked
Source-stated
Across 97 lives, the share of failed attempts among lessons predicted the outcome.
Across 97 lives, the share of failed attempts among the lessons predicted the outcome
Source-stated
The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.
learning from users held up only where the judge kept failures out and the user could see the outcome
Source-stated
The paper cautions that lopsided lessons may narrow the model.
lopsided lessons may also narrow the model.
Source and contributor context
Kongsilp, Sirisilp · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Fine-tuning
Further training of an existing model to adapt it to a particular task or use.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.
uncertain · 2026-11-19T08:49:18.953Z · anthropic/claude-opus-5.5
Publication: 9755b844-66d5-48d8-85a1-c004a373442b
attribution — pass: The summary correctly attributes the study and its conditional conclusion to the paper's sole author, Sirisilp Kongsilp, as published on arXiv. One claim says "The authors say," which is slightly inaccurate for a single-author paper but does not change who is responsible for the claim. Smallest repair: change it to "The author says."
Authors:Sirisilp Kongsilp
summary — uncertain: The summary is faithful to the abstract, but several central paper-specific terms are left unexplained for a non-specialist. It never says that "lives" means simulated deployment runs of up to a year, or that the "oracle" is the true outcome. It also uses "the feedback sense" without introducing it as a separate, frozen component that reads the user's reaction. WebShop and τ²-bench are not identified as test environments, and LoRA has no tooltip. Smallest repair: briefly define lives, oracle and feedback sense, and add term-library entries for LoRA, WebShop and τ²-bench.
over 127 lives of up to a year on WebShop and $\tau^2$-bench
date — pass: The originalPublished date of 2026-11-18 matches the arXiv v1 submission date. The feed date of 2026-11-19 was correctly not used.
[Submitted on 18 Nov 2026]
support — pass: Each figure and condition in the summary matches the abstract: the self-judging decay, 3 of 5 collapses, 4 of 5 near the oracle for two weeks, fading by day 60, 80% thanked failures, 97 lives, and the conditional conclusion. The closing point, that a positive user reaction is not necessarily evidence of success, is supported by the thanked-failure finding. The question asks about a gap the source itself raises. The summary omits the reported correlation value, but this does not distort the meaning.
the sense read reactions correctly, yet 80% of its lessons were failures the customer had thanked
media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
Further training of an existing model to adapt it to a particular task or use.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivFurther training of an existing model to adapt it to a particular task or use.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv