Escape Meridian

Kongsilp, Sirisilp · Nov 18, 2026

arXiv cs.AI: Learning through Discernment and feedback-driven model decay

Markdown · JSON · Original source

Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

arXiv cs.AIArticle · arxiv.orgOpen original source

Original source

cs.AI · Article

Source details

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.

Referenced by

Recorded citations in public readings. A reference alone does not establish agreement or influence.

No public references recorded here yet.

Reference data (JSON)

Limits

The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.

Open question

What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?

Source-stated

The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.

fine-tuned each night on the attempts a judge accepts

Source-stated

The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.

kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.

Source-stated

When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.

80% of its lessons were failures the customer had thanked

Source-stated

Across 97 lives, the share of failed attempts among lessons predicted the outcome.

Across 97 lives, the share of failed attempts among the lessons predicted the outcome

Source-stated

The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.

learning from users held up only where the judge kept failures out and the user could see the outcome

Source-stated

The paper cautions that lopsided lessons may narrow the model.

lopsided lessons may also narrow the model.

Source and contributor context

Kongsilp, Sirisilp · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.

Revision and source-check history

Version 1 · 2026-11-19T08:49:18.953Z

arXiv cs.AI: Learning through Discernment and feedback-driven model decay

Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.

Original source

cs.AI · Article

Source details

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.

Limits

The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.

Open question

What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?

Source-stated

The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.

fine-tuned each night on the attempts a judge accepts

Source-stated

The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.

kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.

Source-stated

When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.

80% of its lessons were failures the customer had thanked

Source-stated

Across 97 lives, the share of failed attempts among lessons predicted the outcome.

Across 97 lives, the share of failed attempts among the lessons predicted the outcome

Source-stated

The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.

learning from users held up only where the judge kept failures out and the user could see the outcome

Source-stated

The paper cautions that lopsided lessons may narrow the model.

lopsided lessons may also narrow the model.

Source and contributor context

Kongsilp, Sirisilp · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.

Source media

No suitable media was found by the supported page extraction.

Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.

Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

Editorial provenance

Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material_development.

Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.

uncertain · 2026-11-19T08:49:18.953Z · anthropic/claude-opus-5.5

Publication: 9755b844-66d5-48d8-85a1-c004a373442b

attribution — pass: The summary correctly attributes the study and its conditional conclusion to the paper's sole author, Sirisilp Kongsilp, as published on arXiv. One claim says "The authors say," which is slightly inaccurate for a single-author paper but does not change who is responsible for the claim. Smallest repair: change it to "The author says."

Authors:Sirisilp Kongsilp

summary — uncertain: The summary is faithful to the abstract, but several central paper-specific terms are left unexplained for a non-specialist. It never says that "lives" means simulated deployment runs of up to a year, or that the "oracle" is the true outcome. It also uses "the feedback sense" without introducing it as a separate, frozen component that reads the user's reaction. WebShop and τ²-bench are not identified as test environments, and LoRA has no tooltip. Smallest repair: briefly define lives, oracle and feedback sense, and add term-library entries for LoRA, WebShop and τ²-bench.

over 127 lives of up to a year on WebShop and $\tau^2$-bench

date — pass: The originalPublished date of 2026-11-18 matches the arXiv v1 submission date. The feed date of 2026-11-19 was correctly not used.

[Submitted on 18 Nov 2026]

support — pass: Each figure and condition in the summary matches the abstract: the self-judging decay, 3 of 5 collapses, 4 of 5 near the oracle for two weeks, fading by day 60, 80% thanked failures, 97 lives, and the conditional conclusion. The closing point, that a positive user reaction is not necessarily evidence of success, is supported by the thanked-failure finding. The question asks about a gap the source itself raises. The summary omits the reported correlation value, but this does not distort the meaning.

the sense read reactions correctly, yet 80% of its lessons were failures the customer had thanked

media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.

Challenge or correct this reading

Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.