# arXiv cs.AI: Learning through Discernment and feedback-driven model decay

[Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-learning-through-discernment-and-feedback-driven-d9ec4593)

Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by fine-tuning a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.

Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.

## Original source

arXiv cs.AI · Article

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.

- [Learning through Discernment: when a small language model learns from user feedback on the job, and when it decays](https://arxiv.org/abs/2611.23716)

## Limits

The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.


## Open question

What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?


## Source-stated

The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.

> fine-tuned each night on the attempts a judge accepts

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.

> kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.

> 80% of its lessons were failures the customer had thanked

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

Across 97 lives, the share of failed attempts among lessons predicted the outcome.

> Across 97 lives, the share of failed attempts among the lessons predicted the outcome

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.

> learning from users held up only where the judge kept failures out and the user could see the outcome

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The paper cautions that lopsided lessons may narrow the model.

> lopsided lessons may also narrow the model.

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source and contributor context

Kongsilp, Sirisilp · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

- [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.


## Revision and source-check history

### Version 1 — 2026-11-19T08:49:18.953Z

Sirisilp Kongsilp studies whether small language models can learn overnight from daily work by fine-tuning a LoRA adapter on attempts accepted by a judge. The problem is that neither the model’s own judgment nor a user’s reaction necessarily shows whether an attempt succeeded. In experiments on WebShop and τ²-bench, self-judging improved and then decayed. A judge that treated polite give-ups as success collapsed three of five lives. A version designed to check whether users gave a clear verdict kept four of five near the oracle for two weeks, then faded to self-judging’s level by day 60. When users could not see the outcome, the feedback sense read reactions correctly, but 80% of its lessons were failed attempts that customers had thanked. Across 97 lives, the share of failed attempts among lessons predicted the outcome. Kongsilp’s conclusion is conditional: in these experiments, learning from users held up only when the judge kept failures out and users could see the outcome. The paper also warns that lopsided lessons may narrow the model. The findings place the quality and balance of feedback at the center of whether learning from daily work lasts; a positive user reaction is not necessarily evidence of success.

## Original source

arXiv cs.AI · Article

Original source date: Nov 18, 2026 (2026-11-18).

Date basis: Date basis not provided.

Added to Escape Meridian: 2026-11-19T08:49:18.953Z. First observed: 2026-11-19T05:01:28.713Z. Retrieved: 2026-11-19T08:48:19.221Z.

- [Learning through Discernment: when a small language model learns from user feedback on the job, and when it decays](https://arxiv.org/abs/2611.23716)

## Limits

The reported experiments use Qwen3 0.6B and 1.7B with a LoRA adapter on WebShop and τ²-bench; the abstract does not establish how the results generalize beyond these settings. The abstract says lopsided lessons may narrow the model, but does not specify the extent or conditions of that effect.


## Open question

What conditions, if any, would keep a discernment-based feedback sense from fading after two weeks when lessons are clean but scarce?


## Source-stated

The paper studies small language models fine-tuned overnight on attempts accepted by a judge, comparing different sources of feedback.

> fine-tuned each night on the attempts a judge accepts

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The discernment version kept four of five lives near the oracle for two weeks, then faded to self-judging’s level by day 60.

> kept 4 of 5 near the oracle for two weeks, then faded on clean but scarce lessons, to the level of self-judging by day 60.

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

When users could not see the outcome, 80% of lessons were failed attempts that customers had thanked.

> 80% of its lessons were failures the customer had thanked

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

Across 97 lives, the share of failed attempts among lessons predicted the outcome.

> Across 97 lives, the share of failed attempts among the lessons predicted the outcome

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The authors say user-feedback learning held up only when the judge excluded failures and users could see the outcome.

> learning from users held up only where the judge kept failures out and the user could see the outcome

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source-stated

The paper cautions that lopsided lessons may narrow the model.

> lopsided lessons may also narrow the model.

- [Supporting source](https://arxiv.org/abs/2611.23716)

## Source and contributor context

Kongsilp, Sirisilp · Article author

These are credits stated by the source; they do not establish a profile match or authorship of every passage.


## Source media

No suitable media was found by the supported page extraction.


## Terms and references

Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.


## Fine-tuning

Further training of an existing model to adapt it to a particular task or use.

- [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning)

## arXiv

arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.

- [Explore this context](/entities/arxiv)
- [Reference](https://arxiv.org/)
- [Reference](https://info.arxiv.org/help/api/index.html)

## Editorial provenance

Version 1. Publication ID: 9755b844-66d5-48d8-85a1-c004a373442b.

Prepared by gpt-6-luna; grounding review by gpt-6-luna.

Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-19T08:49:18.953Z. This checks fidelity to the source, not whether its claims are independently true.

Editorial selection: accept; reasons: material\_development.

Observation: 2a533d8000c930a3fb6ff81630c0ac8fe8649778deb02d0a4cda74f1c434f17c. Source text hash: df9d8da5f253621956fca5925558daae0976a5104feb8d593d75ad6f9f36492d.


### uncertain — 2026-11-19T08:49:18.953Z — anthropic/claude-opus-5.5

Publication: 9755b844-66d5-48d8-85a1-c004a373442b

attribution — pass: The summary correctly attributes the study and its conditional conclusion to the paper's sole author, Sirisilp Kongsilp, as published on arXiv. One claim says "The authors say," which is slightly inaccurate for a single-author paper but does not change who is responsible for the claim. Smallest repair: change it to "The author says."

> Authors:Sirisilp Kongsilp

summary — uncertain: The summary is faithful to the abstract, but several central paper-specific terms are left unexplained for a non-specialist. It never says that "lives" means simulated deployment runs of up to a year, or that the "oracle" is the true outcome. It also uses "the feedback sense" without introducing it as a separate, frozen component that reads the user's reaction. WebShop and τ²-bench are not identified as test environments, and LoRA has no tooltip. Smallest repair: briefly define lives, oracle and feedback sense, and add term-library entries for LoRA, WebShop and τ²-bench.

> over 127 lives of up to a year on WebShop and $\\tau^2$-bench

date — pass: The originalPublished date of 2026-11-18 matches the arXiv v1 submission date. The feed date of 2026-11-19 was correctly not used.

> \[Submitted on 18 Nov 2026\]

support — pass: Each figure and condition in the summary matches the abstract: the self-judging decay, 3 of 5 collapses, 4 of 5 near the oracle for two weeks, fading by day 60, 80% thanked failures, 97 lives, and the conditional conclusion. The closing point, that a positive user reaction is not necessarily evidence of success, is supported by the thanked-failure finding. The question asks about a gap the source itself raises. The summary omits the reported correlation value, but this does not distort the meaning.

> the sense read reactions correctly, yet 80% of its lessons were failures the customer had thanked

media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.

## Recorded references

Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter.

No public references recorded here yet.

[Reference data (JSON)](/readings/d9ec45937f7066792d895d5f7c1ec2e6258532b4179e25e506cec4b70f50241e/references.json)

## Corrections and challenges

[Send a correction or an opposing source](https://escapemeridian.com/corrections/)

[JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-learning-through-discernment-and-feedback-driven-d9ec4593.json)
