{"id":"eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa","title":"arXiv cs.AI: A Full-Ledger Counterfactual Audit of Adaptive Reasoning","argument":"Xiaopeng Chu, Wenzheng Kong, Wei Liu, and Wenyi Zhang introduce the Full-Ledger Counterfactual Value Audit (FLCVA) to assess when additional reasoning helps, rather than treating a prediction that an answer is wrong as proof that more compute will improve it. FLCVA compares an immediate answer with four fixed-length continuations from the same frozen prefix, using one answer procedure and accounting for every signal’s cost. On GSM8K and MATH-500, a random 256-token continuation corrected some wrong answers but also damaged some correct ones. The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models. In offline replay, using those labels to allocate compute improved performance on DeepSeek-R1-Distill-Qwen-7B; the gain on Qwen3-8B remained inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut. The audit separates measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation. The reported evidence comes from GSM8K and MATH-500 and includes a Llama-8B replication and action/cost ablations, whose results are not detailed in the abstract.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence supplied is the arXiv abstract, not the paper’s full methods or results; the abstract does not detail the Llama-8B replication or action/cost ablations. The reported compute-allocation result is from offline replay; the abstract reports an inconclusive Qwen3 gain and does not establish performance outside the described evaluation.","speaker":{"name":"Chu, Xiaopeng, Kong, Wenzheng, Liu, Wei, Zhang, Wenyi","roleAtSource":"Article author"},"source":{"title":"A Full-Ledger Counterfactual Audit of Adaptive Reasoning","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.22778","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce FLCVA to assess continuation value while accounting for the costs of signals used by a policy.","excerpt":"We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"On GSM8K and MATH-500, random 256-token continuations sometimes corrected wrong answers and sometimes damaged correct answers in the two named models.","excerpt":"a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models.","excerpt":"Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"In offline replay, label-based compute allocation improved performance on DeepSeek, while the Qwen3 gain was inconclusive.","excerpt":"In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"With full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut.","excerpt":"Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"The audit distinguishes measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation.","excerpt":"FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22778","checkedAt":"2026-11-18T16:52:10.190Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would resolve whether using correctness labels to allocate compute improves performance on Qwen3-8B?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: A Full-Ledger Counterfactual Audit of Adaptive Reasoning","summary":"Xiaopeng Chu, Wenzheng Kong, Wei Liu, and Wenyi Zhang introduce the Full-Ledger Counterfactual Value Audit (FLCVA) to assess when additional reasoning helps, rather than treating a prediction that an answer is wrong as proof that more compute will improve it. FLCVA compares an immediate answer with four fixed-length continuations from the same frozen prefix, using one answer procedure and accounting for every signal’s cost. On GSM8K and MATH-500, a random 256-token continuation corrected some wrong answers but also damaged some correct ones. The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models. In offline replay, using those labels to allocate compute improved performance on DeepSeek-R1-Distill-Qwen-7B; the gain on Qwen3-8B remained inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut. The audit separates measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation. The reported evidence comes from GSM8K and MATH-500 and includes a Llama-8B replication and action/cost ablations, whose results are not detailed in the abstract.","question":"What evidence would resolve whether using correctness labels to allocate compute improves performance on Qwen3-8B?","claims":[{"text":"The authors introduce FLCVA to assess continuation value while accounting for the costs of signals used by a policy.","excerpt":"We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy.","support":"source-stated"},{"text":"On GSM8K and MATH-500, random 256-token continuations sometimes corrected wrong answers and sometimes damaged correct answers in the two named models.","excerpt":"a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%.","support":"source-stated"},{"text":"The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models.","excerpt":"Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models.","support":"source-stated"},{"text":"In offline replay, label-based compute allocation improved performance on DeepSeek, while the Qwen3 gain was inconclusive.","excerpt":"In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive.","support":"source-stated"},{"text":"With full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut.","excerpt":"Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut.","support":"source-stated"},{"text":"The audit distinguishes measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation.","excerpt":"FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.","support":"source-stated"}],"limitations":["The evidence supplied is the arXiv abstract, not the paper’s full methods or results; the abstract does not detail the Llama-8B replication or action/cost ablations.","The reported compute-allocation result is from offline replay; the abstract reports an inconclusive Qwen3 gain and does not establish performance outside the described evaluation."],"mediaId":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","correctionReason":null,"id":"eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa","publicationId":"ae477e2e-8512-44bb-8b47-d7d2d2f81634","version":1,"sourceUrl":"https://arxiv.org/abs/2611.22778","sourceTitle":"A Full-Ledger Counterfactual Audit of Adaptive Reasoning","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:07:03.863Z","createdAt":"2026-11-18T15:49:54.590Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","kind":"article","url":"https://arxiv.org/abs/2611.22778","sourceUrl":"https://arxiv.org/abs/2611.22778","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:48:59.007Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22778","checkedAt":"2026-11-18T16:52:10.190Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","confidence":0.56,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e54e5d701493e945de836d21bc6d17b7b24accac41fd6671accfe3f2de8f6e5a","decidedAt":"2026-11-18T15:49:00.985Z"},"provenance":{"textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observationId":"4c410c38a50d33df2f78b2f9bdf83e6e9f9b6321006117222062c104ac4adc60","retrievedAt":"2026-11-18T15:48:58.709Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"4c5b3306-ead7-4dbc-8cc6-0deb23614a16"},"reviewer":{"model":"gpt-6-luna","runId":"c07fee81-69d8-4025-8ed3-3dff20e207a0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:49:54.590Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Chu, Xiaopeng","url":null,"kind":"unknown"},{"name":"Kong, Wenzheng","url":null,"kind":"unknown"},{"name":"Liu, Wei","url":null,"kind":"unknown"},{"name":"Zhang, Wenyi","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Chu, Xiaopeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chu, Xiaopeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Kong, Wenzheng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kong, Wenzheng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Liu, Wei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Wei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Zhang, Wenyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Wenyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.22778","snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-a-full-ledger-counterfactual-audit-of-adaptive-eaa0ab41","formats":{"html":"/readings/arxiv-cs-ai-a-full-ledger-counterfactual-audit-of-adaptive-eaa0ab41","markdown":"/readings/arxiv-cs-ai-a-full-ledger-counterfactual-audit-of-adaptive-eaa0ab41.md","json":"/readings/arxiv-cs-ai-a-full-ledger-counterfactual-audit-of-adaptive-eaa0ab41.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"conditions":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-counterfactual","name":"Counterfactual","explanation":"An argument or scenario that considers what would have resulted if events had gone differently from how they actually did, such as if a policy had never been adopted; as an adjective, relating to this kind of thinking about what did not happen but could have.","referenceUrl":"https://dictionary.cambridge.org/dictionary/english/counterfactual"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa","revision":"ae477e2e-8512-44bb-8b47-d7d2d2f81634","revisionKind":"publication-id","title":"arXiv cs.AI: A Full-Ledger Counterfactual Audit of Adaptive Reasoning","url":"https://escapemeridian.com/readings/arxiv-cs-ai-a-full-ledger-counterfactual-audit-of-adaptive-eaa0ab41"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.22778","revision":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","revisionKind":"sha256-source-text","title":"A Full-Ledger Counterfactual Audit of Adaptive Reasoning","url":"https://arxiv.org/abs/2611.22778"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings to this reading. Shared topics are not citations. Other record types need an explicit reference adapter."},"revisions":[{"id":"eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa","title":"arXiv cs.AI: A Full-Ledger Counterfactual Audit of Adaptive Reasoning","argument":"Xiaopeng Chu, Wenzheng Kong, Wei Liu, and Wenyi Zhang introduce the Full-Ledger Counterfactual Value Audit (FLCVA) to assess when additional reasoning helps, rather than treating a prediction that an answer is wrong as proof that more compute will improve it. FLCVA compares an immediate answer with four fixed-length continuations from the same frozen prefix, using one answer procedure and accounting for every signal’s cost. On GSM8K and MATH-500, a random 256-token continuation corrected some wrong answers but also damaged some correct ones. The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models. In offline replay, using those labels to allocate compute improved performance on DeepSeek-R1-Distill-Qwen-7B; the gain on Qwen3-8B remained inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut. The audit separates measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation. The reported evidence comes from GSM8K and MATH-500 and includes a Llama-8B replication and action/cost ablations, whose results are not detailed in the abstract.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The evidence supplied is the arXiv abstract, not the paper’s full methods or results; the abstract does not detail the Llama-8B replication or action/cost ablations. The reported compute-allocation result is from offline replay; the abstract reports an inconclusive Qwen3 gain and does not establish performance outside the described evaluation.","speaker":{"name":"Chu, Xiaopeng, Kong, Wenzheng, Liu, Wei, Zhang, Wenyi","roleAtSource":"Article author"},"source":{"title":"A Full-Ledger Counterfactual Audit of Adaptive Reasoning","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.22778","publishedAt":"2026-11-17","dateBasis":"Date basis not provided."},"evidence":[{"text":"The authors introduce FLCVA to assess continuation value while accounting for the costs of signals used by a policy.","excerpt":"We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"On GSM8K and MATH-500, random 256-token continuations sometimes corrected wrong answers and sometimes damaged correct answers in the two named models.","excerpt":"a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models.","excerpt":"Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"In offline replay, label-based compute allocation improved performance on DeepSeek, while the Qwen3 gain was inconclusive.","excerpt":"In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"With full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut.","excerpt":"Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"},{"text":"The audit distinguishes measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation.","excerpt":"FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.","url":"https://arxiv.org/abs/2611.22778","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22778","checkedAt":"2026-11-18T16:52:10.190Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"What evidence would resolve whether using correctness labels to allocate compute improves performance on Qwen3-8B?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: A Full-Ledger Counterfactual Audit of Adaptive Reasoning","summary":"Xiaopeng Chu, Wenzheng Kong, Wei Liu, and Wenyi Zhang introduce the Full-Ledger Counterfactual Value Audit (FLCVA) to assess when additional reasoning helps, rather than treating a prediction that an answer is wrong as proof that more compute will improve it. FLCVA compares an immediate answer with four fixed-length continuations from the same frozen prefix, using one answer procedure and accounting for every signal’s cost. On GSM8K and MATH-500, a random 256-token continuation corrected some wrong answers but also damaged some correct ones. The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models. In offline replay, using those labels to allocate compute improved performance on DeepSeek-R1-Distill-Qwen-7B; the gain on Qwen3-8B remained inconclusive. Under full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut. The audit separates measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation. The reported evidence comes from GSM8K and MATH-500 and includes a Llama-8B replication and action/cost ablations, whose results are not detailed in the abstract.","question":"What evidence would resolve whether using correctness labels to allocate compute improves performance on Qwen3-8B?","claims":[{"text":"The authors introduce FLCVA to assess continuation value while accounting for the costs of signals used by a policy.","excerpt":"We introduce the Full-Ledger Counterfactual Value Audit (FLCVA), which compares an immediate answer with four fixed-length continuations from the same frozen prefix under one answer procedure and accounts for the cost of every signal used by a policy.","support":"source-stated"},{"text":"On GSM8K and MATH-500, random 256-token continuations sometimes corrected wrong answers and sometimes damaged correct answers in the two named models.","excerpt":"a random 256-token continuation recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%.","support":"source-stated"},{"text":"The authors report that correctness labels from independently sampled continuations predicted a separate continuation’s outcome in both primary models.","excerpt":"Correctness labels from independently sampled continuations predict a separate continuation's outcome in both primary models.","support":"source-stated"},{"text":"In offline replay, label-based compute allocation improved performance on DeepSeek, while the Qwen3 gain was inconclusive.","excerpt":"In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive.","support":"source-stated"},{"text":"With full cost accounting, the tested lightweight, myopic controllers mainly recognized current errors and added little continuation-specific value beyond that shortcut.","excerpt":"Under full cost accounting, the tested lightweight, myopic controllers mainly recognize current errors and add little continuation-specific value beyond that shortcut.","support":"source-stated"},{"text":"The audit distinguishes measuring local continuation value, predicting it from observable signals, and using predictions to allocate computation.","excerpt":"FLCVA separates measuring local continuation value, predicting it from observable signals, and using those predictions to allocate computation.","support":"source-stated"}],"limitations":["The evidence supplied is the arXiv abstract, not the paper’s full methods or results; the abstract does not detail the Llama-8B replication or action/cost ablations.","The reported compute-allocation result is from offline replay; the abstract reports an inconclusive Qwen3 gain and does not establish performance outside the described evaluation."],"mediaId":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","correctionReason":null,"id":"eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa","publicationId":"ae477e2e-8512-44bb-8b47-d7d2d2f81634","version":1,"sourceUrl":"https://arxiv.org/abs/2611.22778","sourceTitle":"A Full-Ledger Counterfactual Audit of Adaptive Reasoning","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-17","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-18T05:07:03.863Z","createdAt":"2026-11-18T15:49:54.590Z","historical":false,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","kind":"article","url":"https://arxiv.org/abs/2611.22778","sourceUrl":"https://arxiv.org/abs/2611.22778","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-18T15:48:59.007Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.22778","checkedAt":"2026-11-18T16:52:10.190Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v9","mediaId":"231c72efff9588dbe331f533de478ee87bfc2276b908af371461752bf2cf3cf8","confidence":0.56,"provider":"typesafe","model":"jev-1.13.0","inputHash":"e54e5d701493e945de836d21bc6d17b7b24accac41fd6671accfe3f2de8f6e5a","decidedAt":"2026-11-18T15:49:00.985Z"},"provenance":{"textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observationId":"4c410c38a50d33df2f78b2f9bdf83e6e9f9b6321006117222062c104ac4adc60","retrievedAt":"2026-11-18T15:48:58.709Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"4c5b3306-ead7-4dbc-8cc6-0deb23614a16"},"reviewer":{"model":"gpt-6-luna","runId":"c07fee81-69d8-4025-8ed3-3dff20e207a0"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-18T15:49:54.590Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Chu, Xiaopeng","url":null,"kind":"unknown"},{"name":"Kong, Wenzheng","url":null,"kind":"unknown"},{"name":"Liu, Wei","url":null,"kind":"unknown"},{"name":"Zhang, Wenyi","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Chu, Xiaopeng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Chu, Xiaopeng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Kong, Wenzheng","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Kong, Wenzheng","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:1","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Liu, Wei","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Liu, Wei","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:2","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}},{"actor":{"name":"Zhang, Wenyi","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Zhang, Wenyi","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.22778","locator":"head/meta[name=author|citation_author]"},"assertionId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be:participation:3","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-18T16:52:10.190Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","sourceUrl":"https://arxiv.org/abs/2611.22778","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z"}}],"participationCoverage":{"total":4,"returned":4,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.22778","snapshotId":"1435e0a40e49107fbc9af076cc935fc5eecea0d2e548de4eca295d5bdc24f3be","contentSha256":"b4f5e30a50780e1fd4b99fcc9acffa990e542d5a355350939633ec69a6bb8b53","textHash":"b505957daf1afd3f9aca7342126e3047b8167276f3b097cde9508b1ad1668041","observedAt":"2026-11-18T16:52:10.190Z","basis":"publisher-page-metadata","sourceLinks":43,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/eaa0ab41da01937773c9ab17ece8cf7836a6a290163246082295891437dcedfa/source"}}}],"audits":[{"publicationId":"ae477e2e-8512-44bb-8b47-d7d2d2f81634","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The reading correctly attributes FLCVA and all findings to the four listed arXiv authors. It keeps the results as reported claims, for example with 'The authors report', rather than stating them as established facts.","excerpt":"Authors:Xiaopeng Chu, Wenzheng Kong, Wei Liu, Wenyi Zhang"},{"dimension":"summary","status":"uncertain","explanation":"The reading is faithful but hard for a non-specialist to follow. Central terms are left unexplained: frozen prefix, fixed-length continuation, offline replay, myopic controllers, correctness labels, GSM8K/MATH-500. It also never states plainly why this matters for AI that 'thinks longer'. Saying a continuation 'corrected some wrong answers but also damaged some correct ones' erases the source's asymmetry (26.6%/18.9% recovered vs 1.4%/1.9% damaged). Smallest repairs: restore those percentages; add tooltips or brief glosses for the central terms; state the core point plainly. That point is that the tested controllers mostly detect a wrong current answer, not whether more reasoning will help.","excerpt":"recovers a wrong answer in 26.6% of Qwen3-8B cases and 18.9% of DeepSeek-R1-Distill-Qwen-7B cases, while damaging a correct answer in 1.4% and 1.9%"},{"dimension":"date","status":"pass","explanation":"originalPublished 2026-11-17 matches the arXiv v1 submission date. It is not the later feed date of 2026-11-18.","excerpt":"[Submitted on 17 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Every claim matches an exact abstract excerpt. The limitations correctly note offline replay and the inconclusive Qwen3 result, and that the Llama-8B and ablation details are absent. No benefits, costs or forecasts are invented. The question follows directly from the inconclusive Qwen3 gain.","excerpt":"In offline replay, using these labels to allocate compute improves performance on DeepSeek; the Qwen3 gain remains inconclusive."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct arXiv abstract page for this paper. It is the most direct way to reach the source.","excerpt":null}],"createdAt":"2026-11-18T15:49:54.590Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}