Frey, Christian M. M. · Nov 5, 2026
arXiv cs.AI: When, Where, How: Active In-Context Learning for Tabular Foundation Models
Markdown · JSON · Original source
Christian M. M. Frey studies how to choose which data rows to label when adapting Tabular (TFMs), which learn a new task from labeled rows in their context. Because obtaining high-quality labels requires specific domain knowledge, choosing rows well could reduce the labeling needed. The paper compares Active in-context learning methods, including diversity-based selection, Target-Aware Nearest Neighbor (TANN), and Expected Predictive Information Gain in Context (EPIC), against classical rules. Across twenty , two TFMs, and classical GBDTs, Frey reports that diversity works best in the first acquisition iterations, while selecting pool rows relevant to the target inputs matters substantially. EPIC yields the best models at the label budget in the study. On the eight benchmarks with the largest pools, it retains on average 80–87% of chance-corrected full-data performance using 5–10% of the pool labeled. The selected labels also improve the predictive performance of gradient-boosted decision trees. These results suggest a way to make limited labeling effort more useful, but the abstract reports benchmark results, not how the methods perform in a particular real-world task.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T04:18:37.371Z. First observed: 2026-11-06T05:03:31.118Z. Retrieved: 2026-11-08T04:17:34.774Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The evidence provides the abstract, not the paper's full methods or results; it does not identify the or describe their domains. The reported 80–87% average applies to the eight benchmarks with the largest pools, not necessarily to other benchmarks or real-world tasks.
Open question
Do these findings hold beyond the twenty and two TFMs studied?
Source-stated
Frey studies acquisition methods for adapting Tabular Foundation Models, which use labeled rows in their context to adapt to a new task.
Tabular Foundation Models (TFMs) adapt to a new task only through the labeled rows in their context.
Source-stated
The study evaluates acquisition methods across twenty benchmarks, using two TFMs and classical GBDTs.
Our study across twenty benchmarks with two well-established TFMs and classical GBDTs
Source-stated
Frey reports that diversity-based acquisition works best during the first acquisition iterations.
When: diversity-based acquisition is best during the first acquisition iterations;
Source-stated
The paper reports that selecting pool rows that serve the target inputs using TANN matters substantially.
Where: labeling pool rows that serve the target inputs via a simple target-aware nearest-neighbor rule matters substantially;
Source-stated
The paper reports that EPIC yields the best models at the label budget and retains on average 80–87% of chance-corrected full-data performance with 5–10% of the pool labeled on the eight benchmarks with the largest pools.
EPIC yields the best models at the label budget, retains on average 80--87% of the chance-corrected full-data performance with only 5-10% of the pool labeled on the eight benchmarks with the largest pools
Source-stated
The paper reports that labels selected by EPIC also improve the predictive performance of gradient-boosted decision trees.
selects labels that also improve the predictive performance of gradient-boosted decision trees.
Source and contributor context
Frey, Christian M. M. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Foundation model
A large model trained on broad data that can be adapted to many different tasks.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: bf1cf446-30fd-424e-846b-40f90ec9419b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-08T04:18:37.371Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 39160a28b9c6faa87182c237350e46ad13526dd04eff56cfff777df97954055c. Source text hash: 497d819a293f4df091394f21a4a94c205740b0db2a3fed535067da9dd4c69c76.
Revision and source-check history
Version 1 · 2026-11-08T04:18:37.371Z
arXiv cs.AI: When, Where, How: Active In-Context Learning for Tabular Foundation Models
Christian M. M. Frey studies how to choose which data rows to label when adapting Tabular (TFMs), which learn a new task from labeled rows in their context. Because obtaining high-quality labels requires specific domain knowledge, choosing rows well could reduce the labeling needed. The paper compares Active in-context learning methods, including diversity-based selection, Target-Aware Nearest Neighbor (TANN), and Expected Predictive Information Gain in Context (EPIC), against classical rules. Across twenty , two TFMs, and classical GBDTs, Frey reports that diversity works best in the first acquisition iterations, while selecting pool rows relevant to the target inputs matters substantially. EPIC yields the best models at the label budget in the study. On the eight benchmarks with the largest pools, it retains on average 80–87% of chance-corrected full-data performance using 5–10% of the pool labeled. The selected labels also improve the predictive performance of gradient-boosted decision trees. These results suggest a way to make limited labeling effort more useful, but the abstract reports benchmark results, not how the methods perform in a particular real-world task.
Original source
cs.AI · Article
Source details
Original source date: Nov 5, 2026 (2026-11-05).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-08T04:18:37.371Z. First observed: 2026-11-06T05:03:31.118Z. Retrieved: 2026-11-08T04:17:34.774Z.
Limits
The evidence provides the abstract, not the paper's full methods or results; it does not identify the or describe their domains. The reported 80–87% average applies to the eight benchmarks with the largest pools, not necessarily to other benchmarks or real-world tasks.
Open question
Do these findings hold beyond the twenty and two TFMs studied?
Source-stated
Frey studies acquisition methods for adapting Tabular Foundation Models, which use labeled rows in their context to adapt to a new task.
Tabular Foundation Models (TFMs) adapt to a new task only through the labeled rows in their context.
Source-stated
The study evaluates acquisition methods across twenty benchmarks, using two TFMs and classical GBDTs.
Our study across twenty benchmarks with two well-established TFMs and classical GBDTs
Source-stated
Frey reports that diversity-based acquisition works best during the first acquisition iterations.
When: diversity-based acquisition is best during the first acquisition iterations;
Source-stated
The paper reports that selecting pool rows that serve the target inputs using TANN matters substantially.
Where: labeling pool rows that serve the target inputs via a simple target-aware nearest-neighbor rule matters substantially;
Source-stated
The paper reports that EPIC yields the best models at the label budget and retains on average 80–87% of chance-corrected full-data performance with 5–10% of the pool labeled on the eight benchmarks with the largest pools.
EPIC yields the best models at the label budget, retains on average 80--87% of the chance-corrected full-data performance with only 5-10% of the pool labeled on the eight benchmarks with the largest pools
Source-stated
The paper reports that labels selected by EPIC also improve the predictive performance of gradient-boosted decision trees.
selects labels that also improve the predictive performance of gradient-boosted decision trees.
Source and contributor context
Frey, Christian M. M. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Foundation model
A large model trained on broad data that can be adapted to many different tasks.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: bf1cf446-30fd-424e-846b-40f90ec9419b.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: passed by anthropic/claude-opus-5.5 on 2026-11-08T04:18:37.371Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 39160a28b9c6faa87182c237350e46ad13526dd04eff56cfff777df97954055c. Source text hash: 497d819a293f4df091394f21a4a94c205740b0db2a3fed535067da9dd4c69c76.
passed · 2026-11-08T04:18:37.371Z · anthropic/claude-opus-5.5
Publication: bf1cf446-30fd-424e-846b-40f90ec9419b
attribution — pass: The reading correctly attributes the study to Christian M. M. Frey, the sole listed author, and keeps findings framed as what the paper reports. The arXiv cs.AI title prefix matches the listed publisher.
Authors:Christian M. M. Frey
summary — pass: The title, summary and question match the abstract. It explains what TFMs are and why label choice matters, then gives the When/Where/How findings with their scope (twenty benchmarks, two TFMs, GBDTs; the 80–87% figure limited to the eight largest-pool benchmarks). Terms such as label budget and chance-corrected performance stay exact and are readable. Grouping diversity-based selection with the new methods slightly blurs which rules are classical, but this does not change the meaning. The question follows directly from the stated scope.
We ask how the value of diversity, predictive uncertainty and target-aware information gain changes as a frozen TFM acquires more context.
date — pass: originalPublished is 2026-11-05. This matches the v1 submission date on arXiv; the feed entry on Nov 6 came later.
[Submitted on 5 Nov 2026]
support — pass: Every claim is backed by a verbatim abstract excerpt. The significance line is suitably hedged ('suggest a way'): it rests on the abstract's point that labels are expensive, and it explicitly says the results come from benchmarks rather than real-world deployment. It does not inflate scores into proof of reliability.
labels are expensive to acquire in real-world scenarios due to the need for highly specific domain knowledge to ensure high-quality data
media — pass: The selected media is the verified direct link to the arXiv abstract page. That is the original source and the easiest way for a reader to reach it.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A large model trained on broad data that can be adapted to many different tasks.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA large model trained on broad data that can be adapted to many different tasks.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition reference