# arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf) In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T01:49:02.277Z. First observed: 2026-11-11T05:04:08.080Z. Retrieved: 2026-11-12T01:48:10.312Z. - [Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation](https://arxiv.org/abs/2611.12942) ## Limits The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there. ## Open question Would the reported EMP gains hold on data from independent telecom operators? ## Source-stated Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy. > We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%. > TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%) - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction. > On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155). - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated The evaluation's resampled splits do not establish performance across independent operators. > The splits resample the same datasets, so these results do not stand for independent operators. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange. > TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains. > The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source and contributor context Polas, Ismail Hossain · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Foundation model A large model trained on broad data that can be adapted to many different tasks. - [Definition reference](https://developers.google.com/machine-learning/glossary#foundation-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: e92018db-e857-4908-8857-86f75697e270. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T01:49:02.277Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e. Source text hash: b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf. ## Revision and source-check history ### Version 1 — 2026-11-12T01:49:02.277Z In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use. ## Original source arXiv cs.AI · Article Original source date: Nov 6, 2026 (2026-11-06). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T01:49:02.277Z. First observed: 2026-11-11T05:04:08.080Z. Retrieved: 2026-11-12T01:48:10.312Z. - [Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation](https://arxiv.org/abs/2611.12942) ## Limits The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there. ## Open question Would the reported EMP gains hold on data from independent telecom operators? ## Source-stated Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy. > We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%. > TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%) - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction. > On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155). - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated The evaluation's resampled splits do not establish performance across independent operators. > The splits resample the same datasets, so these results do not stand for independent operators. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange. > TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source-stated Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains. > The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use. - [Supporting source](https://arxiv.org/abs/2611.12942) ## Source and contributor context Polas, Ismail Hossain · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Foundation model A large model trained on broad data that can be adapted to many different tasks. - [Definition reference](https://developers.google.com/machine-learning/glossary#foundation-model) ## Benchmark A defined set of tests used to compare systems. Results depend on the tasks and measures selected. - [Definition reference](https://arxiv.org/abs/2211.09110) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: e92018db-e857-4908-8857-86f75697e270. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T01:49:02.277Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: 16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e. Source text hash: b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf. ### uncertain — 2026-11-12T01:49:02.277Z — anthropic/claude-opus-5.5 Publication: e92018db-e857-4908-8857-86f75697e270 attribution — pass: The paper, its findings and the licence remark are correctly attributed to the sole listed author, Ismail Hossain Polas, on arXiv cs.AI. The phrase 'his paper' assumes a gender the source does not state. A neutral 'In a paper' would avoid the assumption, but this does not misattribute any claim. > Authors:Ismail Hossain Polas summary — uncertain: The facts track the abstract, but a non-specialist would struggle with central terms. Churn, TFMs, GBDTs, Optuna-tuned, calibration, EMP, PR-AUC, splits and the statistical correction are named but never explained. The summary also cites 'the earlier benchmark' without introducing it. It omits the key context that this benchmark compared TFMs against untuned GBDTs and scored only ranking metrics, which is the reason the paper exists. Smallest repair: add one sentence on that benchmark's setup and plain-language glosses or tooltips for churn, EMP and PR-AUC. > A recent benchmark reported that they decisively outperform tree ensembles for customer churn, but it compared them with untuned gradient-boosted trees (GBDTs) and scored only ranking metrics date — pass: originalPublished is 2026-11-06, which matches the arXiv v1 submission date. The 2026-11-11 feed date is correctly not used. > \[Submitted on 6 Nov 2026\] support — pass: Each claim and its figures (1.9%, 7.6%, 14.3%, Holm p = 0.155) match the abstract. These cover TabPFN-3.5's EMP gains, the non-significant result on Orange, the warning about resampled splits, TabICL v2's results, the narrowed PR-AUC gap and the licence barrier. The draft keeps the significance qualifiers and the limits on generalization. Its question about independent operators follows directly from the source's own caveat, and the draft implies no benefits beyond what the source states. > The splits resample the same datasets, so these results do not stand for independent operators. media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf.json)