Polas, Ismail Hossain · Nov 6, 2026
arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs
Markdown · JSON · Original source
In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier ’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 6, 2026 (2026-11-06).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T01:49:02.277Z. First observed: 2026-11-11T05:04:08.080Z. Retrieved: 2026-11-12T01:48:10.312Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there.
Open question
Would the reported EMP gains hold on data from independent telecom operators?
Source-stated
Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.
We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.
Source-stated
TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.
TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)
Source-stated
TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.
On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).
Source-stated
The evaluation's resampled splits do not establish performance across independent operators.
The splits resample the same datasets, so these results do not stand for independent operators.
Source-stated
TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.
TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.
Source-stated
Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.
The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.
Source and contributor context
Polas, Ismail Hossain · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Foundation model
A large model trained on broad data that can be adapted to many different tasks.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: e92018db-e857-4908-8857-86f75697e270.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T01:49:02.277Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e. Source text hash: b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf.
Revision and source-check history
Version 1 · 2026-11-12T01:49:02.277Z
arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs
In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier ’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.
Original source
cs.AI · Article
Source details
Original source date: Nov 6, 2026 (2026-11-06).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-12T01:49:02.277Z. First observed: 2026-11-11T05:04:08.080Z. Retrieved: 2026-11-12T01:48:10.312Z.
Limits
The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there.
Open question
Would the reported EMP gains hold on data from independent telecom operators?
Source-stated
Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.
We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.
Source-stated
TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.
TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)
Source-stated
TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.
On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).
Source-stated
The evaluation's resampled splits do not establish performance across independent operators.
The splits resample the same datasets, so these results do not stand for independent operators.
Source-stated
TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.
TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.
Source-stated
Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.
The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.
Source and contributor context
Polas, Ismail Hossain · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Foundation model
A large model trained on broad data that can be adapted to many different tasks.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: e92018db-e857-4908-8857-86f75697e270.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T01:49:02.277Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e. Source text hash: b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf.
uncertain · 2026-11-12T01:49:02.277Z · anthropic/claude-opus-5.5
Publication: e92018db-e857-4908-8857-86f75697e270
attribution — pass: The paper, its findings and the licence remark are correctly attributed to the sole listed author, Ismail Hossain Polas, on arXiv cs.AI. The phrase 'his paper' assumes a gender the source does not state. A neutral 'In a paper' would avoid the assumption, but this does not misattribute any claim.
Authors:Ismail Hossain Polas
summary — uncertain: The facts track the abstract, but a non-specialist would struggle with central terms. Churn, TFMs, GBDTs, Optuna-tuned, calibration, EMP, PR-AUC, splits and the statistical correction are named but never explained. The summary also cites 'the earlier benchmark' without introducing it. It omits the key context that this benchmark compared TFMs against untuned GBDTs and scored only ranking metrics, which is the reason the paper exists. Smallest repair: add one sentence on that benchmark's setup and plain-language glosses or tooltips for churn, EMP and PR-AUC.
A recent benchmark reported that they decisively outperform tree ensembles for customer churn, but it compared them with untuned gradient-boosted trees (GBDTs) and scored only ranking metrics
date — pass: originalPublished is 2026-11-06, which matches the arXiv v1 submission date. The 2026-11-11 feed date is correctly not used.
[Submitted on 6 Nov 2026]
support — pass: Each claim and its figures (1.9%, 7.6%, 14.3%, Holm p = 0.155) match the abstract. These cover TabPFN-3.5's EMP gains, the non-significant result on Orange, the warning about resampled splits, TabICL v2's results, the narrowed PR-AUC gap and the licence barrier. The draft keeps the significance qualifiers and the limits on generalization. Its question about independent operators follows directly from the source's own caveat, and the draft implies no benefits beyond what the source states.
The splits resample the same datasets, so these results do not stand for independent operators.
media — pass: The selected media is the verified direct link to the arXiv abstract page, which is the original source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A large model trained on broad data that can be adapted to many different tasks.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA large model trained on broad data that can be adapted to many different tasks.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv