{"id":"49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506","title":"arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs","argument":"In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there.","speaker":{"name":"Polas, Ismail Hossain","roleAtSource":"Article author"},"source":{"title":"Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.12942","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.","excerpt":"We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.","excerpt":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.","excerpt":"On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"The evaluation's resampled splits do not establish performance across independent operators.","excerpt":"The splits resample the same datasets, so these results do not stand for independent operators.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.","excerpt":"TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.","excerpt":"The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12942","checkedAt":"2026-11-12T03:56:11.388Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the reported EMP gains hold on data from independent telecom operators?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs","summary":"In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.","question":"Would the reported EMP gains hold on data from independent telecom operators?","claims":[{"text":"Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.","excerpt":"We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.","support":"source-stated"},{"text":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.","excerpt":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)","support":"source-stated"},{"text":"TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.","excerpt":"On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).","support":"source-stated"},{"text":"The evaluation's resampled splits do not establish performance across independent operators.","excerpt":"The splits resample the same datasets, so these results do not stand for independent operators.","support":"source-stated"},{"text":"TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.","excerpt":"TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.","support":"source-stated"},{"text":"Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.","excerpt":"The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.","support":"source-stated"}],"limitations":["The reported splits resample the same five datasets and, as the paper states, do not represent independent operators.","The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there."],"mediaId":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","correctionReason":null,"id":"49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506","publicationId":"e92018db-e857-4908-8857-86f75697e270","version":1,"sourceUrl":"https://arxiv.org/abs/2611.12942","sourceTitle":"Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:04:08.080Z","createdAt":"2026-11-12T01:49:02.277Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","kind":"article","url":"https://arxiv.org/abs/2611.12942","sourceUrl":"https://arxiv.org/abs/2611.12942","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T01:48:10.493Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12942","checkedAt":"2026-11-12T03:56:11.388Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","confidence":0.63,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0e1313411189e2b98bfe7b74f86a415231af522b38d0969501d814d684d07034","decidedAt":"2026-11-12T01:48:11.169Z"},"provenance":{"textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observationId":"16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e","retrievedAt":"2026-11-12T01:48:10.312Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"46cb703a-f234-4fa0-8cb8-b2a8c9b60a8c"},"reviewer":{"model":"gpt-6-luna","runId":"95e53bc7-7871-4a85-8b4d-50173ecdfd2f"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T01:49:02.277Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Polas, Ismail Hossain","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Polas, Ismail Hossain","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Polas, Ismail Hossain","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12942","locator":"head/meta[name=author|citation_author]"},"assertionId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T03:56:11.388Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034","sourceUrl":"https://arxiv.org/abs/2611.12942","contentSha256":"67f20d7373edcefbc458083a2e5af8cb935af75d3e42c81e0149703665dd73de","textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observedAt":"2026-11-12T03:56:11.388Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.12942","snapshotId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034","contentSha256":"67f20d7373edcefbc458083a2e5af8cb935af75d3e42c81e0149703665dd73de","textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observedAt":"2026-11-12T03:56:11.388Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506/source"}},"canonicalUrl":"https://escapemeridian.com/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf","formats":{"html":"/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf","markdown":"/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf.md","json":"/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf.json"},"attribution":"Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.","maintainedGuideLinks":[],"readerContext":{"version":"reader-context-v1","attribution":"Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.","terms":[{"id":"term-foundation-model","name":"Foundation model","explanation":"A large model trained on broad data that can be adapted to many different tasks.","referenceUrl":"https://developers.google.com/machine-learning/glossary#foundation-model"},{"id":"term-benchmark","name":"Benchmark","explanation":"A defined set of tests used to compare systems. Results depend on the tasks and measures selected.","referenceUrl":"https://arxiv.org/abs/2211.09110"}],"entities":[{"id":"arxiv","name":"arXiv","kind":"organization","context":"arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.","referenceUrls":["https://arxiv.org/","https://info.arxiv.org/help/api/index.html"],"path":"/entities/arxiv","json":"/entities/arxiv.json","markdown":"/entities/arxiv.md"}]},"researchQuestions":[],"withdrawn":false,"references":{"schemaVersion":1,"target":{"type":"reading","id":"49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506","revision":"e92018db-e857-4908-8857-86f75697e270","revisionKind":"publication-id","title":"arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs","url":"https://escapemeridian.com/readings/arxiv-cs-ai-polas-reports-conditional-profit-gains-for-tabpfn-3-49b39caf"},"source":{"type":"source","id":"https://arxiv.org/abs/2611.12942","revision":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","revisionKind":"sha256-source-text","title":"Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation","url":"https://arxiv.org/abs/2611.12942"},"status":"available","items":[],"next":null,"scope":"Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter."},"revisions":[{"id":"49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506","title":"arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs","argument":"In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.","topicIds":["intelligence-and-discovery"],"domain":"science","claimType":"attributed reading","limits":"The reported splits resample the same five datasets and, as the paper states, do not represent independent operators. The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there.","speaker":{"name":"Polas, Ismail Hossain","roleAtSource":"Article author"},"source":{"title":"Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation","publisher":"arXiv cs.AI","format":"Article","url":"https://arxiv.org/abs/2611.12942","publishedAt":"2026-11-06","dateBasis":"Date basis not provided."},"evidence":[{"text":"Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.","excerpt":"We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.","excerpt":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.","excerpt":"On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"The evaluation's resampled splits do not establish performance across independent operators.","excerpt":"The splits resample the same datasets, so these results do not stand for independent operators.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.","excerpt":"TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"},{"text":"Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.","excerpt":"The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.","url":"https://arxiv.org/abs/2611.12942","relationship":"Source-stated"}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12942","checkedAt":"2026-11-12T03:56:11.388Z","items":[],"note":"No suitable media was found by the supported page extraction."},"assumptions":[],"openQuestion":{"attribution":"Open question","text":"Would the reported EMP gains hold on data from independent telecom operators?"},"whatWouldChangeView":{"attribution":"Change condition not recorded","text":""},"editorialComparisons":[],"live":{"title":"arXiv cs.AI: Polas reports conditional profit gains for TabPFN-3.5 over tuned GBDTs","summary":"In his paper, Ismail Hossain Polas argues that churn-model comparisons should measure campaign profit and probability calibration, not ranking alone. He compares tabular foundation models (TFMs) with Optuna-tuned gradient-boosted trees (GBDTs) on five public telecom churn datasets. TabPFN-3.5 earns significantly more expected maximum profit (EMP) than the best tuned GBDT on Cell2Cell and Iranian; on Orange, it leads in every split, but its gain is not significant after correction. The results differ by dataset, and the paper cautions that its splits resample the same datasets rather than representing independent operators. The earlier benchmark’s leader, TabICL v2, beats the best tuned GBDT only on Iranian and underpredicts Orange churn. Retuning the baseline narrows the earlier reported PR-AUC gap but does not close it. Polas says the licence of the TabPFN-3.5 weights used, rather than scoring cost, stands between the reported gains and production use.","question":"Would the reported EMP gains hold on data from independent telecom operators?","claims":[{"text":"Polas evaluates TFMs against tuned GBDTs on five public telecom churn datasets, considering ranking, expected maximum profit and whether probabilities can support a threshold policy.","excerpt":"We re-evaluate TabPFN-2.5, TabPFN-3.5, TabPFN-3.5-Fast and TabICL v2 against Optuna-tuned GBDTs on five public telecom churn datasets over 10 seeded splits.","support":"source-stated"},{"text":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell and Iranian, with gains of 1.9% and 7.6%.","excerpt":"TabPFN-3.5 earns significantly more EMP than the best tuned GBDT on Cell2Cell (1.9%) and Iranian (7.6%)","support":"source-stated"},{"text":"TabPFN-3.5 is ahead on Orange in all splits, but the gain is not statistically significant after correction.","excerpt":"On Orange it is ahead in all 10 splits (14.3%), but the gain is not significant after correction (Holm p = 0.155).","support":"source-stated"},{"text":"The evaluation's resampled splits do not establish performance across independent operators.","excerpt":"The splits resample the same datasets, so these results do not stand for independent operators.","support":"source-stated"},{"text":"TabICL v2 beats the best tuned GBDT only on Iranian and underpredicts churn on Orange.","excerpt":"TabICL v2, the earlier benchmark's leader, beats the best tuned GBDT only on Iranian, not all three of them, and underpredicts Orange churn by 2.1 points on a 7.3% base rate.","support":"source-stated"},{"text":"Polas says the weights' licence, rather than scoring cost, is the barrier to production use of the reported TabPFN-3.5 gains.","excerpt":"The licence of the TabPFN-3.5 weights we used (License v1.0), not scoring cost, is what stands between its gains and production use.","support":"source-stated"}],"limitations":["The reported splits resample the same five datasets and, as the paper states, do not represent independent operators.","The evidence is the paper's abstract; it does not include the full methods or results tables for examining details beyond those reported there."],"mediaId":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","correctionReason":null,"id":"49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506","publicationId":"e92018db-e857-4908-8857-86f75697e270","version":1,"sourceUrl":"https://arxiv.org/abs/2611.12942","sourceTitle":"Tabular Foundation Models vs Tuned Gradient Boosting for Telecom Churn: A Profit- and Calibration-Aware Evaluation","publisher":"arXiv cs.AI","publishedAt":null,"originalPublished":{"value":"2026-11-06","precision":"day","basis":"publisher_citation_date"},"firstObservedAt":"2026-11-11T05:04:08.080Z","createdAt":"2026-11-12T01:49:02.277Z","historical":true,"entityIds":["arxiv"],"topicIds":["intelligence-and-discovery"],"media":[{"id":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","kind":"article","url":"https://arxiv.org/abs/2611.12942","sourceUrl":"https://arxiv.org/abs/2611.12942","label":"Read original","provenance":"source_link","verification":{"status":"verified","checkedAt":"2026-11-12T01:48:10.493Z","method":"acquired_source","contentType":"text/html"},"recommendationReason":"Recommended by Jev for understanding this source; checked by Luna."}],"sourceMedia":{"status":"not_found","sourceUrl":"https://arxiv.org/abs/2611.12942","checkedAt":"2026-11-12T03:56:11.388Z","items":[],"note":"No suitable media was found by the supported page extraction."},"editorialDecision":{"outcome":"accept","reasonCodes":["material_development"],"rubricVersion":"stream-admission-v6","mediaId":"4d203c940610d876eedd5fdc9ee6fb07398cef84280ae8eadee209e6ee238bd9","confidence":0.63,"provider":"typesafe","model":"jev-1.13.0","inputHash":"0e1313411189e2b98bfe7b74f86a415231af522b38d0969501d814d684d07034","decidedAt":"2026-11-12T01:48:11.169Z"},"provenance":{"textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observationId":"16d3986550c9ba474b10f316bc87457c255d1edfc01645670dcaca0807b9ea0e","retrievedAt":"2026-11-12T01:48:10.312Z","kind":"publisher-page","preparer":{"model":"gpt-6-luna","runId":"46cb703a-f234-4fa0-8cb8-b2a8c9b60a8c"},"reviewer":{"model":"gpt-6-luna","runId":"95e53bc7-7871-4a85-8b4d-50173ecdfd2f"}},"audit":{"status":"uncertain","reviewedAt":"2026-11-12T01:49:02.277Z","model":"anthropic/claude-opus-5.5"},"sourceAttribution":{"authors":[{"name":"Polas, Ismail Hossain","url":null,"kind":"unknown"}],"authorRole":"article-author","hosts":[],"status":"stated","authorRoster":{"truncated":false,"omitted":0,"assertionGroupsOmitted":0},"participation":[{"actor":{"name":"Polas, Ismail Hossain","url":null,"kind":"unknown","actorId":null},"role":"author","scope":{"kind":"work-credit","locator":null},"literalCredit":"Polas, Ismail Hossain","status":"stated","provenance":{"basis":"head-meta","sourceUrl":"https://arxiv.org/abs/2611.12942","locator":"head/meta[name=author|citation_author]"},"assertionId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034:participation:0","identity":{"version":"entity-identity-v1","status":"unresolved","actorId":null,"canonicalActorId":null,"candidateActorIds":[],"assertions":[],"sourceObservedAt":"2026-11-12T03:56:11.388Z","knowledgeAsOf":null},"sourceVersion":{"snapshotId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034","sourceUrl":"https://arxiv.org/abs/2611.12942","contentSha256":"67f20d7373edcefbc458083a2e5af8cb935af75d3e42c81e0149703665dd73de","textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observedAt":"2026-11-12T03:56:11.388Z"}}],"participationCoverage":{"total":1,"returned":1,"complete":true,"fullAssertions":"source-metadata-endpoint"},"distribution":null,"publisher":null,"sourceUrl":"https://arxiv.org/abs/2611.12942","snapshotId":"4ab874a65138515ffd5b312d3498aea55842337965918d53d6a8dbae26496034","contentSha256":"67f20d7373edcefbc458083a2e5af8cb935af75d3e42c81e0149703665dd73de","textHash":"b41b3c99b41439dde1243900962e2e4859372858f55ba1fd92c79d093909c8bf","observedAt":"2026-11-12T03:56:11.388Z","basis":"publisher-page-metadata","sourceLinks":40,"linksTruncated":false,"metadataUrl":"/api/pipeline/stream/49b39caf399fe440de0b4c5696a6bf9862490d9a0d7c367a6be88ff4fa95a506/source"}}}],"audits":[{"publicationId":"e92018db-e857-4908-8857-86f75697e270","verdict":"uncertain","findings":[{"dimension":"attribution","status":"pass","explanation":"The paper, its findings and the licence remark are correctly attributed to the sole listed author, Ismail Hossain Polas, on arXiv cs.AI. The phrase 'his paper' assumes a gender the source does not state. A neutral 'In a paper' would avoid the assumption, but this does not misattribute any claim.","excerpt":"Authors:Ismail Hossain Polas"},{"dimension":"summary","status":"uncertain","explanation":"The facts track the abstract, but a non-specialist would struggle with central terms. Churn, TFMs, GBDTs, Optuna-tuned, calibration, EMP, PR-AUC, splits and the statistical correction are named but never explained. The summary also cites 'the earlier benchmark' without introducing it. It omits the key context that this benchmark compared TFMs against untuned GBDTs and scored only ranking metrics, which is the reason the paper exists. Smallest repair: add one sentence on that benchmark's setup and plain-language glosses or tooltips for churn, EMP and PR-AUC.","excerpt":"A recent benchmark reported that they decisively outperform tree ensembles for customer churn, but it compared them with untuned gradient-boosted trees (GBDTs) and scored only ranking metrics"},{"dimension":"date","status":"pass","explanation":"originalPublished is 2026-11-06, which matches the arXiv v1 submission date. The 2026-11-11 feed date is correctly not used.","excerpt":"[Submitted on 6 Nov 2026]"},{"dimension":"support","status":"pass","explanation":"Each claim and its figures (1.9%, 7.6%, 14.3%, Holm p = 0.155) match the abstract. These cover TabPFN-3.5's EMP gains, the non-significant result on Orange, the warning about resampled splits, TabICL v2's results, the narrowed PR-AUC gap and the licence barrier. The draft keeps the significance qualifiers and the limits on generalization. Its question about independent operators follows directly from the source's own caveat, and the draft implies no benefits beyond what the source states.","excerpt":"The splits resample the same datasets, so these results do not stand for independent operators."},{"dimension":"media","status":"pass","explanation":"The selected media is the verified direct link to the arXiv abstract page, which is the original source.","excerpt":null}],"createdAt":"2026-11-12T01:49:02.277Z","model":"anthropic/claude-opus-5.5"}],"correctionUrl":"https://escapemeridian.com/corrections/"}