Sharma, Mayan, Saini, Kriti, Behl, Devansh, R, Suganya, Vijayaragavan, S. · Nov 4, 2026
arXiv cs.AI: Reproduction study tests risk-controlled LEO throughput forecasting
Markdown · JSON · Original source
Mayan Sharma, Kriti Saini, Devansh Behl, Suganya R and S. Vijayaragavan report a reproduction study of BG-CFQS, which turns forecasts of LEO satellite capacity into conservative bounds for admission control. Their central finding is that its risk guarantee depends on the calibration split. They recover the published results with a random split, but under a contiguous temporal split, “which is what a deployed terminal faces,” the guarantee holds on only 1 of 3 datasets. The authors also report that the method cannot meet risk budgets below 0.15 because its candidate quantile set does not go lower. At budgets of 0.05, 0.10 and 0.15, the achieved rate is identical. Online recalibration tracks the budget within 1% in their tests, while group-conditional recalibration performs worse than not conditioning on three of four datasets. In a spike detection test, static conformal calibration cannot improve a ranking, while online calibration improves AUPRC by up to 51%. The authors stress that their contribution is empirical, not algorithmic. Their results raise a specific deployment concern: the risk guarantee they reproduce under a random split holds on fewer datasets under a contiguous temporal split, and the method cannot serve budgets below 0.15. The findings are bounded by the datasets and tests they report.
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T13:18:45.856Z. First observed: 2026-11-05T05:06:38.545Z. Retrieved: 2026-11-09T13:10:23.916Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported findings concern the three Starlink traces used by the method’s authors and an independent fourth dataset; the abstract does not establish how broadly they generalize beyond these datasets. The abstract says the attempt to predict which datasets benefit from group-conditional recalibration failed, so it does not identify a reliable way to anticipate when that approach will help.
Open question
What, if anything, can predict which datasets benefit from group-conditional online recalibration, given that the authors’ attempt to predict this failed?
Source-stated
The authors report that BG-CFQS’s risk guarantee depends on the calibration split: results reproduce under a random split, but hold on only 1 of 3 datasets under a contiguous temporal split.
under a random split we recover every published quantity, including risk-pass on 3 of 3 datasets, but under a contiguous temporal split, which is what a deployed terminal faces, it holds on 1 of 3.
Source-stated
The authors report that the method cannot serve risk budgets below 0.15 and achieves the same rate at budgets of 0.05, 0.10 and 0.15 across all four datasets.
On all four datasets the achieved rate is identical at budgets of 0.05, 0.10 and 0.15
Source-stated
In their latency spike detection test, the authors report that static conformal calibration does not improve a ranking, while online calibration improves AUPRC by up to 51%.
we confirm this exactly on latency spike detection, where online calibration improves AUPRC by up to 51%.
Source-stated
The authors report that group-conditional recalibration performed worse than not conditioning on three of four datasets, and that their attempt to predict which datasets benefit failed.
on three of four datasets, conditioning on any available covariate, including measured serving-satellite geometry, is worse than not conditioning, and our attempt to predict which datasets benefit failed.
Source-stated
The authors characterize the contribution as empirical rather than algorithmic.
What is new here is empirical, not algorithmic: we claim the findings, not the methods.
Source and contributor context
Sharma, Mayan, Saini, Kriti, Behl, Devansh, R, Suganya, Vijayaragavan, S. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Latency
The delay between sending a request and receiving the result.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 71e40c79-f7a4-4139-8123-acb685e5cc6c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T13:18:45.856Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: b5e70617c7e24c4ebc0763ab6e1d36ac190664bbb6d84bf183e7f59b2b71dcb7. Source text hash: 80237880b78c9a1be25e352c03a23ac8e7ec7f9089229eb147db8615bb58d161.
Revision and source-check history
Version 1 · 2026-11-09T13:18:45.856Z
arXiv cs.AI: Reproduction study tests risk-controlled LEO throughput forecasting
Mayan Sharma, Kriti Saini, Devansh Behl, Suganya R and S. Vijayaragavan report a reproduction study of BG-CFQS, which turns forecasts of LEO satellite capacity into conservative bounds for admission control. Their central finding is that its risk guarantee depends on the calibration split. They recover the published results with a random split, but under a contiguous temporal split, “which is what a deployed terminal faces,” the guarantee holds on only 1 of 3 datasets. The authors also report that the method cannot meet risk budgets below 0.15 because its candidate quantile set does not go lower. At budgets of 0.05, 0.10 and 0.15, the achieved rate is identical. Online recalibration tracks the budget within 1% in their tests, while group-conditional recalibration performs worse than not conditioning on three of four datasets. In a spike detection test, static conformal calibration cannot improve a ranking, while online calibration improves AUPRC by up to 51%. The authors stress that their contribution is empirical, not algorithmic. Their results raise a specific deployment concern: the risk guarantee they reproduce under a random split holds on fewer datasets under a contiguous temporal split, and the method cannot serve budgets below 0.15. The findings are bounded by the datasets and tests they report.
Original source
cs.AI · Article
Source details
Original source date: Nov 4, 2026 (2026-11-04).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-09T13:18:45.856Z. First observed: 2026-11-05T05:06:38.545Z. Retrieved: 2026-11-09T13:10:23.916Z.
Limits
The reported findings concern the three Starlink traces used by the method’s authors and an independent fourth dataset; the abstract does not establish how broadly they generalize beyond these datasets. The abstract says the attempt to predict which datasets benefit from group-conditional recalibration failed, so it does not identify a reliable way to anticipate when that approach will help.
Open question
What, if anything, can predict which datasets benefit from group-conditional online recalibration, given that the authors’ attempt to predict this failed?
Source-stated
The authors report that BG-CFQS’s risk guarantee depends on the calibration split: results reproduce under a random split, but hold on only 1 of 3 datasets under a contiguous temporal split.
under a random split we recover every published quantity, including risk-pass on 3 of 3 datasets, but under a contiguous temporal split, which is what a deployed terminal faces, it holds on 1 of 3.
Source-stated
The authors report that the method cannot serve risk budgets below 0.15 and achieves the same rate at budgets of 0.05, 0.10 and 0.15 across all four datasets.
On all four datasets the achieved rate is identical at budgets of 0.05, 0.10 and 0.15
Source-stated
In their latency spike detection test, the authors report that static conformal calibration does not improve a ranking, while online calibration improves AUPRC by up to 51%.
we confirm this exactly on latency spike detection, where online calibration improves AUPRC by up to 51%.
Source-stated
The authors report that group-conditional recalibration performed worse than not conditioning on three of four datasets, and that their attempt to predict which datasets benefit failed.
on three of four datasets, conditioning on any available covariate, including measured serving-satellite geometry, is worse than not conditioning, and our attempt to predict which datasets benefit failed.
Source-stated
The authors characterize the contribution as empirical rather than algorithmic.
What is new here is empirical, not algorithmic: we claim the findings, not the methods.
Source and contributor context
Sharma, Mayan, Saini, Kriti, Behl, Devansh, R, Suganya, Vijayaragavan, S. · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Latency
The delay between sending a request and receiving the result.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 71e40c79-f7a4-4139-8123-acb685e5cc6c.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-09T13:18:45.856Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: b5e70617c7e24c4ebc0763ab6e1d36ac190664bbb6d84bf183e7f59b2b71dcb7. Source text hash: 80237880b78c9a1be25e352c03a23ac8e7ec7f9089229eb147db8615bb58d161.
uncertain · 2026-11-09T13:18:45.856Z · anthropic/claude-opus-5.5
Publication: 71e40c79-f7a4-4139-8123-acb685e5cc6c
attribution — pass: The five listed authors match the arXiv page. The findings are consistently framed as the authors' reports, and the closing self-characterization (empirical, not algorithmic) is attributed to them.
Authors:Mayan Sharma, Kriti Saini, Devansh Behl, Suganya R, S. Vijayaragavan
summary — uncertain: The summary is faithful but hard for a non-specialist to follow. Central terms are left unexplained: LEO, risk budget (the allowed overestimation rate), random vs contiguous temporal calibration split, admission control and AUPRC. It never says why overestimating capacity is the risk. Smallest repairs: (1) add a plain-language line that the bound should overestimate capacity no more often than a user-set budget so admission control can act safely; (2) restore the source's overshoot finding, which carries the stakes of the 0.15 floor; (3) suggest tooltip entries for the remaining terms.
overshooting by 1.4x to 3.7x at the tightest
date — pass: The original publication date of 2026-11-04 matches the arXiv submission date for v1. The feed date of Nov 5 is later and correctly not used.
[Submitted on 4 Nov 2026]
support — pass: Each claim's excerpt is verbatim and supports it. The deployment-concern sentence rests on the authors' own statement that a temporal split is what a deployed terminal faces. The question follows directly from the reported failed prediction attempt. The limitations are appropriately bounded.
under a contiguous temporal split, which is what a deployed terminal faces, it holds on 1 of 3
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
The delay between sending a request and receiving the result.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivThe delay between sending a request and receiving the result.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXiv