Kim, Geunhyoung, Hwang, Sung Ju · Oct 27, 2026
arXiv cs.AI: Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data
Markdown · JSON · Original source
Authors Geunhyoung Kim and Sung Ju Hwang argue that channel selection in (MoE) decoding can avoid calibration data by selecting each token’s top-scoring channels. They report that this approach matched or beat threshold-based selection in 40 of 43 comparisons at 13% and 18% read budgets, including every generation-task comparison. They also report a reader built from that retained 98.1% of full-model accuracy while using 17.8% of routed-expert reads across three post-trained MoE models. Triton kernels ran the MoE blocks 1.60 to 1.90x faster than optimized vLLM at batch one, and up to 2.69x faster at larger batches on those models. These are reported results from the authors’ evaluation; the abstract does not establish how well they generalize to other models or settings. Would the approach retain these accuracy and speed results on MoE models beyond the three evaluated?
Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims.
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-07T06:31:46.383Z. First observed: 2026-10-28T04:50:37.363Z. Retrieved: 2026-10-30T05:31:24.715Z.
Referenced by
Recorded citations and public file attachments. A reference alone does not establish agreement or influence.
No public references recorded here yet.
Limits
The reported reader results cover three post-trained models; the abstract does not establish whether they generalize to other models or settings. The abstract reports comparisons and kernel speeds but does not specify enough evaluation detail to assess performance beyond the reported setups.
Open question
Would the approach retain these accuracy and speed results on models beyond the three evaluated?
Source-stated
The authors argue that top-k channel selection does not require calibration data.
Second, top-k keeps each token's k highest-scoring channels and needs no calibration data.
Source-stated
At 13% and 18% read budgets, top-k matched or beat threshold selection in 40 of 43 comparisons, including all generation-task comparisons.
At the calibrated budget, a selector's top-k version matches or beats its threshold version on the same score in 40 of 43 comparisons at 13% and 18% budgets, including all 23 on generation tasks.
Source-stated
Across three post-trained MoE models, the authors’ reader retained 98.1% of full-model accuracy at 17.8% of routed-expert reads.
Across three post-trained MoE models, our reader retains 98.1% of full-model accuracy at 17.8% of routed-expert reads
Source-stated
The authors report that their Triton kernels ran MoE blocks faster than optimized vLLM in their evaluations.
with Triton kernels running MoE blocks 1.60 to 1.90x faster than optimized vLLM at batch one and up to 2.69x at larger batches on the same three models.
Source and contributor context
Kim, Geunhyoung, Hwang, Sung Ju · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Mixture of experts
A model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6a6c0ed6-da30-4e0e-8c2e-45912c48b595.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-07T06:31:46.383Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2670e76fa4bd971f1ff15a6016fe371f21dc5fa6e96ce915d8fc9c7b534b4554. Source text hash: ecff4dd6176be117f20966a256d4a3fc8763e45bf93cfb8c8edbace30e321868.
Revision and source-check history
Version 1 · 2026-11-07T06:31:46.383Z
arXiv cs.AI: Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data
Authors Geunhyoung Kim and Sung Ju Hwang argue that channel selection in (MoE) decoding can avoid calibration data by selecting each token’s top-scoring channels. They report that this approach matched or beat threshold-based selection in 40 of 43 comparisons at 13% and 18% read budgets, including every generation-task comparison. They also report a reader built from that retained 98.1% of full-model accuracy while using 17.8% of routed-expert reads across three post-trained MoE models. Triton kernels ran the MoE blocks 1.60 to 1.90x faster than optimized vLLM at batch one, and up to 2.69x faster at larger batches on those models. These are reported results from the authors’ evaluation; the abstract does not establish how well they generalize to other models or settings. Would the approach retain these accuracy and speed results on MoE models beyond the three evaluated?
Original source
cs.AI · Article
Source details
Original source date: Oct 27, 2026 (2026-10-27).
Date basis: Date basis not provided.
Added to Escape Meridian: 2026-11-07T06:31:46.383Z. First observed: 2026-10-28T04:50:37.363Z. Retrieved: 2026-10-30T05:31:24.715Z.
Limits
The reported reader results cover three post-trained models; the abstract does not establish whether they generalize to other models or settings. The abstract reports comparisons and kernel speeds but does not specify enough evaluation detail to assess performance beyond the reported setups.
Open question
Would the approach retain these accuracy and speed results on models beyond the three evaluated?
Source-stated
The authors argue that top-k channel selection does not require calibration data.
Second, top-k keeps each token's k highest-scoring channels and needs no calibration data.
Source-stated
At 13% and 18% read budgets, top-k matched or beat threshold selection in 40 of 43 comparisons, including all generation-task comparisons.
At the calibrated budget, a selector's top-k version matches or beats its threshold version on the same score in 40 of 43 comparisons at 13% and 18% budgets, including all 23 on generation tasks.
Source-stated
Across three post-trained MoE models, the authors’ reader retained 98.1% of full-model accuracy at 17.8% of routed-expert reads.
Across three post-trained MoE models, our reader retains 98.1% of full-model accuracy at 17.8% of routed-expert reads
Source-stated
The authors report that their Triton kernels ran MoE blocks faster than optimized vLLM in their evaluations.
with Triton kernels running MoE blocks 1.60 to 1.90x faster than optimized vLLM at batch one and up to 2.69x at larger batches on the same three models.
Source and contributor context
Kim, Geunhyoung, Hwang, Sung Ju · Article author
These are credits stated by the source; they do not establish a profile match or authorship of every passage.
Source media
No suitable media was found by the supported page extraction.
Terms and references
Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement.
Mixture of experts
A model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Model weights
The learned numbers that make up a trained model; publishing them lets others run it.
Benchmark
A defined set of tests used to compare systems. Results depend on the tasks and measures selected.
arXiv
arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Editorial provenance
Version 1. Publication ID: 6a6c0ed6-da30-4e0e-8c2e-45912c48b595.
Prepared by gpt-6-luna; grounding review by gpt-6-luna.
Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-07T06:31:46.383Z. This checks fidelity to the source, not whether its claims are independently true.
Editorial selection: accept; reasons: material_development.
Observation: 2670e76fa4bd971f1ff15a6016fe371f21dc5fa6e96ce915d8fc9c7b534b4554. Source text hash: ecff4dd6176be117f20966a256d4a3fc8763e45bf93cfb8c8edbace30e321868.
uncertain · 2026-11-07T06:31:46.383Z · anthropic/claude-opus-5.5
Publication: 6a6c0ed6-da30-4e0e-8c2e-45912c48b595
attribution — pass: The reading correctly attributes the paper and its claims to authors Geunhyoung Kim and Sung Ju Hwang. It frames the results as the authors' reported findings rather than established facts.
Authors:Geunhyoung Kim, Sung Ju Hwang
summary — uncertain: Central terms are never explained for a non-specialist: MoE, decoding, channels, calibration data, read budget, routed-expert reads, Triton kernels, vLLM and batch one. The reading also omits the motivating problem: memory loading is the bottleneck in interactive decoding. It drops the paper's first argument, that calibrated thresholds do not fix how much is read (an 18% target averaged 12.9%), and the reported avoidance of repetition-loop collapse on Gemma 4. Smallest repair: add one plain-language sentence each on the memory bottleneck and the threshold-budget finding, and add tooltips for the terms. The title only repeats the paper title.
Prox with thresholds calibrated for an 18% read budget actually reads only 12.9% on average across our benchmarks.
date — pass: The originalPublished date of 2026-10-27 matches the v1 submission date on arXiv. It is not the later feed date.
[Submitted on 27 Oct 2026]
support — pass: Each claim matches the abstract: the 40 of 43 comparisons including all 23 generation tasks, 98.1% accuracy at 17.8% of reads, and the 1.60–1.90x and up to 2.69x speedups over vLLM. The limitations and the question about generalization beyond three models are appropriately conditional and are not stated as findings.
Across three post-trained MoE models, our reader retains 98.1% of full-model accuracy at 17.8% of routed-expert reads
media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct route to the source.
Challenge or correct this reading
Send a correction or an opposing source with this reading’s URL. Disagreement and uncertainty can remain unresolved.
A model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referenceA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referenceThe learned numbers that make up a trained model; publishing them lets others run it.
Definition referencearXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed.
Explore arXivA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition referenceA defined set of tests used to compare systems. Results depend on the tasks and measures selected.
Definition referenceA model design that sends each input to a few specialized sub-networks instead of the whole model, which saves computation.
Definition reference