Trendoday

Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data

Mixture-of-Experts (MoE) models are bottlenecked by loading routed-expert weights from memory during interactive decoding at small batch sizes. Because most intermediate channels in a routed expert co

  • Upvotes21
–Rank now
#13Peak rank
3Days on list
–Score · 7d
Oct 28, 2026First seen

About this paper

Prox replaces calibrated thresholds with top-k channel selection and a weight-derived reader to accelerate Mixture-of-Experts inference while preserving accuracy.

Mixture-of-Experts (MoE) models are bottlenecked by loading routed-expert weights from memory during interactive decoding at small batch sizes. Because most intermediate channels in a routed expert contribute little to any single token, channel selectors predict which channels matter and read only their weights, typically keeping channels above a threshold calibrated on offline data. We show that channel selection needs no calibration data. First, a calibrated threshold does not fix how much a selector reads, because the number of channels passing it varies across inputs; Prox with thresholds calibrated for an 18% read budget actually reads only 12.9% on average across our benchmarks.…

Mixture-of-ExpertsMoErouted-expert weightschannel selectorstop-kthreshold calibrationProxternary sketchlow-rank mapTriton kernels
Upvotes
21
Authors
2
Published
Oct 27, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data was first seen on Hugging Face · Daily papers on Oct 28, 2026. Since then it has appeared in 24 checks on 3 different days. Its best position was #13 of 30, reached on Oct 30, 01:28 UTC. It dropped off the list after Oct 30, 01:28 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 03:2814:5802:2813:5801:28 Oct 28, 03:28 UTC · #19Oct 28, 05:28 UTC · #17Oct 28, 07:28 UTC · #18Oct 28, 09:28 UTC · #17Oct 28, 11:28 UTC · #19Oct 28, 13:28 UTC · #19Oct 28, 15:28 UTC · #20Oct 28, 17:28 UTC · #19Oct 28, 19:28 UTC · #19Oct 28, 21:28 UTC · #20Oct 28, 23:28 UTC · #20Oct 29, 01:28 UTC · #19Oct 29, 03:28 UTC · #18Oct 29, 05:28 UTC · #19Oct 29, 07:28 UTC · #19Oct 29, 09:28 UTC · #20Oct 29, 11:28 UTC · #20Oct 29, 13:28 UTC · #19Oct 29, 15:28 UTC · #17Oct 29, 17:28 UTC · #17Oct 29, 19:28 UTC · #16Oct 29, 21:28 UTC · #15Oct 29, 23:28 UTC · #15Oct 30, 01:28 UTC · #13

Last 14 days

Best rank per day (UTC).

Oct 26today

Metric history

Platform metric as reported by Hugging Face.

071421 03:2814:5802:2813:5801:28 Oct 28, 03:28 UTC · 8Oct 28, 05:28 UTC · 10Oct 28, 07:28 UTC · 13Oct 28, 09:28 UTC · 17Oct 28, 11:28 UTC · 17Oct 28, 13:28 UTC · 17Oct 28, 15:28 UTC · 17Oct 28, 17:28 UTC · 18Oct 28, 19:28 UTC · 18Oct 28, 21:28 UTC · 18Oct 28, 23:28 UTC · 18Oct 29, 01:28 UTC · 19Oct 29, 03:28 UTC · 19Oct 29, 05:28 UTC · 19Oct 29, 07:28 UTC · 19Oct 29, 09:28 UTC · 21Oct 29, 11:28 UTC · 21Oct 29, 13:28 UTC · 21Oct 29, 15:28 UTC · 21Oct 29, 17:28 UTC · 21Oct 29, 19:28 UTC · 21Oct 29, 21:28 UTC · 21Oct 29, 23:28 UTC · 21Oct 30, 01:28 UTC · 21

Questions

Is Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Oct 30, 01:28 UTC, after 3 days of trending.

What is the highest rank Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data reached?

#13 on Hugging Face · Daily papers, on Oct 30, 01:28 UTC. Trendoday checks this list every 120 minutes.

How long has Channel Selection for Mixture-of-Experts Decoding Needs No Calibration Data been trending?

It was first seen on Oct 28, 2026 and has been on the list on 3 days (24 checks) since.