Trendoday

The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models

A quantized model is usually judged by comparing it with its BF16 original, but that comparison changes more than the weights. It often changes the serving engine, it always runs on a different server

  • Upvotes4
–Rank now
#23Peak rank
2Days on list
44Score · 7d
Nov 18, 2026First seen
Rank · 7 days

About this paper

A quantized model is usually judged by comparing it with its BF16 original, but that comparison changes more than the weights. It often changes the serving engine, it always runs on a different server instance, it may change how requests are batched, and on some stacks the library selects a different kernel depending only on which packages import. We measure each of these sources on the same 2,400 public decisions for two of Cloudflare's decision models, Clef-flash (9B) and Clef (27B), on an NVIDIA GB10, and state every quantization effect as the excess over them. Sources that are not quantization move between 0 and 0.92% of decisions. llama.cpp restarts are bit-identical on every record…

Upvotes
4
Authors
2
Published
Nov 11, 2026

Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.

Trending history

The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models was first seen on Hugging Face · Daily papers on Nov 18, 2026. Since then it has appeared in 7 checks on 2 different days. Its best position was #23 of 30, reached on Nov 19, 07:29 UTC. It dropped off the list after Nov 19, 07:29 UTC.

Rank history

Position on Hugging Face · Daily papers at every check (lower is better).

#1#11#20#30 17:2820:5800:2903:5907:29 Nov 18, 17:28 UTC · #27Nov 18, 19:28 UTC · #27Nov 18, 21:28 UTC · #27Nov 18, 23:28 UTC · #27Nov 19, 01:28 UTC · #28Nov 19, 05:28 UTC · #26Nov 19, 07:29 UTC · #23

Last 14 days

Best rank per day (UTC).

Nov 9today

Metric history

Platform metric as reported by Hugging Face.

0134 17:2820:5800:2903:5907:29 Nov 18, 17:28 UTC · 4Nov 18, 19:28 UTC · 4Nov 18, 21:28 UTC · 4Nov 18, 23:28 UTC · 4Nov 19, 01:28 UTC · 4Nov 19, 05:28 UTC · 4Nov 19, 07:29 UTC · 4

Questions

Is The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models trending on HF Daily Papers right now?

Not at the moment. It was last on the list on Nov 19, 07:29 UTC, after 2 days of trending.

What is the highest rank The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models reached?

#23 on Hugging Face · Daily papers, on Nov 19, 07:29 UTC. Trendoday checks this list every 120 minutes.

How long has The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models been trending?

It was first seen on Nov 18, 2026 and has been on the list on 2 days (7 checks) since.