August 8, 2026
40 min read
View as PDF
4-bit quantization really is nearly free — but at 3 bits both long-context retrieval and multi-step arithmetic break, and retrieval takes 3.2× the standardized damage. Eight components get better when you quantize them. And the standard way of ranking which layers matter turns out to fail four separate statistical tests. A plain-English walkthrough of the paper, with every figure and number intact.