Weight Quantization

Weight quantization in plain terms: what changes and what stays the same?

Match each weight-quantization regime to what it buys you and where it breaks

Why is 'reduce FLOPs to speed up decode' the most common beginner misconception in LLM serving?

How does KV cache quantization differ from model weight quantization, and why is it often more sensitive?