#Quantization
3 posts on Quantization.
Reading a model's architecture from its safetensors header, without downloading the weights
How I recover a neural network's anatomy from tensor names and shapes alone: 96.8% role accuracy on 510 architectures, from about 46 KB of header. The method behind AI Model Explorer.
Fitting an LLM in your own server room: the memory math behind on-prem AI
Bits per weight, quantization error, outliers, KV cache and memory bandwidth: how to decide which model actually runs on the GPUs you own.
TurboQuant, reviewed: when a theory paper walks straight into production
A close read of TurboQuant (ICLR 2026): random rotations, Lloyd–Max codebooks and a 1-bit QJL residual, and why it went from proof to vLLM and a 17k-star vector index within weeks.