NVFP4

NVIDIA's 4-bit quantization format (NVIDIA Floating Point 4): represents model weights with 4 bits plus a per-group scale factor, cutting memory by roughly a quarter compared to 16 bits. It is the native format of Blackwell tensor cores and lets 35B models run on a 32GB GPU.