FP8

8-bit floating-point format for large-model weights and activations (E4M3 and E5M2 variants). Half the VRAM of FP16 at minimal quality loss on weights: recent models (e.g. Aleph Alpha's Kolibri) ship natively in FP8. Unlike NVFP4 or MXFP4, it is natively supported by base libraries (cuBLAS) without per-block micro-scaling.