Four-bit training quantizes every number to one of 16 values. NVFP4's menu is {0, ±0. 5, ±1, ±1.

Source: [Dev.to](https://dev.to/megapixel99/comparing-int4-and-nvfp4-palettes-on-real-gradient-tensors-g99)

Sponsored