Skip to content

Tag

#ai-inference

1post

Tech6 min read

FP4: the 16-value float powering billion-parameter models

FP4, a 4-bit float with just 16 representable numbers, is now the default inference format for billion-parameter models on NVIDIA Blackwell hardware.

#machine-learning#floating-point#nvidia