FP4

Search documents
NVFP4 Unlocks Huge Improvements for Training AI Models at Scale
NVIDIAยท 2025-08-26 17:09
AI models are growing in terms of size and complexity and this is creating even more demands on the AI and data center infrastructure. In order to meet those requirements, we need to innovate at every level. We've talked a lot about all the enhancements we made in our hardware platforms, but we're also doing incredible innovations on the algorithmic side.We're introducing a new FP4 format called MVFP4. While we still support MXFP4, which is the open standard, we've invented MVFP4 to drive more performance a ...