FP8
AIFP8: An 8-bit floating-point number format used to store weights and activations more compactly than 16-bit, speeding up inference on supporting hardware.
FP8: An 8-bit floating-point number format used to store weights and activations more compactly than 16-bit, speeding up inference on supporting hardware.