Experimental versions of FP-Quant models
-
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 44 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 74 -
daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 54 -
daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 38