Thanks. FP8 quant will help a lot.
The fp8 version will be released soon. Stay tuned.
· Sign up or log in to comment
