f16.gguf version has any advantages over the f16 version of safetensor.

#2
by david5812345 - opened

Hello, I would like to ask if the f16.gguf version has any advantages over the f16 version of safetensor. Will the inference speed or loading speed be faster?

Sign up or log in to comment