Quality

[ianncity]

Whats the quality like between the safetensors and the gguf, is it roughly the same from fp8 to gguf?

[subspecs]

@ianncity
GGUF is more compact and for the most part works a bit faster.
SafeTensors is just basically a direct dump of tensors, usually bigger in file size.

Quality wise, Q8 should be on par with FP8. This is also true for other AI models not only S2 btw.