Large scale model quantification techniques: GGUF, GPTQ, AWQ comparison

Large scale model quantization is a technique for compressing model parameters from high precision (such as FP16) to low precision (such as INT4, INT8), which can significantly reduce model storage an