RunByAI

Tag: GGUF

2 post(s)

May 30, 20260 comment(s)

Complete Guide to Local Deployment of Large Models: From Hardware Selection to Operational Optimization

With the rapid development of open-source big models, deploying big models locally is no longer the exclusive skill of geeks. This article will systematically introduce the complete process of deployi

Tech Guide Ollama large model GGUF

May 30, 20260 comment(s)

Large scale model quantification techniques: GGUF, GPTQ, AWQ comparison

Large scale model quantization is a technique for compressing model parameters from high precision (such as FP16) to low precision (such as INT4, INT8), which can significantly reduce model storage an

Tech News Guide Model Quantization GGUF GPTQ