Wondering how much RAM is needed to run a given GGUF? Try: npx @huggingface/gguf [model].gguf This also work with remote file, for example: npx @huggingface/gguf https: //huggingface.co/bartowski/Qwen_QwQ-32B-GGUF/resolve/main/Qwen_QwQ-32B-Q4_K_M.gguf