Originally published at mrsaynothing. dev . Last week a reader asked why their GGUF file 404s inside vLLM on a CPU box while the same file runs fine in Ollama.

Source: [Dev.to](https://dev.to/mrsaynothing/can-vllm-run-gguf-yes-on-gpu-only-1hpj)

Sponsored