How to size hardware for a local LLM: weights, KV cache and memory bandwidth, checked against official specs for 12 open models and 9 GPUs and Macs.
Source: [HackerNoon](https://hackernoon.com/how-much-gpu-memory-do-you-really-need-to-run-an-open-llm-locally?source=rss)