26 points, 10 comments on Hacker News
Source: [Hacker News](https://www.iroh.computer/blog/mesh-llm)
1 points, 0 comments on Hacker News
1 points, 0 comments on Hacker News
109 points, 60 comments on Hacker News
1 points, 0 comments on Hacker News
2 points, 0 comments on Hacker News
Local LLM inference has an expensive habit: It recomputes prefixes it has already seen. A system prompt. A reused RAG document.