Why Fewer, Better-Chosen Chunks Beat a Bigger, More Expensive Model For a while, my retrieval setting was top_k = 10 . It felt responsible. If I only pulled back 3 chunks and the right one wasn't among them, the answer would be wrong for a reason that had nothing to do with the model.
Source: [Dev.to](https://dev.to/surajrkhonde/where-does-rag-actually-cost-you-money-episode-6-4l4o)