I have been building multiple LLM systems and for our Organization biggest cost savings weren't from prompt-wordsmithing or model switchings. Sharing useful to anyone watching their token bill : 1) JSON → TOON for structured output: JSON was not made for LLMs. well you can implement your own ve...
Source: [Hacker News](https://news.ycombinator.com/item?id=48608978)