How the hell are AI APIs still basically stateless? It can't be true that the whole context needs to be sent every single time. Even if we use prefix caching or a durable object it not really a solution!
Source: [Hacker News](https://news.ycombinator.com/item?id=49424697)