I'd like to give user queries to ollama running a small model, but ollama does have a complex tokenization pipeline. Most software that processes user input has turned out to have flaws over the years, is there anything I can do to sanitize users' input before I pass it on to ollama, or anythin...
Source: [Hacker News](https://news.ycombinator.com/item?id=49360318)