I built an experiment that uses an overfitted transformer and arithmetic coding to compress individual files. Instead of training the model to generalize, I train a 900KB transformer to memorize a single file and predict the next byte. Those predictions are fed into an arithmetic coder to produ...

Source: [Hacker News](https://news.ycombinator.com/item?id=48644463)

Sponsored