Hi HN, We are the developers of OpenLake, an open source storage engine for KV cache offloading to remote disk and memory. Once we offloaded to local disk, we realized the bottleneck is the PCIe or NIC bandwidth. We wondered whether on GPU lossless compression is viable for fast reads and lower...
Source: [Hacker News](https://www.theopenlake.com/blog/exans-lossless-gpu-compression-for-bf16-kv-cache)