"I wanted to see if I could optimize the dequantization bottleneck during 4-bit LLM inference. By writing a custom kernel in Triton to optimize memory access patterns, I managed to get up to a 1. 41x speedup over the standard bitsandbytes implementation.
Source: [Hacker News](https://github.com/Griffith-7/nf4-triton-kernel)