Hi all! I made this small proxy when I built a small GPU cluster at home and wanted to share it with friends while keeping speed limits and token accounting. I also put a lot of effort in making it work as quick as possible, and IMO the result is worth sharing!
Source: [Hacker News](https://github.com/robolamp/smol-llm-proxy)