After checking out Turbo Fieldfare (a very interesting project that streamed experts from SSD on Apple Silicon Macs to run Gemma 4 26B with very little RAM usage), I tried to make this project much faster and succeeded! This project gets up to 100+ tokens/s inference on Gemma 4 26B (Turbo Fieldf...
Source: [Hacker News](https://github.com/zw5/ane-fieldfare)