In the last entry I got Gemma-4's 128-expert MoE running on an inf2. 24xlarge and signed off with a cliffhanger: fitting it on a 2-core box "needs fp4 β a separate expedition. " This is that expedition.
Source: [Dev.to](https://dev.to/gde/gemma4-devops-in-action-10bl)