Self-hosting a lite agent backend on one TPU: Gemma 4 E2B + vLLM on a v5e-1

Self-hosting a lite agent backend on one TPU chip A single Google Cloud TPU v5e chip — 16 GB of HBM, about $0. 58/hour on spot — will serve google/gemma-4-E2B-it under vLLM at 1,496 output tokens/sec aggregate, with 8. 02 ms per-token latency at single stream and native tool-calling.

Source: [Dev.to](https://dev.to/gde/self-hosting-a-lite-agent-backend-on-one-tpu-gemma-4-e2b-vllm-on-a-v5e-1-fk1)