An LLM gateway is a small system with a big trust load. It's small enough for one on-call to own, and it holds your org's model credentials, its spend attribution and its audit trail. That combination shapes how you run it: conservative where the trust is, pragmatic everywhere else.
Source: [Dev.to](https://dev.to/zerokdevops/llm-gateway-on-call-the-4-incidents-that-actually-happen-4755)