Short answer: move marketplace review summarization, tagging, and extraction to batch LLM jobs when no customer is waiting, but keep realtime calls for interactive work and attribute every job to a tenant before it enters the queue. This is a deadline decision before it is a vendor decision. A ...
Source: [Dev.to](https://dev.to/holdenfox8476/batch-llm-jobs-vs-realtime-apis-bulk-summarization-cost-attribution-41lp)