Notes from a 2 AM On-Call: Why Our vLLM Semantic Router Dropped 40% of Requests Under Load The Failure Symptom 2024-03-15 02:17:43 WARNING: Route decision timeout after 5000ms 2024-03-15 02:17:48 ERROR: 127 requests dropped (no route assigned) 2024-03-15 02:18:12 INFO: QPS: 240 → 140 (41% degrada...
I'm the only developer on Bloop. Design, code, UI, levels and the store pages are all me. It's a mobile puzzle game where you get one bullet per level: pull back, bank it off the walls, and pop every Bloop on the screen with that one shot.
1 points, 0 comments on Hacker News
3. 2 Million Redis and 1. 9 Million MongoDB Services: The Steady Background of Exposed Data Stores Month after month, the same services appear in internet scan data at the same order of magnitude: Redis in the millions, MongoDB in the millions, and a long tail of databases below them.
1 points, 0 comments on Hacker News
Hey everyone 👋, If you’re building AI apps today, you probably know the headache of API fragmentation. You might want to use GPT-4o for reasoning, Claude 3. 5 for coding, and Llama 3 for fast, cheap processing.