1 points, 0 comments on Hacker News
The Flash Attention 2 path was easier to finish after the algorithm existed in plain JavaScript first. The forward pass used one workgroup per batch, head, and query tile. It walked keys and values in blocks while keeping the online-softmax state in registers.
2 points, 1 comments on Hacker News
Companies have stopped hiring, and layoffs have become more and more common. Job postings are rarely found. New types of roles are appearing and disappearing so fast that it is now nearly impossible to get experienced in something and then get that job.
1 points, 0 comments on Hacker News
The page that wakes an on-call engineer is rarely the password form itself. It is usually a tenant support ticket followed by a suspicious email-change event: a property manager is locked out, a new address now owns the account, and the audit trail cannot explain why a step-up verification gate ...