1 points, 0 comments on Hacker News
The Flash Attention 2 path was easier to finish after the algorithm existed in plain JavaScript first. The forward pass used one workgroup per batch, head, and query tile. It walked keys and values in blocks while keeping the online-softmax state in registers.
2 points, 1 comments on Hacker News
WOODLAND HILLS, Calif.
The strength of a randomly generated password is one number — its entropy , in bits — and it comes from a single line of arithmetic. I computed it across every length and character-set choice using the exact character sets our password generator ships, then turned each into a crack time. One th...
Companies have stopped hiring, and layoffs have become more and more common. Job postings are rarely found. New types of roles are appearing and disappearing so fast that it is now nearly impossible to get experienced in something and then get that job.