The smallest async RL trainer I could write: one loop that runs REINFORCE on CartPole on a laptop and async GRPO on a cluster (e. g. 8xH100 trainer, 8 vLLM workers, ran as a [SkyPilot job group]( https://docs.

Source: [Hacker News](https://github.com/alex000kim/nanoRL)

Sponsored