All-Reduce Rhythm

Keep the gradients flowing in a perfect ring.

Follow the numbered GPU cue and tap the matching GPU on each beat to keep gradient chunks moving.

Combo 0 · Score 0 · 30s Click GPUs or 1-4 on the beat · R retry

How to play

GPUs are arranged in a ring. Follow the displayed order from GPU 1 to GPU 4 and press its number on each one-second beat. A correct hit sends a gradient chunk and grows your combo. An early, late, or wrong-GPU input breaks the combo. The round ends after 30 seconds.

The Systems Concept

Ring all-reduce passes gradient chunks between GPUs in ordered steps. A delayed participant makes its peers wait, leaving communication capacity idle. The rhythm game is a timing analogy for synchronization; it does not model network packets or contention in detail.

---

Part of MLSysBook Playground. Found a bug? Report an issue.