MoE Router

Route each token to the expert selected for it.

Press 1–4 or tap an expert to route each colored token before it reaches the bottom.
score 0 press 1-4 to route the next token · avoid routing errors · R retry

How to play

Tokens arrive colored for a specific expert. Press 1, 2, 3, or 4 to route the oldest token to that expert before it reaches the bottom. A wrong route is a routing error.

The Systems Concept

Mixture-of-Experts models route each token to one or more specialized subnetworks. This version teaches the basic routing idea: the router must send each token to the expert selected for it. A fuller version should add expert capacity, queueing, and dropped-token penalties to teach load balancing.


Part of MLSysBook Playground. Found a bug? Report an issue.