Machine Learning Systems
  • Textbook
    • Home

    • Volume I: Foundations
    • Volume II: At Scale

    • TinyTorch
    • Hardware Kits

    • Labs (Coming 2026)
  • Downloads
    • Volume I PDF
    • Volume I EPUB

    • Volume II PDF
  • Star
  • Support
  • Subscribe
  • GitHub
    • Edit this page
    • Report an issue
    • Discussions
    • View source

Machine Learning Systems

TWO-VOLUME TEXTBOOK

Machine Learning
Systems.

Two volumes. One curriculum.
The physics of AI engineering.

A rigorous, principles-first treatment of how ML systems
are built, optimized, and deployed—from a single
machine to fleet-scale infrastructure.

TinyTorch · Hardware Kits · Labs

GitHub · Open Collective

Volume I cover

Volume I

Introduction to Machine Learning Systems

HTML PDF EPUB

Volume II cover

Volume II

Machine Learning Systems at Scale

HTML PDF EPUB

Scroll to Explore
↓

TINYTORCH

Build it.
From scratch.

20 interactive modules.
Zero magic.

Understand the inner workings of modern ML frameworks by building your own tensor library, automatic differentiation engine, and neural network modules in Python.

Start Building →

class Tensor:
def __init__(self, data):
self.data = data
self.grad = 0.0
self._backward = lambda: None

A pedagogical framework for learning ML systems engineering.

HARDWARE KITS

Deploy to
the edge.

Real silicon.
Real constraints.

Take your models out of the cloud and into the physical world. Hands-on deployment labs using Arduino, Raspberry Pi, and Seeed Studio hardware.

Explore Kits →

Nicla Vision

Microcontrollers, single-board computers, and specialized accelerators.

INTERACTIVE LABS

Learn by
doing.

Jupyter and Marimo.
Coming Summer 2026.

A complete suite of interactive notebooks designed to accompany the textbook. Profile performance, optimize kernels, and simulate distributed training.

View Labs →

Algorithm
Data
Machine
Compute
Communicate
Coordinate

The core design space: balancing D·A·M workload characteristics with C³ infrastructure constraints.

Vijay Janapa Reddi, Harvard University · MIT Press 2026

© 2024-2026 Harvard University. Licensed under CC-BY-NC-SA 4.0

Volume I · Volume II