core.solver.SingleNodeModel

core.solver.SingleNodeModel()

Resolves single-node hardware Roofline bounds and feasibility.

This solver handles the ‘Iron Law’ of machine learning systems, calculating whether a model fits in memory and predicting its throughput based on arithmetic intensity.

Literature Source: Williams et al. (2009), “Roofline: An Insightful Visual Performance Model for Floating-Point Programs and Multicore Architectures.”

Methods

Name Description
solve Solves the performance profile for a single hardware node.

solve

core.solver.SingleNodeModel.solve(
    model,
    hardware,
    batch_size=1,
    precision='fp16',
    efficiency=0.5,
    raise_errors=False,
)

Solves the performance profile for a single hardware node.

Back to top