Skip to main content

PrefixRebuildScenario

Serving scenarios · Implementation: mlsysim/engine/scenario_definitions/serving.py.

Construct this scenario with keyword inputs. The fields below show the types and defaults declared by this class.

A cached prefix on node: the prefill a miss rebuilds against one short suffix pass on a hit.

Notes

Equation: Result = mlsysim.solvers.PrefixRebuildModel.solve with the named scenario fields; no extra fitting or postprocessing is applied.

Assumptions: The supplied inputs use the units and validity regime documented by PrefixRebuildModel.solve; this class binds one reproducible configuration.

Excludes: Any behavior excluded by PrefixRebuildModel.solve, and measurement or calibration of the supplied inputs.

References

Implementation reference: mlsysim.solvers.PrefixRebuildModel.solve documents the composed equation and its sources.

Examples

The named registry scenario supplies the stated inputs; this is a modeled calculation, not a new measurement.

>>> from mlsysim import Scenarios
>>> scenario = Scenarios.InvariantPrefixRebuildDgxH100
>>> round(scenario.result.n_params, 6)
70600000000.0

Attributes

Name Description
node
precision
prefix_tokens
result Return mlsysim.solvers.PrefixRebuildModel.solve for this scenario; output fields retain the units and feasibility semantics specified by that solver.
suffix_tokens
utilization
workload

workload

Type: Workload.

Declared default: required.

node

Type: Any.

Declared default: required.

precision

Type: str.

Declared default: 'fp16'.

prefix_tokens

Type: int.

Declared default: required.

suffix_tokens

Type: int.

Declared default: required.

utilization

Type: float.

Declared default: required.

result

engine.scenario_types.PrefixRebuildScenario.result

Return mlsysim.solvers.PrefixRebuildModel.solve for this scenario; output fields retain the units and feasibility semantics specified by that solver.

Equation: mlsysim.solvers.PrefixRebuildModel.solve (scenario fields).

Back to top