PrefixRebuildScenario
Serving scenarios · Implementation: mlsysim/engine/scenario_definitions/serving.py.
Construct this scenario with keyword inputs. The fields below show the types and defaults declared by this class.
A cached prefix on node: the prefill a miss rebuilds against one short suffix pass on a hit.
Notes
Equation: Result = mlsysim.solvers.PrefixRebuildModel.solve with the named scenario fields; no extra fitting or postprocessing is applied.
Assumptions: The supplied inputs use the units and validity regime documented by PrefixRebuildModel.solve; this class binds one reproducible configuration.
Excludes: Any behavior excluded by PrefixRebuildModel.solve, and measurement or calibration of the supplied inputs.
References
Implementation reference: mlsysim.solvers.PrefixRebuildModel.solve documents the composed equation and its sources.
Examples
The named registry scenario supplies the stated inputs; this is a modeled calculation, not a new measurement.
>>> from mlsysim import Scenarios
>>> scenario = Scenarios.InvariantPrefixRebuildDgxH100
>>> round(scenario.result.n_params, 6)
70600000000.0Attributes
| Name | Description |
|---|---|
| node | |
| precision | |
| prefix_tokens | |
| result | Return mlsysim.solvers.PrefixRebuildModel.solve for this scenario; output fields retain the units and feasibility semantics specified by that solver. |
| suffix_tokens | |
| utilization | |
| workload |
workload
Type: Workload.
Declared default: required.
node
Type: Any.
Declared default: required.
precision
Type: str.
Declared default: 'fp16'.
prefix_tokens
Type: int.
Declared default: required.
suffix_tokens
Type: int.
Declared default: required.
utilization
Type: float.
Declared default: required.
result
engine.scenario_types.PrefixRebuildScenario.result
Return mlsysim.solvers.PrefixRebuildModel.solve for this scenario; output fields retain the units and feasibility semantics specified by that solver.
Equation: mlsysim.solvers.PrefixRebuildModel.solve (scenario fields).