Economics Scenarios
Cost, resource pricing, staffing, and investment tradeoffs.
Source locations
- Inputs and calculations:
mlsysim/engine/scenario_definitions/economics.py. - Named configurations:
mlsysim/engine/scenario_catalog/economics/. - Result schemas:
mlsysim/engine/result_types/economics.py.
Public imports and existing class reference URLs remain stable.
Scenario contracts
- AdaptationPaybackScenario: A one-time adaptation that cuts each task’s model usage, against its incremental cost.
- ArchitectureChoiceScenario: Single-call designs and a bounded loop under one check, with a human fallback for rejects.
- BatchServingCostScenario: One accelerator rented at
price, serving batches back to back: cost per request by batch size. - CanaryScheduleScenario: A staged rollout that needs
samples_per_variantguardrail samples per stage atrequest_rate;stagesis the configured ladder of (traffic share, duration). - ClickLossScenario: A silent click-through regression from
ctr_beforetoctr_afteratrequest_rate, caught afterdetection_time; each click is worthvalue_per_click. - CloudEdgeCostScenario: Serving a network of sites from the cloud (pay per image) or from a device at each site (buy up front).
- CohortAttemptCostScenario: One configuration’s cohort of tasks, one bounded attempt each, all charges settled.
- CompactionPaybackScenario: One compaction of a billed trajectory: a summary resent fresh, then shorter cached reads.
- ConservedBudgetScenario: A root budget granted to two children; the second stops with a remote job billed late.
- DedicatedBreakEvenScenario: Renting a matched-capability API against owning capacity at a fixed hourly cost.
- DisclosurePenaltyScenario: Penalties for an incomplete account:
days_withheldatdaily_maximumeach, plusothers(name -> amount), all in USD. - ExplanationLoadScenario: Reasons owed for every denial:
decisions_per_dayatdenial_share, each explained by a sampling attributor ofsamplesmodel evaluations or by exact Shapley overfeatures. - FeatureHistoryScenario: Full-snapshot feature history:
entitiesxfeaturesvalues everyupdate_interval, kept forretention, each row a value, an entity key, andtimestampstimestamps. - IdleCapacityCostScenario:
gpusaccelerators held idle fordurationatdevice_hour_rate. - KingmanQueueScenario: One server under Kingman’s approximation at two utilizations, with a holding price.
- LifecycleTcoScenario: Monthly lifecycle cost in four terms (training, inference, data, iteration), each counted once.
- ModelCascadeScenario: A tiered cascade over a completed cohort, every exit under one gate, against the top tier alone.
- OperationalLoadScenario: Assumed operational-load shapes for
Nmodels: alertsa N, deploymentsN ln N, and pairwise conflictsc N^2against one team’steam_capacity. - OptimizationPaybackScenario: An optimization costing
implementation_costthat cuts amonthly_billbyreduction. - OwnVsRentScenario: Owning
gpusaccelerators against renting them atrent_rateper GPU-hour forutilizationof every hour, overyears. - PlatformBenefitScenario: A shared platform costing
platform_costper month that saves each ofmodelsmodel teamshours_savedper month atengineer_rate. - ResendCacheBillScenario: An append-only trajectory (
TrajectoryResendScenario) billed under one tariff, with and without reuse. - RetryPolicyScenario: A cheap attempt retried up to a cap, run as a batch, or one stronger attempt.
- RevenueRegressionScenario: A metric regression that cuts revenue in proportion for
undetected(or foralertedwith an alert and containment); revenue isweekly_revenueper week. - ReviewStaffingScenario: Substantive human review:
appeal_rateofdecisions_per_dayattime_per_caseeach, staffed inshift-long shifts; optionally against a reportedcompare_caseshandled atcompare_time_per_case. - RolloutExposureScenario: Users exposed until rollback under an all-at-once cutover against a canary share, with the same request rate, harm, and time to rollback.
- SerialEpisodeScenario: One serial episode as disjoint intervals; the model’s intervals sped up by
model_speedup. - ServiceLifecycleCostScenario: A service’s multi-year cost in three terms: repeated training cycles, recurring inference, and operations, with a GPU-hour carbon factor.
- ServingCostScenario: One model version’s training spend against its first year of serving.
- ServingInstanceCostScenario: Instances with an hourly price and a saturated request rate: cost per request, and when the
smallinstance sized to the load undercuts onelargeinstance. - SpeculativeEpisodeScenario: Speculative decoding on a serial episode’s model time, at two draft acceptance levels.
- SpotEffectiveCostScenario: Spot capacity priced per hour of retained progress.
- SpotRunScenario: A training run of
run_durationonfleet, on demand against spot capacity. - SupervisionLaborScenario: The person-hours a supervised fleet creates in one
operating_day: an assistant staffed the whole day (busy atqueue’s utilization, watching otherwise) plussweepscorridor sweeps. - TokenPriceComparisonScenario: Two cohort configurations under one acceptance contract: does the cheaper token win?
- TrainingCampaignCostScenario:
runs_per_yeartraining runs ofrun_lowtorun_highon an owned cluster (ownership) against renting the same GPUs only while each run lasts. - TrajectoryAdmissionScenario: A stationary admitted population of trajectories against a token-per-minute quota.
- UtilizationGainScenario: A fleet of
fleet_gpusraised fromutilization_beforetoutilization_after. - WorkloadLeverScenario: Attempt cost by term for several workloads, and three levers on cost per accepted task.