inferenceHistory

Stores the last MAX_HISTORY_SIZE inference durations (in ms) per model-type key. Used by estimateWaitMs to compute average inference time per model type.