When should a monitoring agent intervene?
Your monitoring agent sees more promotion-day orders. Inspect input drift today, then reveal delayed outcomes to decide whether retraining is warranted.
In training, promotion-day orders made up 20% of traffic. This monitoring policy flags a shift of at least 15 percentage points.
Traffic mix shifted +20 percentage points. Input drift alert opened.
Log the affected cohort and schedule evaluation when actual demand arrives. Forecast accuracy is still unknown.