Control · C85

Measure forecast accuracy and bias

Question addressed

Does plan variance come from normal volatility or systematic forecasting bias?

Direct answer

The analysis combines weighted absolute error, signed bias and stability by horizon to distinguish imprecision from recurring optimism.

Decision supported

01Keep the method, correct the bias, shorten the horizon or change the assumptions.

02The rule, the evidence and the next review date stay visible.

How to use this

Move from the question to the deliverable.

01Starting point

Does plan variance come from normal volatility or systematic forecasting bias?

02Decision prepared

Keep the method, correct the bias, shorten the horizon or change the assumptions.

03Deliverable to use

Original forecast-accuracy series

Original chart · SQ-85

Tell an imprecise forecast from a systematically optimistic one

An average error close to zero can hide large errors that offset each other. Precision requires an absolute measure; bias keeps the sign of the variances.

Working context

Fictitious series of marketing pipeline planned and delivered over six months, at constant scope.

  1. 01Freeze

    Keep the forecast published at each horizon instead of replacing it with the latest estimate.

  2. 02Measure

    Calculate WAPE for precision and signed bias for optimism or caution.

  3. 03Segment

    Compare by horizon, channel and type of initiative before aggregating.

  4. 04Correct

    Change the method or the assumptions when the bias persists for three periods.

Original element

Six months of forecast: 9.7% error and optimistic bias

Five months out of six are overestimated. The error is therefore not only volatility: the method carries a bias.

Calculation methodWAPE = Σ|actual − forecast| ÷ Σ actual; bias = Σ(actual − forecast) ÷ Σ actual
M1
−7%Contained variance
M2
−13%Under-delivery confirmed
M3
−5%Close to plan
M4
+2%The only cautious month
M5
−12%Recurring bias
M6
−13%Bias confirmed
MonthForecastActualAbsolute errorBiasReading
M1€420k€390k€30k−€30kOptimistic
M2€460k€402k€58k−€58kOptimistic
M3€480k€455k€25k−€25kOptimistic
M4€500k€512k€12k+€12kCautious
M5€535k€470k€65k−€65kOptimistic
M6€560k€486k€74k−€74kOptimistic
Decision interpretation

01WAPE reaches 9.7% while the signed bias reaches −8.8%: the forecast is affected above all by systematic optimism.

02The bias persists over five months and justifies correcting the planned conversion rates.

03The target is not rewritten: a new forecast is kept alongside the approved plan.

Fictitious data. WAPE becomes unstable when the delivered volumes are very low or nil.

Coherence controls

Minimum conditions before validation.

01Constant scope

The status, the evidence and the owner must be available for review.

02Documented cause

The status, the evidence and the owner must be available for review.

03Assigned decision

The status, the evidence and the owner must be available for review.

04History kept

The status, the evidence and the owner must be available for review.

Usable deliverable

Output produced

Original forecast-accuracy series

Explore the decision further with an interactive control, or start from a structured template to produce your deliverable.