Limitations of traditional statistical forecasting techniques

Limitations of traditional statistical forecasting techniques

Limitations of traditional statistical forecasting techniques

Statistical forecasting is probably the most wrongly applied analytical technique in history. When applied right it can function as a strong quantitative baseline for your forecasting and decision-making processes. However, be cautious when using traditional statistical forecasting techniques in case of significant sales turning points in your data.

What’s statistical forecasting?

Put simply, statistical forecasting techniques are used to make predictions about the future by looking at historical data. In the context of a global manufacturing company, it is mostly used to predict future demand by looking at historical sales data. Despite the very quantitative nature of statistical forecasting techniques, one might think that developing a good forecast, boils down to selecting the best forecasting technique that has proven their worth for your type of data/industry/…

However, both researchers and practitioners understand developing a good statistical forecast can sometimes be more an art than a science. Not only is there a wide variety of techniques that you can choose from, depending on how intermittent, seasonal, … your data is, one also has to decide at which level of aggregation the forecast(s) should be calculated, and what kind of metrics should be used to measure its accuracy.

Predicting future sales by extrapolating trends in historical data

Now, here is the bad news… Even if you made all the right decisions with respect to the forecasting techniques, aggregation levels, and accuracy metrics, your forecasts will be way off in case of significant sales turning points in your data.

Let’s take a time series example. Imagine you have the following historical sales pattern:

Figure 1 Example sales pattern

The example sales pattern is quite common. It is in line with the economic situation that a lot of sectors have been in pre-2020: An economy of consistent growth.

Figure 2 illustrates how traditional statistical forecasting techniques extrapolate history to predict the future. Depending on the selected technique we will take a short or a long-term trend, both will predict a further increase in the future. The short-term trend will predict a faster increase than the long-term trend.

Figure 2 Different statistical forecasting techniques extrapolate history to predict the future.

Suppose this consistent growth is followed by a sudden decline in our sales, or a so-called “sales turning point”. At some point in time, we see our sales volumes declining. Traditional statistical forecasting techniques as such cannot predict a sales turning point in the data.

Figure 3 Traditional statistical forecasting extrapolates the short or long term trend. They will therefore never be able to predict a sales turning point

Let’s now take a look at what statistical forecasting models will do: All of a sudden instead of predicting an increase they will predict a decrease. And if you look at the short-term trend in Figure 4 they will extrapolate more aggressively all the way to the bottom, which is not necessarily very helpful either. Month after month your quantitative baseline for forecasting is changing, which creates a very nervous environment for decision making.

Figure 4 Extrapolation of the downward trend during a sales turning point by statistical forecasting techniques

Relying on human judgement

Now what will demand planning best practices recommend us to do? They will recommend that in this situation we refer to experts. We set up a collaborative forecasting process within the company, or across company boundaries with our customers. We will ask the relevant people in the company what they think will happen with our sales. We will not rely on the traditional statistical forecast, but we will rely on our human judgement and our salespeople for specific customer input. That is very nice in theory, but many of those experts don’t have an idea either. If we don’t have good contextual information, we also don’t have an idea. Human behaviour and judgments typically come from short term memory. So, if you look at a consensus forecasting process in companies, also human judgment will typically just extrapolate the recent trend. Whether we rely on trad stat, whether we rely on human judgement, this is what we expect to see in the forecast:

Figure 5 Experts (and collaborative forecasts) will generally adopt a ‘wait and see’ approach, by copying the short-term trend

At some point in time, the situation might stabilize, and we might see a boost again, a recovery. Again, if I’m not able to predict trend changes, I will be too late. Because at some point in time I will see a kind of recovery and if it’s not in my forecast, I won’t have the material to supply. Going forward we know that at some point in time a downward sales turning point is going to bottom out,

  • Either we will see a kind of recovery not really to the level of before (long L-shape)
  • Or are we going to see a recovery to the level of before (V-shape or U-shape)
  • Or are we going to see a recovery which is even going beyond the original level because we recover some earlier lost sales during that crisis period because we are doing better than the competition during the crisis?

Traditional methods don’t help during this situation. The information we get from this is not helpful, on the contrary, it is even misleading. That does not mean that traditional methods don’t have value; they can still help you to predict the mix, they can still help you to predict the short-term trend and short-term volumes. But you should not use a traditional statistical forecasting technique to predict trend changes, because it is simply not capable of doing that.

Sales turning points and leading indicator forecasting

This allows us to arrive at the million-dollar question: how to predict sales turning points? The prediction of this trend changes is not something that can be done solely by looking at our own historical data but is an insight that should be derived by using the impact of external (macro-economic) indicators on our sales patterns.

The technique of leading indicator forecasting looks at which external indicators are making the same turning points as your sales data, only a couple of months in advance. Leading indicators forecasting techniques use those indicators with leading value for your business in order to indicate when a sales turning point is coming up.

Figure 6 Statistical vs leading indicator forecasting

Once we have identified this sales turning or inflection point, we can again focus on the challenge of optimally applying our traditional forecasting techniques to extrapolate short- or long-term trends, seasonality, etc. The combination of statistical forecasting techniques and leading indicators provides companies with the best possible baseline for collaborative forecasting and decision-making processes, that enables us to achieve the optimal balance between supply and demand we are all looking for today!

How to deal with these limitations?

Watch our webinar for more practical tips about how to follow the impact of black swan events and sales turning points with leading indicators!

Watch our webinar
2020-06-09T17:05:30+00:00

Leave A Comment