One thing that bothers me when I read posts on social media or papers in peer-reviewed journals is the claim that a proposed approach is “assumption-free.” In forecasting, this is never true. Such an approach is like a spherical unicorn in a vacuum (see image above). Here’s why. Every model is a simplification of reality, […]
theory
A paper to read over the Xmas holiday: Wang et al. (2023) – Forecast combinations: An over 50-year review
Christmas and the New Year are upon us, and I wanted to publish a celebratory post before taking a break. Instead of writing something educational, I decided to simply recommend a paper for you to read over the holidays – something you might have overlooked in the past couple of years. Here it is or […]
Intermittent demand: don’t try to predict WHEN it will happen
I’ve seen several times ML experts applying principles of classification for intermittent demand forecasting. For example, they try predicting, WHEN the demand will happen. This is not a very sensible thing to do. The featured image in this post shows two forecasting approaches: one that tries to predict when demand happens (the yellow line), and […]
Is there such thing as “Time series forecasting”?
Is there such thing as “Time series forecasting”? I personally don’t like this term and think that we should use a different one. Which one? Come with me in this post to find out. I understand why people use the term “Time series forecasting” – they want to show the type of data they work […]
What about the training/test sets?
Another question my students sometimes ask is how to define the sizes for the training and test sets in a forecasting experiment. If you’ve done data mining or machine learning, you’re likely familiar with this concept. But when it comes to forecasting, there are a few nuances. Let’s discuss. First and foremost, in forecasting, the […]
How to choose forecast horizon?
One of the questions my students sometimes ask is how to set the forecast horizon. The answer depends largely on the task at hand, but there are still some guidelines. First, the forecast horizon depends on data granularity. A “year ahead” forecast on monthly data means forecasting 12 steps ahead, while for daily data, it […]
Are all forecasts wrong?
You’ve probably heard the phrase “all forecasts are wrong”, suggesting that the future is unpredictable and that no forecast will ever match the actual outcome. Well, this phrase is not entirely correct, and here’s why. When your favourite forecasting approach generates point forecasts, it usually provides a conditional mean. This means it’s giving you the […]
Structure vs. Noise: A Fundamental Concept in Forecasting
One of the core ideas in statistics, which extends to many other fields including forecasting, is the concept of structure versus noise. You’ve probably heard of it, but it’s often overlooked by those without a strong quantitative background. So, let’s discuss. The core of the idea is that any data consists of two fundamental parts: […]
Introduction to intermittent demand
Sometimes, when you need to forecast demand, you may notice that the recorded data contains zeroes. There are several possible reasons for this, but today we’ll briefly discuss one of them. Welcome to the world of “intermittent demand”! Intermittent demand is the demand that happens at irregular frequency (Svetunkov & Boylan, 2023). This means you […]
Multistep loss functions: Trace MSE
As we discussed last time, there are two possible strategies in forecasting: recursive and direct. The latter aligns with the estimation of a model using a so-called multistep loss function, such as Mean Squared Error for h-steps-ahead forecast (MSEh). But this is not the only loss function that can be efficiently used for model estimation. […]