smooth in Python: TBATS implementation

TBATS results on two datasets

TBATS is a popular exponential smoothing model for data with complex seasonality: long seasonal periods, fractional ones (e.g. 52.18 weeks in a year, as I discussed in my previous post), and several of them at once. It models seasonality with harmonics and includes a Box-Cox transformation, ETS level and trend, and ARMA errors (De Livera, … Read more

smooth in Python: iETS and the Croston’s Method

Occurrence ETS model

Is there a statistical model underlying Croston’s method? This question has been bothering researchers for decades. Croston proposed his method back in 1972, and some even argued that there is no sensible model behind it (Shenstone & Hyndman, 2005). Yet there is one! Let me explain. But first, why bother? Because a method just gives … Read more

smooth in Python: fixed probability model for demand occurrence

Example of intermittent demand

When demand is intermittent, one of the most useful forecasts you can produce is not “how much will we sell”, but “how likely are we to sell anything at all”. And this probability can be modelled, just like demand itself. This idea goes back to Croston, who suggested splitting intermittent demand into demand occurrence and … Read more

What the Average Demand Interval (ADI) hides

Demand occurrence with changing probability of occurrence

Have you used the Average Demand Interval (ADI) for analysis or classification? Do you know that it has some issues? Let me explain. I don’t know when specifically ADI was proposed, but it was popularised by Syntetos, Boylan & Croston (2005), yes, the same Croston from this post. A demand interval is the number of … Read more

The main idea behind the Croston’s method

How Croston works

Have you heard of Croston’s method for intermittent demand forecasting? Some modern data scientists dislike it because it is too simple and not as accurate as some modern forecasting approaches. And they have a point. But here is why it is worth keeping Croston in mind. Back in 1972, John Croston, who worked on stock … Read more

Simple Exponential Smoothing: one parameter instead of many weights

SMA vs SES

In one of the comments to my previous post about the Simple Moving Average on LinkedIn, a reader mentioned that they use a Weighted Moving Average with their own weighting scheme. This can work well although defining the weights can be a nuisance: a Weighted Moving Average of order 12 needs 12 weights that someone … Read more

smooth for Python: Automatic order selection for MSARIMA

Multiple seasonal ARIMA selected for the half-hourly electricity demand series

Have you ever tried to identify ARIMA for your data? The old school Box-Jenkins methodology implies analysing ACF/PACF plots and selecting the orders iteratively. This approach has a fundamental flaw I discussed in one of my earlier posts. Brute force does not help either: even p ≤ 3, d ≤ 2, q ≤ 3 gives … Read more

The Menace of ML: Simple Moving Average

Simple Moving Average of order 8

And here is another forecasting method that is hard to beat in practice. In a recent competition, it gave data scientists huge headaches and even outperformed some powerful ML methods. What’s the name of this beast?! Simple Moving Average! The idea behind the Simple Moving Average (SMA) is to take the average of the last … Read more