4.5 ETS basic assumptions and principles
Several assumptions need to hold for the conventional ETS models to work properly. Some of them have already been discussed in Section 1.4.1, and we will come back to them in Chapter 14. What is important in our context is that the conventional ETS assumes that the error term \(\epsilon_t\) follows the Normal distribution with zero mean and variance \(\sigma^2\). There are several points related to this that need to be clarified:
- If the mean was not equal to zero then, for example, the level models would act as models with drift (see Subsection 3.3.4). This implies that the architecture of the model should change, and the conventional ETS models cannot be efficiently applied to such data. Furthermore, correctly estimating such models would not be straightforward, because ETS exhibits a “pull to centre” effect, where the predicted value gets closer to the actual one based on the forecast error of the model. As a result, it would be challenging to capture the non-zero mean of the error term. So, the zero mean assumption is essential for such dynamic models as ETS. For the multiplicative error models, this translates into \(\mathrm{E}(1+\epsilon_t)=1\);
- As it is well known, the Normal distribution is defined for positive, negative, and zero values. This is not a big deal for additive models, which assume that the actual value can be anything, and it is not an issue for the multiplicative models when we deal with high-level positive data (e.g. thousands of units): in this case, the variance of the error term will be small enough, protecting it from becoming negative. However, if the level of the data is low, then the variance of the error term can be large enough for the normally distributed error to cover negative values. And if the error term \(1+\epsilon_t\) becomes negative the model will break. This is a potential flaw in the conventional ETS model with the multiplicative error term. So, what the standard multiplicative error ETS model actually assumes, is that the data we work with is strictly positive and has high-level values.
Based on the assumption of normality of error term, the ETS model can be estimated via the maximisation of likelihood (discussed in Section 11.1), which is equivalent to the minimisation of the mean squared one step ahead forecast error \(e_t\). Note that in order to apply the ETS models to the data, we also need to know the initial values of components, \(\hat{l}_0, \hat{b}_0, \hat{s}_{-m+2}, \hat{s}_{-m+3}, \dots, \hat{s}_{0}\). The conventional approach is to estimate these values together with the smoothing parameters during likelihood maximisation. As a result, the optimisation might involve a large number of parameters. In addition, the variance of the error term is considered as an additional parameter in the maximum likelihood estimation, so the number of parameters for different models is (here “*” stands for any type):
- ETS(*,N,N) – 3 parameters: \(\hat{l}_0\), \(\hat{\alpha}\), and \(\hat{\sigma}^2\);
- ETS(*,*,N) – 5 parameters: \(\hat{l}_0\), \(\hat{b}_0\), \(\hat{\alpha}\), \(\hat{\beta}\), and \(\hat{\sigma}^2\);
- ETS(*,*d,N) – 6 parameters: \(\hat{l}_0\), \(\hat{b}_0\), \(\hat{\alpha}\), \(\hat{\beta}\), \(\hat{\phi}\), and \(\hat{\sigma}^2\);
- ETS(*,N,*) – 4+m-1 parameters: \(\hat{l}_0\), \(\hat{s}_{-m+2}, \hat{s}_{-m+3}, \dots, \hat{s}_{0}\), \(\hat{\alpha}\), \(\hat{\gamma}\), and \(\hat{\sigma}^2\);
- ETS(*,*,*) – 6+m-1 parameters: \(\hat{l}_0\), \(\hat{b}_0\), \(\hat{s}_{-m+2}, \hat{s}_{-m+3}, \dots, \hat{s}_{0}\), \(\hat{\alpha}\), \(\hat{\beta}\), \(\hat{\gamma}\), and \(\hat{\sigma}^2\);
- ETS(*,*d,*) – 7+m-1 parameters: \(\hat{l}_0\), \(\hat{b}_0\), \(\hat{s}_{-m+2}, \hat{s}_{-m+3}, \dots, \hat{s}_{0}\), \(\hat{\alpha}\), \(\hat{\beta}\), \(\hat{\gamma}\), \(\hat{\phi}\), and \(\hat{\sigma}^2\).
Remark. In the case of seasonal models, we typically make sure that the initial seasonal indices are normalised, so we only need to estimate \(m-1\) of them, and the last one is calculated based on the linear combination of the others. For example, for the additive seasonality, it is equal to \(-\sum_{j=1}^{m-1} s_j\) because the sum of all the indices should be equal to zero.
When it comes to selecting the most appropriate model, the conventional approach involves the application of all models to the data and then selecting the most appropriate of them based on an information criterion (Section 15.1). This was first proposed by Hyndman et al. (2002). In the case of the conventional ETS model, this relies on the likelihood value of Normal distribution used in the estimation of the model.
Finally, the assumption of normality is used to generate a prediction interval from the model. There are typically two ways of doing that:
- Calculating the variance of multiple steps ahead forecast error and then using it for the intervals’ construction (see Chapter 6 of Hyndman et al. (2008) or Sections 5.3 and 18.2);
- Generating thousands of possible paths for the components of the series and the actual values and then taking the necessary quantiles for the prediction intervals (see Section 18.1 for details).
Typically, (1) is applied for the pure additive models, where the closed forms for the variances are known, and the assumption of normality holds for several steps ahead. In some special cases of mixed models, approximations for variances work on short horizons (see Section 6.4 of Hyndman et al., 2008). But in all the other cases, (2) should be used, despite being typically slower than (1) and producing bounds that differ slightly from run to run due to randomness.