\( \newcommand{\mathbbm}[1]{\boldsymbol{\mathbf{#1}}} \)

Preface

Disclaimer

This is the online version of the monograph published by Chapman and Hall/CRC on 8th November 2023. You can find out more about the book and purchase it on the website of the publisher.

Remark. This is the up-to-date version of the monograph, which relies on the most recent version of the smooth package in R. If you want to run examples in R, make sure to use the appropriate version of the package. This book is compiled with the smooth v4.1.1.41004.

Who is this book for?

This monograph assumes that the reader has a good understanding of statistics and a good knowledge of regression analysis. Some chapters rely on more advanced topics, including likelihood and information criteria. These are explained, for example, in Svetunkov (2022). Some parts of the book also use linear algebra to show how various properties of state space models are derived. However, these can be skipped by a reader who is not comfortable with higher maths without losing in the understanding of the main idea of models. Furthermore, while the monograph is self-sufficient to a large extent, it does not contain a detailed discussion of special cases of state space models (e.g. the local level model is only discussed in passing in Section 4.3, while the local trend is covered in Section 4.4). The reader interested in knowing more about some special cases is referred to the Hyndman et al. (2008) monograph. Finally, while the monograph starts with the basics of forecasting and explains some of the simple forecasting techniques, it does not cover these in detail. A good book covering the fundamentals of forecasting is Ord et al. (2017).

In a more wide sense, this book is written for data scientists, computer scientists, and data, business, and marketing analysts who work in forecasting or want to learn more about univariate forecasting using statistical models.

What is ADAM?

ADAM stands for “Augmented Dynamic Adaptive Model”. The term “adaptive model” means that the parameters of the model change over time according to some assumed process. The word “dynamic” reflects the idea that the model has time series related components (ETS, ARIMA). Finally, the word “augmented” is included because ADAM is the model that supports additional features not included in the conventional ETS/ARIMA. ADAM is a unified framework for constructing ETS/ARIMA/regression, based on more advanced statistical instruments. For example, classical ARIMA is built on the assumption of normality of the error term, but ADAM lifts this assumption and allows for using other distributions as well (e.g. Generalised Normal, Inverse Gaussian, etc). Another example: typically the conventional models are estimated either via the maximisation of the likelihood function or using basic losses like MSE or MAE (see Section 2.1), but ADAM includes a broader spectrum of losses and allows using custom ones. There is much more, and we will discuss different aspects of ADAM in detail later in this monograph. Here is a brief list of ADAM features:

ETS (Chapters 5, 6 and 7);
ARIMA (Chapter 9);
Regression (Chapter 10);
TVP regression (Chapter 10);
Combination of (1), (2), and either (3) or (4);
Automatic selection/combination of states for ETS (Section 15.1);
Automatic orders selection for ARIMA (Section 15.2);
Variables selection for regression (Section 15.3);
Normal and non-normal distributions (Sections 5.5 and 6.5);
Automatic selection of most suitable distributions (Chapter 15);
Multiple seasonality (Chapter 12);
Occurrence part of the model to handle zeroes in data (intermittent demand, Chapter 13);
Modelling scale of distribution (GARCH and beyond, Chapter 17);
Handling uncertainty of estimates of parameters (Chapter 16);
A variety of ways to produce forecasts for different situation (Chapter 18).

All these extensions are needed to solve specific real life problems, so we will include examples and case studies later in the book to see how all of this can be used. The adam() function from the smooth package for R implements ADAM and supports the following features:

Model diagnostics using plot() and other methods (Chapter 14);
Confidence intervals for parameters of models (Sections 16.2 and 16.3);
Automatic outliers detection (Section 14.4);
Handling missing data (based on the model in Chapter 13);
Fine-tuning of persistence vector (smoothing parameters, discussed briefly in Section 11.4);
Fine-tuning of initial values of the state vector (e.g. level/trend/seasonality, see Section 11.4);
Two initialisation options (optimal/backcasting from Section 11.4);
Advanced and custom loss functions (Chapter 11);
Manual parameters for ETS, ARMA, and regression;
Fine-tuning of the optimiser (selection of optimisation algorithm and convergence criteria, Section 11.4);
Scale model via the sm() method (Chapter 17).

This monograph uses two packages from R, namely greybox, which focuses on forecasting using regression models, and smooth, which implements Single Source of Error (SSOE) state space models for time series analysis and forecasting. The monograph focuses on explaining how ADAM, one of the smooth functions (introduced in v3.0.0), works, also showing how it can be used in practice with examples from R.

If you want to run examples from the monograph, two R packages are needed (Svetunkov, 2024a, 2024b):

install.packages("greybox")
install.packages("smooth")

Some explanations of functions from the packages are given in my blog: Package greybox for R, Package smooth for R.

An important thing to note is that this monograph does not use tidyverse packages. I like base R, and, to be honest, I am sure that tidyverse packages are great, but I have never needed them in my research. So, I will not use pipeline operators, tibble or tsibble objects and ggplot2. I assume throughout the monograph that you can do all those nice tricks on your own if you want to.

How to cite ADAM

You can use the following to cite the monograph:

Svetunkov, I. (2023). Forecasting and Analytics with the Augmented Dynamic Adaptive Model (ADAM) (1st ed.). Chapman and Hall/CRC. https://doi.org/10.1201/9781003452652

If you use LaTeX, the following can be used instead:

@book{SvetunkovAdam,
    author = {Ivan Svetunkov},
    isbn = {978-1-003-45265-2},
    publisher = {Chapman and Hall/CRC},
    title = {Forecasting and Analytics with the Augmented Dynamic Adaptive Model (ADAM)},
    doi = {10.1201/9781003452652},
    url = {https://openforecast.org/adam/},
    year = {2023}
}

License

This monograph is licensed under Creative Common License by-nc-sa 4.0, which means that you can share, copy, redistribute, and remix the content of the monograph for non-commercial purposes as long as you give appropriate credit to the author and provide the link to the original license. If you remix, transform, or build upon the material, you must distribute your contributions under the same CC-BY-NC-SA 4.0 license. See the explanation on the Creative Commons website.

Acknowledgments

I would like to thank Robert Fildes for his comments about this book and helping in shaping it into a monograph and J. Keith Ord for his invaluable suggestions for improvement of the monograph. I also would like to thank Tobias Schmidt and Benedikt Sonnleitner for correcting grammatical mistakes.

References

• Hyndman, R.J., Koehler, A.B., Ord, J.K., Snyder, R.D., 2008. Forecasting with Exponential Smoothing: The State Space Approach. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-71918-2

• Ord, J.Keith., Fildes, R., Kourentzes, N., 2017. Principles of Business Forecasting, 2nd ed. Wessex Press, Inc, New York, New York, USA.

• Svetunkov, I., 2024a. Greybox: Toolbox for model building and forecasting. https://github.com/config-i1/greybox R package version 2.0.3.41005

• Svetunkov, I., 2024b. Smooth: Forecasting using state space models. https://github.com/config-i1/smooth R package version 4.1.1.41004

• Svetunkov, I., 2022. Statistics for business analytics. https://openforecast.org/sba/ version: 31.10.2022