Methods and formulas for ARIMA

Select the method or formula of your choice.

Coefficients

The coefficients are estimated using an iterative algorithm that calculates least squares estimates. At each iteration, the back forecasts are computed and SSE is calculated. For more details, see Box and Jenkins1.

The ARIMA algorithm is based on the fitting routine in the TSERIES package written by Professor William Q. Meeker, Jr., of Iowa State University2. We are grateful to Professor Meeker for his help in the adaptation of his routine to Minitab.

Back forecasts

Back forecasts are calculated using the specified model and the current iteration's parameter estimates. For more details, see Cryer3.

SSE

Formula

Notation

TermDescription
n total number of observations
residuals using that iteration's parameter estimates, including back forecasts

SS for residuals

Formula

Notation

TermDescription
n total number of observations
at residuals using the final parameter estimates, excluding back forecasts

DF for residuals

Formula

For a nonseasonal model with a constant term:

(nd) – pq – 1

For a nonseasonal model without a constant term:

(nd) – pq

For a seasonal model with a constant term:

(ndD×s) – pqPQ – 1

For a seasonal model without a constant term

(ndD×s) – pqPQ

Notation

TermDescription
n total number of observations
d number of nonseasonal differences
p number of nonseasonal autoregressive parameters included in the model
q number of nonseasonal moving average parameters included in the model
Dnumber of seasonal differences
slength of the seasonal period
Pnumber of seasonal autoregressive parameters included in the model
Qnumber of seasonal moving average parameters included in the model

MS for residuals

Formula

SS / DF

Chi-square statistic

Formula

Notation

TermDescription
n total number of observations
d number of differences
K 12, 24, 36, 48
k lag
autocorrelation of the residuals for the k th lag

DF for chi-square statistic

Formula

For a nonseasonal model with a constant term:

Kpq – 1

For a nonseasonal model without a constant term:

Kpq

For a seasonal model with a constant term:

KpqPQ – 1

For a seasonal model without a constant term

KpqPQ

Notation

TermDescription
K 12, 24, 36, 48
p number of nonseasonal autoregressive parameters included in the model
q number of nonseasonal moving average parameters included in the model
Pnumber of seasonal autoregressive parameters included in the model
Qnumber of seasonal moving average parameters included in the model

P-value for chi-square statistic

Formula

P(X < χ 2)

Notation

TermDescription
X distributed as χ 2 (DF)

Forecasts

Formula

Forecasts are calculated recursively, based on the model and the parameter estimates. For more details, see Box and Jenkins1. For example, if an ARIMA model is fit with 1 autoregressive term (AR(1)) and one seasonal differencing term with a seasonal period of 12, this model is fit:

Yt Yt–12 = γ + Φ(Yt–1Yt–12–1)

To estimate , the first forecast, where k is the origin, find:

Then, you find , in the same manner, and so on.

To calculate the 95% prediction interval for the forecast, first you have to calculate the weights.

where , for j < 0, and for j > q.

Notation

TermDescription
Yt actual value at time t
Φ autoregressive term
estimated autoregressive term
γ constant term
dnumber of differences
pnumber of autoregressive parameters
qnumber of moving average parameters
estimated moving average term
estimated constant term
MSmean square error
1 Box, G. E. P., Jenkins, G. M., Reinsel, G. C., & Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, 5th Edition. Wiley.
2 W. Q. Meeker (1978). "TSERIES-A User-Oriented Computer Program for Time Series Analysis", The American Statistician, 32, 111-112.
3 J.D. Cryer (1986). Time Series Analysis. Duxbury Press.