Partial autocorrelation function

In time series analysis, the partial autocorrelation function (PACF) gives the partial correlation of a stationary time series with its own lagged values, regressed the values of the time series at all shorter lags. It contrasts with the autocorrelation function, which does not control for other lags.

This function plays an important role in data analysis aimed at identifying the extent of the lag in an autoregressive (AR) model. The use of this function was introduced as part of the Box–Jenkins approach to time series modelling, whereby plotting the partial autocorrelative functions one could determine the appropriate lags p in an AR (p) model or in an extended ARIMA (p,d,q) model.

Definition

Given a time series $z_{t}$ , the partial autocorrelation of lag $k$ , denoted $\phi _{k,k}$ , is the autocorrelation between $z_{t}$ and $z_{t+k}$ with the linear dependence of $z_{t}$ on $z_{t+1}$ through $z_{t+k-1}$ removed. Equivalently, it is the autocorrelation between $z_{t}$ and $z_{t+k}$ that is not accounted for by lags $1$ through $k-1$ , inclusive. $\phi _{1,1}=\operatorname {corr} (z_{t+1},z_{t}),{\text{ for }}k=1,$ $\phi _{k,k}=\operatorname {corr} (z_{t+k}-{\hat {z}}_{t+k},\,z_{t}-{\hat {z}}_{t}),{\text{ for }}k\geq 2,$ where ${\hat {z}}_{t+k}$ and ${\hat {z}}_{t}$ are linear combinations of $\{z_{t+1},z_{t+2},...,z_{t+k-1}\}$ that minimize the mean squared error of $z_{t+k}$ and $z_{t}$ respectively. For stationary processes, ${\hat {z}}_{t+k}$ and ${\hat {z}}_{t}$ are the same.^[2]

Calculation

The theoretical partial autocorrelation function of a stationary time series can be calculated by using the Durbin–Levinson Algorithm: $\phi _{n,n}={\frac {\rho (n)-\sum _{k=1}^{n-1}\phi _{n-1,k}\rho (n-k)}{1-\sum _{k=1}^{n-1}\phi _{n-1,k}\rho (k)}}$ where $\phi _{n,k}=\phi _{n-1,k}-\phi _{n,n}\phi _{n-1,n-k}$ for $1\leq k\leq n-1$ and $\rho (n)$ is the autocorrelation function.^[3]^[4]^[5]

The formula above can be used with sample autocorrelations to find the sample partial autocorrelation function of any given time series.^[6]^[7]

Examples

The partial autocorrelation of white noise is zero for all lags.

AR models have nonzero partial autocorrelations for lags less than or equal to its order. In other words, the partial autocorrelation of an AR(p) process is zero at lags greater than p.

For moving average (MA) models, their partial autocorrelation exponentially decays to 0. For MA models that have $\phi _{1,1}>0$ , the decay is oscillating and the other models with $\phi _{1,1}<0$ have geometric decay.

The partial autocorrelation function of an ARMA(p, q) model also exponentially decays but only after lags greater than p.^[5]^[8]

Autoregressive model identification

Partial autocorrelation is a commonly used tool for identifying the order of an autoregressive model.^[6] As previously mentioned, the partial autocorrelation of an AR(p) process is zero at lags greater than p.^[5]^[8] If an AR model is determined to be appropriate, then the sample partial autocorrelation plot is examined to help identify the order.

The estimated partial autocorrelation of lags greater than p for an AR(p) time series is independently and normally distributed with a mean of 0 and a variance of ${\textstyle {\frac {1}{n}}}$ where ${\textstyle n}$ is the number of observations in the time series.^[9] The standard error is ${\textstyle {\frac {1}{\sqrt {n}}}}$ and a confidence interval can be constructed by multiplying the standard error and a selected z-score. Lags with partial autocorrelations outside of the confidence interval indicate that the AR model's order is likely greater than or equal to the lag. Plotting the partial autocorrelation function and drawing the lines of the confidence interval is a common way to analyze the order of an AR model.

References

^ Brockwell, Peter J.; Davis, Richard A. (2016). "Modeling and Forecasting with ARMA Processes". Introduction to Time Series and Forecasting (Third ed.). Springer International Publishing. p. 132. ISBN 978-3319298528.
^ Shumway, Robert H.; Stoffer, David S. (2017). Time Series Analysis and Its Applications: With R Examples. Springer Texts in Statistics. Cham: Springer International Publishing. pp. 97–98. doi:10.1007/978-3-319-52452-8. ISBN 978-3-319-52451-1.
^ Durbin, J. (1960). "The Fitting of Time-Series Models". Revue de l'Institut International de Statistique / Review of the International Statistical Institute. 28 (3): 233–244. doi:10.2307/1401322. ISSN 0373-1138.
^ Shumway, Robert H.; Stoffer, David S. (2017). Time Series Analysis and Its Applications: With R Examples. Springer Texts in Statistics. Cham: Springer International Publishing. pp. 103–104. doi:10.1007/978-3-319-52452-8. ISBN 978-3-319-52451-1.
^ ^a ^b ^c Enders, Walter (2004). Applied econometric time series (2nd ed.). Hoboken, NJ: J. Wiley. pp. 65–67. ISBN 0-471-23065-0. OCLC 52387978.
^ ^a ^b Box, George E. P.; Reinsel, Gregory C.; Jenkins, Gwilym M. (2008). Time Series Analysis: Forecasting and Control (4th ed.). Hoboken, New Jersey: John Wiley. ISBN 9780470272848.
^ Brockwell, Peter J.; Davis, Richard A. (1991). Time Series: Theory and Methods (2nd ed.). New York, NY: Springer. pp. 102, 243–245. ISBN 9781441903198.
^ ^a ^b Das, Panchanan (2019). Econometrics in Theory and Practice : Analysis of Cross Section, Time Series and Panel Data with Stata 15. 1. Singapore: Springer. pp. 294–299. ISBN 978-981-329-019-8. OCLC 1119630068.{{cite book}}: CS1 maint: date and year (link)
^ Quenouille, M. H. (1949). "Approximate Tests of Correlation in Time-Series". Journal of the Royal Statistical Society: Series B (Methodological). 11 (1): 68–84. doi:10.1111/j.2517-6161.1949.tb00023.x.

This article incorporates public domain material from http://www.itl.nist.gov/div898/handbook/pmc/section4/pmc4463.htm. National Institute of Standards and Technology. {{citation}}: External link in |title= (help)

[1] Brockwell, Peter J.; Davis, Richard A. (2016). "Modeling and Forecasting with ARMA Processes". Introduction to Time Series and Forecasting (Third ed.). Springer International Publishing. p. 132. ISBN 978-3319298528.

[2] Shumway, Robert H.; Stoffer, David S. (2017). Time Series Analysis and Its Applications: With R Examples. Springer Texts in Statistics. Cham: Springer International Publishing. pp. 97–98. doi:10.1007/978-3-319-52452-8. ISBN 978-3-319-52451-1.

[3] Durbin, J. (1960). "The Fitting of Time-Series Models". Revue de l'Institut International de Statistique / Review of the International Statistical Institute. 28 (3): 233–244. doi:10.2307/1401322. ISSN 0373-1138.

[4] Shumway, Robert H.; Stoffer, David S. (2017). Time Series Analysis and Its Applications: With R Examples. Springer Texts in Statistics. Cham: Springer International Publishing. pp. 103–104. doi:10.1007/978-3-319-52452-8. ISBN 978-3-319-52451-1.

[:1-5] Enders, Walter (2004). Applied econometric time series (2nd ed.). Hoboken, NJ: J. Wiley. pp. 65–67. ISBN 0-471-23065-0. OCLC 52387978.

[:0-6] Box, George E. P.; Reinsel, Gregory C.; Jenkins, Gwilym M. (2008). Time Series Analysis: Forecasting and Control (4th ed.). Hoboken, New Jersey: John Wiley. ISBN 9780470272848.

[7] Brockwell, Peter J.; Davis, Richard A. (1991). Time Series: Theory and Methods (2nd ed.). New York, NY: Springer. pp. 102, 243–245. ISBN 9781441903198.

[:2-8] Das, Panchanan (2019). Econometrics in Theory and Practice : Analysis of Cross Section, Time Series and Panel Data with Stata 15. 1. Singapore: Springer. pp. 294–299. ISBN 978-981-329-019-8. OCLC 1119630068.{{cite book}}: CS1 maint: date and year (link)

[9] Quenouille, M. H. (1949). "Approximate Tests of Correlation in Time-Series". Journal of the Royal Statistical Society: Series B (Methodological). 11 (1): 68–84. doi:10.1111/j.2517-6161.1949.tb00023.x.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]