Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-lj6df Total loading time: 0 Render date: 2024-11-05T04:13:54.448Z Has data issue: false hasContentIssue false

10 - Analysis of changepoint models

from III - Switching models

Published online by Cambridge University Press:  07 September 2011

Idris A. Eckley
Affiliation:
Lancaster University
Paul Fearnhead
Affiliation:
Lancaster University
Rebecca Killick
Affiliation:
Lancaster University
David Barber
Affiliation:
University College London
A. Taylan Cemgil
Affiliation:
Boğaziçi Üniversitesi, Istanbul
Silvia Chiappa
Affiliation:
University of Cambridge
Get access

Summary

Introduction

Many time series are characterised by abrupt changes in structure, such as sudden jumps in level or volatility. We consider changepoints to be those time points which divide a dataset into distinct homogeneous segments. In practice the number of changepoints will not be known. The ability to detect changepoints is important for both methodological and practical reasons including: the validation of an untested scientific hypothesis [27]; monitoring and assessment of safety critical processes [14]; and the validation of modelling assumptions [21].

The development of inference methods for changepoint problems is by no means a recent phenomenon, with early works including [39], [45] and [28]. Increasingly the ability to detect changepoints quickly and accurately is of interest to a wide range of disciplines. Recent examples of application areas include numerous bioinformatic applications [37, 15], the detection of malware within software [51], network traffic analysis [35], finance [46], climatology [32] and oceanography [34].

In this chapter we describe and compare a number of different approaches for estimating changepoints. For a more general overview of changepoint methods, we refer interested readers to [8] and [11]. The structure of this chapter is as follows. First we introduce the model we focus on. We then describe methods for detecting a single changepoint and methods for detecting multiple changepoint, which will cover both frequentist and Bayesian approaches.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] H., Akaike. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6):716–723, 1974.Google Scholar
[2] I. E., Auger and C. E., Lawrence. Algorithms for the optimal identification of segment neighborhoods. Bulletin of Mathematical Biology, 51(1):39–54, 1989.Google Scholar
[3] D., Barry and J. A., Hartigan. Product partition models for change point problems. Annals of Statistics, 20:260–279, 1992.Google Scholar
[4] D., Barry and J. A., Hartigan. A Bayesian analysis for change point problems. Journal of the American Statistical Association, 88:309–319, 1993.Google Scholar
[5] M. S., Bartlett. A comment on D. V. Lindley's statistical paradox. Biometrika, 44:533–534, 1957.Google Scholar
[6] J. V., Braun, R. K., Braun and H. G., Muller. Multiple changepoint fitting via quasilikelihood, with application to DNA sequence segmentation. Biometrika, 87:301–314, 2000.Google Scholar
[7] J. V., Braun and H. G., Muller. Statistical methods for DNA sequence segmentation. Statistical Science, 13(2):142–162, 1998.Google Scholar
[8] E., Carlstein, H. G., Muller and D., Siegmund, editors. Change-point problems. Institute of Mathematical Statistics Lecture Notes, 1994.Google Scholar
[9] T., Cemgil, H. J., Kappen and D., Barber. A generative model for music transcription. IEEE Transactions on Audio, Speech and Language Processing, 14:679–694, 2006.Google Scholar
[10] J., Chen and A. K., Gupta. Testing and locating variance changepoints with application to stock prices. Journal of the American Statistical Association, 92:739–747, 1997.Google Scholar
[11] J., Chen and A. K., Gupta. Parametric Statistical Change Point Analysis. Birkhauser, 2000.Google Scholar
[12] R. A, Davis, T. C. M, Lee and G. A., Rodriguez-Yam. Structural break estimation for nonstationary time series models. Journal of the American Statistical Association, 101(473):223–239, 2006.Google Scholar
[13] S., Dayanik, C., Goulding and H. V., Poor. Bayesian sequential change diagnosis. Mathematics of Operations Research, 33:475–496, 2008.Google Scholar
[14] J. B., Elsner, F. N., Xu and T. H., Jagger. Detecting shifts in hurricane rates using a Markov chain Monte Carlo approach. Journal of Climate, 17:2652–2666, 2004.Google Scholar
[15] C., Erdman and J. W., Emerson. A fast Bayesian change point analysis for the segmentation of microarray data. Bioinformatics, 24(19):2143–2148, 2008.Google Scholar
[16] P., Fearnhead. Exact Bayesian curve fitting and signal segmentation. IEEE Transactions on Signal Processing, 53:2160–2166, 2005.Google Scholar
[17] P., Fearnhead. Exact and effcient Bayesian inference for multiple changepoint problems. Statistics and Computing, 16:203–213, 2006.Google Scholar
[18] P., Fearnhead. Computational methods for complex stochastic systems: A review of some alternatives to MCMC. Statistics and Computing, 18:151–171, 2008.Google Scholar
[19] P., Fearnhead and Z., Liu. Online inference for multiple changepoint problems. Journal of the Royal Statistical Society Series B, 69:589–605, 2007.Google Scholar
[20] P., Fearnhead and D., Vasilieou. Bayesian analysis of isochores. Journal of the American Statistical Association, 485:132–141, 2009.Google Scholar
[21] P., Fryzlewicz and S., Subba Rao. Basta: consistent multiscale multiple change-point detection for piecewise-stationary ARCH processes. (In submission), 2009.
[22] P. J., Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82:711–732, 1995.Google Scholar
[23] A. K., Gupta and J., Chen. Detecting changes of mean in multidimensional normal sequences with applications to literature and geology. Computational Statistics, 11:211–221, 1996.Google Scholar
[24] A. K., Gupta and J., Tang. On testing homogeneity of variances for Gaussian models. Journal of Statistical Computation and Simulation, 27:155–173, 1987.Google Scholar
[25] P., Haccou, E., Meelis and S., Geer. The likelihood ratio test for the change point problem for exponentially distributed random variables. Stochastic Processes and Their Applications, 27:121–139, 1988.Google Scholar
[26] E. J., Hannan and B. G., Quinn. The determination of the order of an autoregression. Journal of the Royal Statistical Society, Series B, 41(2):190–195, 1979.Google Scholar
[27] R., Henderson and J. N. S., Matthews. An investigation of changepoints in the annual number of cases of haemolytic uraemic syndrome. Applied Statistics, 42:461–471, 1993.Google Scholar
[28] D. V., Hinkley. Inference about the change-point in a sequence of random variables. Biometrika, 57:1–17, 1970.Google Scholar
[29] D. V., Hinkley and E. A., Hinkley. Inference about the change-point in a sequence of binomial random variables. Biometrika, 57:477–488, 1970.Google Scholar
[30] D. A., Hsu. Detecting shifts of parameter in gamma sequences with applications to stock price and air traffic flow analysis. Journal of the American Statistical Association, 74:31–40, 1979.Google Scholar
[31] C., Inclan and G. C., Tiao. Use of cumulative sums of squares for retrospective detection of changes of variance. Journal of the American Statistical Association, 89(427):913–923, 1994.Google Scholar
[32] J., Reeves, J., Chen, X. L., Wang, R., Lund and Q., Lu. A review and comparison of changepoint detection techniques for climate data. Journal of Applied Meteorology and Climatology, 6:900–915, 2007.Google Scholar
[33] H., Jeffreys. The Theory of Probability. Oxford University Press, 1961.Google Scholar
[34] R., Killick, I. A., Eckley, K., Ewans and P., Jonathan. Detection of changes in variance of oceanographic time-series using changepoint analysis. Ocean Engineering, 37:1120–1126, 2010.Google Scholar
[35] D. W., Kwon, K., Ko, M., Vannucci, A. L. N., Reddy and S., Kim. Wavelet methods for the detection of anomalies and their application to network traffic analysis. Quality and Reliability Engineering International, 22:953–969, 2006.Google Scholar
[36] M., Lavielle and E., Lebarbier. An application of MCMC methods for the multiple change-points problem. Signal Processing, 81:39–53, 2001.Google Scholar
[37] P., Lio and M., Vannucci. Wavelet change-point prediction of transmembrane proteins. Bioinformatics, 16(4):376–382, 2000.Google Scholar
[38] J. S., Liu and C. E., Lawrence. Bayesian inference on biopolymer models. Bioinformatics, 15:38–52, 1999.Google Scholar
[39] E. S., Page. Continuous inspection schemes. Biometrika, 41:100–115, 1954.Google Scholar
[40] A. N., Pettitt. A non-parametric approach to the change-point problem. Applied Statistics, 28:126–135, 1979.Google Scholar
[41] E., Punskaya, C., Andrieu, A., Doucet and W. J., Fitzgerald. Bayesian curve fitting using MCMC with applications to signal segmentation. IEEE Transactions on Signal Processing, 50:747–758, 2002.Google Scholar
[42] G., Schwarz. Estimating the dimension of a model. Annals of Statistics, 6:461–464, 1978.Google Scholar
[43] A. J., Scott and M., Knott. A cluster analysis method for grouping means in the analysis of variance. Biometrics, 30(3):507–512, 1974.Google Scholar
[44] A., Sen and M. S., Srivastava. On tests for detecting change in mean. Annals of Statistics, 3(1):98–108, 1975.Google Scholar
[45] A. N., Shiryaev. On optimum methods in quickest detection problems. Theory of Probability and its Applications, 8:26–51, 1963.Google Scholar
[46] V., Spokoiny. Multiscale local change point detection with applications to value-at-risk. Annals of Statistics, 37:1405–1436, 2009.Google Scholar
[47] A. G., Tartakovsky and V. V., Veeravalli. General asymptotic Bayesian theory of quickest change detection. Theory of Probability and Its Applications, 49:458–497, 2004.Google Scholar
[48] E. S., Venkatraman. Consistency results in multiple change-point problems. PhD thesis, Stanford University, 1993.
[49] L. J., Vostrikova. Detecting disorder in multidimensional random processes. Soviet Mathematics Doklady, 24:55–59, 1981.Google Scholar
[50] G. C. G., Wei and M. A., Tanner. A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. Journal of the American Statistical Association, 85(411):699–704, 1990.Google Scholar
[51] G., Yan, Z., Xiao and S., Eidenbenz. Catching instant messaging worms with change-point detection techniques. In Proceedings of the USENIX workshop on large-scale exploits and emergent threats, 2008.Google Scholar
[52] T. Y., Yang and L., Kuo. Bayesian binary segmentation procedure for a Poisson process with multiple changepoints. Journal of Computational and Graphical Statistics, 10:772–785, 2001.Google Scholar
[53] Y., Yao. Estimation of a noisy discrete-time step function: Bayes and empirical Bayes approaches. Annals of Statistics, 12:1434–1447, 1984.Google Scholar
[54] Y., Yao. Estimating the number of change-points via Schwarz's criterion. Statistics and Probability Letters, 6:181–189, 1988.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×