Hostname: page-component-5cf477f64f-n7lw4 Total loading time: 0 Render date: 2025-03-26T10:12:54.513Z Has data issue: false hasContentIssue false
  • English
  • Français

Perturbation theory for killed Markov processes and quasi-stationary distributions

Part of: Markov processes Probabilistic methods, simulation and stochastic differential equations

Published online by Cambridge University Press:  19 March 2025

Daniel Rudolf  and
Andi Q. Wang
Daniel Rudolf*
Affiliation:
Universität Passau
Andi Q. Wang*
Affiliation:
University of Warwick
*
*Postal address: Faculty of Computer Science and Mathematics, Universität Passau, Innstrasse 33, 94032 Passau, Germany. Email: [email protected]
**Postal address: Department of Statistics, University of Warwick, Coventry, CV4 7AL, UK. Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Motivated by recent developments of quasi-stationary Monte Carlo methods, we investigate the stability of quasi-stationary distributions of killed Markov processes under perturbations of the generator. We first consider a general bounded self-adjoint perturbation operator, and then study a particular unbounded perturbation corresponding to truncation of the killing rate. In both scenarios, we quantify the difference between eigenfunctions of the smallest eigenvalue of the perturbed and unperturbed generators in a Hilbert space norm. As a consequence, $\mathcal{L}^1$-norm estimates of the difference of the resulting quasi-stationary distributions in terms of the perturbation are provided.

Keywords

Monte Carlo methods

MSC classification

Primary: 60J35: Transition functions, generators and resolvents
Secondary: 65C05: Monte Carlo methods 60J22: Computational methods in Markov chains
Type
Original Article
Information
Advances in Applied Probability , First View , pp. 1 - 28
Check for updates
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Applied Probability Trust

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aldous, D., Flannery, B. and Palacios, J. L. (1988). Two applications of urn processes: the fringe analysis of search trees and the simulation of quasi-stationary distributions of Markov chains. Probability in the Engineering and Informational Sciences 2, 293–307.CrossRefGoogle Scholar
Baudel, M., Guyader, A. and Lelièvre, T. (2023). On the Hill relation and the mean reaction time for metastable processes. Stochastic Processes and their Applications 155, 393–436.CrossRefGoogle Scholar
Baumgärtel, H. (1985). Analytic Perturbation Theory for Matrices and Operators, Vol. 15. Birkhäuser, Basel.Google Scholar
Bierkens, J., Fearnhead, P. and Roberts, G. (2019). The Zig-Zag process and super-efficient sampling for Bayesian analysis of big data. The Annals of Statistics 47, 1288–1320.CrossRefGoogle Scholar
Bouchard-Côté, A., Vollmer, S. J. and Doucet, A. (2018). The bouncy particle sampler: a nonreversible rejection-free Markov chain Monte Carlo method. Journal of the American Statistical Association 113, 855–867.CrossRefGoogle Scholar
Burdzy, K., Hoyst, R. and March, P. (2000). A Fleming–Viot particle representation of the Dirichlet laplacian. Communications in Mathematical Physics 214, 679–703.CrossRefGoogle Scholar
Champagnat, N. and Villemonais, D. (2023). General criteria for the study of quasi-stationarity. Electron. J. Probab. 28, 1–84.CrossRefGoogle Scholar
Collet, P., Martínez, S. and Martín, J. S. (2013). Quasi-Stationary Distributions: Markov Chains, Diffusions and Dynamical Systems (Probability and its Applications). Springer-Verlag, Berlin.CrossRefGoogle Scholar
Davies, E. B. (2007). Linear Operators and their Spectra. Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Davis, C. and Kahan, W. M. (1970). The rotation of eigenvectors by a perturbation. III. SIAM Journal on Numerical Analysis 7, 1–46.CrossRefGoogle Scholar
Del Moral, P. and Miclo, L. (2003). Particle approximations of Lyapunov exponents connected to Schrödinger operators and Feynman–Kac semigroups. ESAIM: Probability and Statistics 7, 171–208.CrossRefGoogle Scholar
Durmus, A., Guillin, A. and Monmarché, P. (2021). Piecewise deterministic Markov processes and their invariant measures. Ann. Inst. H. Poincaré Probab. Statist. 57, 1442–1475.CrossRefGoogle Scholar
Fuhrmann, S., Kupper, M. and Nendel, M. (2023). Wasserstein perturbations of Markovian transition semigroups. Ann. Inst. H. Poincaré Probab. Statist. 59, 904–932.CrossRefGoogle Scholar
Hislop, P. D. and Sigal, I. M. (1996). Introduction to Spectral Theory, Vol. 113. Springer, New York.CrossRefGoogle Scholar
Hosseini, B. and Johndrow, J. E. (2023). Spectral gaps and error estimates for infinite-dimensional Metropolis–Hastings with non-Gaussian priors. Annals of Applied Probability 33, 1827–1873.CrossRefGoogle Scholar
Johndrow, J. and Mattingly, J. (2017). Error bounds for approximations of Markov chains used in Bayesian sampling. arXiv Preprint.Google Scholar
Kartashov, N. (1996). Strong Stable Markov Chains. De Gruyter.CrossRefGoogle Scholar
Kato, T. (1995). Perturbation Theory for Linear Operators (Classics in Mathematics). 2nd edn. Springer-Verlag, Berlin.Google Scholar
Kolb, M. and Steinsaltz, D. (2012). Quasilimiting behavior for one-dimensional diffusions with killing. Annals of Probability 40, 162–212.CrossRefGoogle Scholar
Kulkarni, S. H., Nair, M. T. and Ramesh, G. (2008). Some properties of unbounded operators with closed range. Proc. Indian Acad. Sci. 118, 613–625.CrossRefGoogle Scholar
Kumar, D. (2019). On a quasi-stationary approach to Bayesian computation, with application to tall data. PhD Thesis, University of Warwick.Google Scholar
Laurent, B. and Massart, P. (2000). Adaptive estimation of a quadratic functional by model selection. The Annals of Statistics 28, 1302–1338.CrossRefGoogle Scholar
Lelièvre, T. (2015). Accelerated dynamics: mathematical foundations and algorithmic improvements. European Physical Journal: Special Topics 224, 2429–2444.Google Scholar
Lewis, P. A. W. and Shedler, G. S. (1979). Simulation of nonhomogeneous poisson processes by thinning. Naval Research Logistics Quarterly 26, 403–413.CrossRefGoogle Scholar
Mailler, C. and Villemonais, D. (2020). Stochastic approximation on noncompact measure spaces and application to measure-valued pólya processes. Annals of Applied Probability 30, 2393–2438.CrossRefGoogle Scholar
Medina-Aguayo, F., Rudolf, D. and Schweizer, N. (2020). Perturbation bounds for Monte Carlo within Metropolis via restricted approximations. Stochastic Processes and their Applications 130, 2200–2227.CrossRefGoogle ScholarPubMed
Méléard, S. and Villemonais, D. (2012). Quasi-stationary distributions and population processes. Probability Surveys 9, 340–410.CrossRefGoogle Scholar
Metafune, G., Pallara, D. and Priola, E. (2002). Spectrum of Ornstein-Uhlenbeck operators in Lp spaces with respect to invariant measures. Journal of Functional Analysis 196, 40–60.CrossRefGoogle Scholar
Mielnik, B. and Reyes, M. A. (1996). The classical Schrödinger equation. Journal of Physics A: Mathematical and General 29, 6009–6025.CrossRefGoogle Scholar
Mitrophanov, A. Y. (2003). Stability and exponential convergence of continuous-time Markov chains. Journal of Applied Probability 40, 970–979.CrossRefGoogle Scholar
Mitrophanov, A. Y. (2005). Sensitivity and convergence of uniformly ergodic Markov chains. J. App. Prob. 42, 1003–1014.CrossRefGoogle Scholar
Negrea, J. and Rosenthal, J. S. (2021). Approximations of geometrically ergodic reversible Markov chains. Adv. Appl. Probab. 53, 981–1022.CrossRefGoogle Scholar
Pollock, M., Fearnhead, P., Johansen, A. M. and Roberts, G. O. (2020). Quasi-stationary Monte Carlo and the ScaLE algorithm. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 82, 1167–1221.CrossRefGoogle Scholar
Reed, M. and Simon, B. (1978). Methods of Modern Mathematical Physics IV: Analysis of Operators. Academic Press, New York.Google Scholar
Roberts, G. O., Rosenthal, J. S. and Schwartz, P. O. (1998). Convergence properties of perturbed Markov chains. Journal of Applied Probability 35, 1–11.CrossRefGoogle Scholar
Rudolf, D. and Schweizer, N. (2018). Perturbation theory for Markov chains via Wasserstein distance. Bernoulli 24, 2610–2639.CrossRefGoogle Scholar
Rudolf, D. and Wang, A. Q. (2020). Discussion of ‘Quasi-stationary Monte Carlo and the ScaLE algorithm’ by Pollock, Fearnhead, Johansen and Roberts. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 82, 1214–1215.Google Scholar
Seneta, E. (2006). Non-negative Matrices and Markov Chains (Springer Series in Statistics). Revised edn. Springer, Berlin.Google Scholar
Simon, B. (1993). Large time behaviour of the heat kernel: on a theorem of Chavel and Karp. Proceedings of the American Mathematical Society 118, 513–514.CrossRefGoogle Scholar
Taylor, J. C. (1989). The minimal eigenfunctions characterize the Ornstein–Uhlenbeck Process. The Annals of Probability 17, 1055–1062.CrossRefGoogle Scholar
Wainwright, M. J. (2019). High-Dimensional Statistics. Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Wang, A. Q. (2020). Theory of killing and regeneration in continuous-time Monte Carlo sampling. PhD Thesis, University of Oxford.Google Scholar
Wang, A. Q., Kolb, M., Roberts, G. O. and Steinsaltz, D. (2019). Theoretical properties of quasi-stationary Monte Carlo methods. The Annals of Applied Probability 29, 434–457.CrossRefGoogle Scholar
Wang, A. Q., Pollock, M., Roberts, G. O. and Steinsaltz, D. (2021). Regeneration-enriched Markov processes with application to Monte Carlo. The Annals of Applied Probability 31, 703–735.CrossRefGoogle Scholar
Wang, A. Q., Roberts, G. O. and Steinsaltz, D. (2020). An approximation scheme for quasi-stationary distributions of killed diffusions. Stochastic Processes and their Applications 130, 3193–3219.CrossRefGoogle Scholar