Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-22T15:11:37.671Z Has data issue: false hasContentIssue false
  • English
  • Français

Point processes generated by transitions of Markov chains

Published online by Cambridge University Press:  01 July 2016

Mats Rudemo
Mats Rudemo*
Affiliation:
Research Institute of National Defence, Stockholm
Get access Rights & Permissions [Opens in a new window]

Abstract

For a continuous time Markov chain the time points of transitions, belonging to a subset of the set of all transitions, are observed. Special cases include the point process generated by all transitions and doubly stochastic Poisson processes with a Markovian intensity. Equations are derived for the conditional distribution of the state of the Markov chain, given observations of the point process. This distribution may be used for prediction. For the forward recurrence time of the point process, distributions corresponding to synchronous and asynchronous sampling are also derived. The Palm distribution for the point process is specified in terms of the corresponding initial distribution for the Markov chain. In examples the point processes of arrivals and departures in a queueing system are studied. Two biological applications deal with estimation of population size and detection of epidemics.

Keywords

POINT PROCESSMARKOV CHAINSTATE ESTIMATIONPREDICTION OF POINT PROCESSESPALM PROBABILITIESDOUBLY STOCHASTIC POISSON PROCESSESESTIMATION OF POPULATION SIZEDETECTION OF EPIDEMICS
Type
Research Article
Information
Advances in Applied Probability , Volume 5 , Issue 2 , August 1973 , pp. 262 - 286
Copyright
Copyright © Applied Probability Trust 1973 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ash, R. B. (1965) Information Theory. Interscience, New York.Google Scholar
Bailey, N. T. J. (1957) The Mathematical Theory of Epidemics. Griffin, London.Google Scholar
Bailey, N. T. J. (1964) The Elements of Stochastic Processes. Wiley, New York.Google Scholar
Burke, P. J. (1956) The output of a queueing system. Operations Res. 4, 699–704.Google Scholar
Chung, K. L. (1967) Markov Chains with Stationary Transition Probabilities. 2nd edition. Springer, Berlin.Google Scholar
Cox, D. R. (1963) Some models for series of events. Bull. Int. Statist. Inst. 40, 737–746.Google Scholar
Cox, D. R. and Lewis, P. A. W. (1966) The Statistical Analysis of Series of Events. Methuen, London.Google Scholar
Cox, D. R. and Lewis, P. A. W. (1972) Multivariate point processes. Proc. Sixth Berkeley Symp. 3, 401–448.Google Scholar
Daley, D. J. and Vere-Jones, D. (1972) A summary of the theory of point processes. Stochastic Point Processes: Statistical Analysis, Theory and Applications. (Lewis, P. A. W., ed.), Wiley, New York. 299–383.Google Scholar
Fieger, W. (1965) Eine für beliebige Call-Prozesse geltende Verallgemeinerung der Palmschen Formeln. Math. Scand. 16, 121–147.Google Scholar
Freedman, D. (1971) Markov Chains. Holden Day, San Francisco.Google Scholar
Galchuk, L. I. and Rozovskii, B. L. (1971) The “disorder” problem for a Poisson process. Theor. Probability Appl. 16, 712–717.Google Scholar
Gilbert, E. N. (1960) Capacity of a burst noise channel. Bell System Techn. J. 39, 1253–1265.Google Scholar
Hawkes, A. G. (1971) Spectra of some self-exciting and mutually exciting point processes. Biometrika 58, 83–90.Google Scholar
Jazwinski, A. H. (1970) Stochastic Processes and Filtering Theory. Academic Press, New York.Google Scholar
Jowett, J. and Vere-Jones, D. (1972) The prediction of stationary point processes. Stochastic Point Processes: Statistical Analysis, Theory and Applications. (Lewis, P. A. W., ed.), Wiley, New York. 405–435.Google Scholar
Karlin, S. (1966) A First Course in Stochastic Processes. Academic Press, New York.Google Scholar
Lawrance, A. J. (1972) Some models for stationary series of univariate events. Stochastic Point Processes: Statistical Analysis, Theory and Applications (Lewis, P. A. W., ed.), Wiley, New York. 199–256.Google Scholar
Leadbetter, M. R. (1972) On basic results of point process theory. Proc. Sixth Berkeley Symp. 3, 449–462.Google Scholar
Lundberg, O. (1940) On random processes and their application to sickness and accident statistics. Almqvist and Wiksell, Uppsala.Google Scholar
Neuts, M. F. (1971) A queue subject to extraneous phase changes. Adv. Appl. Prob. 3, 78–119.Google Scholar
Pyke, R. (1961a) Markov renewal processes: definitions and preliminary properties. Ann. Math. Statist. 32, 1231–1242.Google Scholar
Pyke, R. (1961b) Markov renewal processes with finitely many states. Ann. Math. Statist. 32, 1243–1259.Google Scholar
Rodhe, H. and Grandell, J. (1972) On the removal time of aerosol particles from the atmosphere by precipitation scavenging. Tellus 24, 442–454.Google Scholar
Rubin, I. (1972) Regular point processes and their detection. IEEE Trans. Information Theory 18, 547–557.Google Scholar
Rudemo, M. (1972) (Referred to as (A)) Doubly stochastic Poisson processes and process control. Adv. Appl. Prob. 4, 318–338.Google Scholar
Rudemo, M. (1973a) (Referred to as (B)) State estimation for partially observed Markov chains. J. Math. Anal. Appl. To appear.Google Scholar
Rudemo, M. (1973b) Multivariate point processes generated by transitions of Markov chains. To appear.Google Scholar
Serfozo, R. F. (1972) Conditional Poisson processes. J. Appl. Prob. 9, 288–302.Google Scholar
Snyder, D. L. (1972) Filtering and detection for doubly stochastic Poisson processes. IEEE Trans. Information Theory 18, 91–102.Google Scholar
Stratonovich, R. L. (1960) Conditional Markov processes. Theor. Probability Appl. 5, 156–178.Google Scholar
Wold, H. (1948a) On stationary point processes and Markov chains. Skand. Aktuarietidskr. 31, 229–240.Google Scholar
Wold, H. (1948b) Sur les processus stationnaires ponctuels. Colloques Internationaux du Cent. Natn. Rech. Scient. 13, 75–86.Google Scholar
Yashin, A. I. (1970) Filtering of jump processes. Automat. Remote Control 31, 725–730.Google Scholar