Hostname: page-component-cd9895bd7-dk4vv Total loading time: 0 Render date: 2024-12-23T09:19:39.478Z Has data issue: false hasContentIssue false
  • English
  • Français

Connecting reversible Markov processes

Published online by Cambridge University Press:  01 July 2016

P. K. Pollett
P. K. Pollett*
Affiliation:
The University of Adelaide
Get access Rights & Permissions [Opens in a new window]

Abstract

We provide a framework for interconnecting a collection of reversible Markov processes in such a way that the resulting process has a product-form invariant measure with respect to which the process is reversible. A number of examples are discussed including Kingman&s reversible migration process, interconnected random walks and stratified clustering processes.

Keywords

REVERSIBILITYQUEUEING NETWORKSPRODUCT-FORMINVARIANT MEASURES
Type
Research Article
Information
Advances in Applied Probability , Volume 18 , Issue 4 , December 1986 , pp. 880 - 900
Copyright
Copyright © Applied Probability Trust 1986 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Atkins, P. W. (1982) Physical Chemistry. Clarendon Press, Oxford.Google Scholar
Baskett, F., Chandy, K. M., Muntz, R. R. and Palacios, F. G. (1975) Open, closed and mixed networks of queues with different classes of customers. J. Assoc. Comput. Mach. 22, 248–260.Google Scholar
Bremaud, P. (1978) On the output theorem of queueing theory. J. Appl. Prob. 15, 397–405.Google Scholar
Brown, M. (1970) A property of Poisson processes and its application to macroscopic equilibrium of particle systems. Ann. Math. Statist. 41, 1935–1941.Google Scholar
Cohen, J. E. (1971) Casual Groups of Monkeys and Men. Harvard University Press, Cambridge, Mass.Google Scholar
Cohen, J. E. (1972) Markov population processes as models of primate social and population dynamics. Theoret. Pop. Biol. 3, 119–134.Google Scholar
Cohen, M. H. and Robertson, A. (1971) Wave propagation in the early stages of aggregation of cellular slime moulds. J. Theoret. Biol. 31, 101–118.Google Scholar
Coleman, J. S. and James, J. (1961) The equilibrium size distribution of freely forming groups. Sociometry , 24, 36–45.Google Scholar
Derman, C. (1955) Some contributions to the theory of denumerable Markov chains. Trans. Amer. Math. Soc. 79, 541–555.Google Scholar
Franken, P., König, D., Arndt, U. and Schmidt, V. (1981) Queues and Point Processes. Akademie-Verlag, Berlin.Google Scholar
Goodman, L. A. (1964) Mathematical methods for the study of systems of groups. Amer. J. Sociol. 70, 170–192.Google Scholar
Jackson, J. R. (1957) Networks of waiting lines. Operat. Res. 5, 518–521.CrossRefGoogle Scholar
Jansen, U., and König, D. (1980) Insensitivity and steady-state probabilities in product form for queueing networks. Elektron. Informationsverarb. Kybernet. 16, 385–397.Google Scholar
Keller, E. F. and Segel, L. A. (1970) Initiation of slime mould aggregation viewed as an instability. J. Theoret. Biol. 26, 399–415.Google Scholar
Kelly, F. P. (1976a) On stochastic population models in genetics. J. Appl. Prob. 13, 127–131.Google Scholar
Kelly, F. P. (1976b) Networks of queues. Adv. Appl. Prob. 8, 416–432.Google Scholar
Kelly, F. P. (1976c) Stochastic models with electrical analogues. Math. Proc. Camb. Phil. Soc. 80, 145–151.Google Scholar
Kelly, F. P. (1977) Exact results for the Moran neutral allele model. Adv. Appl. Prob. 9, 197–201.Google Scholar
Kelly, F. P. (1979) Reversibility and Stochastic Networks. Wiley, London.Google Scholar
Kelly, F. P. (1981) Networks of quasi-reversible nodes. In Proc. ORSA-TIMS Special Interest Meeting: Applied Probability-Computer Science, the Interface. Birkhäuser-Boston, Cambridge, Mass.Google Scholar
Kelly, F. P. (1983) Invariant measures and the q-matrix. In Probability, Statistics and Analysis , ed, Kingman, J. F. C. and Reuter, G. E. H., London Mathematical Society Lecture Notes Series 79, Cambridge University Press, 143–160.Google Scholar
Kemeny, J. G., Snell, J. L. and Knapp, A. W. (1976) Denumerable Markov Chains , 2nd edn. Springer-Verlag, New York.Google Scholar
Kendall, D. G. (1959) Unitary dilations of one-parameter semigroups of Markov transition operators, and the corresponding integral representations for Markov processes with a countable infinity of states. Proc. London Math. Soc. (3) 9, 417–431.Google Scholar
Kendall, D. G. (1975) Some problems in mathematical genealogy. In Perspectives in Probability and Statistics: Papers in Honour of M. S. Bartlett, ed. Gani, J., Applied Probability Trust, Sheffield, 325–345.Google Scholar
Kingman, J. F. C. (1969) Markov population processes. J. Appl. Prob. 6, 1–18.Google Scholar
Kolmogorov, A. N. (1936) Zur Theorie der Markoffschen Ketten. Math. Ann. 112, 155–160.Google Scholar
Mcquarrie, D. A. (1967) Stochastic approach to chemical kinetics. J. Appl. Prob. 4, 413–478.Google Scholar
Moran, P. A. P. (1958) Random processes in genetics. Proc. Camb. Phil. Soc. 54, 60–72.Google Scholar
Morgan, B. J. T. (1976) Stochastic models of grouping changes. Adv. Appl. Prob. 8, 30–57.Google Scholar
Muntz, R. R. (1972) Poisson departure processes and queueing networks. IBM Research Report RC4145 , IBM Thomas J. Watson Research Centre, Yorktown Heights, New York. (A shortened version of this paper appeared in Proc. 7th Ann. Conf. Information Science and Systems, Princeton, 1973, 435-440.) Google Scholar
Nash-Williams, C. St. J. A. (1959) Random walks and electric current in networks. Proc. Camb. Phil. Soc. 55, 181–194.Google Scholar
Reuter, G. E. H. (1957) Denumerable Markov processes and the associated contraction semigroups on l. Acta Math. 97, 1–46.Google Scholar
Spitzer, F. (1970) Interaction of Markov processes. Adv. Math. 5, 246–290.Google Scholar
Trajstman, A. C. (1974) On a conjecture of G. A. Watterson. Adv. Appl. Prob. 6, 489–493.Google Scholar
Walrand, J. (1981) Filtering formulas and the ·/M/1 queue in a quasireversible network. Stochastics 6, 1–22.Google Scholar
Walrand, J., and Varaiya, P. (1980) Interconnections of Markov chains and quasireversible queueing networds. Stoch. Proc. Appl. 10, 209–219.Google Scholar
Watterson, G. A. (1976) Reversibility and the age of an allele, I. Moran&s infinitely many neutral alleles model. Theoret. Popn. Biol. 10, 239–253.Google Scholar
Watterson, G. A. and Guess, H. A. (1977) Is the most frequent allele the oldest? Theoret. Popn. Biol. 11, 141–160.Google Scholar
White, H. C. (1962) Chance models of systems of casual groups. Sociometry 25, 153–172.Google Scholar
Whittle, P. (1965a) Statistical processes of aggregation and polymerization. Proc. Camb. Phil. Soc. 61, 475–495.Google Scholar
Whittle, P. (1965b) The equilibrium statistics of a clustering process in the uncondensed phase. Proc. R. Soc. London A285, 501–519.Google Scholar
Whittle, P. (1967) Nonlinear migration processes. Bull. Inst. Int. Statist. 42, 642–647.Google Scholar
Whittle, P. (1968) Equilibrium distributions for an open migration process. J. Appl. Prob. 5, 567–571.Google Scholar
Whittle, P. (1972) Statistics and critical points of polymerization processes. Suppl. Adv. Appl. Prob. 1974, 199–220.Google Scholar
Whittle, P. (1980a) Polymerisation processes with intrapolymer bonding. I. One type of unit. Adv. Appl. Prob. 12, 94–115.Google Scholar
Whittle, P. (1980b) Polymerisation processes with intrapolymer bonding. II. Stratified processes. Adv. Appl. Prob. 12, 116–134.Google Scholar
Whittle, P. (1980c) Polymerisation processes with intrapolymer bonding. III. Several types of unit. Adv. Appl. Prob. 12, 135–153.Google Scholar
Whittle, P. (1983) Relaxed Markov processes. Adv. Appl. Prob. 15, 769–782.Google Scholar
Whittle, P. (1984) Weak coupling in stochastic systems. Proc. R. Soc. London A395, 141–151.Google Scholar
Whittle, P. (1985) Partial balance and insensitivity. J. Appl. Prob. 22, 168–176.Google Scholar