A random number of independent identically distributed random variables is inspected in strict succession. As a variable is inspected, it can either be selected or rejected and this decision becomes final at once. The selected sequence must increase. The problem is to maximize the expected length of the selected sequence.

We demonstrate decision policies which approach optimality when the number of observations becomes in a sense large and show that the maximum expected length is close to an easily computable value.

We obtain characterizations of densities on the real line and provide solutions to stochastic equations using the Gibbs sampler. Particular stochastic equations considered are of the type X =dB(X+C) and X =dBX+C.

For a large class of neutral population models the asymptotics of the ancestral structure of a sample of n individuals (or genes) is studied, if the total population size becomes large. Under certain conditions and under a well-known time-scaling, which can be expressed in terms of the coalescence probabilities, weak convergence in DE([0,∞)) to the coalescent holds. Further the convergence behaviour of the jump chain of the ancestral process is studied. The results are used to approximate probabilities which are of certain interest in applications, for example hitting probabilities.

We define a stochastic process {Xn} based on partial sums of a sequence of integer-valued random variables (K0,K1,…). The process can be represented as an urn model, which is a natural generalization of a gambling model used in the first published exposition of the criticality theorem of the classical branching process. A special case of the process is also of interest in the context of a self-annihilating branching process. Our main result is that when (K1,K2,…) are independent and identically distributed, with mean a ∊ (1,∞), there exist constants {cn} with cn+1/cn → a as n → ∞ such that Xn/cn converges almost surely to a finite random variable which is positive on the event {Xn ↛ 0}. The result is extended to the case of exchangeable summands.

A Markov decision model is considered for the control of a truncated general immigration process, which represents a pest population, by the introduction of total catastrophes. The optimality criterion is that of minimizing the expected long-run average cost per unit time. Firstly, a necessary and sufficient condition is found under which the policy of never controlling is optimal. If this condition fails, a parametric analysis, in which a fictitious parameter is varied over the entire real line, is used to establish the optimality of a control-limit policy. Furthermore, an efficient Markov decision algorithm operating on the class of control-limit policies is developed for the computation of the optimal policy.

On the basis of the Karlin and McGregor result, which states that the transition probability functions of a birth and death process can be expressed via the introduction of an orthogonal polynomial system and a spectral measure, we investigate in this paper how the Laplace transforms and the distributions of different transient characteristics related to excursions of a birth and death process can be expressed by means of the basic orthogonal polynomial system and the spectral measure. This allows us in particular to give a probabilistic interpretation of the series introduced by Stieltjes to study the convergence of the fundamental continued fraction associated with the system. Throughout the paper, we pay special attention to the case when the birth and death process is ergodic. Under the assumption that the spectrum of the spectral measure is discrete, we show how the distributions of different random variables associated with excursions depend on the fundamental continued fraction, the orthogonal polynomial system and the spectral measure.

Conditions are derived for the components of the normed limit of a multi-type branching process with varying environments, to be continuous on (0, ∞). The main tool is an inequality for the concentration function of sums of independent random variables, due originally to Petrov. Using this, we show that if there is a discontinuity present, then a particular linear combination of the population types must converge to a non-random constant (Equation (1)). Ensuring this can not happen provides the desired continuity conditions.

We develop an algorithm for computing approximations to the stationary distribution of a discrete birth-and-death process, provided that the infinitesimal generator is a banded matrix. We begin by computing stationary distributions for processes whose infinitesimal generators are Hessenberg. Our derivation in this special case is different from the classical case but it leads to the same result. We then show how to extend these ideas to processes where the infinitesimal generator is banded (or half-banded) and to quasi-birth–death processes. Finally, we give an example of the application of this method to a nearly completely decomposable Markov chain to demonstrate the general applicability of the technique.

The random triangle model was recently introduced as a random graph model that captures the property of transitivity that is often found in social networks, i.e. the property that given that two vertices are second neighbors, they are more likely to be neighbors. For parameters p ∊ [0,1] and q ≥ 1, and a finite graph G = (V, E), it assigns to elements η of {0,1}E probabilities which are proportional to where t(η) is the number of triangles in the open subgraph. In this paper the behavior of the random triangle model on the two-dimensional triangular lattice is studied. By mapping the system onto an Ising model with external field on the hexagonal lattice, it is shown that phase transition occurs if and only if p = (q−1)−2/3 and q > qc for a critical value qc which turns out to equal It is furthermore demonstrated that phase transition cannot occur unless p = pc(q), the critical value for percolation of open edges for given q. This implies that for q ≥ qc, pc(q) = (q−1)−2/3.

We generalize a population-size-dependent branching process to a more general branching model called the population-size-dependent branching process in random environments. For the model where {Zn}n≥0 is associated with the stationary environment ξ− = {ξn}n≥0, let B = {ω : Zn(ω) = for some n}, and q(ξ−) = P(B | ξ−, Z0 = 1). The result is that P(q(̅ξ) = 1) is either 1 or 0, and sufficient conditions for certain extinction (i.e. P(q(ξ−) = 1) = 1) and for non-certain extinction (i.e. P(q(ξ−) < 1) = 1) are obtained for the model.

In this paper we introduce the notion of general final state random variables for generalized epidemic models. These random variables are defined as sums over all ultimately infected individuals of random quantities of interest associated with an individual; examples include final severity. By exploiting a construction originally due to Sellke (1983), exact results concerning the final size and general final state random variables are obtained in terms of Gontcharoff polynomials. In particular, our approach highlights the way in which these polynomials arise via simple probabilistic arguments. For ease of exposition we focus initially upon the single-population case before extending our arguments to multi-population epidemics and other variants of our basic model.

We consider the distribution of the number of generations to extinction in subcritical branching processes, with particular emphasis on applications to the spread of infectious diseases. We derive the generation distributions for processes with Bernoulli, geometric and Poisson offspring, and discuss some of their distributional and inferential properties. We present applications to the spread of infection in highly vaccinated populations, outbreaks of enteric fever, and person-to-person transmission of human monkeypox.

Take a sample of individuals in the fixed-size population model with exchangeable family sizes. Follow the ancestral lines for the sampled individuals backwards in time to observe the ancestral process. We describe a class of asymptotic structures for the ancestral process via a convergence criterion. One of the basic conditions of the criterion prevents simultaneous mergers of ancestral lines. Another key condition implies that the marginal distribution of the family size is attracted by an infinitely divisible distribution. If the latter is normal the coalescent allows only for pairwise mergers (Kingman's coalescent). Otherwise multiple mergers happen with positive probability.

In this paper, given personnel distributions that are not attainable, we introduce the grade of attainability in order to measure the degree to which there exists a similar distribution that is attainable. For constant size systems controlled by recruitment, properties of the most similar distribution to a given distribution are formulated.

A random mapping (Tn;q) of a finite set V, V = {1,2,…,n}, into itself assigns independently to each i ∊ V its unique image j ∊ V with probability q if i = j and with probability P = (1-q)/(n−1) if i ≠ j. Three versions of epidemic processes on a random digraph GT representing (Tn;q) are studied. The exact probability distributions of the total number of infected elements as well as the threshold functions for these epidemic processes are determined.

The Greenberg–Hastings model (GHM) is a simple cellular automaton which emulates two properties of excitable media: excitation by contact and a refractory period. We study two ways in which external stimulation can make ring dynamics in the GHM recurrent. The first scheme involves the initial placement of excitation centres which gradually lose strength, i.e. each time they become inactive (and then stay inactive forever) with probability 1 − pf. In this case, the density of excited sites must go to 0; however, their long–term connectivity structure undergoes a phase transition as pf increases from 0 to 1. The second proposed rule utilizes continuous nucleation in that new rings are started at every rested site with probability ps. We show that, for small ps, these dynamics make a site excited about every ps−1/3 time units. This result yields some information about the asymptotic shape of a closely related random growth model.

We consider a discrete-time financial market model with L1 risky asset price process subject to proportional transaction costs. In this general setting, using a dual martingale representation we provide sufficient conditions for the super-replication cost to coincide with the replication cost. Next, we study the convergence problem in a stationary binomial model as the time step tends to zero, keeping the proportional transaction costs fixed. We derive lower and upper bounds for the limit of the super-replication cost. In the case of European call options and for a unit initial holding in the risky asset, the upper and lower bounds are equal. This result also holds for the replication cost of European call options. This is evidence (but not a proof) against the common opinion that the replication cost is infinite in a continuous-time model.

We consider a brokered market with heterogeneous suppliers and consumers of identical items or services. Each supplier determines a minimum acceptable price for the items it supplies, based on its costs and target rate of return. The broker begins with a fixed set of items from the suppliers. Customers arrive periodically to the market and offer a bid for an item. If a customer wants more than one item, a set of bids is made. If the broker accepts a bid it must be assigned an item with minimum accceptable price less than or equal to the bid, and the price paid is the bid price. The broker has the option of rejecting a bid. The broker makes acceptance and assignment decisions to maximize the total expected discounted revenue. We show the optimal policy has a simple threshold structure where thresholds can be easily determined by finding the individually optimal policies subject to priorities.

The ‘change of numéraire’ technique has been introduced by Geman, El Karoui and Rochet for pricing and hedging contingent claims in the case of complete markets. In this paper we study the ‘change of numéraire’ using the ‘locally risk-minimizing approach’, when the market is not complete. We prove that, if the stochastic process which represents the prices is continuous, the l.r.m. strategy is invariant by a change of numéraire (this result is false in the right-continuous case, as is shown by some counterexamples).

We also give an extension of Merton's formula to the case of stochastic volatility.

This paper aims to show how certain known martingales for epidemic models may be derived using general techniques from the theory of stochastic integration, and hence to extend the allowable infection and removal rate functions of the model as far as possible. Denoting by x, y the numbers of susceptible and infective individuals in the population, then we assume that new infections occur at rate βxyxy and infectives are removed at rate γxyy, where the ratio βxy / γxy can be written in the form q(x+y) / xp(x) for appropriate functions p,q. Under this condition, we find equations giving the distribution of the number of susceptibles remaining in the population at appropriately defined stopping times. Using results on Abel–Gontcharoff pseudopolynomials we also derive an expression for the expectation of any function of the number of susceptibles at these times, as well as considering certain integrals over the course of the epidemic. Finally, some simple examples are given to illustrate our results.