Let I1,I2,…,In be independent indicator functions on some probability space We suppose that these indicators can be observed sequentially. Furthermore, let T be the set of stopping times on (Ik), k=1,…,n, adapted to the increasing filtration where The odds algorithm solves the problem of finding a stopping time τ ∈ T which maximises the probability of stopping on the last Ik=1, if any. To apply the algorithm, we only need the odds for the events {Ik=1}, that is, rk=pk/(1-pk), where The goal of this paper is to offer tractable solutions for the case where the pk are unknown and must be sequentially estimated. The motivation is that this case is important for many real-world applications of optimal stopping. We study several approaches to incorporate sequential information. Our main result is a new version of the odds algorithm based on online observation and sequential updating. Questions of speed and performance of the different approaches are studied in detail, and the conclusiveness of the comparisons allows us to propose always using this algorithm to tackle selection problems of this kind.

We show that, contrary to common wisdom, the cumulative input process in a fluid queue with cluster Poisson arrivals can converge, in the slow growth regime, to a fractional Brownian motion, and not to a Lévy stable motion. This emphasizes the lack of robustness of Lévy stable motions as ‘birds-eye’ descriptions of the traffic in communication networks.

Just after the fixation of an advantageous allele in the population (this spread is called a selective sweep), the neutral genes close to the site under selection tend to have the same ancestor as the gene under selection. However, some recombinations may occur during the selective sweep and break the link, which reduces the number of hitchhiking alleles. We consider a large selection coefficient α and extend the results of Etheridge, Pfaffelhuber and Wakolbinger (2006) and the work of Pfaffelhuber and Studeny (2007) about genetic hitchhiking, where the recombination rate scales with α/log α. We first describe the genealogy at an arbitrary number of partially linked neutral loci, with an order of accuracy of in total variation. Then, we use this framework to obtain an approximate distribution for the size of the hitchhiking set at the end of the selective sweep, with the same accuracy.

A necessary condition for a rational Laplace–Stieltjes transform to correspond to a matrix exponential distribution is that the pole of maximal real part is real and negative. Given a rational Laplace–Stieltjes transform with such a pole, we present a method to determine whether or not the numerator polynomial admits a transform that corresponds to a matrix exponential distribution. The method relies on the minimization of a continuous function of one variable over the nonnegative real numbers. Using this approach, we give an alternative characterization for all matrix exponential distributions of order three.

In this paper we study the tail and the extremal behaviors of stationary solutions of threshold autoregressive (TAR) models. It is shown that a regularly varying noise sequence leads in general to only an O-regularly varying tail of the stationary solution. Under further conditions on the partition, it is shown however that TAR(S,1) models of order 1 with S regimes have regularly varying tails, provided that the noise sequence is regularly varying. In these cases, the finite-dimensional distribution of the stationary solution is even multivariate regularly varying and its extremal behavior is studied via point process convergence. In particular, a TAR model with regularly varying noise can exhibit extremal clusters. This is in contrast to TAR models with noise in the maximum domain of attraction of the Gumbel distribution and which is either subexponential or in ℒ(γ) with γ > 0. In this case it turns out that the tail of the stationary solution behaves like a constant times that of the noise sequence, regardless of the order and the specific partition of the TAR model, and that the process cannot exhibit clusters on high levels.

In this paper we explore the impact of imitation rules on players' long-run behaviors in evolutionary prisoner's dilemma games. All players sit sequentially and equally spaced around a circle. Players are assumed to interact only with their neighbors, and to imitate either their successful neighbors and/or themselves or the successful actions taken by their neighbors and/or themselves. In the imitating-successful-player dynamics, full defection is the unique long-run equilibrium as the probability of players' experimentations (or mutations) tend to 0. By contrast, full cooperation could emerge in the long run under the imitating-successful-action dynamics. Moreover, it is discovered that the convergence rate to equilibrium under local interaction could be slower than that under global interaction.

The lying oracle problem is a problem of finding the optimal strategies in a two-person game where an oracle predicts the outcomes of coin flips and a player bets on the outcomes. The oracle announces whether the coin will land heads or tails, but may at times lie. We analyze the variant of the game which uses a biased coin, where the probability p that the coin lands heads is common knowledge. We determine optimal strategies for both the oracle and player, and we give an explicit expression for the expected payoff to the player when the coin is flipped n times and the oracle may lie at most k times.

In this paper we consider a stochastic SIR (susceptible→infective→removed) epidemic model in which individuals may make infectious contacts in two ways, both within ‘households’ (which for ease of exposition are assumed to have equal size) and along the edges of a random graph describing additional social contacts. Heuristically motivated branching process approximations are described, which lead to a threshold parameter for the model and methods for calculating the probability of a major outbreak, given few initial infectives, and the expected proportion of the population who are ultimately infected by such a major outbreak. These approximate results are shown to be exact as the number of households tends to infinity by proving associated limit theorems. Moreover, simulation studies indicate that these asymptotic results provide good approximations for modestly sized finite populations. The extension to unequal-sized households is discussed briefly.

In this paper we consider Lévy processes without negative jumps, reflected at the origin. Feedback information about the level of the Lévy process (‘workload level’) may lead to adaptation of the Lévy exponent. Examples of such models are queueing models in which the service speed or customer arrival rate changes depending on the workload level, and dam models in which the release rate depends on the buffer content. We first consider a class of models where information about the workload level is continuously available. In particular, we consider dam processes with a two-step release rule and M/G/1 queues in which the arrival rate, service speed, and/or jump size distribution may be adapted depending on whether the workload is above or below some level K. Secondly, we consider a class of models in which the workload can only be observed at Poisson instants. At these Poisson instants, the Lévy exponent may be adapted based on the amount of work present. For both classes of models, we determine the steady-state workload distribution.

We study the tail behavior of the distribution of the sum of asymptotically independent risks whose marginal distributions belong to the maximal domain of attraction of the Gumbel distribution. We impose conditions on the distribution of the risks (X, Y) such that P(X + Y > x) ∼ (constant) P(X > x). With the further assumption of nonnegativity of the risks, the result is extended to more than two risks. We note a sufficient condition for a distribution to belong to both the maximal domain of attraction of the Gumbel distribution and the subexponential class. We provide examples of distributions which satisfy our assumptions. The examples include cases where the marginal distributions of X and Y are subexponential and also cases where they are not. In addition, the asymptotic behavior of linear combinations of such risks with positive coefficients is explored, leading to an approximate solution of an optimization problem which is applied to portfolio design.

The secretary problem for selecting one item so as to minimize its expected rank, based on observing the relative ranks only, is revisited. A simple suboptimal rule, which performs almost as well as the optimal rule, is given. The rule stops with the smallest i such that Ri≤ic/(n+1-i) for a given constant c, where Ri is the relative rank of the ith observation and n is the total number of items. This rule has added flexibility. A curtailed version thereof can be used to select an item with a given probability P, P<1. The rule can be used to select two or more items. The problem of selecting a fixed percentage, α, 0<α<1, of n, is also treated. Numerical results are included to illustrate the findings.

In this article we analyse the behaviour of the extremes of a random walk in a random scenery. The random walk is assumed to be in the domain of attraction of a stable law, and the scenery is assumed to be in the domain of attraction of an extreme value distribution. The resulting random sequence is stationary and strongly dependent if the underlying random walk is recurrent. We prove a limit theorem for the extremes of the resulting stationary process. However, if the underlying random walk is recurrent, the limit distribution is not in the class of classical extreme value distributions.

We prove a central limit theorem for the sequence of random compositions of a two-color randomly reinforced urn. As a consequence, we are able to show that the distribution of the urn limit composition has no point masses.

We consider a branching model for a population of dividing cells infected by parasites. Each cell receives parasites by inheritance from its mother cell and independent contamination from outside the cell population. Parasites multiply randomly inside the cell and are shared randomly between the two daughter cells when the cell divides. The law governing the number of parasites which contaminate a given cell depends only on whether the cell is already infected or not. We first determine the asymptotic behavior of branching processes in a random environment with state-dependent immigration, which gives the convergence in distribution of the number of parasites in a cell line. We then derive a law of large numbers for the asymptotic proportions of cells with a given number of parasites. The main tools are branching processes in a random environment and laws of large numbers for a Markov tree.

By expressing the discounted net loss process as a randomly weighted sum, we investigate the finite-time ruin probabilities for the Poisson risk model with an exponential Lévy process investment return and heavy-tailed claims. It is found that in finite time, however, the extreme of insurance risk dominates the extreme of financial risk, but, for the case of dangerous investment (see Klüppelberg and Kostadinova (2008) for an accurate definition of dangerous investment), the extreme of financial risk has more and more of an effect on the total risk, and as time passes, the extreme of financial risk finally dominates the extreme of insurance risk.

In this paper we obtain some equivalent conditions and sufficient conditions for the local and nonlocal asymptotics of the φ-moments of the overshoot and undershoot of a random walk, where φ is a nonnegative, long-tailed function. By the strong Markov property, it can be shown that the moments of the overshoot and undershoot and the moments of the first ascending ladder height of a random walk satisfy some renewal equations. Therefore, in this paper we first investigate the local and nonlocal asymptotics for the moments of the first ascending ladder height of a random walk, and then give some equivalent conditions and sufficient conditions for the asymptotics of the solutions to some renewal equations. Using the above results, the main results of this paper are obtained.

In this paper we first consider the expectation of the total discounted claim costs up to the time of ruin, and then, more generally, we study the expectation of the total discounted operating costs up to the time of default, which is the first passage time of a surplus process downcrossing a given level. These two quantities include the expected discounted penalty function at ruin or the Gerber–Shiu function, the expected total discounted dividends up to ruin, and other interesting quantities as special cases among a class of risk processes. As an illustration, we consider a piecewise-deterministic compound Poisson risk model. This model recovers many risk models appearing in the literature such as the compound Poisson risk models with interest, absolute ruin, dividends, multiple thresholds, and their dual models. We derive and solve the integro-differential equation for the expected present value of the total discounted operating costs up to default. The solutions to the expected present value of the total discounted operating costs up to default can be used as a unified approach to solving many ruin-related quantities. As applications, we derive explicit solutions for the expected accumulated utility up to ruin, the absolute ruin probability with varying borrowing rates, the expected total discounted claim costs up to ruin, the Gerber–Shiu function with two-sided jumps, and the price for a perpetual American put option with two-sided jumps.

In the framework of a multitype Bienaymé–Galton–Watson (BGW) process, the event that the daughter's type differs from the mother's type can be viewed as a mutation event. Assuming that mutations are rare, we study a situation where all types except one produce on average less than one offspring. We establish a neat asymptotic structure for the BGW process escaping extinction due to a sequence of mutations toward the supercritical type. Our asymptotic analysis is performed by letting mutation probabilities tend to 0. The limit process, conditional on escaping extinction, is another BGW process with an enriched set of types, allowing us to delineate a stem lineage of particles that leads toward the escape event. The stem lineage can be described by a simple Markov chain on the set of particle types. The total time to escape becomes a sum of a random number of independent, geometrically distributed times spent at intermediate types.

Let Kn denote the number of types of a sample of size n taken from an exchangeable coalescent process (Ξ-coalescent) with mutation. A distributional recursion for the sequence (Kn)n∈ℕ is derived. If the coalescent does not have proper frequencies, i.e. if the characterizing measure Ξ on the infinite simplex Δ does not have mass at 0 and satisfies ∫Δ ∣x∣Ξ(dx)/(x,x)<∞, where ∣x∣:=∑i=1∞xi and (x,x)≔∑i=1∞xi2 for x=(x1,x2,…)∈Δ, then Kn/n converges weakly as n→∞ to a limiting variable K that is characterized by an exponential integral of the subordinator associated with the coalescent process. For so-called simple measures Ξ satisfying ∫ΔΞ(d x)/(x,x)<∞, we characterize the distribution of K via a fixed-point equation.

Large deviation principles and related results are given for a class of Markov chains associated to the ‘leaves' in random recursive trees and preferential attachment random graphs, as well as the ‘cherries’ in Yule trees. In particular, the method of proof, combining analytic and Dupuis–Ellis-type path arguments, allows for an explicit computation of the large deviation pressure.