In this paper we analyze the first-order behavior (that is, the right-sided derivative) of the volume of the dilation A⊕tQ as t converges to 0. Here A and Q are subsets of n-dimensional Euclidean space, A has finite perimeter, and Q is finite. If Q consists of two points only, n and n+u, say, this derivative coincides up to a sign with the directional derivative of the covariogram of A in direction u. By known results for the covariogram, this derivative can therefore be expressed by the cosine transform of the surface area measure of A. We extend this result to finite sets Q and use it to determine the derivative of the contact distribution function with finite structuring element of a stationary random set at 0. The proofs are based on an approximation of the indicator function of A by smooth functions of bounded variation.

We consider the stationary solution Z of the Markov chain {Zn}n∈ℕ defined by Zn+1=ψn+1(Zn), where {ψn}n∈ℕ is a sequence of independent and identically distributed random Lipschitz functions. We estimate the probability of the event {Z>x} when x is large, and develop a state-dependent importance sampling estimator under a set of assumptions on ψn such that, for large x, the event {Z>x} is governed by a single large jump. Under natural conditions, we show that our estimator is strongly efficient. Special attention is paid to a class of perpetuities with heavy tails.

Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite state space E, let v: E→ℝ\{0}, and let (φt)t≥0 be defined by φt=∫0tv(Xs)d s. We consider the case in which the process (φt)t≥0 is oscillating and that in which (φt)t≥0 has a negative drift. In each of these cases, we condition the process (Xt,φt)t≥0 on the event that (φt)t≥0 hits level y before hitting 0 and prove weak convergence of the conditioned process as y→∞. In addition, we show the relationship between the conditioning of the process (φt)t≥0 with a negative drift to oscillate and the conditioning of it to stay nonnegative for a long time, and the relationship between the conditioning of (φt)t≥0 with a negative drift to drift to ∞ and the conditioning of it to hit large levels before hitting 0.

We use a simple coupling to prove the classical result that the renewal function U of a zero-delayed renewal process satisfies U(t) – λ . t→λ2μ2/2 as t→∞ if the life-length distribution is of non-lattice type and has finite first and second moments μ and μ2 respectively; λ is the renewal intensity, and is equal to 1/μ.

This article investigates the long-time behavior of conservative affine processes on the cone of symmetric positive semidefinite $d\times d$ matrices. In particular, for conservative and subcritical affine processes we show that a finite $\log$ -moment of the state-independent jump measure is sufficient for the existence of a unique limit distribution. Moreover, we study the convergence rate of the underlying transition kernel to the limit distribution: first, in a specific metric induced by the Laplace transform, and second, in the Wasserstein distance under a first moment assumption imposed on the state-independent jump measure and an additional condition on the diffusion parameter.

This paper considers ergodic, continuous-time Markov chains $\{X(t)\}_{t \in (\!-\infty,\infty)}$ on $\mathbb{Z}^+=\{0,1,\ldots\}$ . For an arbitrarily fixed $N \in \mathbb{Z}^+$ , we study the conditional stationary distribution $\boldsymbol{\pi}(N)$ given the Markov chain being in $\{0,1,\ldots,N\}$ . We first characterize $\boldsymbol{\pi}(N)$ via systems of linear inequalities and identify simplices that contain $\boldsymbol{\pi}(N)$ , by examining the $(N+1) \times (N+1)$ northwest corner block of the infinitesimal generator $\textbf{\textit{Q}}$ and the subset of the first $N+1$ states whose members are directly reachable from at least one state in $\{N+1,N+2,\ldots\}$ . These results are closely related to the augmented truncation approximation (ATA), and we provide some practical implications for the ATA. Next we consider an extension of the above results, using the $(K+1) \times (K+1)$ ( $K > N$ ) northwest corner block of $\textbf{\textit{Q}}$ and the subset of the first $K+1$ states whose members are directly reachable from at least one state in $\{K+1,K+2,\ldots\}$ . Furthermore, we introduce new state transition structures called (K, N)-skip-free sets, using which we obtain the minimum convex polytope that contains $\boldsymbol{\pi}(N)$ .

Random sets with long-range dependence can be generated using a Boolean model with power-law grain sizes. We study thinnings of such Boolean models which have the hard-core property that no grains overlap in the resulting germ‒grain model. A fundamental question is whether long-range dependence is preserved under such thinnings. To answer this question, we study four natural thinnings of a Poisson germ‒grain model where the grains are spheres with a regularly varying size distribution. We show that a thinning which favors large grains preserves the slow correlation decay of the original model, whereas a thinning which favors small grains does not. Our most interesting finding concerns the case where only disjoint grains are retained, which corresponds to the well-known Matérn type-I thinning. In the resulting germ‒grain model, typical grains have exponentially small sizes, but rather surprisingly, the long-range dependence property is still present. As a byproduct, we obtain new mechanisms for generating homogeneous and isotropic random point configurations having a power-law correlation decay.

We propose a class of random scale-free spatial networks with nested community structures called SHEM and analyze Reed–Frost epidemics with community related independent transmissions. We show that in a specific example of the SHEM the epidemic threshold may be trivial or not as a function of the relation among community sizes, distribution of the number of communities, and transmission rates.

In this paper we develop methods for reducing the study, the computation, and the construction of stochastic functionals to those of standard concepts such as the moments of the pertinent random variables. Principally, our methods are based on the notion of ladder height densities and their Laguerre expansions, and our results provide a unifying framework for the distinct approaches of Dufresne (2000) and Schröder (2005).

The best-choice problem and the duration problem, known as versions of the secretary problem, are concerned with choosing an object from those that appear sequentially. Let (B,p) denote the best-choice problem and (D,p) the duration problem when the total number N of objects is a bounded random variable with prior p=(p1, p2,...,pn) for a known upper bound n. Gnedin (2005) discovered the correspondence relation between these two quite different optimal stopping problems. That is, for any given prior p, there exists another prior q such that (D,p) is equivalent to (B,q). In this paper, motivated by his discovery, we attempt to find the alternate correspondence {p(m),m≥0}, i.e. an infinite sequence of priors such that (D,p(m-1)) is equivalent to (B,p(m)) for all m≥1, starting with p(0)=(0,...,0,1). To be more precise, the duration problem is distinguished into (D1,p) or (D2,p), referred to as model 1 or model 2, depending on whether the planning horizon is N or n. The aforementioned problem is model 1. For model 2 as well, we can find the similar alternate correspondence {p[m],m≥ 0}. We treat both the no-information model and the full-information model and examine the limiting behaviors of their optimal rules and optimal values related to the alternate correspondences as n→∞. A generalization of the no-information model is given. It is worth mentioning that the alternate correspondences for model 1 and model 2 are respectively related to the urn sampling models without replacement and with replacement.

Quasi-stationary distributions (QSDs) arise from stochastic processes that exhibit transient equilibrium behaviour on the way to absorption. QSDs are often mathematically intractable and even drawing samples from them is not straightforward. In this paper the framework of sequential Monte Carlo samplers is utilised to simulate QSDs and several novel resampling techniques are proposed to accommodate models with reducible state spaces, with particular focus on preserving particle diversity on discrete spaces. Finally, an approach is considered to estimate eigenvalues associated with QSDs, such as the decay parameter.

Suppose that a system is affected by a sequence of random shocks that occur over certain time periods. In this paper we study the discrete censored $\delta$-shock model, $\delta \ge 1$, for which the system fails whenever no shock occurs within a $\delta$-length time period from the last shock, by supposing that the interarrival times between consecutive shocks are described by a first-order Markov chain (as well as under the binomial shock process, i.e., when the interarrival times between successive shocks have a geometric distribution). Using the Markov chain embedding technique introduced by Chadjiconstantinidis et al. (Adv. Appl. Prob. 32, 2000), we study the joint and marginal distributions of the system’s lifetime, the number of shocks, and the number of periods in which no shocks occur, up to the failure of the system. The joint and marginal probability generating functions of these random variables are obtained, and several recursions and exact formulae are given for the evaluation of their probability mass functions and moments. It is shown that the system’s lifetime follows a Markov geometric distribution of order $\delta$ (a geometric distribution of order $\delta$ under the binomial setup) and also that it follows a matrix-geometric distribution. Some reliability properties are also given under the binomial shock process, by showing that a shift of the system’s lifetime random variable follows a compound geometric distribution. Finally, we introduce a new mixed discrete censored $\delta$-shock model, for which the system fails when no shock occurs within a $\delta$-length time period from the last shock, or the magnitude of the shock is larger than a given critical threshold $\gamma >0$. Similarly, for this mixed model, we study the joint and marginal distributions of the system’s lifetime, the number of shocks, and the number of periods in which no shocks occur, up to the failure of the system, under the binomial shock process.

We develop diffusion approximations for parallel-queueing systems with the randomized longest-queue-first scheduling (LQF) algorithm by establishing new mean-field limit theorems as the number of buffers n → ∞. We achieve this by allowing the number of sampled buffers d = d(n) to depend on the number of buffers n, which yields an asymptotic 'decoupling' of the queue length processes. We show through simulation experiments that the resulting approximation is accurate even for moderate values of n and d(n). To the best of the authors' knowledge, this is the first derivation of diffusion approximations for a queueing system in the large-buffer mean-field regime. Another noteworthy feature of our scaling idea is that the randomized LQF algorithm emulates the LQF algorithm, yet is computationally more attractive. The analysis of the system performance as a function of d(n) is facilitated by the multi-scale nature in our limit theorems: the various processes we study have different space scalings. This allows us to show the trade-off between performance and complexity of the randomized LQF scheduling algorithm.

We consider a simple random walk starting at 0 and leading to 0 after 2n steps. By a generating functions approach we achieve closed formulae for the moments of the random variables ‘number of visits to the origin'.

We show that the simple characterizations given by Takahashi for the independence and the total dependence of a multivariate extreme value distribution do not hold for the larger class of maximum infinitely divisible (max i.d.) distributions. This holds also for sup self-decomposable distributions.

The Holme‒Kim random graph process is a variant of the Barabási‒Álbert scale-free graph that was designed to exhibit clustering. In this paper we show that whether the model does indeed exhibit clustering depends on how we define the clustering coefficient. In fact, we find that the local clustering coefficient typically remains positive whereas global clustering tends to 0 at a slow rate. These and other results are proven via martingale techniques, such as Freedman's concentration inequality combined with a bootstrapping argument.

We consider a gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We show, under natural conditions on the system primitives, the existence of a deterministic stationary optimal policy out of a more general class of policies that allow multiple simultaneous impulses, randomized selection of impulses with random effects, and accumulation of jumps. After characterizing the value function using the optimality equation, we reduce the gradual-impulse control problem to an equivalent simple discrete-time Markov decision process, whose action space is the union of the sets of gradual and impulsive actions.

Recently, Massey [1] proved that the vector of queue lengths of some queueing networks is stochastically dominated at any given time by that of a corresponding system of parallel M/M/l queues. This result is interesting, even though the bounds are generally quite conservative, in that the transient behavior of independent parallel M/M/l queues is considerably easier to analyze than that of a network.

This note provides an alternative proof of a generalized form of that result.

Consider a genetic population evolving in time. In particular, suppose that the population is very large, that there is a large number of genetic types (alleles) possible for the genes making up the population, and that the numbers of the various alleles change stochastically in time, subject to Mendel's law of inheritance. Assume that there are no selective differences among the genotypes, but that mutation may occur among the alleles.

Motivated by recent studies of big samples, this work aims to construct a parametric model which is characterized by the following features: (i) a ‘local’ reinforcement, i.e. a reinforcement mechanism mainly based on the last observations, (ii) a random persistent fluctuation of the predictive mean, and (iii) a long-term almost sure convergence of the empirical mean to a deterministic limit, together with a chi-squared goodness-of-fit result for the limit probabilities. This triple purpose is achieved by the introduction of a new variant of the Eggenberger–Pólya urn, which we call the rescaled Pólya urn. We provide a complete asymptotic characterization of this model, pointing out that, for a certain choice of the parameters, it has properties different from the ones typically exhibited by the other urn models in the literature. Therefore, beyond the possible statistical application, this work could be interesting for those who are concerned with stochastic processes with reinforcement.