We investigate queueing networks in a random environment. The impact of the evolving environment on the network is by changing service capacities (upgrading and/or degrading, breakdown, repair) when the environment changes its state. On the other side, customers departing from the network may enforce the environment to jump immediately. This means that the environment is nonautonomous and therefore results in a rather complex two-way interaction, especially if the environment is not itself Markov. To react to the changes of the capacities we implement randomised versions of the well-known deterministic rerouteing schemes 'skipping' (jump-over protocol) and `reflection' (repeated service, random direction). Our main result is an explicit expression for the joint stationary distribution of the queue-lengths vector and the environment which is of product form.

The signature of a coherent system is a useful tool in the study and comparison of lifetimes of engineered systems. In order to compare two systems of different sizes with respect to their signatures, the smaller system needs to be represented by an equivalent system of the same size as the larger system. In the paper we show how to construct equivalent systems by adding irrelevant components to the smaller system. This leads to simpler proofs of some current key results, and throws new light on the interpretation of mixed systems. We also present a sufficient condition for equivalence of systems of different sizes when restricting to coherent systems. In cases where for a given system there is no equivalent system of smaller size, we characterize the class of lower-sized systems with a signature vector which stochastically dominates the signature of the larger system. This setup is applied to an optimization problem in reliability economics.

The Marcinkiewicz strong law, limn→∞(1 / n1/p)∑k=1n(Dk - D) = 0 almost surely with p ∈ (1, 2), is studied for outer products Dk = {XkX̅kT}, where {Xk} and {X̅k} are both two-sided (multivariate) linear processes (with coefficient matrices (Cl), (C̅l) and independent and identically distributed zero-mean innovations {Ξ} and {Ξ̅}). Matrix sequences Cl and C ̅l can decay slowly enough (as |l| → ∞) that {Xk,X ̅k} have long-range dependence, while {Dk} can have heavy tails. In particular, the heavy-tail and long-range-dependence phenomena for {Dk} are handled simultaneously and a new decoupling property is proved that shows the convergence rate is determined by the worst of the heavy tails or the long-range dependence, but not the combination. The main result is applied to obtain a Marcinkiewicz strong law of large numbers for stochastic approximation, nonlinear function forms, and autocovariances.

This paper is devoted to probabilistic cellular automata (PCAs) on N,Z or Z / nZ, depending on two neighbors with a general alphabet E (finite or infinite, discrete or not). We study the following question: under which conditions does a PCA possess a Markov chain as an invariant distribution? Previous results in the literature give some conditions on the transition matrix (for positive rate PCAs) when the alphabet E is finite. Here we obtain conditions on the transition kernel of a PCA with a general alphabet E. In particular, we show that the existence of an invariant Markov chain is equivalent to the existence of a solution to a cubic integral equation. One of the difficulties in passing from a finite alphabet to a general alphabet comes from the problem of measurability, and a large part of this work is devoted to clarifying these issues.

In this paper we are concerned with analysing optimal wealth allocation techniques within a defaultable financial market similar to Bielecki and Jang (2007). We study a portfolio optimization problem combining a continuous-time jump market and a defaultable security; and present numerical solutions through the conversion into a Markov decision process and characterization of its value function as a unique fixed point to a contracting operator. In this paper we analyse allocation strategies under several families of utility functions, and highlight significant portfolio selection differences with previously reported results.

We study the optimal financing and dividend distribution problem with restricted dividend rates in a diffusion type surplus model, where the drift and volatility coefficients are general functions of the level of surplus and the external environment regime. The environment regime is modeled by a Markov process. Both capital injection and dividend payments incur expenses. The objective is to maximize the expectation of the total discounted dividends minus the total cost of the capital injection. We prove that it is optimal to inject capital only when the surplus tends to fall below 0 and to pay out dividends at the maximal rate when the surplus is at or above the threshold, dependent on the environment regime.

Affine processes possess the property that expectations of exponential affine transformations are given by a set of Riccati differential equations, which is the main feature of this popular class of processes. In this paper we generalise these results for expectations of more general transformations. This is of interest in, e.g. doubly stochastic Markov models, in particular in life insurance. When using affine processes for modelling the transition rates and interest rate, the results presented allow for easy calculation of transition probabilities and expected present values.

In this paper we define and study a new class of multivariate counting processes, named `multivariate generalized Pólya process'. Initially, we define and study the bivariate generalized Pólya process and briefly discuss its reliability application. In order to derive the main properties of the process, we suggest some key properties and an important characterization of the process. Due to these properties and the characterization, the main properties of the bivariate generalized Pólya process are obtained efficiently. The marginal processes of the multivariate generalized Pólya process are shown to be the univariate generalized Pólya processes studied in Cha (2014). Given the history of a marginal process, the conditional property of the other process is also discussed. The bivariate generalized Pólya process is extended to the multivariate case. We define a new dependence concept for multivariate point processes and, based on it, we analyze the dependence structure of the multivariate generalized Pólya process.

In this paper we focus on a class of linear Hawkes processes with general immigrants. These are counting processes with shot-noise intensity, including self-excited and externally excited patterns. For such processes, we introduce the concept of the age pyramid which evolves according to immigration and births. The virtue of this approach that combines an intensity process definition and a branching representation is that the population age pyramid keeps track of all past events. This is used to compute new distribution properties for a class of Hawkes processes with general immigrants which generalize the popular exponential fertility function. The pathwise construction of the Hawkes process and its underlying population is also given.

In this paper we consider time-changed models of population evolution Xf(t) = X(Hf(t)), where X is a counting process and Hf is a subordinator with Laplace exponent f. In the case where X is a pure birth process, we study the form of the distribution, the intertimes between successive jumps, and the condition of explosion (also in the case of killed subordinators). We also investigate the case where X represents a death process (linear or sublinear) and study the extinction probabilities as a function of the initial population size n0. Finally, the subordinated linear birth–death process is considered. Special attention is devoted to the case where birth and death rates coincide; the sojourn times are also analysed.

In this paper we consider linear functions constructed on two different weighted branching processes and provide explicit bounds for their Kantorovich–Rubinstein distance in terms of couplings of their corresponding generic branching vectors. Motivated by applications to the analysis of random graphs, we also consider a variation of the weighted branching process where the generic branching vector has a different dependence structure from the usual one. By applying the bounds to sequences of weighted branching processes, we derive sufficient conditions for the convergence in the Kantorovich–Rubinstein distance of linear functions. We focus on the case where the limits are endogenous fixed points of suitable smoothing transformations.

We consider an extension of the Poisson hail model where the service speed is either 0 or ∞ at each point of the Euclidean space. We use and develop tools pertaining to sub-additive ergodic theory in order to establish shape theorems for the growth of the ice-heap under light tail assumptions on the hailstone characteristics. The asymptotic shape depends on the statistics of the hailstones, the intensity of the underlying Poisson point process, and on the geometrical properties of the zero speed set.

A Poisson line tessellation is observed in the window Wρ := B(0, π-1/2ρ1/2) for ρ > 0. With each cell of the tessellation, we associate the inradius, which is the radius of the largest ball contained in the cell. Using the Poisson approximation, we compute the limit distributions of the largest and smallest order statistics for the inradii of all cells whose nuclei are contained in Wρ as ρ goes to ∞. We additionally prove that the limit shape of the cells minimising the inradius is a triangle.

In the full rectangular version of Gilbert's planar tessellation (see Gilbert (1967), Mackisack and Miles (1996), and Burridge et al. (2013)), lines extend either horizontally (with east- and west-growing rays) or vertically (north- and south-growing rays) from seed points which form a stationary Poisson point process, each ray stopping when it meets another ray that has blocked its path. In the half-Gilbert rectangular version, east- and south-growing rays, whilst having the potential to block each other, do not interact with west and north rays, and vice versa. East- and south-growing rays have a reciprocality of blocking, as do west and north. In this paper we significantly expand and simplify the half-Gilbert analytic results that we gave in Burridge et al. (2013). We also show how the idea of reciprocality of blocking between rays can be used in a much wider context, with rays not necessarily orthogonal and with seeds that produce more than two rays.

In their recent paper Velleman and Warrington (2013) analyzed the expected values of some of the parameters in a memory game; namely, the length of the game, the waiting time for the first match, and the number of lucky moves. In this paper we continue this direction of investigation and obtain the limiting distributions of those parameters. More specifically, we prove that when suitably normalized, these quantities converge in distribution to a normal, Rayleigh, and Poisson random variable, respectively. We also make a connection between the memory game and one of the models of preferential attachment graphs. In particular, as a by-product of our methods, we obtain the joint asymptotic normality of the degree counts in the preferential attachment graphs. Furthermore, we obtain simpler proofs (although without rate of convergence) of some of the results of Peköz et al. (2014) on the joint limiting distributions of the degrees of the first few vertices in preferential attachment graphs. In order to prove that the length of the game is asymptotically normal, our main technical tool is a limit result for the joint distribution of the number of balls in a multitype generalized Pólya urn model.

We consider a game with K ≥ 2 players, each having an integer-valued fortune. On each round, a pair (i,j) among the players with nonzero fortunes is chosen to play and the winner is decided by flipping a fair coin (independently of the process up to that time). The winner then receives a unit from the loser. All other players' fortunes remain the same. (Once a player's fortune reaches 0, this player is out of the game.) The game continues until only one player wins all. The choices of pairs represent the control present in the problem. While it is known that the expected time to ruin (i.e. expected duration of the game) is independent of the choices of pairs (i,j) (the strategies), our objective is to find a strategy which maximizes the variance of the time to ruin. We show that the maximum variance is uniquely attained by the (optimal) strategy, which always selects a pair of players who have currently the largest fortunes. An explicit formula for the maximum value function is derived. By constructing a simple martingale, we also provide a short proof of a result of Ross (2009) that the expected time to ruin is independent of the strategies. A brief discussion of the (open) problem of minimizing the variance of the time to ruin is given.