In this paper, we study a monotone process maintenance model for a multistate system with k working states and ℓ failure states. By making different assumptions, we can apply the model to a multistate deteriorating system as well as to a multistate improving system. We show that the monotone process model for a multistate system is equivalent to a geometric process model for a two-state system. Then, for both the deteriorating and the improving system, we analytically determine an optimal replacement policy for minimizing the long-run average cost per unit time.

We give a very general reformulation of multi-actor Markov decision processes and show that there is a tendency for the actors to take the same action whenever possible. This considerably reduces the complexity of the problem, either facilitating numerical computation of the optimal policy or providing a basis for a heuristic.

We investigate the conditions on a hedger, who overestimates the (time- and level-dependent) volatility, to superreplicate a convex claim on several underlying assets. It is shown that the classic Black-Scholes model is the only model, within a large class, for which overestimation of the volatility yields the desired superreplication property. This is in contrast to the one-dimensional case, in which it is known that overestimation of the volatility with any time- and level-dependent model guarantees superreplication of convex claims.

We consider two versions of a simple evolutionary algorithm (EA) model for protein folding at zero temperature, namely the (1 + 1)-EA on the LeadingOnes problem. In this schematic model, the structure of the protein, which is encoded as a bit-string of length n, is evolved to its native conformation through a stochastic pathway of sequential contact bindings. We study the asymptotic behavior of the hitting time, in the mean case scenario, under two different mutations: the one-flip, which flips a unique bit chosen uniformly at random in the bit-string, and the Bernoulli-flip, which flips each bit in the bit-string independently with probability c/n, for some c ∈ ℝ+ (0 ≤ c ≤ n). For each algorithm, we prove a law of large numbers, a central limit theorem, and compare the performance of the two models.

As proposed by Irle and Gani in 2001, a process X is said to be slower in level crossing than a process Y if it takes X stochastically longer to exceed any given level than it does Y. In this paper, we extend a result of Irle (2003), relative to the level crossing ordering of uniformizable skip-free-to-the-right continuous-time Markov chains, to derive a new set of sufficient conditions for the level crossing ordering of these processes. We apply our findings to birth-death processes with and without catastrophes, and M/M/s/c systems.

The first passage time of a random walk to a barrier (constant or concave) is of great importance in many areas, such as insurance, finance, and sequential analysis. Here, we consider a sum of independent, identically distributed random variables and the convex barrier cb(n/c), where c is a scale parameter and n is time. It is shown, using large-deviation techniques, that the limit distribution of the first passage time decays exponentially in c. Under a tilt of measure, which changes the drift, four properties are proved: the limit distribution of the overshoot is distributed as an overshoot over a linear barrier; the stopping time is asymptotically normally distributed when it is properly normalized; the overshoot and the asymptotic normal part are asymptotically independent; and the overshoot over a linear barrier is bounded by an exponentially distributed random variable. The determination of the function that multiplies the exponential part is guided by consideration of these properties.

We give explicit upper bounds for convergence rates when approximating both one- and two-sided general curvilinear boundary crossing probabilities for the Wiener process by similar probabilities for close boundaries of simpler form, for which computation of the boundary crossing probabilities is feasible. In particular, we partially generalize and improve results obtained by Pötzelberger and Wang in the case when the approximating boundaries are piecewise linear. Applications to barrier option pricing are also discussed.

In practical situations, we observe the number of claims to an insurance portfolio but not the claim intensity. It is therefore of interest to try to solve the ‘filtering problem’; that is, to obtain the best estimate of the claim intensity on the basis of reported claims. In order to use the Kalman-Bucy filter, based on the Cox process incorporating a shot noise process as claim intensity, we need to approximate it by a Gaussian process. We demonstrate that, if the primary-event arrival rate of the shot noise process is reasonably large, we can then approximate the intensity, claim arrival, and aggregate loss processes by a three-dimensional Gaussian process. We establish weak-convergence results. We then use the Kalman-Bucy filter and we obtain the price of reinsurance contracts involving high-frequency events.

Let X1, X2,…, Xn be independent, identically distributed random variables, uniform on [0,1]. We observe the Xk sequentially and must stop on exactly one of them. No recollection of the preceding observations is permitted. What stopping rule τ minimizes the expected rank of the selected observation? This full-information expected-rank problem is known as Robbins' problem. The general solution is still unknown, and only some bounds are known for the limiting value as n tends to infinity. After a short discussion of the history and background of this problem, we summarize what is known. We then try to present, in an easily accessible form, what the author believes should be seen as the essence of the more difficult remaining questions. The aim of this article is to evoke interest in this problem and so, simply by viewing it from what are possibly new angles, to increase the probability that a reader may see what seems to evade probabilistic intuition.

Mr. G owes $100 000 to a loan shark, and will be killed at dawn if the loan is not repaid in full. Mr. G has $20 000, but partial payments are not accepted, and he has no other source of income or credit. The loan shark owns a primitive casino where one can stake any amount in one's possession, gaining r times the stake with probability w and losing the stake with probability 1 - w (r > 0, 0 < w < 1). Mr. G is permitted to gamble at the casino, but each time he places a bet, the amount of his debt is increased by a factor of 1 + α (α ≥ 0). How should Mr. G gamble to maximize his chance of reaching his (moving) target and thereby surviving? Dubins and Savage showed that an optimal strategy is to stake boldly if the primitive casino is subfair or fair (i.e. w(1 + r) ≤ 1) and the inflation rate α is 0. Intuitively, a positive inflation rate would motivate Mr. G to try to reach his goal as quickly as possible, so it seems plausible that the bold strategy is optimal. However, Chen, Shepp, and Zame found that, surprisingly, the bold strategy is no longer optimal for subfair primitive casinos with inflation if both r > 1 and α satisfies 1/r ≤ α < r. They also conjectured that the bold strategy is optimal for subfair primitive casinos with inflation if r < 1. It is shown in the present paper that this conjecture is true provided that w ≤ ½. Furthermore, by introducing an interesting notion of sharp strategy, additional results are obtained on optimality of the bold strategy.

We set up a model for electronic foreign-exchange markets, suggesting subordinators to represent sellers' and buyers' offers. Its analysis naturally leads to the study of level passage events. The classical level passage event concerns the joint law of the time, height, and jump size observed when a real-valued stochastic process first exceeds a given level h. We provide an up-to-date treatment in the case when this process is a subordinator, and extend these results to a multivariate setting.

Let (Yn, Nn)n≥1 be independent and identically distributed bivariate random variables such that the Nn are positive with finite mean ν and the Yn have a common heavy-tailed distribution F. We consider the process (Zn)n≥1 defined by Zn = Yn - Σn-1, where It is shown that the probability that the maximum M = maxn≥1Zn exceeds x is approximately as x → ∞, where F' := 1 - F. Then we study the integrated tail of the maximum of a random walk with long-tailed increments and negative drift over the interval [0, σ], defined by some stopping time σ, in the case in which the randomly stopped sum is negative. Finally, an application to risk theory is considered.

In this paper, we consider a risk model in which each main claim induces a delayed claim called a by-claim. The time of delay for the occurrence of a by-claim is assumed to be exponentially distributed. From martingale theory, an expression for the ultimate ruin probability can be derived using the Lundberg exponent of the associated nondelayed risk model. It can be shown that the Lundberg exponent of the proposed risk model is the same as that of the nondelayed one. Brownian motion approximations for ruin probabilities are also discussed.

In this paper, we study a class of bisexual Galton-Watson branching processes in which the law of offspring distribution is dependent on the population size. Under a suitable condition on the offspring distribution, we prove that the limit of mean growth-rate per mating unit exists. Based on this limit, we give a criterion to identify whether the process admits ultimate extinction with probability one.

We study birth-death processes on the nonnegative integers, where {1, 2,…} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.

We consider a two-node Jackson network in which the buffer of node 1 is truncated. Our interest is in the limit of the tail decay rate of the queue-length distribution of node 2 when the buffer size of node 1 goes to infinity, provided that the stability condition of the unlimited network is satisfied. We show that there can be three different cases for the limit. This generalizes some recent results obtained for the tandem Jackson network. Special cases and some numerical examples are also presented.

We consider an M/G/1 queue that is idle at time 0. The number of customers sampled at an independent exponential time is shown to have the same geometric distribution under the preemptive-resume last-in-first-out and the processor-sharing disciplines. Hence, the marginal distribution of the queue length at any time is identical for both disciplines. We then give a detailed analysis of the time until the first departure for any symmetric queueing discipline. We characterize its distribution and show that it is insensitive to the service discipline. Finally, we study the tail behavior of this distribution.

A linear list is a collection of items that can be accessed sequentially. The cost of a request is the number of items that need to be examined before the desired item is located, i.e. the distance of the requested item from the beginning of the list. The transposition rule is one of the algorithms designed to reduce the search cost by organizing the list. In particular, upon a request for a given item, the item is transposed with the preceding one. We develop a new approach for analyzing the algorithm, based on a coupling to a certain constrained asymmetric exclusion process. This allows us to establish an asymptotic optimality of the rule for two families of request distributions.

Probability theory, and its dynamic aspect stochastic process theory, is both a venerable subject, in that its roots go back to the mid-seventeenth century, and a young one, in that its modern formulation happened comparatively recently - well within living memory. The year 2003 marked the seventieth anniversary of Kolmogorov's Grundbegriffe der Wahrscheinlichkeitsrechnung, usually regarded as having inaugurated modern (measure-theoretic) probability theory. It also marked the fiftieth anniversary of Doob's Stochastic Processes. The profound and continuing influence of this classic work prompts the present piece.