We consider storage models where the input rate and the demand are modulated by a Markov jump process. One particular example from teletraffic theory is a fluid model of a multiplexer loaded by exponential on-off sources. Although the storage level process has been widely studied, little attention has been paid to the output rate process. We will show that, under certain assumptions, there exists another Markov jump process that modulates the output rate. The modulating process is explicitly constructed. It turns out to be a modification of a GI/G/1 queueing process

We consider a stochastic fluid network with independent subordinator inputs to the various stations and deterministic internal flow which is of feed-forward type. We show that under suitable conditions the process of fluid contents in the station has a limiting distribution, where the limit holds in total variation and is independent of the initial condition. We also show that this limiting distribution is of product form only for trivial setups.

In Part I we developed stability concepts for discrete chains, together with Foster–Lyapunov criteria for them to hold. Part II was devoted to developing related stability concepts for continuous-time processes. In this paper we develop criteria for these forms of stability for continuous-parameter Markovian processes on general state spaces, based on Foster-Lyapunov inequalities for the extended generator.

Such test function criteria are found for non-explosivity, non-evanescence, Harris recurrence, and positive Harris recurrence. These results are proved by systematic application of Dynkin's formula.

We also strengthen known ergodic theorems, and especially exponential ergodic results, for continuous-time processes. In particular we are able to show that the test function approach provides a criterion for f-norm convergence, and bounding constants for such convergence in the exponential ergodic case.

We apply the criteria to several specific processes, including linear stochastic systems under non-linear feedback, work-modulated queues, general release storage processes and risk processes.

We apply the general theory of stochastic integration to identify a martingale associated with a Lévy process modified by the addition of a secondary process of bounded variation on every finite interval. This martingale can be applied to queues and related stochastic storage models driven by a Lévy process. For example, we have applied this martingale to derive the (non-product-form) steady-state distribution of a two-node tandem storage network with Lévy input and deterministic linear fluid flow out of the nodes.

Non-negative time series which are first-order autoregressive with a mixed exponential innovation process are studied. Properties and approximate marginal distributions for such series are found. Modifications to include exact zeroes and to increase variability so that the time series is a more realistic model of rivers which are dry for part of the year are discussed.

This paper considers a semi-infinite storage model, of the type studied by Senturia and Puri [13] and Balagopal [2], defined on a Markov renewal process, {(Xn, Tn), n = 0, 1, ·· ·}, with 0 = T0 < T1 < · ··, almost surely, where Xn takes values in the set {1, 2, ·· ·}. If at Tn, Xn = j, then there is a random ‘input' Vn (j) (a negative input implying a demand) of ‘type' j, having distribution function Fj(·). We assume that {Vn (j)} is an i.i.d. sequence of random variables, taken to be independent of {(Xn, Tn)} and of {Vn (k)}, for k ≠ j, and that Vn (j) has first and second moments. Here the random variables Vn (j) represent instantaneous ‘inputs' (a negative value implying a demand) of type j for our storage model. Under these assumptions, we establish certain limit distributions for the joint process (Z(t), L(t)), where Z(t) (defined in (2)) is the level of storage at time t and L(t) (defined in (3)) is the demand lost due to shortage of supply during [0, t]. Different limit distributions are obtained for the cases when the ‘average stationary input' ρ, as defined in (5), is positive, zero or negative.