Imagine, you enter a grocery store to buy food. How many people do you overlap with in this store? How much time do you overlap with each person in the store? In this paper, we answer these questions by studying the overlap times between customers in the infinite server queue. We compute in closed form the steady-state distribution of the overlap time between a pair of customers and the distribution of the number of customers that an arriving customer will overlap with. Finally, we define a residual process that counts the number of overlapping customers that overlap in the queue for at least $\delta$ time units and compute its distribution.

We consider a collection of statistically identical two-state continuous time Markov chains (channels). A controller continuously selects a channel with the view of maximizing infinite horizon average reward. A switching cost is paid upon channel changes. We consider two cases: full observation (all channels observed simultaneously) and partial observation (only the current channel observed). We analyze the difference in performance between these cases for various policies. For the partial observation case with two channels or an infinite number of channels, we explicitly characterize an optimal threshold for two sensible policies which we name “call-gapping” and “cool-off.” Our results present a qualitative view on the interaction of the number of channels, the available information, and the switching costs.

We consider the assignment of servers to two phases of service in a two-stage tandem queueing system when customers can abandon from each stage of service. New jobs arrive at both stations. Jobs arriving at station 1 may go through both phases of service and jobs arriving at station 2 may go through only one phase of service. Stage-dependent holding and lump-sum abandonment costs are incurred. Continuous-time Markov decision process formulations are developed that minimize discounted expected and long-run average costs. Because uniformization is not possible, we use the continuous-time framework and sample path arguments to analyze control policies. Our main results are conditions under which priority rules are optimal for the single-server model. We then propose and evaluate threshold policies for allocating one or more servers between the two stages in a numerical study. These policies prioritize a phase of service before “switching” to the other phase when total congestion exceeds a certain number. Results provide insight into how to adjust the switching rule to significantly reduce costs for specific input parameters as well as more general multi-server situations when neither preemption or abandonments are allowed during service and service and abandonment times are not exponential.

We consider a competition involving $r$ teams, where each individual game involves two teams, and where each game between teams $i$ and $j$ is won by $i$ with probability $P_{i,j} = 1 - P_{j,i}$. We suppose that $i$ and $j$ are scheduled to play $n(i,j)$ games and say that the team that wins the most games is the winner of the competition. We show that the conditional probability that $i$ is the winner, given that $i$ wins $k$ games, is increasing in $k$. We bound the tail probability of the number of wins of the winning team. We consider the special case where $P_{i,j} = {v_i}/{(v_i + v_j)}$, and obtain structural results on the probability that team $i$ is the winner. We give efficient simulation approaches for computing the probability that team $i$ is the winner, and the conditional probability given the number of wins of $i$.

There is a set of n bandits and at every stage, two of the bandits are chosen to play a game, with the result of a game being learned. In the “weak regret problem,” we suppose there is a “best” bandit that wins each game it plays with probability at least p > 1/2, with the value of p being unknown. The objective is to choose bandits to maximize the number of times that one of the competitors is the best bandit. In the “strong regret problem”, we suppose that bandit i has unknown value vi, i = 1, …, n, and that i beats j with probability vi/(vi + vj). One version of strong regret is interested in maximizing the number of times that the contest is between the players with the two largest values. Another version supposes that at any stage, rather than choosing two arms to play a game, the decision maker can declare that a particular arm is the best, with the objective of maximizing the number of stages in which the arm with the largest value is declared to be the best. In the weak regret problem, we propose a policy and obtain an analytic bound on the expected number of stages over an infinite time frame that the best arm is not one of the competitors when this policy is employed. In the strong regret problem, we propose a Thompson sampling type algorithm and empirically compare its performance with others in the literature.

We analyze a mean field game model of SIR dynamics (Susceptible, Infected, and Recovered) where players choose when to vaccinate. We show that this game admits a unique mean field equilibrium (MFE) that consists in vaccinating at a maximal rate until a given time and then not vaccinating. The vaccination strategy that minimizes the total cost has the same structure as the MFE. We prove that the vaccination period of the MFE is always smaller than the one minimizing the total cost. This implies that, to encourage optimal vaccination behavior, vaccination should always be subsidized. Finally, we provide numerical experiments to study the convergence of the equilibrium when the system is composed by a finite number of agents ($N$) to the MFE. These experiments show that the convergence rate of the cost is $1/N$ and the convergence of the switching curve is monotone.

As more people move back into densely populated cities, bike sharing is emerging as an important mode of urban mobility. In a typical bike-sharing system (BSS), riders arrive at a station and take a bike if it is available. After retrieving a bike, they ride it for a while, then return it to a station near their final destinations. Since space is limited in cities, each station has a finite capacity of docks, which cannot hold more bikes than its capacity. In this paper, we study BSSs with stations having a finite capacity. By an appropriate scaling of our stochastic model, we prove a mean-field limit and a central limit theorem for an empirical process of the number of stations with k bikes. The mean-field limit and the central limit theorem provide insight on the mean, variance, and sample path dynamics of large-scale BSSs. We also leverage our results to estimate confidence intervals for various performance measures such as the proportion of empty stations, the proportion of full stations, and the number of bikes in circulation. These performance measures have the potential to inform the operations and design of future BSSs.

The random neural network (RNN) is a mathematical model for an “integrate and fire” spiking network that closely resembles the stochastic behavior of neurons in mammalian brains. Since its proposal in 1989, there have been numerous investigations into the RNN's applications and learning algorithms. Deep learning (DL) has achieved great success in machine learning. Recently, the properties of the RNN for DL have been investigated, in order to combine their power. Recent results demonstrate that the gap between RNNs and DL can be bridged and the DL tools based on the RNN are faster and can potentially be used with less energy expenditure than existing methods.

In quantitative finance, it is often necessary to analyze the distribution of the sum of specific functions of observed values at discrete points of an underlying process. Examples include the probability density function, the hedging error, the Asian option, and statistical hypothesis testing. We propose a method to calculate such a distribution, utilizing a recursive method, and examine it using various examples. The results of the numerical experiment show that our proposed method has high accuracy.

A novel quantitative assessment of late Holocene precipitation in the Levant is presented, including mean and variance of annual precipitation and their trends. A stochastic framework was utilized and allowed, possibly for the first time, linking high-quality, reconstructed rises/declines in Dead Sea levels with precipitation trends in its watershed. We determined the change in mean annual precipitation for 12 specific intervals over the past 4500 yr, concluding that: (1) the twentieth century was substantially wetter than most of the late Holocene; (2) a representative reference value of mean annual precipitation is 75% of the present-day parameter; (3) during the late Holocene, mean annual precipitation ranged between −17 and +66% of the reference value (−37 to +25% of present-day conditions); (4) the driest intervals were 1500–1200 BC and AD 755–890, and the wettest intervals were 2500–2460 BC, 130–40 BC, AD 350–490, and AD 1770–1940; (5) lake-level rises and declines probably occurred in response to trends in precipitation means and are less likely to occur when precipitation mean is constant; (6) average trends in mean annual precipitation during intervals of ≥200 yr did not exceed 15 mm per decade. The precipitation trends probably reflect shifts in eastern Mediterranean cyclone tracks.

The variable selection has been an important topic in regression and Bayesian survival analysis. In the era of rapid development of genomics and precision medicine, the topic is becoming more important and challenging. In addition to the challenges of handling censored data in survival analysis, we are facing increasing demand of handling big data with too many predictors where most of them may not be relevant to the prediction of the survival outcome. With the desire of improving upon the accuracy of prediction, we explore the Bregman divergence criterion in selecting predictive models. We develop sparse Bayesian formulation for parametric regression and semiparametric regression models and demonstrate how variable selection is done using the predictive approach. Model selections for a simulated data set, and two real-data sets (one for a kidney transplant study, and the other for a breast cancer microarray study at the Memorial Sloan-Kettering Cancer Center) are carried out to illustrate our methods.

For rare blood groups the recruitment of donor relatives, for example siblings, is expected to be effective, since the probability of a similar rare blood group is likely. However, the likelihood differs between blood groups and is not commonly available. This paper provides a unified mathematical formulation to calculate such likelihoods. From a mathematical and probabilistic point of view, it is shown that these likelihoods can be obtained from the computation of a stationary genotype distribution. This, in turn, can be brought down to a system of quadratic stochastic operators. A generic mathematical approach is presented which directly leads to a stationary genotype distribution for arbitrary blood groups. The approach enables an exact computation for the effectiveness of recruiting next of kin for blood donorship. Next to an illustration of computations for ‘standard’ ABO and Rhesus-D blood groups, it is particularly illustrated for the extended Rhesus blood group system. Also other applications requiring next of kin blood group associations can be solved directly by using the unified mathematical formulation.

Different virtual machines can share servers, subject to resource constraints. Incoming jobs whose resource requirements cannot be satisfied are queued and receive service according to a preemptive-resume scheduling policy. The problem is to evaluate a cost function, including holding and server costs, with a view to searching for the optimal number of servers. A model with two job types is analyzed exactly and the results are used to develop accurate approximations, which are then extended to more than two classes. Numerical examples and comparisons with simulations are presented.

From health care to maintenance shops, many systems must contend with allocating resources to customers or jobs whose initial service requirements or costs change when they wait too long. We present a new queueing model for this scenario and use a Markov decision process formulation to analyze assignment policies that minimize holding costs. We show that the classic cμ rule is generally not optimal when service or cost requirements can change. Even for a two-class customer model where a class 1 task becomes a class 2 task upon waiting, we show that additional orderings of the service rates are needed to ensure the optimality of simple priority rules. We then show that seemingly-intuitive switching curve structures are also not optimal in general. We study these scenarios and provide conditions under which they do hold. Lastly, we show that results from the two-class model do not extend to when there are n≥3 customer classes. More broadly, we find that simple priority rules are not optimal. We provide sufficient conditions under which a simple priority rule holds. In short, allowing service and/or cost requirements to change fundamentally changes the structure of the optimal policy for resource allocation in queueing systems.

The concept of Energy Packet Network (EPN) proposed by Gelenbe, is a new framework for modeling power grids that takes distributed energy generation such as renewable energy sources into consideration, and which contributes to modeling the smart grid. Based on G-network theory, this paper presents a simplified model of EPN and formulates energy-distribution as an optimization problem. We analyze it theoretically, and detail its optimal solutions. In addition to using existing optimization algorithms, a heuristic algorithm is proposed to solve for EPN optimization. The optimal solutions and efficacy of the algorithm are illustrated with numerical experiments. Further, we present an EPN with disconnections and a similar optimization problem is investigated. Optimal solutions are presented, and numerical results using the analytic optimal solutions, random solutions, a cooperative particle swarm optimizer and a heuristic algorithm illustrate the power of different approaches for solving energy-distribution problems using the EPN formalism.

Relying only on the classical Bahadur–Rao approximation for large deviations (LDs) of univariate sample means, we derive strong LD approximations for probabilities involving two sets of sample means. The main result concerns the exact asymptotics (as n→∞) of

$$ {\open P}\left({\max_{i\in\{1,\ldots,d_x\}}\bar X_{i,n} \les \min_{i\in\{1,\ldots,d_y\}}\bar Y_{i,n}}\right),$$

${\bar X}_{i,n}{\rm s}$

${\bar Y}_{i,n}{\rm s}$

${\open E}X \gt {\open E}Y$

In this paper, we generalize the Gaussian Variance Approximation (GVA), developed by Massey and Pender [16], to Jackson networks with abandonment. We approximate the queue length process with a multivariate Gaussian distribution and thus, we are able to estimate the mean and covariance matrix of the entire network with more accuracy than the associated fluid and diffusion limits of Mandelbaum, Massey, and Reiman [14]. We also show how the GVA method can be used to construct staffing schedules that approximately stabilize salient performance measures such as the probability of delay and the abandonment probabilities for the entire network. Unlike the work of Feldman et al. [5] which uses Monte Carlo simulation to stabilize the delay probabilities, our method does not require simulation and only requires the numerical integration of ${1 \over 2}(N^2 + 3N)$ differential equations for an N-dimensional network, which is more computationally efficient. Lastly, to confirm our approximations are accurate, we perform several numerical experiments for a wide range of parameter settings.

In this paper, we establish a fluid limit for a two-sided Markov order book model. The main result states that in a certain asymptotic regime, a pair of measure-valued processes representing the “sell-side shape” and “buy-side shape” of an order book converges to a pair of deterministic measure-valued processes in a certain sense. We also test the fluid approximation on data. The empirical results suggest that the approximation is reasonably good for liquidly traded stocks in certain time periods.

The importance of funded private or occupational old-age provision is expected to increase due to demographic changes and the resulting problems for government-run pay-as-you-go systems. Clients and advisors therefore need reliable methodologies to match offered products with clients' needs and risk appetite. In Graf et al. (2012), the authors have introduced a methodology based on stochastic modeling to properly assess the risk-return profiles — i.e. the probability distribution of future benefits — of various old-age provision products. In this paper, we additionally consider the impact of inflation on the risk-return profile of old-age provision products. In a model with stochastic interest rates, stochastic inflation and equity returns including stochastic equity volatility, we derive risk-return-profiles for various types of existing unit-linked products with and without embedded guarantees and especially focus on the difference between nominal and real returns. We find that typical “rule of thumb” approximations for considering inflation risk are inappropriate and further show that products that are considered particularly safe by practitioners because of nominal guarantees may bear significant inflation risk. Finally, we propose product designs suitable to reduce inflation risk and investigate their risk-return profile in real terms.

Based on the study of two commonly used stochastic elliptic models: I: − ∇· (a(x,w)·∇u(x,w)) = f (x) and II: − ∇·(a(x,w)◊∇u(x,w)) = f (x), we constructed a new stochastic elliptic model III: −∇ ◊ ((a−1)·(−1)◊∇u(x,w)) = f (x), in. The difference between models I and II is twofold: a scaling factor induced by the way of applying the Wick product and the regularization induced by the Wick product itself. In, we showed that model III has the same scaling factor as model I. In this paper we present a detailed discussion about the difference between models I and III with respect to the two characteristic parameters of the random coefficient, i.e., the standard deviation σ and the correlation length lc. Numerical results are presented for both one- and two-dimensional cases.