Consider the following migration process based on a closed network of N queues with $K_N$ customers. Each station is a $\cdot$/M/$\infty$ queue with service (or migration) rate $\mu$. Upon departure, a customer is routed independently and uniformly at random to another station. In addition to migration, these customers are subject to a susceptible–infected–susceptible (SIS) dynamics. That is, customers are in one of two states: I for infected, or S for susceptible. Customers can swap their state either from I to S or from S to I only in stations. More precisely, at any station, each susceptible customer becomes infected with the instantaneous rate $\alpha Y$ if there are Y infected customers in the station, whereas each infected customer recovers and becomes susceptible with rate $\beta$. We let N tend to infinity and assume that $\lim_{N\to \infty} K_N/N= \eta $, where $\eta$ is a positive constant representing the customer density. The main problem of interest concerns the set of parameters of such a system for which there exists a stationary regime where the epidemic survives in the limiting system. The latter limit will be referred to as the thermodynamic limit. We use coupling and stochastic monotonicity arguments to establish key properties of the associated Markov processes, which in turn allow us to give the structure of the phase transition diagram of this thermodynamic limit with respect to $\eta$. The analysis of the Kolmogorov equations of this SIS model reduces to that of a wave-type PDE for which we have found no explicit solution. This plain SIS model is one among several companion stochastic processes that exhibit both random migration and contagion. Two of them are discussed in the present paper as they provide variants to the plain SIS model as well as some bounds and approximations. These two variants are the departure-on-change-of-state (DOCS) model and the averaged-infection-rate (AIR) model, which both admit closed-form solutions. The AIR system is a classical mean-field model where the infection mechanism based on the actual population of infected customers is replaced by a mechanism based on some empirical average of the number of infected customers in all stations. The latter admits a product-form solution. DOCS features accelerated migration in that each change of SIS state implies an immediate departure. This model leads to another wave-type PDE that admits a closed-form solution. In this text, the main focus is on the closed stochastic networks and their limits. The open systems consisting of a single station with Poisson input are instrumental in the analysis of the thermodynamic limits and are also of independent interest. This class of SIS dynamics has incarnations in virtually all queueing networks of the literature.

Imagine, you enter a grocery store to buy food. How many people do you overlap with in this store? How much time do you overlap with each person in the store? In this paper, we answer these questions by studying the overlap times between customers in the infinite server queue. We compute in closed form the steady-state distribution of the overlap time between a pair of customers and the distribution of the number of customers that an arriving customer will overlap with. Finally, we define a residual process that counts the number of overlapping customers that overlap in the queue for at least $\delta$ time units and compute its distribution.

We consider the assignment of servers to two phases of service in a two-stage tandem queueing system when customers can abandon from each stage of service. New jobs arrive at both stations. Jobs arriving at station 1 may go through both phases of service and jobs arriving at station 2 may go through only one phase of service. Stage-dependent holding and lump-sum abandonment costs are incurred. Continuous-time Markov decision process formulations are developed that minimize discounted expected and long-run average costs. Because uniformization is not possible, we use the continuous-time framework and sample path arguments to analyze control policies. Our main results are conditions under which priority rules are optimal for the single-server model. We then propose and evaluate threshold policies for allocating one or more servers between the two stages in a numerical study. These policies prioritize a phase of service before “switching” to the other phase when total congestion exceeds a certain number. Results provide insight into how to adjust the switching rule to significantly reduce costs for specific input parameters as well as more general multi-server situations when neither preemption or abandonments are allowed during service and service and abandonment times are not exponential.

Standard server assignment policies for multi-server queueing stations include the noncollaborative policy, where the servers work in parallel on different jobs; and the fully collaborative policy, where the servers work together on the same job. However, if each job can be decomposed into subtasks with no precedence relationships, then we consider a form of server coordination named task assignment where the servers work in parallel on different subtasks of the same job. We identify the task assignment policy that maximizes the long-run average throughput of a queueing station with finite internal buffers when blocked servers can be idled or reassigned to either replace or collaborate with other servers on unblocked subtasks. We then compare the server coordination policies and show that the task assignment is best when the servers are highly specialized; otherwise, the fully collaborative or noncollaborative policies are preferable depending on whether the synergy level among the servers is high or not. We also provide numerical results that quantify our previous comparison. Finally, we address buffer allocation in longer lines where there are precedence relationships between some of the tasks, and present numerical results that suggest our comparisons for one queueing station generalize to longer lines.

As more people move back into densely populated cities, bike sharing is emerging as an important mode of urban mobility. In a typical bike-sharing system (BSS), riders arrive at a station and take a bike if it is available. After retrieving a bike, they ride it for a while, then return it to a station near their final destinations. Since space is limited in cities, each station has a finite capacity of docks, which cannot hold more bikes than its capacity. In this paper, we study BSSs with stations having a finite capacity. By an appropriate scaling of our stochastic model, we prove a mean-field limit and a central limit theorem for an empirical process of the number of stations with k bikes. The mean-field limit and the central limit theorem provide insight on the mean, variance, and sample path dynamics of large-scale BSSs. We also leverage our results to estimate confidence intervals for various performance measures such as the proportion of empty stations, the proportion of full stations, and the number of bikes in circulation. These performance measures have the potential to inform the operations and design of future BSSs.

Reliability theory and survival analysis, the residual entropy is known as a measure suitable to describe the dynamic information content in stochastic systems conditional on survival. Aiming to analyze the variability of such information content, in this paper we introduce the variance of the residual lifetimes, “residual varentropy” in short. After a theoretical investigation of some properties of the residual varentropy, we illustrate certain applications related to the proportional hazards model and the first-passage times of an Ornstein–Uhlenbeck jump-diffusion process.

We study a single server queue under a processor-sharing type of scheduling policy, where the weights for determining the sharing are given by functions of each job's remaining service (processing) amount, and obtain a fluid limit for the scaled measure-valued system descriptors.

We introduce a Markov queueing system with Poisson arrivals, exponential services, and jockeying between two parallel and equivalent servers. An arriving customer admits to the shortest line. Every transition, of only the last customer in line, from the longer line to the shorter line may accompanied by a certain fixed cost. Thus, a transition from the longer queue to the shorter queue occurs whenever the difference between the lines reaches a certain discrete threshold (d = 2, 3, …). In this study, we focus on the stochastic analysis of the number of transitions of an arbitrary customer.

Falls are a major health concern in older adults. Falls lead to mortality, immobility and high costs to social and health care services. Early detection and classification of falls is imperative for timely and appropriate medical aid response. Traditional machine learning models have been explored for fall classification. While newly developed deep learning techniques have the ability to potentially extract high-level features from raw sensor data providing high accuracy and robustness to variations in sensor position, orientation and diversity of work environments that may skew traditional classification models. However, frequently used deep learning models like Convolutional Neural Networks (CNN) are computationally intensive. To the best of our knowledge, we present the first instance of a Hybrid Multichannel Random Neural Network (HMCRNN) architecture for fall detection and classification. The proposed architecture provides the highest accuracy of 92.23% with dropout regularization, compared to other deep learning implementations. The performance of the proposed technique is approximately comparable to a CNN yet requires only half the computation cost of the CNN-based implementation. Furthermore, the proposed HMCRNN architecture provides 34.12% improvement in accuracy on average than a Multilayer Perceptron.

We consider an M/M/1 queue with a removable server that dynamically chooses its service rate from a set of finitely many rates. If the server is off, the system must warm up for a random, exponentially distributed amount of time, before it can begin processing jobs. We show under the average cost criterion, that work conserving policies are optimal. We then demonstrate the optimal policy can be characterized by a threshold for turning on the server and the optimal service rate increases monotonically with the number in system. Finally, we present some numerical experiments to provide insights into the practicality of having both a removable server and service rate control.

We analyze Energy Packet Networks (EPNs) in which the service centers consist of multiclass queues and the Data Packets (DPs) initiate the transfer (i.e., the arrival of a DP at the battery triggers the movement) with multiple energy packet requirements. In other words, a class-k DP in cell i is sent successfully to the next cell if there are $c_i^{(k)}$ energy packets and it is dropped otherwise. Besides, we consider that the queues handling DPs operate under one of the following disciplines: First-Input-First-Output (FIFO), Processor Sharing (PS), or Preemptive Last-Input-First-Output (LIFO-PR). This model is an extension of previously studied EPNs [6,16] where the steady-state distribution of the number of jobs in the queues has a product form. In our model, we show the existence of a product form of the steady-state stationary distribution, where the load of the servers is given by a fixed point expression. We study the existence of a solution to the derived fixed point problem and we provide sufficient conditions for the stability of our model. Finally, we show that, for feed forward EPNs, the load of all the queues can be fully characterized.

This paper discusses a system of difference-differential equations (DDE) that is satisfied by the time-dependent state probabilities of open Markov queueing networks with various features. The number of network states in this case and the number of equations in this system is infinite. Flows of customers arriving at the network are a simple and independent, the time of customer services is exponentially distributed. The intensities of transitions between the network states are deterministic functions depending on its states.

To solve the system of DDE, we propose a modified method of successive approximations, combined with the method of series. The convergence of successive approximations with time to a stationary probability distribution, the form of which is indicated in the paper has been proved. The sequence of approximations converges to a unique solution of the system of equations. Any successive approximation can be represented as a convergent power series with an infinite radius of convergence, the coefficients of which satisfy recurrence relations, which is convenient for calculations on a computer. Examples of the analysis of Markov G-networks with various features have been presented.

We consider single-server scheduling to minimize holding costs where the capacity, or rate of service, depends on the number of jobs in the system, and job sizes become known upon arrival. In general, this is a hard problem, and counter-intuitive behavior can occur. For example, even with linear holding costs the optimal policy may be something other than SRPT or LRPT, it may idle, and it may depend on the arrival rate. We first establish an equivalence between our problem of deciding which jobs to serve when completed jobs immediately leave, and a problem in which we have the option to hold on to completed jobs and can choose when to release them, and in which we always serve jobs according to SRPT. We thus reduce the problem to determining the release times of completed jobs. For the clearing, or transient system, where all jobs are present at time 0, we give a complete characterization of the optimal policy and show that it is fully determined by the cost-to-capacity ratio. With arrivals, the problem is much more complicated, and we can obtain only partial results.

We present the first algorithm that samples maxn≥0{Sn − nα}, where Sn is a mean zero random walk, and nα with $\alpha \in ({1 \over 2},1)$ defines a nonlinear boundary. We show that our algorithm has finite expected running time. We also apply this algorithm to construct the first exact simulation method for the steady-state departure process of a GI/GI/∞ queue where the service time distribution has infinite mean.

The random neural network (RNN) is a mathematical model for an “integrate and fire” spiking network that closely resembles the stochastic behavior of neurons in mammalian brains. Since its proposal in 1989, there have been numerous investigations into the RNN's applications and learning algorithms. Deep learning (DL) has achieved great success in machine learning. Recently, the properties of the RNN for DL have been investigated, in order to combine their power. Recent results demonstrate that the gap between RNNs and DL can be bridged and the DL tools based on the RNN are faster and can potentially be used with less energy expenditure than existing methods.

A cloud provider hosts virtual machines (VMs) of different types, with different resource requirements. There are bounds on the total amounts of each kind of resource that are available. Requests arrive in batches of different sizes. Under the ‘complete blocking’ policy, a request is accepted only if all the VMs in its batch can be accommodated. The ‘partial blocking’ policy would accept a request if there is room for at least one of the VMs in the batch. Blocked requests are lost, with an associated loss of revenue. The trade-offs between costs and benefits are evaluated by means of appropriate models, for which novel solutions based on fixed-point iterations are proposed. The applicability of those solutions is extended, by means of simplifications, to very large-scale systems. Numerical examples and comparisons with simulations are presented.

Investigation of the G-network with multiple classes of positive and negative customers has been carried out in the article. The purpose of the investigation is to analyze such a network at a transient regime, finding expected revenues in the network systems depending on time. A negative customer arriving to the system and destroys a positive customer of its class. Streams of positive and negative customers arriving to each of the network systems are independent. Services of positive customers of all types occur in accordance with a random selection of them for service. For the expected revenues, a system of Kolmogorov's difference-differential equations has been derived. A method for their finding is proposed. It is based on the use of a modified method of successive approximations, combined with the method of series. A model example illustrating the finding of time-dependent expected revenues of network systems has been calculated, which shows that the expected revenues of network systems can be either increasing or decreasing time functions. The obtained results can be applied in forecasting losses in information and telecommunication systems and networks from the penetration of computer viruses into it and conducting computer attacks.

The paper provides an analysis of G-network with positive customers and signals when signals arriving to the system move customer to another system or destroy in it a group of customers, reducing their number to a random value that is given by a probability distribution. The signal arriving to the system, in which there are no positive customers, does not exert any influence on the queueing network and immediately disappears from it. Streams of positive customers and signals arriving to each of the network systems are independent. Customer in the transition from one system to another brings the latest some revenue, and the revenue of the first system is reduced by this amount. A method of finding the expected revenues of the systems of such a network has been proposed. The case when the revenues from transitions between network states are deterministic functions depending on its states has been considered. A description of the network is given, all possible transitions between network states, transition probabilities, and revenues from state transitions are indicated. A system of difference-differential equations for the expected revenues of network systems has been obtained. To solve it, we propose a method of successive approximations, combined with the method of series. It is proved that successive approximations converge to the stationary solution of such a system of equations, and the sequence of approximations converges to a unique solution of the system. Each approximation can be represented as a convergent power series with an infinite radius of convergence, the coefficients of which are related by recurrence relations. Therefore, it is convenient to use them for calculations on a PC. The obtained results can be applied in forecasting losses in information and telecommunication systems and networks from the penetration of computer viruses into it and conducting computer attacks.