This note corrects an error in the formula to obtain the Whittle index using the Sherman–Morrison formula in Akbarzadeh and Mahajan (2022). Also, some other minor typos are highlighted.

Restless bandits are a class of sequential resource allocation problems concerned with allocating one or more resources among several alternative processes where the evolution of the processes depends on the resources allocated to them. Such models capture the fundamental trade-offs between exploration and exploitation. In 1988, Whittle developed an index heuristic for restless bandit problems which has emerged as a popular solution approach because of its simplicity and strong empirical performance. The Whittle index heuristic is applicable if the model satisfies a technical condition known as indexability. In this paper, we present two general sufficient conditions for indexability and identify simpler-to-verify refinements of these conditions. We then revisit a previously proposed algorithm called the adaptive greedy algorithm which is known to compute the Whittle index for a sub-class of restless bandits. We show that a generalization of the adaptive greedy algorithm computes the Whittle index for all indexable restless bandits. We present an efficient implementation of this algorithm which can compute the Whittle index of a restless bandit with K states in $\mathcal{O}\!\left(K^3\right)$ computations. Finally, we present a detailed numerical study which affirms the strong performance of the Whittle index heuristic.

In this paper, we study the optimal reinsurance contracts that minimize the convex combination of the Conditional Value-at-Risk (CVaR) of the insurer’s loss and the reinsurer’s loss over the class of ceded loss functions such that the retained loss function is increasing and the ceded loss function satisfies Vajda condition. Among a general class of reinsurance premium principles that satisfy the properties of risk loading and convex order preserving, the optimal solutions are obtained. Our results show that the optimal ceded loss functions are in the form of five interconnected segments for general reinsurance premium principles, and they can be further simplified to four interconnected segments if more properties are added to reinsurance premium principles. Finally, we derive optimal parameters for the expected value premium principle and give a numerical study to analyze the impact of the weighting factor on the optimal reinsurance.

A forwards induction policy is a type of greedy algorithm for Markov decision processes. It is straightforward to implement and is optimal for a large class of models, especially in stochastic resource allocation. In this paper we consider a model for the optimal allocation of resources in pre-clinical pharmaceutical research. We show that although they are not always strictly optimal, forwards induction policies perform well.

Pharmaceutical companies have to face huge risks and enormous costs of production before they can produce a drug. Efficient allocation of resources is essential to help in maximizing profits. Yu and Gittins (2007) described a model and associated software for determining efficient allocations for a preclinical research project. This is the starting point for this paper. We provide explicit optimal policies for the selection of successive candidate drugs for two restricted versions of the Yu and Gittins (2007) model. To some extent these policies are likely to be applicable to the unrestricted model.

For general risk processes, we introduce and study the expected time-integrated negative part of the process on a fixed time interval. Differentiation theorems are stated and proved. They make it possible to derive the expected value of this risk measure, and to link it with the average total time below 0, studied by Dos Reis, and the probability of ruin. We carry out differentiation of other functionals of one-dimensional and multidimensional risk processes with respect to the initial reserve level. Applications to ruin theory, and to the determination of the optimal allocation of the global initial reserve that minimizes one of these risk measures, illustrate the variety of fields of application and the benefits deriving from an efficient and effective use of such tools.