The stochastic sequential assignment problem assigns distinct workers to sequentially arriving tasks with stochastic parameters. In this paper the assignments are performed so as to minimize the threshold probability, which is the probability of the long-run reward per task failing to achieve a target value (threshold). As the number of tasks approaches infinity, the problem is studied for independent and identically distributed (i.i.d.) tasks with a known distribution function and also for tasks that are derived from r distinct unobservable distributions (governed by a Markov chain). Stationary optimal policies are presented, which simultaneously minimize the threshold probability and achieve the optimal long-run expected reward per task.

We consider a brokered market with heterogeneous suppliers and consumers of identical items or services. Each supplier determines a minimum acceptable price for the items it supplies, based on its costs and target rate of return. The broker begins with a fixed set of items from the suppliers. Customers arrive periodically to the market and offer a bid for an item. If a customer wants more than one item, a set of bids is made. If the broker accepts a bid it must be assigned an item with minimum accceptable price less than or equal to the bid, and the price paid is the bid price. The broker has the option of rejecting a bid. The broker makes acceptance and assignment decisions to maximize the total expected discounted revenue. We show the optimal policy has a simple threshold structure where thresholds can be easily determined by finding the individually optimal policies subject to priorities.