Hostname: page-component-586b7cd67f-dlnhk Total loading time: 0 Render date: 2024-11-24T22:39:04.238Z Has data issue: false hasContentIssue false
  • English
  • Français

Optimality of Randomized Trunk Reservation

Published online by Cambridge University Press:  27 July 2009

Eugene A. Feinberg  and
Martin I. Reiman
Eugene A. Feinberg
Affiliation:
W. A. Harriman School for Management and Policy, SUNY at Stony Brook, Stony Brook, New York 11794–3775.
Martin I. Reiman
Affiliation:
AT&T Bell Laboratories, Murray Hill, New Jersey 07974
Get access Rights & Permissions [Opens in a new window]

Abstract

We consider a controlled queueing system that is a generalization of the M/M/c/W queue. There are m types of customers that arrive according to independent Poisson processes. Service times are exponential and independent and do not depend on the customer type. There is room in the system for a total of N customers; if there are N customers in the system, new arrivals are lost. Type j customers are more profitable than type (j + 1 ) customers, j = 2,…, m —, and type 1 customers are at least as profitable as type 2 customers. The allowed control is to accept or reject customers at arrival. No preemption of customers in service is allowed. The goal is to maximize the average reward per unit of time subject to a constraint that the blocking probability of type 1 customers is no greater than a given level.

For an M/M/c/c system without a constraint, Miller [12] proved that an optimal policy has a simple threshold structure. We show that, for the constrained problem described above, an optimal policy has a similar structure, but one of the thresholds might have to be randomized. We also derive an algorithm that constructs an optimal policy and describe other forms of optimal policies.

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 8 , Issue 4 , October 1994 , pp. 463 - 489
Copyright
Copyright © Cambridge University Press 1994

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1.Altman, E. & Shwartz, A. (1991). Adaptive control of constrained Markov chains. IEEE Transactions on Automatic Control 36: 454–462.CrossRefGoogle Scholar
2.Derman, C. (1970). Finite state Markovian decision processes. New York: Academic Press.Google Scholar
3.Feinberg, E.A. (1994). Constrained semi-Markov decision processes with average rewards. ZOR— Mathematical Methods of Operations Research 39: 257–288.CrossRefGoogle Scholar
4.Feinberg, E.A. (1994). A generalization of “expectation equals reciprocal of intensity” to non-stationary exponential distributions. Journal of Applied Probability 31: 262–267.CrossRefGoogle Scholar
5.Heyman, D.P. & Sobel, M.J. (1984). Stochastic models in operations research. Vol. II: Stochastic optimization. New York: McGraw-Hill.Google Scholar
6.Hordijk, A. & Kallenberg, L.C.M. (1984). Constrained undiscounted stochastic dynamic programming. Mathematics of Operations Research 9: 276–289.CrossRefGoogle Scholar
7.Kallenberg, L.C.M. (1983). Linear programming and finite Markovian control problems. Mathematical Centre Tracts 148, Mathematisch Centrum, Amsterdam.Google Scholar
8.Kelly, F.P. (1990). Routing and capacity allocation in networks with trunk reservation. Mathematics of Operations Research 15: 771–793.CrossRefGoogle Scholar
9.Key, P.B. (1990). Optimal control and trunk reservation in loss networks. Probability in the Engineering and Informational Sciences 4: 203–221.CrossRefGoogle Scholar
10.Lippman, S. (1975). Applying a new device in the optimization of exponential queueing systems. Operations Research 23: 687–710.CrossRefGoogle Scholar
11.Ma, D.-J. & Makowski, A.M. (1988). A class of steering policies under a recurrence condition. Proceedings of the 27th IEEE Conference on Decision and Control, pp. 1192–1197.Google Scholar
12.Miller, B.L. (1969). A queueing reward system with several customer classes. Management Science 16: 234–245.CrossRefGoogle Scholar
13.Mine, H. & Osaki, S. (1970). Markovian decision processes. New York: Elsevier.Google Scholar
14.Nguyen, V. (1991). Optimality of trunk reservation in overflow process. Probability in the Engineering and Informational Sciences 5: 369–390.CrossRefGoogle Scholar
15.Reiman, M.I. (1991). Optimal trunk reservation for a critically loaded link. In Jensen, A. & Iverson, V.B. (eds.), Teletraffic and datatraffic in a period of change, ITC-13. Amsterdam: North-Holland, pp. 247–252.Google Scholar
16.Ross, K.W. (1989). Randomized and past-dependent policies for Markov decision processes with multiple constraints. Operations Research 37: 474–477.CrossRefGoogle Scholar
17.Ross, S.M. (1970). Applied probability models with optimization applications. San Francisco: Holden-Day.Google Scholar
18.Wolff, R.W. (1982). Poisson arrivals see time averages. Operations Research 30: 223–231.CrossRefGoogle Scholar