This paper obtains logarithmic asymptotics of moderate deviations of the stochastic process of the number of customers in a many-server queue with generally distributed inter-arrival and service times under a heavy-traffic scaling akin to the Halfin–Whitt regime. The deviation function is expressed in terms of the solution to a Fredholm equation of the second kind. A key element of the proof is the large-deviation principle in the scaling of moderate deviations for the sequential empirical process. The techniques of large-deviation convergence and idempotent processes are used extensively.

In this paper we study a large system of N servers, each with capacity to process at most C simultaneous jobs; an incoming job is routed to a server if it has the lowest occupancy amongst d (out of N) randomly selected servers. A job that is routed to a server with no vacancy is assumed to be blocked and lost. Such randomized policies are referred to JSQ(d) (Join the Shortest Queue out of d) policies. Under the assumption that jobs arrive according to a Poisson process with rate $N\lambda^{(N)}$ where $\lambda^{(N)}=\sigma-\frac{\beta}{\sqrt{N}\,}$ , $\sigma\in\mathbb{R}_+$ and $\beta\in\mathbb{R}$ , we establish functional central limit theorems for the fluctuation process in both the transient and stationary regimes when service time distributions are exponential. In particular, we show that the limit is an Ornstein–Uhlenbeck process whose mean and variance depend on the mean field of the considered model. Using this, we obtain approximations to the blocking probabilities for large N, where we can precisely estimate the accuracy of first-order approximations.