We tested the effectiveness of performance-based incentive structures using three incentive structures — commission base, best only and flat fee — and two levels of context — no context and house-selling — in an experiment in which participants made decisions in a variant of the secretary problem. Key measures of performance were the amount of search and the rounds in which the very best (optimal) offer was chosen. We found that having a commission-based proportional incentive did not produce better performance than having a flat payment for any of the performance measures considered. However, another performance-based incentive — the best only — increased the length of their searches and led to more optimal offers. These results applied both when there was no context and when the context was selling a house.

When faced with a decision, people collect information to help them decide. Though it may seem unnecessary, people often continue to search for information about alternatives after they have already chosen an option, even if this choice is irreversible (e.g., checking out other cars after just purchasing one). While previous post-decision search studies focused on “one-shot” decisions and highlighted its irrational aspects, here we explore the possible benefits of post-decision search in the long run. We use a simple search task in which participants repeatedly decide whether to select the current alternative or continue to search for a better alternative. In a preliminary study we find that participants indeed conduct post-decision search even in unique environments, where information about forgone options cannot be used in future choices. In the main studies exposure to post-decision information was manipulated directly in unique environments, and was found to lead to better performance. The source of the observed improvement was further investigated with an explicit strategy elicitation methodology. We find that following exposure to post-decision information, people collect more data before generating thresholds. Thus, although post-decision search in unique environments might appear redundant, our results suggest it can help decision makers to modify their strategy and improve their future choices.

In the subject of optimal stopping, the classical secretary problem is concerned with optimally selecting the best of n candidates when their relative ranks are observed sequentially. This problem has been extended to optimally selecting the kth best candidate for k ≥ 2. While the optimal stopping rule for k=1,2 (and all n ≥ 2) is known to be of threshold type (involving one threshold), we solve the case k=3 (and all n ≥ 3) by deriving an explicit optimal stopping rule that involves two thresholds. We also prove several inequalities for p(k, n), the maximum probability of selecting the k-th best of n candidates. It is shown that (i) p(1, n) = p(n, n) > p(k, n) for 1<k<n, (ii) p(k, n) ≥ p(k, n + 1), (iii) p(k, n) ≥ p(k + 1, n + 1) and (iv) p(k, ∞): = lim n→∞p(k, n) is decreasing in k.

The vertices of the kth power of a directed path with n vertices are exposed one by one to a selector in some random order. At any time the selector can see the graph induced by the vertices that have already appeared. The selector's aim is to choose online the maximal vertex (i.e. the vertex with no outgoing edges). We give upper and lower bounds for the asymptotic behaviour of pn,kn1/(k+1), where pn,k is the probability of success under the optimal algorithm. In order to derive the upper bound, we consider a model in which the selector obtains some extra information about the edges that have already appeared. We give the exact asymptotics of the probability of success under the optimal algorithm in this case. In order to derive the lower bound, we analyse a site percolation process on a sequence of the kth powers of a directed path with n vertices.

In this paper we deal with an optimal stopping problem whose objective is to maximize the probability of selecting k out of the last ℓ successes, given a sequence of independent Bernoulli trials of length N, where k and ℓ are predetermined integers satisfying 1≤k≤ℓ<N. This problem includes some odds problems as special cases, e.g. Bruss’ odds problem, Bruss and Paindaveine’s problem of selecting the last ℓ successes, and Tamaki’s multiplicative odds problem for stopping at any of the last m successes. We show that an optimal stopping rule is obtained by a threshold strategy. We also present the tight lower bound and an asymptotic lower bound for the probability of a win. Interestingly, our asymptotic lower bound is attained by using a variation of the well-known secretary problem, which is a special case of the odds problem. Our approach is based on the application of Newton’s inequalities and optimization technique, which gives a unified view to the previous works.

The best-choice problem and the duration problem, known as versions of the secretary problem, are concerned with choosing an object from those that appear sequentially. Let (B,p) denote the best-choice problem and (D,p) the duration problem when the total number N of objects is a bounded random variable with prior p=(p1, p2,...,pn) for a known upper bound n. Gnedin (2005) discovered the correspondence relation between these two quite different optimal stopping problems. That is, for any given prior p, there exists another prior q such that (D,p) is equivalent to (B,q). In this paper, motivated by his discovery, we attempt to find the alternate correspondence {p(m),m≥0}, i.e. an infinite sequence of priors such that (D,p(m-1)) is equivalent to (B,p(m)) for all m≥1, starting with p(0)=(0,...,0,1). To be more precise, the duration problem is distinguished into (D1,p) or (D2,p), referred to as model 1 or model 2, depending on whether the planning horizon is N or n. The aforementioned problem is model 1. For model 2 as well, we can find the similar alternate correspondence {p[m],m≥ 0}. We treat both the no-information model and the full-information model and examine the limiting behaviors of their optimal rules and optimal values related to the alternate correspondences as n→∞. A generalization of the no-information model is given. It is worth mentioning that the alternate correspondences for model 1 and model 2 are respectively related to the urn sampling models without replacement and with replacement.

The full-information duration problem with a random number N of objects is considered. These objects appear sequentially and their values Xk are observed, where Xk, independent of N, are independent and identically distributed random variables from a known continuous distribution. The objective of the problem is to find a stopping rule that maximizes the duration of holding a relative maximum (e.g. the kth object is a relative maximum if Xk = max{X1, X2, . . ., Xk}). We assume that N is a random variable with a known upper bound n, so two models, Model 1 and Model 2, can be considered according to whether the planning horizon is N or n. The structure of the optimal rule, which depends on the prior distribution assumed on N, is examined. The monotone rule is defined and a necessary and sufficient condition for the optimal rule to be monotone is given for both models. Special attention is paid to the class of priors such that N / n converges, as n → ∞, to a random variable Vm having density fVm(v) = m(1 - v)m-1, 0 ≤ v ≤ 1 for a positive integer m. An interesting feature is that the optimal duration (relative to n) for Model 2 is just (m + 1) times as large as that for Model 1 asymptotically.

As a class of optimal stopping problems with monotone thresholds, we define the candidate-choice problem (CCP) and derive two formulae for calculating its expected payoff. We apply the first formula to a particular CCP, i.e. the best-choice duration problem treated by Ferguson et al. (1992). The recall case is also examined as a comparison. We also derive the distribution of the stopping time of the CCP and find, as a by-product, that the best-choice problem has a remarkable feature in that the optimal probability of choosing the best is just the expected value of the (proportional) stopping time. The similarity between the best-choice duration problem and the best-choice problem with uniform freeze studied by Samuel-Cahn (1996) is recognized.

We consider a nonnegative discrete time and bounded horizon process X for which 0 is an absorbing state and extend it by a random variable that is independent of X. We find a sufficient condition for the resulting process to satisfy, after a canonical time rescaling, the hypothesis of the monotone case theorem. If X describes a secretary type search on a poset with one maximal element or if we consider X with no extension then this condition assumes an especially simple log-concavity type form.

In this note we present a bound of the optimal maximum probability for the multiplicative odds theorem of optimal stopping theory. We deal with an optimal stopping problem that maximizes the probability of stopping on any of the last m successes of a sequence of independent Bernoulli trials of length N, where m and N are predetermined integers satisfying 1 ≤ m < N. This problem is an extension of Bruss' (2000) odds problem. In a previous work, Tamaki (2010) derived an optimal stopping rule. We present a lower bound of the optimal probability. Interestingly, our lower bound is attained using a variation of the well-known secretary problem, which is a special case of the odds problem.

As a version of the secretary problem, Ferguson, Hardwick and Tamaki (1992) considered an optimal stopping problem called the duration problem. The basic duration problem is the classical duration problem, in which the objective is to maximize the time of possession of a relatively best object when a known number of rankable objects appear in random order. In this paper we generalize this classical problem in two directions by allowing the number N (of available objects) to be a random variable with a known upper bound n and also allowing the objects to appear in accordance with Bernoulli trials. Two models can be considered for our random horizon duration problem according to whether the planning horizon is N or n. Since the form of the optimal rule is in general complicated, our main concern is to give to each model a sufficient condition for the optimal rule to be simple. For N having a uniform, generalized uniform, or curtailed geometric distribution, the optimal rule is shown to be simple in the so-called secretary case. The asymptotic results, as n → ∞, will also be given for these priors.

We consider the problem of maximizing the probability of stopping on any of the last m successes in independent Bernoulli trials with random horizon of length N, where m is a predetermined integer. A prior is given for N. It is known that, when N is degenerate, i.e. P{N = n} = 1 for a given n > m, the sum-the-multiplicative-odds theorem gives the solution and shows that the optimal rule is a threshold rule, i.e. it stops on the first success appearing after a given stage. However, when N is nondegenerate, the optimal rule is not necessarily a threshold rule. So our main concern in Section 2 is to give a sufficient condition for the optimal rule to be a threshold rule when N is a bounded random variable such that P{N ≤ n} = 1. Application will be made to the usual (discrete arrival time) secretary problem with a random number N of applicants in Section 3. When N is uniform or curtailed geometric, the optimal rules are shown to be threshold rules and their asymptotic results are obtained. We also examine, as a nonhomogeneous Poisson process model, an intermediate prior that allows N to be uniform or degenerate. In Section 4 we consider a continuous arrival time version of the secretary problem with a random number M of applicants. It is shown that, whatever the distribution of M, we can win with probability greater than or equal to um*, where um* is, as given in (1.4), the asymptotic win probability of the usual secretary problem when N degenerates to n and n → ∞.

We consider the optimal stopping problem of maximizing the probability of stopping on any of the last m successes of a sequence of independent Bernoulli trials of length n, where m and n are predetermined integers such that 1 ≤ m < n. The optimal stopping rule of this problem has a nice interpretation, that is, it stops on the first success for which the sum of the m-fold multiplicative odds of success for the future trials is less than or equal to 1. This result can be viewed as a generalization of Bruss' (2000) odds theorem. Application will be made to the secretary problem. For more generality, we extend the problem in several directions in the same manner that Ferguson (2008) used to extend the odds theorem. We apply this extended result to the full-information analogue of the secretary problem, and derive the optimal stopping rule and the probability of win explicitly. The asymptotic results, as n tends to ∞, are also obtained via the planar Poisson process approach.

The problem we consider here is a full-information best-choice problem in which n applicants appear sequentially, but each applicant refuses an offer independently of other applicants with known fixed probability 0≤q<1. The objective is to maximize the probability of choosing the best available applicant. Two models are distinguished according to when the availability can be ascertained; the availability is ascertained just after the arrival of the applicant (Model 1), whereas the availability can be ascertained only when an offer is made (Model 2). For Model 1, we can obtain the explicit expressions for the optimal stopping rule and the optimal probability for a given n. A remarkable feature of this model is that, asymptotically (i.e. n→∞), the optimal probability becomes insensitive to q and approaches 0.580 164. The planar Poisson process (PPP) model provides more insight into this phenomenon. For Model 2, the optimal stopping rule depends on the past history in a complicated way and seems to be intractable. We have not solved this model for a finite n but derive, via the PPP approach, a lower bound on the asymptotically optimal probability.

The secretary problem for selecting one item so as to minimize its expected rank, based on observing the relative ranks only, is revisited. A simple suboptimal rule, which performs almost as well as the optimal rule, is given. The rule stops with the smallest i such that Ri≤ic/(n+1-i) for a given constant c, where Ri is the relative rank of the ith observation and n is the total number of items. This rule has added flexibility. A curtailed version thereof can be used to select an item with a given probability P, P<1. The rule can be used to select two or more items. The problem of selecting a fixed percentage, α, 0<α<1, of n, is also treated. Numerical results are included to illustrate the findings.

Suppose that an unknown number of objects arrive sequentially according to a Poisson process with random intensity λ on some fixed time interval [0,T]. We assume a gamma prior density Gλ(r, 1/a) for λ. Furthermore, we suppose that all arriving objects can be ranked uniquely among all preceding arrivals. Exactly one object can be selected. Our aim is to find a stopping time (selection time) which maximizes the time during which the selected object will stay relatively best. Our main result is the following. It is optimal to select the ith object that is relatively best and arrives at some time si(r) onwards. The value of si(r) can be obtained for each r and i as the unique root of a deterministic equation.

Let I1,I2,…,In be independent indicator functions on some probability space We suppose that these indicators can be observed sequentially. Furthermore, let T be the set of stopping times on (Ik), k=1,…,n, adapted to the increasing filtration where The odds algorithm solves the problem of finding a stopping time τ ∈ T which maximises the probability of stopping on the last Ik=1, if any. To apply the algorithm, we only need the odds for the events {Ik=1}, that is, rk=pk/(1-pk), where The goal of this paper is to offer tractable solutions for the case where the pk are unknown and must be sequentially estimated. The motivation is that this case is important for many real-world applications of optimal stopping. We study several approaches to incorporate sequential information. Our main result is a new version of the odds algorithm based on online observation and sequential updating. Questions of speed and performance of the different approaches are studied in detail, and the conclusiveness of the comparisons allows us to propose always using this algorithm to tackle selection problems of this kind.

Let X1, X2, …, Xn be independent random variables uniformly distributed on [0,1]. We observe these sequentially and have to stop on exactly one of them. No recall of preceding observations is permitted. What stopping rule minimizes the expected rank of the selected observation? What is the value of the expected rank (as a function of n) and what is the limit of this value when n goes to ∞? This full-information expected selected-rank problem is known as Robbins' problem of minimizing the expected rank, and its general solution is unknown. In this paper we provide an alternative approach to Robbins' problem. Our model is similar to that of Gnedin (2007). For this, we consider a continuous-time version of the problem in which the observations follow a Poisson arrival process on ℝ+ × [0,1] of homogeneous rate 1. Translating the previous optimal selection problem in this setting, we prove that, under reasonable assumptions, the corresponding value function w(t) is bounded and Lipschitz continuous. Our main result is that the limiting value of the Poisson embedded problem exists and is equal to that of Robbins' problem. We prove that w(t) is differentiable and also derive a differential equation for this function. Although we have not succeeded in using this equation to improve on bounds on the optimal limiting value, we argue that it has this potential.