Hostname: page-component-78c5997874-g7gxr Total loading time: 0 Render date: 2024-11-09T08:21:55.971Z Has data issue: false hasContentIssue false

Modern statistical estimation via oracle inequalities

Published online by Cambridge University Press:  16 May 2006

Emmanuel J. Candès
Affiliation:
Applied and Computational Mathematics, California Institute of Technology, Pasadena, CA 91125, USA E-mail: [email protected]

Abstract

A number of fundamental results in modern statistical theory involve thresholding estimators. This survey paper aims at reconstructing the history of how thresholding rules came to be popular in statistics and describing, in a not overly technical way, the domain of their application. Two notions play a fundamental role in our narrative: sparsity and oracle inequalities. Sparsity is a property of the object to estimate, which seems to be characteristic of many modern problems, in statistics as well as applied mathematics and theoretical computer science, to name a few. ‘Oracle inequalities’ are a powerful decision-theoretic tool which has served to understand the optimality of thresholding rules, but which has many other potential applications, some of which we will discuss.

Our story is also the story of the dialogue between statistics and applied harmonic analysis. Starting with the work of Wiener, we will see that certain representations emerge as being optimal for estimation. A leitmotif throughout our exposition is that efficient representations lead to efficient estimation.

Type
Research Article
Copyright
2006 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)