Observational constraints on the birth and early evolution of massive black holes come from two extreme regimes. At high redshift, quasars signal the rapid growth of billion-solar-mass black holes and indicate that these objects began remarkably heavy and/or accreted mass at rates above the Eddington limit. At low redshift, the smallest nuclear black holes known are found in dwarf galaxies and provide the most concrete limits on the mass of black hole seeds. Here, we review current observational work in these fields that together are critical for our understanding of the origin of massive black holes in the Universe.