Multitemporal and multisensor image registration

doi:10.1017/CBO9780511777684.015

14 - Multitemporal and multisensor image registration

from PART IV - Applications and Operational Systems

Published online by Cambridge University Press: 03 May 2011

Jacqueline Le Moigne ,

Arlene A. Cole-Rhodes ,

Roger D. Eastman ,

Nathan S. Netanyahu ,

Harold S. Stone ,

Ilya Zavorin and

Jeffrey T. Morisette

Edited by

Jacqueline Le Moigne ,

Nathan S. Netanyahu and

Roger D. Eastman

Show author details

Jacqueline Le Moigne: Affiliation:
NASA Goddard Space Flight Center, Maryland
Arlene A. Cole-Rhodes: Affiliation:
Morgan State University, Maryland
Roger D. Eastman: Affiliation:
Loyola University, Maryland
Nathan S. Netanyahu: Affiliation:
University of Maryland, Maryland
Harold S. Stone: Affiliation:
NEC Research Laboratory Retiree, New Jersey
Ilya Zavorin: Affiliation:
University of Maryland, Maryland
Jeffrey T. Morisette: Affiliation:
NASA Goddard Space Flight Center, Maryland
Jacqueline Le Moigne: Affiliation:
NASA-Goddard Space Flight Center
Nathan S. Netanyahu: Affiliation:
Bar-Ilan University, Israel and University of Maryland, College Park
Roger D. Eastman: Affiliation:
Loyola University Maryland

Book contents

Get access

Summary

Abstract

Registration of multiple source imagery is one of the most important issues when dealing with Earth science remote sensing data where information from multiple sensors exhibiting various resolutions must be integrated. Issues ranging from different sensor geometries, different spectral responses, to various illumination conditions, various seasons and various amounts of noise, need to be dealt with when designing a new image registration algorithm. This chapter represents a first attempt at characterizing a framework that addresses these issues, in which possible choices for the three components of any registration algorithm are validated and combined to provide different registration algorithms. A few of these algorithms were tested on three different types of datasets – synthetic, multitemporal and multispectral. This chapter presents the results of these experiments and introduces a prototype registration toolbox.

Introduction

In Chapter 1, we showed how the analysis of Earth science data for applications, such as the study of global environmental changes, involves the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, spectral, and spatial resolutions. For such applications, the first required step is fast and automatic image registration which can provide precision correction of satellite imagery, band-to-band calibration, and data reduction for ease of transmission. Furthermore, future decision support systems, intelligent sensors and adaptive constellations will rely on real- or near-real-time interpretation of Earth observation data, performed both onboard and at ground-based stations.

Type: Chapter
Information: Image Registration for Remote Sensing , pp. 293 - 338

DOI: https://doi.org/10.1017/CBO9780511777684.015 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Brown, L. G. (1992). A survey of image registration techniques. ACM Computing Surveys, 24(4), 325–376.CrossRef Google Scholar

Cole-Rhodes, A. A., Johnson, K. L., Moigne, J., and Zavorin, I. (2003). Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient. IEEE Transactions on Image Processing, 12(2), 1495–1511.CrossRef Google Scholar PubMed

Daubechies, I. (1992). Ten Lectures on Wavelets. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).CrossRef

Eastman, R. and Moigne, J. (2001). Gradient-descent techniques for multi-temporal and multi-sensor image registration of remotely sensed imagery. In Proceedings of the 4th International Conference on Image Fusion, Montreal, Canada.Google Scholar

Foroosh, H., Zerubia, J. B., and Berthod, M. (2002). Extension of phase correlation to subpixel registration. IEEE Transactions on Image Processing, 11(3), 188–200.CrossRef Google Scholar PubMed

Irani, M. and Peleg, S. (1991). Improving resolution by image registration, Computer Vision, Graphics and Image Processing, 53(3), 231–239.Google Scholar

Moigne, J., Campbell, W. J., and Cromp, R. F. (2002a). An automated parallel image registration technique based on the correlation of wavelet features. IEEE Transactions on Geoscience and Remote Sensing, 40(8), 1849–1864.CrossRef Google Scholar

Moigne, J., Cole-Rhodes, A., Eastman, R., Johnson, K., Morisette, J., Netanyahu, N., Stone, H., and Zavorin, I. (2002b). Multisensor image registration for on-the-ground or on-board science data processing. In Proceedings of the Science Data Workshop, Greenbelt, MD.Google Scholar

Moigne, J., Cole-Rhodes, A., Eastman, R., Johnson, K., Morisette, J. T., Netanyahu, N. S., Stone, H. S., and Zavorin, I. (2001). Multisensor registration of Earth remotely sensed imagery. In Proceedings of the SPIE Conference on Image and Signal Processing for Remote Sensing VII, Toulouse, France, Vol. 4541, pp. 1–10.Google Scholar

Moigne, J., Cole-Rhodes, A., Eastman, R., Johnson, K., Morisette, J., Netanyahu, N. S., Stone, H., and Zavorin, I. (2003). Earth science imagery registration. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Toulouse, France, Vol. I, pp. 161–163.Google Scholar

Moigne, J., Cole-Rhodes, A., Eastman, R., Johnson, K., Morisette, J., Netanyahu, N. S., Stone, H., Zavorin, I., and Jain, P. (2004). A study of the sensitivity of automatic image registration algorithms to initial conditions. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, Vol. 2, pp. 1390–1393.Google Scholar

Moigne, J., El-Saleous, N., and Vermote, E. (1997). Iterative edge- and wavelet-based registration of AVHRR and GOES satellite imagery. In Proceedings of the Image Registration Workshop, NASA Goddard Space Flight Center, Greenbelt, MD, pp. 137–146.Google Scholar

Moigne, J., Xia, W., El-Ghazawi, T., Mareboyana, M., Netanyahu, N., Tilton, J. C., Campbell, W. J., and Cromp, R. F. (1998). First evaluation of automatic image registration methods. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Seattle, WA, Vol. 1, pp. 315–317.Google Scholar

Lyon, R. G., Dorband, J. E., and Hollis, J. M. (1997). Hubble space telescope faint object camera calculated point-spread functions. Applied Optics, 36(8), 1752–1765.CrossRef Google Scholar PubMed

Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., and Suetens, P. (1997). Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging, 16(2), 187–198.CrossRef Google Scholar PubMed

Morisette, J. T., Privette, J. L., and Justice, C. O. (2002). A framework for the validation of MODIS land products. Remote Sensing of Environment, 83, 77–96.CrossRef Google Scholar

Mount, D. M., Netanyahu, N. S., and Moigne, J. (1999). Efficient algorithms for robust feature matching. Special Issue of Pattern Recognition on Image Registration, 32(1), 17–38.Google Scholar

,National Imagery and Mapping Agency (2000). Department of Defense World Geodetic System 1984: Its Definition and Relationships with Local Geodetic Systems. Technical Report 8350.2, 3rd edn.

Netanyahu, N. S., Moigne, J., and Masek, J. G. (2004). Georegistration of Landsat data via robust matching of multiresolution features. IEEE Transactions on Geoscience and Remote Sensing, 42(7), 1586–1600.CrossRef Google Scholar

Stone, H. S., Moigne, J., and McGuire, M. (1999). The translation sensitivity of wavelet-based registration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(10), 1074–1081.CrossRef Google Scholar

Stone, H. S., Orchard, M. T., Cheng, E.-C., and Martucci, S. A. (2001). A fast direct Fourier-based algorithm for subpixel registration of images. IEEE Transactions on Geoscience and Remote Sensing, 39(10), 2235–2243.CrossRef Google Scholar

Thévenaz, P., Ruttimann, U. E., and Unser, M. (1998). A pyramid approach to subpixel registration based on intensity. IEEE Transactions on Image Processing, 7(1), 27–41.CrossRef Google Scholar PubMed

Unser, M., Aldroubi, A., and Murry, E. (1993). The L2 polynomial spline pyramid. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(4), 364–379.CrossRef Google Scholar

Zavorin, I. and Moigne, J. (2005). Use of multiresolution wavelets feature pyramids. IEEE Transactions on Image Processing, 14(6), 770–782.CrossRef Google Scholar PubMed