Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2025-01-05T15:11:17.563Z Has data issue: false hasContentIssue false

9 - HDR imaging in the presence of motion blur

Published online by Cambridge University Press:  05 June 2014

By
C. S. Vijay ,
C. Paramanand  and
A. N. Rajagopalan
Edited by
A. N. Rajagopalan  and
Rama Chellappa
C. S. Vijay
Affiliation:
Indian Institute of Technology
C. Paramanand
Affiliation:
Indian Institute of Technology
A. N. Rajagopalan
Affiliation:
Indian Institute of Technology
A. N. Rajagopalan
Affiliation:
Indian Institute of Technology, Madras
Rama Chellappa
Affiliation:
University of Maryland, College Park
Get access

Summary

Introduction

Digital cameras convert incident light energy into electrical signals and present them as an image after altering the signals through different processes which include sensor correction, noise reduction, scaling, gamma correction, image enhancement, color space conversion, frame-rate change, compression, and storage/transmission (Nakamura 2005). Although today's camera sensors have high quantum efficiency and high signalto-noise ratios, they inherently have an upper limit (full well capacity) for accumulation of light energy. Also, the sensor's least acquisition capacity depends on its pre-set sensitivity. The total variation in the magnitude of irradiance incident at a camera is called the dynamic range (DR) and is defined as DR = (maximum signal value)/(minimum signal value). Most digital cameras available in the market today are unable to account for the entire DR due to hardware limitations. Scenes with high dynamic range (HDR) either appear dark or become saturated. The solution for overcoming this limitation and estimating the original data is referred to as high dynamic range imaging (HDRI) (Debevec & Malik 1997, Mertens, Kautz & Van Reeth 2007, Nayar & Mitsunaga 2000).

Over the years, several algorithmic approaches have been investigated for estimation of scene irradiance (see, for example, Debevec & Malik (1997), Mann & Picard (1995), Mitsunaga & Nayar (1999)). The basic idea in these approaches is to capture multiple images of a scene with different exposure settings and algorithmically extract HDR information from these observations. By varying the exposure settings, one can control the amount of energy received by the sensors to overcome sensor bounds/limits.

Type
Chapter
Information
Motion Deblurring
Algorithms and Systems
 , pp. 184 - 206
Publisher: Cambridge University Press
Print publication year: 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bae, S., Paris, S. & Durand, F. (2006). Two-scale tone management for photographic look. ACM Transactions on Graphics, 25(3), 637–45.Google Scholar
Brajovic, V. & Kanade, T. (1996). A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors. In IEEE Proceedings of International Conference on Robotics and Automation, vol. 2, pp. 1638–43.
Cai, J., Ji, H., Liu, C. & Shen, Z. (2012). Framelet-based blind motion deblurring from a single image. IEEE Transactions on Image Processing, 21(2), 562–72.Google Scholar
Cho, S., Wang, J. & Lee, S. (2011). Handling outliers in non-blind image deconvolution. In IEEE International Conference on Computer Vision, pp. 495–502.
Debevec, P. E. & Malik, J. (1997). Recovering high dynamic range radiance maps from photographs. In ACM Special Interest Group on Graphics and Interactive Techniques, pp. 369–78.
Drago, F., Myszkowski, K., Annen, T. & Chiba, N. (2003). Adaptive logarithmic mapping for displaying high contrast scenes. Computer Graphics Forum, 22(3), 419–26.Google Scholar
Durand, F. & Dorsey, J. (2002). Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics, 21(3), 257–66.Google Scholar
Engl, H., Hanke, M. & Neubauer, A. (1996). Regularization of Inverse Problems. Springer.
Fattal, R., Lischinski, D. & Werman, M. (2002). Gradient domain high dynamic range compression. ACM Transactions on Graphics, 21(3), 249–56.Google Scholar
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. & Freeman, W. (2006). Removing camera shake from a single photograph. ACM Transactions on Graphics, 25(3), 787–94.Google Scholar
Gupta, A., Joshi, N., Lawrence Zitnick, C., Cohen, M. & Curless, B. (2010). Single image deblurring using motion density functions. In Proceedings of European Conference on Computer Vision. Springer, pp. 171–84.
Hartley, R. & Zisserman, A. (2000). Multiple View Geometry in Computer Vision, vol. 2. Cambridge University Press.
Kim, S., Tai, Y., Kim, S., Brown, M. & Matsushita, Y. (2012). Nonlinear camera response functions and image deblurring. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 25-32.
Levin, A., Weiss, Y., Durand, F. & Freeman, W. (2011). Understanding blind deconvolution algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12), 2354–67.Google Scholar
Levin, A., Weiss, Y., Durand, F. & Freeman, W. T. (2009). Understanding and evaluating blind deconvolution algorithms. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 1964–71.
Liu, J., Ji, S. & Ye, J. (2009). Sparse learning with efficient projections (SLEP). http://www.public.asu.edu/~jye02/Software/SLEP.
Lu, P., Huang, T., Wu, M., Cheng, Y. & Chuang, Y. (2009). High dynamic range image reconstruction from hand-held cameras. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 509–16.
Mann, S. & Picard., R. W. (1995). On being ‘undigital’ with digital cameras: extending dynamic range by combining differently exposed pictures. In Proceedings of 46th Annual Conference of Imaging, Science and Technology, pp. 422–8.
Mertens, T., Kautz, J. & Van Reeth, F. (2007). Exposure fusion. In 15th IEEE Pacific Conference on Computer Graphics and Applications, pp. 382–90.
Mitsunaga, T. & Nayar, S. K. (1999). Radiometric self calibration. In Proceedings of Computer Vision and Pattern Recognition, pp. 374–80.
Nakamura, J. (2005). Image Sensors and Signal Processing for Digital Still Cameras. CRC Press.
Nayar, S. & Mitsunaga, T. (2000). High dynamic range imaging: spatially varying pixel exposures. In IEEE Proceedings of Computer Vision and Pattern Recognition, vol. 1, pp. 472–9.
Paramanand, C. & Rajagopalan, A. (2012). Depth from motion and optical blur with an unscented Kalman filter. IEEE Transactions on Image Processing, 21(5), 2798–811.Google Scholar
Paramanand, C. & Rajagopalan, A. N. (2010). Inferring image transformation and structure from motion-blurred images. In Proceedings of the British Machine Vision Conference, 73:1-12.Google Scholar
Raman, S. & Chaudhuri, S. (2009). Bilateral filter based compositing for variable exposure photography. In Eurographics, pp. 1-4.
Raskar, R., Ilie, A. & Yu, J. (2005). Image fusion for context enhancement and video surrealism. In ACM Special Interest Groupon Graphics and Interactive Techniques Courses, p. 4.
Reinhard, E., Heidrich, W., Pattanaik, S., Debevec, P., Ward, G. & Myszkowski, K. (2010). High Dynamic Range Imaging: Acquisition, Display, and Image-based Lighting. Morgan Kaufmann.
Reinhard, E., Stark, M., Shirley, P. & Ferwerda, J. (2002). Photographic tone reproduction for digital images. ACM Transactions on Graphics, 21(3), 267–76.Google Scholar
Seetzen, H., Heidrich, W., Stuerzlinger, W., Ward, G., Whitehead, L., Trentacoste, M., Ghosh, A. & Vorozcovs, A. (2004). High dynamic range display systems. ACM Transactions on Graphics, 23(3), 760–8.Google Scholar
Shan, Q., Jia, J. & Agarwala, A. (2008). High-quality motion deblurring from a single image. ACM Transactions on Graphics, 27(3), 73-81.Google Scholar
Sorel, M. & Flusser, J. (2008). Space-variant restoration of images degraded by camera motion blur, IEEE Transactions on Image Processing, 17(2), 105–16.Google Scholar
Šroubek, F. & Flusser, J. (2005). Multichannel blind deconvolution of spatially misaligned images. IEEE Transactions on Image Processing, 14(7), 874–83.Google Scholar
Tai, Y., Tan, P. & Brown, M. (2011). Richardson-Lucy deblurring for scenes under a projective motion path. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(8), 1603–18.Google Scholar
Tukey, J. (1967). An introduction to the calculations of numerical spectrum analysis. Spectral Analysis of Time Series, pp. 25-46.
Vijay, C., Paramanand, C. & Rajagopalan, A. N. (2012). HDR imaging under non-uniform blurring. In European Conference on Computer Vision, Workshops and Demonstrations, Springer, pp. 451–60.
Vijay, C. S., Paramanand, C., Rajagopalan, A. N. & Chellappa, R. (2013). Non-uniform deblurring in HDR image reconstruction. IEEE Transactions on Image Processing, 22(10), 3739–50.Google Scholar
Ward, G. (2003). Fast, robust image registration for compositing high dynamic range photographs from hand-held exposures. Journal of Graphics Tools, 8(2), 17-30.Google Scholar
Whyte, O., Sivic, J. & Zisserman, A. (2011). Deblurring shaken and partially saturated images. In IEEE International Conference on Computer Vision Workshops, pp. 745–52.
Whyte, O., Sivic, J., Zisserman, A. & Ponce, J. (2010). Non-uniform deblurring for shaken images. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 491–8.
Whyte, O., Sivic, J., Zisserman, A. & Ponce, J. (2012). Non-uniform deblurring for shaken images. International Journal of Computer Vision, 98(2), 168–86.Google Scholar
Yuan, L., Sun, J., Quan, L. & Shum, H. (2007). Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics, 26(3), 1-8.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×