Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-wg55d Total loading time: 0 Render date: 2024-06-08T01:35:30.217Z Has data issue: false hasContentIssue false

12 - Direct recognition of motion-blurred faces

Published online by Cambridge University Press:  05 June 2014

Kaushik Mitra
Affiliation:
Rice University
Priyanka Vageeswaran
Affiliation:
University of Maryland
Rama Chellappa
Affiliation:
University of Maryland
A. N. Rajagopalan
Affiliation:
Indian Institute of Technology, Madras
Rama Chellappa
Affiliation:
University of Maryland, College Park
Get access

Summary

The need to recognize motion-blurred faces is vital for a wide variety of security applications ranging from maritime surveillance to road traffic policing. While much of the theory in the analysis of motion-blurred images focuses on restoration of the blurred image, we argue that this is an unnecessary and expensive step for face recognition. Instead, we adopt a direct approach based on the set-theoretic characterization of the space of motion-blurred images of a single sharp image. This set lacks the nice property of convexity that was exploited in a recent paper to achieve competitive results in real-world datasets (Vageeswaran, Mitra & Chellappa 2013). Keeping this non-convexity in mind, we propose a bank of classifiers (BoC) approach for directly recognizing motion-blurred face images. We divide the parameter space of motion blur into many different bins in such a way that the set of blurred images within each bin is a convex set. In each such bin, we learn support vector machine (SVM) classifiers that separate the convex sets associated with each person in the gallery database. Our experiments on synthetic and real datasets provide compelling evidence that this approach is a viable solution for recognition of motion-blurred face images.

Introduction

A system that can recognize motion-blurred faces can be of vital use in a wide variety of security applications, ranging from maritime surveillance to road traffic policing. Figure 12.1 shows two possible maritime surveillance scenarios: shore-to-ship (the camera is mounted on-shore and the subjects are in the ship), and ship-to-shore (the camera is on the ship and the subjects are moving on-shore).

Type
Chapter
Information
Motion Deblurring
Algorithms and Systems
, pp. 246 - 257
Publisher: Cambridge University Press
Print publication year: 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ahonen, T., Hadid, A. & Pietikainen, M. (2004). Face recognition with local binary patterns. In European Conference on Computer Vision, pp. 469–481.
Ahonen, T., Rahtu, E., Ojansivu, V. & Heikkila, J. (2008). Recognition of blurred faces using local phase quantization. In International Conference on Pattern Recognition, pp. 1-4.
Bovik, A. C. (2009). The Essential Guide to Image Processing. Elsevier.
Chellappa, R., Ni, J. & Patel, V. M. (2011). Remote identification of faces: problems, prospects, and progress. Pattern Recognition Letters, 33(14), 1849–59.Google Scholar
Cho, S. & Lee, S. (2009). Fast motion deblurring. ACM Transactions on Graphics, 28(5), 145: 1–8.Google Scholar
Combettes, P. L. (1996). The convex feasibility problem in image recovery. Advances in Imaging and Electron Physics, 95, 155–270.Google Scholar
Combettes, P. & Pesquet, J.-C. (2004). Image restoration subject to a total variation constraint. IEEE Transactions on Image Processing, 13(9), 1213–22.Google Scholar
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T. & Freeman, W. T. (2006). Removing camera shake from a single photograph. ACM Transactions on Graphics, 25(3), 787–94.Google Scholar
Gopalan, R., Taheri, S., Turaga, P. & Chellappa, R. (2012). A blur-robust descriptor with applications to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(6), 1220–6.Google Scholar
Hsu, C.-W. & Lin, C.-J. (2002). A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks, 13(2), 415–25.Google Scholar
Hu, H. & de Haan, G. (2006). Low cost robust blur estimator. In IEEE International Conference on Image Processing, pp. 617–20.
Jia, J. (2007). Single image motion deblurring using transparency. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
Kundur, D. & Hatzinakos, D. (1996). Blind image deconvolution. IEEE Signal Processing Magazine, 13(3), 43-64.Google Scholar
Levin, A. (2006). Blind motion deblurring using image statistics. Advances in Neural Information Processing Systems, pp. 841–8.
Levin, A., Weiss, Y., Durand, F. & Freeman, W. T. (2009). Understanding and evaluating blind deconvolution algorithms. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1964–71.
Likas, C. & Galatsanos, N. (2004). A variational approach for Bayesian blind image deconvolution. IEEE Transactions on Signal Processing, 52(8), 2222–33.Google Scholar
Ni, J. & Chellappa, R. (2010). Evaluation of state-of-the-art algorithms for remote face recognition. In IEEE International Conference on Image Processing, pp. 1581–4.
Nishiyama, M., Hadid, A., Takeshima, H., Shotton, J., Kozakaya, T. & Yamaguch, O. (2010). Facial deblur inference using subspace analysis for recognition of blurred faces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(4), 838–45.Google Scholar
Ojansivu, V. & Heikkil, J. (2008). Blur insensitive texture classification using local phase quantization. In Image and Signal Processing. Berlin/Heidelberg: Springer.
Richardson, W. H. (1972). Bayesian-based iterative method of image restoration. Journal of the Optical Society of America, 62(1), 55–9.Google Scholar
Shan, Q., Jia, J. & Agarwala, A. (2008). High-quality motion deblurring from a single image. ACM Transactions on Graphics, 27(3), 73:1–10.Google Scholar
Sim, T., Baker, S. & Bsat, M. (2002). The CMU pose, illumination, andexpression (PIE) database.
Stainvas, I. & Intrator, N. (2000). Blurred face recognition via a hybrid network architecture. In International Conference on Pattern Recognition, pp. 2805–8.
Trussell, H. & Civanlar, M. (1984). The feasible solution in signal restoration. IEEE Transactions on Acoustics, Speech and Signal Processing, 32(2), 201–12.Google Scholar
Vageeswaran, P., Mitra, K. & Chellappa, R. (2013). Blurand illumination robust face recognition via set-theoretic characterization. IEEE Transactions on Image Processing, 22(4), 1362–72.Google Scholar
Wright, J., Yang, A., Ganesh, A., Sastry, S. & Ma, Y. (2009). Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(2), 210–27.Google Scholar
Yitzhaky, Y., Mor, I., Lantzman, A. & Kopeika, N. S. (1998). A direct method for restoration of motion blurred images. Journal of the Optical Society of America A, 15(6), 1512–19.Google Scholar
Zhang, H., Yang, J., Zhang, Y., Nasrabadi, N. M. & Huang, T. S. (2011). Close the loop: joint blind image restoration and recognition with sparse representation prior. In IEEE Proceedings of the International Conference on Computer Vision, pp. 770–7.

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×