TY - JOUR
TI - 3D-2D face recognition with pose and illumination normalization
AU - Kakadiaris, I.A.
AU - Toderici, G.
AU - Evangelopoulos, G.
AU - Passalis, G.
AU - Chu, D.
AU - Zhao, X.
AU - Shah, S.K.
AU - Theoharis, T.
JO - Computer Vision and Image Understanding
PY - 2017
VL - 154
TODO - null
SP - 137-151
PB - Academic Press Inc.
SN - 1077-3142, 1090-235X
TODO - 10.1016/j.cviu.2016.04.012
TODO - Biometrics;  Computer vision;  Gesture recognition;  Large dataset;  Object recognition;  Probes;  Textures, Face and gesture recognition;  Illumination normalization;  Model fitting;  Model-based OPC;  Physically based modeling, Face recognition
TODO - In this paper, we propose a 3D-2D framework for face recognition that is more practical than 3D-3D, yet more accurate than 2D-2D. For 3D-2D face recognition, the gallery data comprises of 3D shape and 2D texture data and the probes are arbitrary 2D images. A 3D-2D system (UR2D) is presented that is based on a 3D deformable face model that allows registration of 3D and 2D data, face alignment, and normalization of pose and illumination. During enrollment, subject-specific 3D models are constructed using 3D+2D data. For recognition, 2D images are represented in a normalized image space using the gallery 3D models and landmark-based 3D-2D projection estimation. A method for bidirectional relighting is applied for non-linear, local illumination normalization between probe and gallery textures, and a global orientation-based correlation metric is used for pairwise similarity scoring. The generated, personalized, pose- and light- normalized signatures can be used for one-to-one verification or one-to-many identification. Results for 3D-2D face recognition on the UHDB11 3D-2D database with 2D images under large illumination and pose variations support our hypothesis that, in challenging datasets, 3D-2D outperforms 2D-2D and decreases the performance gap against 3D-3D face recognition. Evaluations on FRGC v2.0 3D-2D data with frontal facial images, demonstrate that the method can generalize to databases with different and diverse illumination conditions. © 2016
ER -