Robust Face Recognition Based on Covariance Matrix

Abstract

As the issue of robustness of face recognition based on depth image sets, we propose that multiple Kinect images is being as a set of images, and depth data captured is used to automatically estimate poses and crop face area. Firstly, divide image sets into c subsets, and divide the images in all the subsets into image blocks of 4×4. Then, simulate images in sets as a form of image blocks, dividing in accordance with posture. Each set is represented using covariance matrix. Finally, the simulation of images in subsets is on Riemannian manifold. In order to classify, separately learnt SVM models for each image subset on the Lie group of Riemannian manifold and introduce a fusion strategy to combine results from all image subsets. We have verified the effectiveness of the proposed method on the three largest public Kinect face data sets Curtin Faces, Biwi Kinect and UWA Kinect. Compared to other advanced methods, the recognition rate has improved greater, the standard deviation is kept low, with robust to the number of image sets, image sub-setting number and spatial resolution.