Facial Feature Detection

Real-time Facial Feature Detection using Conditional Regression Forests.

Matthias Dantone, Juergen Gall, Gabriele Fanelli, Luc van Gool

Abstract

lthough facial feature detection from 2D images is a well-studied field, there is a lack of real-time methods that estimate feature points even on low quality images. Here we propose conditional regression forest for this task. While regression forest learn the relations between facial image patches and the location of feature points from the entire set of faces, conditional regression forest learn the relations conditional to global face properties. In our experiments, we use the head pose as a global property and demonstrate that conditional regression forests outperform regression forests for facial feature detection. We have evaluated the method on the challenging Labeled Faces in the Wild database where close-to-human accuracy is achieved while processing images in real-time.

Images and Video

video  [14 MB, DivX Movie]

Dataset

All annotations are only for research purposes. When using this annotations, please acknowledge the effort that went into data collection by referencing the corresponding paper. If you have questions concerning the data, please contact dantone@vision.ee.ethz.ch

lfw_ffd_ann.txt

 Sourcecode

Download

The provided source code is based on the CVPR paper but it is not the original code.  In fact, it is a complete new implementation due to license issues and better speed performance (different image features, integer arithmetic, …).
The provided source code also does not support yet the automatic parameter estimation described in the paper, but uses some default parameters.
The provided source code has not been tested intensively and it might contain some bugs. We will maintain the code, so if you observe any problems or if you have suggestions to improve the source code, let us know.
For a comparison with the paper, we therefore recommend to compare your approach on the LFW dataset using the provided annotations.

 Plots – Data

Download data for plots

Bibtex

@InProceedings{dantone_2012_rtffd,
author = {M. Dantone and J. Gall and G. Fanelli and L. Van Gool},
title = {Real-time Facial Feature Detection using Conditional Regression Forests },
booktitle = {CVPR},
year = {2012},
keywords = {facial feature detection, conditional random forest}
}