Pose-Invariant Facial Expression Recognition using Variable-Intensity Templates

facial-expression.jpg

In this work, we developed a method for pose-invariant facial expression recognition from monocular video sequences. The advantage of our method is that, unlike existing methods, our method uses a very simple model, called the variable-intensity template, for describing different facial expressions, making it possible to prepare a model for each person with very little time and effort. Variable-intensity templates describe how the intensity of multiple points defined in the vicinity of facial parts varies for different facial expressions. By using this model in the framework of a particle filter, our method is capable of estimating facial poses and expressions simultaneously. Experiments demonstrate the effectiveness of our method. A recognition rate of over 90% was achieved for horizontal facial orientations on a range of ±40 degrees from the frontal view.

Publications

  • Shiro Kumano, Kazuhiro Otsuka, Junji Yamato, Eisaku Maeda and Yoichi Sato, "Pose-Invariant Facial Expression Recognition using Variable-Intensity Templates", International Journal of Computer Vision, Vol. 83, No. 2, pp. 178-194, June 2009.
  • Shiro Kumano, Kazuhiro Otsuka, Junji Yamato, Eisaku Maeda and Yoichi Sato, "Pose-Invariant Facial Expression Recognition using Variable-Intensity Templates", Proc. Asian Conference on Computer Vision (ACCV2007), pp. 324-334, November 2007. (Honorable Mention)