A new method for automatic tracking of facial landmarks in 3D motion captured images (4D)

Int J Oral Maxillofac Surg. 2013 Jan;42(1):9-18. doi: 10.1016/j.ijom.2012.10.035. Epub 2012 Dec 4.

Abstract

The aim of this study was to validate the automatic tracking of facial landmarks in 3D image sequences. 32 subjects (16 males and 16 females) aged 18-35 years were recruited. 23 anthropometric landmarks were marked on the face of each subject with non-permanent ink using a 0.5mm pen. The subjects were asked to perform three facial animations (maximal smile, lip purse and cheek puff) from rest position. Each animation was captured by the 3D imaging system. A single operator manually digitised the landmarks on the 3D facial models and their locations were compared with those of the automatically tracked ones. To investigate the accuracy of manual digitisation, the operator re-digitised the same set of 3D images of 10 subjects (5 male and 5 female) at 1 month interval. The discrepancies in x, y and z coordinates between the 3D position of the manual digitised landmarks and that of the automatic tracked facial landmarks were within 0.17mm. The mean distance between the manually digitised and the automatically tracked landmarks using the tracking software was within 0.55 mm. The automatic tracking of facial landmarks demonstrated satisfactory accuracy which would facilitate the analysis of the dynamic motion during facial animations.

Publication types

  • Comparative Study

MeSH terms

  • Adolescent
  • Adult
  • Anatomic Landmarks / anatomy & histology*
  • Cephalometry / methods
  • Cheek / physiology
  • Chin / anatomy & histology
  • Eyebrows / anatomy & histology
  • Eyelids / anatomy & histology
  • Face / anatomy & histology*
  • Facial Expression
  • Female
  • Frontal Bone / anatomy & histology
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Imaging, Three-Dimensional / methods*
  • Lip / anatomy & histology
  • Lip / physiology
  • Male
  • Movement
  • Nose / anatomy & histology
  • Observer Variation
  • Reproducibility of Results
  • Smiling / physiology
  • Software
  • Video Recording / methods*
  • Young Adult
  • Zygoma / anatomy & histology