Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Action Units and Their Cross-Correlations for Prediction of Cognitive Load during Driving
 
research article

Action Units and Their Cross-Correlations for Prediction of Cognitive Load during Driving

Yuce, Anil  
•
Gao, Hua  
•
Cuendet, Gabriel Louis  
Show more
2017
IEEE Transactions on Affective Computing

Driving requires the constant coordination of many body systems and full attention of the person. Cognitive distraction (subsidiary mental load) of the driver is an important factor that decreases attention and responsiveness, which may result in human error and accidents. In this paper, we present a study of facial expressions of such mental diversion of attention. First, we introduce a multi-camera database of 46 people recorded while driving a simulator in two conditions, baseline and induced cognitive load using a secondary task. Then, we present an automatic system to differentiate between the two conditions, where we use features extracted from Facial Action Unit (AU) values and their cross-correlations in order to exploit recurring synchronization and causality patterns. Both the recording and detection system are suitable for integration in a vehicle and a real-world application, e.g. an early warning system. We show that when the system is trained individually on each subject we achieve a mean accuracy and F-score of ~95%, and for the subject independent tests ~68% accuracy and ~66% F-score, with person-specific normalization to handle subject-dependency. Based on the results, we discuss the universality of the facial expressions of such states and possible real-world uses of the system.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1109/TAFFC.2016.2584042
Web of Science ID

WOS:000402709900003

Author(s)
Yuce, Anil  
Gao, Hua  
Cuendet, Gabriel Louis  
Thiran, Jean-Philippe  
Date Issued

2017

Publisher

Ieee-Inst Electrical Electronics Engineers Inc

Published in
IEEE Transactions on Affective Computing
Volume

8

Issue

5

Start page

161

End page

175

Subjects

Affect sensing and analysis

•

Facial Expression

•

Action Unit

•

Affective Computing Applications

•

Vehicle operation

•

Emotional corpora

•

Driver cognitive distraction

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTS5  
Available on Infoscience
January 11, 2016
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/122135
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés