Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Cognitive workload monitoring in virtual reality based rescue missions with drones
 
conference paper

Cognitive workload monitoring in virtual reality based rescue missions with drones

Dell'Agnola, Fabio Isidoro Tiberio  
•
Momeni, Niloofar  
•
Arza Valdes, Adriana  
Show more
February 21, 2020
Virtual, Augmented and Mixed Reality. Design and Interaction
12th International Conference on Virtual, Augmented and Mixed Reality

The use of drones in search and rescue (SAR) missions can be very cognitively demanding. Since high levels of cognitive workload can negatively affect human performance, there is a risk of compromising the mission and leading to failure with catastrophic outcomes. Therefore, cognitive workload monitoring is the key to prevent the rescuers from taking dangerous decisions. Due to the difficulties of gathering data during real SAR missions, we rely on virtual reality. In this work, we use a simulator to induce three levels of cognitive workload related to SAR missions with drones. To detect cognitive workload, we extract features from different physiological signals, such as electrocardiogram, respiration, skin temperature, and photoplethysmography. We propose a recursive feature elimination method that combines the use of both an eXtreme Gradient Boosting (XGBoost) algorithm and the SHapley Additive exPlanations (SHAP) score to select the more representative features. Moreover, we address both a binary and a three-class detection approaches. To this aim, we investigate the use of different machine-learning algorithms, such as XGBoost, random forest, decision tree, k-nearest neighbors, logistic regression, linear discriminant analysis, gaussian naïve bayes, and support vector machine. Our results show that on an unseen test set extracted from 24 volunteers, an XGBoost with 24 features for discrimination reaches an accuracy of 80.2% and 62.9% in order to detect two and three levels of cognitive workload, respectively. Finally, our results are open the doors to a fine grained cognitive workload detection in the field of SAR missions.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1007/978-3-030-49695-1_26
Author(s)
Dell'Agnola, Fabio Isidoro Tiberio  
Momeni, Niloofar  
Arza Valdes, Adriana  
Atienza, David  
Date Issued

2020-02-21

Published in
Virtual, Augmented and Mixed Reality. Design and Interaction
Series title/Series vol.

Lecture Notes in Computer Science; 12190

Start page

397

End page

409

Subjects

Cognitive Workload Monitoring

•

Physiological Signals

•

Machine Learning

•

Search and Rescue Missions Simulator

•

Drones

URL
http://2020.hci.international/vamr.html
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
ESL  
Event nameEvent placeEvent date
12th International Conference on Virtual, Augmented and Mixed Reality

Copenhagen, Denmark

July 19-24, 2020

Available on Infoscience
February 21, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/166434
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés