Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Cognitive workload monitoring in virtual reality based rescue missions with drones
 
conference paper

Cognitive workload monitoring in virtual reality based rescue missions with drones

Dell'Agnola, Fabio Isidoro Tiberio  
•
Momeni, Niloofar  
•
Arza Valdes, Adriana  
Show more
February 21, 2020
Virtual, Augmented and Mixed Reality. Design and Interaction
12th International Conference on Virtual, Augmented and Mixed Reality

The use of drones in search and rescue (SAR) missions can be very cognitively demanding. Since high levels of cognitive workload can negatively affect human performance, there is a risk of compromising the mission and leading to failure with catastrophic outcomes. Therefore, cognitive workload monitoring is the key to prevent the rescuers from taking dangerous decisions. Due to the difficulties of gathering data during real SAR missions, we rely on virtual reality. In this work, we use a simulator to induce three levels of cognitive workload related to SAR missions with drones. To detect cognitive workload, we extract features from different physiological signals, such as electrocardiogram, respiration, skin temperature, and photoplethysmography. We propose a recursive feature elimination method that combines the use of both an eXtreme Gradient Boosting (XGBoost) algorithm and the SHapley Additive exPlanations (SHAP) score to select the more representative features. Moreover, we address both a binary and a three-class detection approaches. To this aim, we investigate the use of different machine-learning algorithms, such as XGBoost, random forest, decision tree, k-nearest neighbors, logistic regression, linear discriminant analysis, gaussian naïve bayes, and support vector machine. Our results show that on an unseen test set extracted from 24 volunteers, an XGBoost with 24 features for discrimination reaches an accuracy of 80.2% and 62.9% in order to detect two and three levels of cognitive workload, respectively. Finally, our results are open the doors to a fine grained cognitive workload detection in the field of SAR missions.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Springer_VAMR2020_Final.pdf

Type

Publisher's Version

Version

Published version

Access type

openaccess

Size

797.48 KB

Format

Adobe PDF

Checksum (MD5)

04ea5d75ab1362e57ada18b65c4709ee

Loading...
Thumbnail Image
Name

Springer_VAMR2020_InvitedPaper.pdf

Type

Preprint

Version

Submitted version (Preprint)

Access type

openaccess

Size

797.48 KB

Format

Adobe PDF

Checksum (MD5)

04ea5d75ab1362e57ada18b65c4709ee

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés