Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction.
 
research article

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction.

Iwane, Fumiaki  
•
Porssut, Thibault  
•
Blanke, Olaf  
Show more
2024
Journal of Neural Engineering

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside the virtual body when they perceive erroneous interaction, i.e. Break-in-embodiment (BiE). However, the way to detect such an inadequate event is currently limited to questionnaires or spontaneous reports from users. The ability to implicitly detect BiE in real-time enables us to adjust human-avatar mapping without interruption. Approach. We propose and empirically demonstrate a novel Brain Computer Interface (BCI) approach that monitors the occurrence of BiE based on the users' brain oscillatory activity in real-time to adjust the human-avatar mapping in VR. We collected EEG data of 37 participants while they performed reaching movements with their avatar with different magnitude of distortion. Main results. Our BCI approach seamlessly predicts occurrence of BiE in varying magnitude of erroneous interaction. The mapping has been customized by BCI-reinforcement learning (RL) closed-loop system to prevent BiE from occurring. Furthermore, a non-personalized BCI decoder generalizes to new users, enabling "Plug-and-Play" ErrP-based non-invasive BCI. The proposed VR system allows customization of human-avatar mapping without personalized BCI decoders or spontaneous reports. Significance. We anticipate that our newly developed VR-BCI can be useful to maintain an engaging avatar-based interaction and a compelling immersive experience while detecting when users notice a problem and seamlessly correcting it.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1088/1741-2552/ad2c02
Author(s)
Iwane, Fumiaki  
Porssut, Thibault  
Blanke, Olaf  
Chavarriaga, Ricardo  
Millan, Jose del R  
Herbelin, Bruno  
Boulic, Ronan  
Date Issued

2024

Published in
Journal of Neural Engineering
Subjects

Virtual Reality

•

Embodiment

•

Brain-Computer Interface

•

Error potential

•

EEG

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SCI-IC-RB  
CNBI  
FunderGrant Number

FNS

200020.17879

RelationURL/DOI

IsSupplementedBy

https://doi.org/10.5281/zenodo.8111105
Available on Infoscience
March 11, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/205953
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés