Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI
 
research article

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Rakovic, Mirko
•
Duarte, Nuno Ferreira  
•
Marques, Jorge
Show more
November 29, 2022
Ieee Transactions On Cybernetics

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other hand, gaze movements fulfil the purpose of communication, both for reading the intention of our interaction partners, as well as to signal our action intentions to others. We study this Gaze Dialogue between two participants working on a collaborative task involving two types of actions: 1) individual action and 2) action-in-interaction. We recorded the eye-gaze data of both participants during the interaction sessions in order to build a computational model, the Gaze Dialogue, encoding the interplay of the eye movements during the dyadic interaction. The model also captures the correlation between the different gaze fixation points and the nature of the action. This knowledge is used to infer the type of action performed by an individual. We validated the model against the recorded eye-gaze behavior of one subject, taking the eye-gaze behavior of the other subject as the input. Finally, we used the model to design a humanoid robot controller that provides interpersonal gaze coordination in human-robot interaction scenarios. During the interaction, the robot is able to: 1) adequately infer the human action from gaze cues; 2) adjust its gaze fixation according to the human eye-gaze behavior; and 3) signal nonverbal cues that correlate with the robot's own action intentions.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TCYB.2022.3222077
Web of Science ID

WOS:000896602300001

Author(s)
Rakovic, Mirko
•
Duarte, Nuno Ferreira  
•
Marques, Jorge
•
Billard, Aude  
•
Santos-Victor, Jose
Date Issued

2022-11-29

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Published in
Ieee Transactions On Cybernetics
Subjects

Automation & Control Systems

•

Computer Science, Artificial Intelligence

•

Computer Science, Cybernetics

•

Computer Science

•

bio-inspired robotics

•

human-in-the-loop

•

human-robot interaction (hri)

•

hand coordination

•

robot

•

object

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LASA  
Available on Infoscience
January 2, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/193557
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés