Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Learning Coupled Dynamical Systems from Human Demonstration for Robotic Eye-Arm-Hand Coordination
 
conference paper

Learning Coupled Dynamical Systems from Human Demonstration for Robotic Eye-Arm-Hand Coordination

Lukic, Luka  
•
Santos-Victor, José  
•
Billard, Aude  
2012
Proceedings of the IEEE-RAS International Conference on Humanoid Robots
IEEE-RAS International Conference on Humanoid Robots

Efficient, adaptive and reliable visuomotor control system is crucial to enable robots to display flexibility in the face of changes in the environment. This paper takes inspiration in human eye-arm-hand coordination pattern to develop an equivalently robust robot controller. We recorded gaze, arm, hand, and trunk data from human subjects in reaching and grasping scenarios with/without obstacle in the workspace. An eye-arm-hand controller is developed, based on our extension of Coupled Dynamical Systems (CDS). We exploit the time-invariant properties of the CDS to allow fast adaptation to spatial and temporal perturbations during task completion. CDS global stability guarantees that the eye, the arm and the hand will reach the target in retinal, operational and grasp space respectively. When facing perturbations, the system can re-plan its actions almost instantly, without the need for an additional planning module. Coupling profiles for eye-arm and arm-hand systems can be modulated allowing to adjust the behavior of each slave system with respect to control signals flowing from the corresponding master system. We show how the CDS eye-arm-hand control framework can be used to handle the presence of obstacles in the workspace. The eye-arm-hand controller is validated in a series of experiments conducted with the iCub robot.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1109/HUMANOIDS.2012.6651574
Author(s)
Lukic, Luka  
Santos-Victor, José  
Billard, Aude  
Date Issued

2012

Published in
Proceedings of the IEEE-RAS International Conference on Humanoid Robots
Start page

552

End page

559

Subjects

visuomotor coordination

•

coupled dynamical systems

•

obstacle avoidance

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LASA  
Event nameEvent placeEvent date
IEEE-RAS International Conference on Humanoid Robots

Osaka, Japan

November 29-December 1, 2012

Available on Infoscience
October 4, 2012
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/85940
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés