Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. A Probabilistic Approach to Multi-Modal Adaptive Virtual Fixtures
 
research article

A Probabilistic Approach to Multi-Modal Adaptive Virtual Fixtures

Muehlbauer, Maximilian
•
Hulin, Thomas
•
Weber, Bernhard
Show more
June 1, 2024
Ieee Robotics And Automation Letters

Virtual Fixtures (VFs) provide haptic feedback for teleoperation, typically requiring distinct input modalities for different phases of a task. This often results in vision- and position-based fixtures. Vision-based fixtures, particularly, require the handling of visual uncertainty, as well as target appearance/disappearance for increased flexibility. This creates the need for principled ways to add/remove fixtures, in addition to uncertainty-aware assistance regulation. Moreover, the arbitration of different modalities plays a crucial role in providing an optimal feedback to the user throughout the task. In this letter, we propose a Mixture of Experts (MoE) model that synthesizes visual servoing fixtures, elegantly handling full pose detection uncertainties and teleoperation goals in a unified framework. An arbitration function combining multiple vision-based fixtures arises naturally from the MoE formulation, leveraging uncertainties to modulate fixture stiffness and thus the degree of assistance. The resulting visual servoing fixtures are then fused with position-based fixtures using a Product of Experts (PoE) approach, achieving guidance throughout the complete workspace. Our results indicate that this approach not only permits human operators to accurately insert printed circuit boards (PCBs) but also offers added flexibility and retains the performance level of a baseline with carefully handtuned VFs, without requiring the manual creation of VFs for individual connectors.

  • Details
  • Metrics
Type
research article
DOI
10.1109/LRA.2024.3384759
Web of Science ID

WOS:001209579600002

Author(s)
Muehlbauer, Maximilian
•
Hulin, Thomas
•
Weber, Bernhard
•
Calinon, Sylvain  
•
Stulp, Freek
•
Albu-Schaeffer, Alin
•
Silverio, Joao
Date Issued

2024-06-01

Publisher

Ieee-Inst Electrical Electronics Engineers Inc

Published in
Ieee Robotics And Automation Letters
Volume

9

Issue

6

Start page

5298

End page

5305

Subjects

Technology

•

Assembly

•

Space Robotics And Automation

•

Telerobotics And Teleoperation

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIDIAP  
FunderGrant Number

Federal Ministry BMWK

Available on Infoscience
May 16, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/207981
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés