Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Depth Estimation for Egocentric Rehabilitation Monitoring Using Deep Learning Algorithms
 
research article

Depth Estimation for Egocentric Rehabilitation Monitoring Using Deep Learning Algorithms

Izadmehr, Yasaman
•
Satizabal, Hector F.
•
Aminian, Kamiar  
Show more
July 1, 2022
Applied Sciences-Basel

Upper limb impairment is one of the most common problems for people with neurological disabilities, affecting their activity, quality of life (QOL), and independence. Objective assessment of upper limb performance is a promising way to help patients with neurological upper limb disorders. By using wearable sensors, such as an egocentric camera, it is possible to monitor and objectively assess patients' actual performance in activities of daily life (ADLs). We analyzed the possibility of using Deep Learning models for depth estimation based on a single RGB image to allow the monitoring of patients with 2D (RGB) cameras. We conducted experiments placing objects at different distances from the camera and varying the lighting conditions to evaluate the performance of the depth estimation provided by two deep learning models (MiDaS & Alhashim). Finally, we integrated the best performing model for depth-estimation (MiDaS) with other Deep Learning models for hand (MediaPipe) and object detection (YOLO) and evaluated the system in a task of hand-object interaction. Our tests showed that our final system has a 78% performance in detecting interactions, while the reference performance using a 3D (depth) camera is 84%.

  • Details
  • Metrics
Type
research article
DOI
10.3390/app12136578
Web of Science ID

WOS:000825525200001

Author(s)
Izadmehr, Yasaman
Satizabal, Hector F.
Aminian, Kamiar  
Perez-Uribe, Andres
Date Issued

2022-07-01

Publisher

MDPI

Published in
Applied Sciences-Basel
Volume

12

Issue

13

Article Number

6578

Subjects

Chemistry, Multidisciplinary

•

Engineering, Multidisciplinary

•

Materials Science, Multidisciplinary

•

Physics, Applied

•

Chemistry

•

Engineering

•

Materials Science

•

Physics

•

monocular depth estimation

•

single-image depth prediction

•

free-living monitoring

•

wearable devices

•

context awareness

•

upper-limb neurological disorders

•

quality of movement

•

rehabilitation

•

activity recognition

•

stroke

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

Available on Infoscience
August 1, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/189552
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés