Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Contrasting action and posture coding with hierarchical deep neural network models of proprioception
 
research article

Contrasting action and posture coding with hierarchical deep neural network models of proprioception

Sandbrink, Kai J.
•
Mamidanna, Pranav
•
Michaelis, Claudio
Show more
May 31, 2023
Elife

Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body's state. The canonical role of proprioception is representing the body state. We hypothesize that the proprioceptive system could also be critical for high-level tasks such as action recognition. To test this theory, we pursued a task-driven modeling approach, which allowed us to isolate the study of proprioception. We generated a large synthetic dataset of human arm trajectories tracing characters of the Latin alphabet in 3D space, together with muscle activities obtained from a musculoskeletal model and model-based muscle spindle activity. Next, we compared two classes of tasks: trajectory decoding and action recognition, which allowed us to train hierarchical models to decode either the position and velocity of the end-effector of one's posture or the character (action) identity from the spindle firing patterns. We found that artificial neural networks could robustly solve both tasks, and the networks' units show tuning properties similar to neurons in the primate somatosensory cortex and the brainstem. Remarkably, we found uniformly distributed directional selective units only with the action-recognition-trained models and not the trajectory-decoding-trained models. This suggests that proprioceptive encoding is additionally associated with higher-level functions such as action recognition and therefore provides new, experimentally testable hypotheses of how proprioception aids in adaptive motor control.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.7554/eLife.81499
Web of Science ID

WOS:001035377300001

Author(s)
Sandbrink, Kai J.
Mamidanna, Pranav
Michaelis, Claudio
Bethge, Matthias
Mathis, Mackenzie Weygandt  
Mathis, Alexander  
Ba, Demba
Date Issued

2023-05-31

Publisher

eLIFE SCIENCES PUBL LTD

Published in
Elife
Volume

12

Article Number

e81499

Subjects

Biology

•

Life Sciences & Biomedicine - Other Topics

•

proprioception

•

somatosensory

•

deep learning

•

biomechanics

•

task-driven modeling

•

sensory systems

•

none

•

somatosensory cortex

•

peripheral inputs

•

motor

•

afferents

•

discharges

•

receptors

•

framework

•

software

•

position

•

feedback

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
UPMWMATHIS  
UPAMATHIS  
RelationRelated workURL/DOI

IsSupplementedBy

Task-driven modeling of proprioception

https://github.com/amathislab/DeepDraw

IsSupplementedBy

Data for Contrasting action and posture coding with hierarchical deep neural network models of proprioception

https://infoscience.epfl.ch/handle/20.500.14299/246910
Available on Infoscience
August 14, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/199831
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés