Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. DeepFly3D, a deep learning-based approach for 3D limb and appendage tracking in tethered, adult Drosophila
 
research article

DeepFly3D, a deep learning-based approach for 3D limb and appendage tracking in tethered, adult Drosophila

Günel, Semih  
•
Rhodin, Helge  
•
Morales, Daniel  
Show more
October 4, 2019
eLife

Studying how neural circuits orchestrate limbed behaviors requires the precise measurement of the positions of each appendage in 3-dimensional (3D) space. Deep neural networks can estimate 2-dimensional (2D) pose in freely behaving and tethered animals. However, the unique challenges associated with transforming these 2D measurements into reliable and precise 3D poses have not been addressed for small animals including the fly, Drosophila melanogaster. Here we present DeepFly3D, a software that infers the 3D pose of tethered, adult Drosophila using multiple camera images. DeepFly3D does not require manual calibration, uses pictorial structures to automatically detect and correct pose estimation errors, and uses active learning to iteratively improve performance. We demonstrate more accurate unsupervised behavioral embedding using 3D joint angles rather than commonly used 2D pose data. Thus, DeepFly3D enables the automated acquisition of Drosophila behavioral measurements at an unprecedented level of detail for a variety of biological applications.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.7554/eLife.48571
Author(s)
Günel, Semih  
Rhodin, Helge  
Morales, Daniel  
Campagnolo, João H
Ramdya, Pavan  
Fua, Pascal  
Date Issued

2019-10-04

Published in
eLife
Volume

8

Article Number

e48571

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
UPRAMDYA  
CVLAB  
Available on Infoscience
October 24, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/162319
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés