Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Reports, Documentation, and Standards
  4. On the inference speed and video-compression robustness of DeepLabCut
 
report

On the inference speed and video-compression robustness of DeepLabCut

Mathis, Alexander  
•
Warren, Richard
October 30, 2018

Pose estimation is crucial for many applications in neuroscience, biomechanics, genetics and beyond. We recently presented a highly efficient method for markerless pose estimation based on transfer learning with deep neural networks called DeepLabCut. Current experiments produce vast amounts of video data, which pose challenges for both storage and analysis. Here we improve the inference speed of DeepLabCut by up to tenfold and benchmark these updates on various CPUs and GPUs. In particular, depending on the frame size, poses can be inferred offline at up to 1200 frames per second (FPS). For instance, 278 × 278 images can be processed at 225 FPS on a GTX 1080 Ti graphics card. Furthermore, we show that DeepLabCut is highly robust to standard video compression (ffmpeg). Compression rates of greater than 1,000 only decrease accuracy by about half a pixel (for 640 × 480 frame size). DeepLabCut’s speed and robustness to compression can save both time and hardware expenses.

  • Details
  • Metrics
Type
report
DOI
10.1101/457242
Author(s)
Mathis, Alexander  
•
Warren, Richard
Date Issued

2018-10-30

Publisher

Animal Behavior and Cognition

URL
http://biorxiv.org/lookup/doi/10.1101/457242
Editorial or Peer reviewed

NON-REVIEWED

Written at

OTHER

EPFL units
UPAMATHIS  
Available on Infoscience
November 6, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/173055
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés