Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Events-to-Video: Bringing Modern Computer Vision to Event Cameras
 
conference paper

Events-to-Video: Bringing Modern Computer Vision to Event Cameras

Rebecq, Henri
•
Ranftl, René
•
Koltun, Vladlen
Show more
2019
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Event cameras are novel sensors that report brightness changes in the form of asynchronous “events” instead of intensity frames. They have significant advantages over conventional cameras: high temporal resolution, high dynamic range, and no motion blur. Since the output of event cameras is fundamentally different from conventional cam-eras, it is commonly accepted that they require the development of specialized algorithms to accommodate the particular nature of events. In this work, we take a different view and propose to apply existing, mature computer vision techniques to videos reconstructed from event data. We propose a novel recurrent network to reconstruct videos from a stream of events, and train it on a large amount of simulated event data. Our experiments show that our approach surpasses state-of-the-art reconstruction methods by a large margin (>20%) in terms of image quality. We further apply off-the-shelf computer vision algorithms to videos reconstructed from event data on tasks such as object classification and visual-inertial odometry,and show that this strategy consistently outperforms algorithms that were specifically designed for event data. We believe that our approach opens the door to bringing the outstanding properties of event cameras to an entirely new range of tasks. A video of the experiments is available at https://youtu.be/IdYrC4cUO0I

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/CVPR.2019.00398
Author(s)
Rebecq, Henri
Ranftl, René
Koltun, Vladlen
Scaramuzza, Davide
Date Issued

2019

Published in
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Start page

3852

End page

3861

URL

Video experiment

https://youtu.be/IdYrC4cUO0I

Paper

http://rpg.ifi.uzh.ch/docs/CVPR19_Rebecq.pdf
Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
NCCR-ROBOTICS  
Event nameEvent place
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Long Beach, USA

Available on Infoscience
October 31, 2019
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/162574
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés