Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization
 
conference paper

Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization

Rebecq, Henri
•
Horstschaefer, Timo
•
Scaramuzza, Davide
2017
Proceedings of the British Machine Vision Conference (BMVC)
British Machine Vision Conference (BMVC)

Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odom- etry pipeline for such cameras that leverages their outstanding properties to estimate the camera ego-motion in challenging conditions, such as high-speed motion or high dynamic range scenes. The method tracks a set of features (extracted on the image plane) through time. To achieve that, we consider events in overlapping spatio-temporal windows and align them using the current camera motion and scene structure, yielding motion-compensated event frames. We then combine these feature tracks in a keyframe- based, visual-inertial odometry algorithm based on nonlinear optimization to estimate the camera’s 6-DOF pose, velocity, and IMU biases. The proposed method is evaluated quantitatively on the public Event Camera Dataset [19] and significantly outperforms the state-of-the-art [28], while being computationally much more efficient: our pipeline can run much faster than real-time on a laptop and even on a smartphone processor. Fur- thermore, we demonstrate qualitatively the accuracy and robustness of our pipeline on a large-scale dataset, and an extremely high-speed dataset recorded by spinning an event camera on a leash at 850 deg/s.

  • Details
  • Metrics
Type
conference paper
DOI
10.5244/C.31.16
Author(s)
Rebecq, Henri
Horstschaefer, Timo
Scaramuzza, Davide
Date Issued

2017

Published in
Proceedings of the British Machine Vision Conference (BMVC)
Start page

16.1

End page

16.12

URL

URL

http://rpg.ifi.uzh.ch/docs/BMVC17_Rebecq.pdf
Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
NCCR-ROBOTICS  
Event nameEvent place
British Machine Vision Conference (BMVC)

London, UK

Available on Infoscience
December 13, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/142770
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés