Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Robust Isometric Non-Rigid Structure-From-Motion
 
research article

Robust Isometric Non-Rigid Structure-From-Motion

Parashar, Shaifali  
•
Pizarro, Daniel
•
Bartoli, Adrien
October 1, 2022
Ieee Transactions On Pattern Analysis And Machine Intelligence

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. This prevents one to use automatically established correspondences, which are prone to errors, thereby strongly limiting the scope of NRSfM. We propose a three-step automatic pipeline to solve NRSfM robustly by exploiting isometry. Step (i) computes the optical flow from correspondences, step (ii) reconstructs each 3D point's normal vector using multiple reference images and integrates them to form surfaces with the best reference and step (iii) rejects the 3D points that break isometry in their local neighborhood. Importantly, each step is designed to discard or flag erroneous correspondences. Our contributions include the robustification of optical flow by warp estimation, new fast analytic solutions to local normal reconstruction and their robustification, and a new scale-independent measure of 3D local isometric coherence. Experimental results show that our robust NRSfM method consistently outperforms existing methods on both synthetic and real datasets.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TPAMI.2021.3089923
Web of Science ID

WOS:000853875300041

Author(s)
Parashar, Shaifali  
Pizarro, Daniel
Bartoli, Adrien
Date Issued

2022-10-01

Publisher

IEEE COMPUTER SOC

Published in
Ieee Transactions On Pattern Analysis And Machine Intelligence
Volume

44

Issue

10

Start page

6409

End page

6423

Subjects

Computer Science, Artificial Intelligence

•

Engineering, Electrical & Electronic

•

Computer Science

•

Engineering

•

image reconstruction

•

three-dimensional displays

•

shape

•

measurement

•

mathematical model

•

tensors

•

strain

•

3d computer vision

•

nrsfm

•

robustness

•

isometry

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CVLAB  
Available on Infoscience
October 10, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/191364
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés