Wide-baseline object interpolation using shape prior regularization of epipolar plane images

This paper considers the synthesis of intermediate views of an object captured by two calibrated and widely spaced cameras. Based only on those two very different views, our paper proposes to reconstruct the object Epipolar Plane Image Volume [1] (EPIV), which describes the object transformation when continuously moving the viewpoint of the synthetic view in-between the two reference cameras. This problem is clearly ill-posed since the occlusions and the foreshortening effect make the reference views significantly different when the cameras are far apart. Our main contribution consists in disambiguating this ill-posed problem by constraining the interpolated views to be consistent with an object shape prior. This prior is learnt based on images captured by the two reference views, and consists in a nonlinear shape manifold representing the plausible silhouettes of the object described by Elliptic Fourier Descriptors. Experiments on both synthetic and natural images show that the proposed method preserves the topological structure of objects during the intermediate view synthesis, while dealing effectively with the self-occluded regions and with the severe foreshortening effect associated to wide-baseline camera configurations.


Publié dans:
IEEE Transactions on Image Processing, 26, 11, 5477-5490
Année
2017
ISSN:
1057-7149
Mots-clefs:
Laboratoires:




 Notice créée le 2014-08-07, modifiée le 2018-12-03

Fichiers:
SupplementaryMaterial_TIP2015_WideBaselineShapePriors - Télécharger le documentPDF
Src-Free_viewpoint_rendering - Télécharger le documentZIP
Video_TIP2015_WideBaselineShapePriors - Télécharger le documentM4V
n/a:
Télécharger le documentPDF
Évaluer ce document:

Rate this document:
1
2
3
 
(Pas encore évalué)