Learning to Find Good Correspondences

We develop a deep architecture to learn to find good correspondences for wide-baseline stereo. Given a set of putative sparse matches and the camera intrinsics, we train our network in an end-to-end fashion to label the correspondences as inliers or outliers, while simultaneously using them to recover the relative pose, as encoded by the essential matrix. Our architecture is based on a multi-layer perceptron operating on pixel coordinates rather than directly on the image, and is thus simple and small. We introduce a novel normalization technique, called Context Normalization, which allows us to process each data point separately while embedding global information in it, and also makes the network invariant to the order of the correspondences. Our experiments on multiple challenging datasets demonstrate that our method is able to drastically improve the state of the art with little training data.


Published in:
2018 Ieee/Cvf Conference On Computer Vision And Pattern Recognition (Cvpr), 2666-2674
Presented at:
31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, Jun 18-23, 2018
Year:
Jan 01 2018
Publisher:
New York, IEEE
ISSN:
1063-6919
ISBN:
978-1-5386-6420-9
Laboratories:




 Record created 2019-06-18, last modified 2019-08-12


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)