Image Inpainting through Neural Networks Hallucinations

We consider in this paper the problem of image inpainting, where the objective is to reconstruct large continuous regions of missing or deteriorated parts of an image. Traditional inpainting algorithms are unfortunately not well adapted to handle such corruptions as they rely on image processing techniques that cannot properly infer missing information when the corrupted holes are too large. To tackle this problem, we propose a novel approach where we rely on the hallucinations of pre-trained neural networks to fill large holes in images. To generate globally coherent images, we further impose smoothness and consistency regularization, thereby constraining the neural network hallucinations. Through illustrative experiments, we show that pre-trained neural networks contain crucial prior information that can effectively guide the reconstruction process of complex inpainting problems.

Published in:
Proceedings of the IEEE IVMSP Workshop
Presented at:
12th IEEE Image, Video, and Multidimensional Signal Processing Workshop (IVMSP), Bordeaux, FRANCE, JUL 11-12, 2016
New York, Ieee

 Record created 2017-01-28, last modified 2018-09-13

Rate this document:

Rate this document:
(Not yet reviewed)