Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360° Neural Radiance Fields
 
conference paper

InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360° Neural Radiance Fields

Wang, Dongqing  
•
Zhang, Tong  
•
Abboud, Alaa
Show more
June 16, 2024
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition CVPR 2024

We propose InNeRF360, an automatic system that accurately removes text-specified objects from 360 • Neural Radiance Fields (NeRF). The challenge is to effectively remove objects while inpainting perceptually consistent content for the missing regions, which is particularly demanding for existing NeRF models due to their implicit volumetric representation. Moreover, unbounded scenes are more prone to floater artifacts in the inpainted region than frontal-facing scenes, as the change of object appearance and background across views is more sensitive to inaccurate segmentations and inconsistent inpainting. With a trained NeRF and a text description, our method efficiently removes specified objects and inpaints visually consistent content without artifacts. We apply depth-space warping to enforce consistency across multiview text-encoded segmentations, and then refine the inpainted NeRF model using perceptual priors and 3D diffusion-based geometric priors to ensure visual plausibility. Through extensive experiments in segmentation and inpainting on 360 • and frontal-facing NeRFs, we show that our approach is effective and enhances NeRF's editability. Project page: https://ivrl.github.io/ InNeRF360/.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

InNeRF360.pdf

Type

Main Document

Version

http://purl.org/coar/version/c_970fb48d4fbd8a85

Access type

restricted

License Condition

N/A

Size

8.99 MB

Format

Adobe PDF

Checksum (MD5)

340f6073157fed8ad510a22bfbe060e6

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés