Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Decline
 
conference paper

LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Decline

Batlle, Victor
•
Montiel, José
•
Fua, Pascal  
Show more
2023
Medical Image Computing And Computer Assisted Intervention, Miccai 2023, Pt X
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)

We propose a new approach to 3D reconstruction from sequences of images acquired by monocular endoscopes. It is based on two key insights. First, endoluminal cavities are watertight, a property naturally enforced by modeling them in terms of a signed distance function. Second, the scene illumination is variable. It comes from the endoscope's light sources and decays with the inverse of the squared distance to the surface. To exploit these insights, we build on NeuS [25], a neural implicit surface reconstruction technique with an outstanding capability to learn appearance and a SDF surface model from multiple views, but currently limited to scenes with static illumination. To remove this limitation and exploit the relation between pixel brightness and depth, we modify the NeuS architecture to explicitly account for it and introduce a calibrated photometric model of the endoscope's camera and light source.|Our method is the first one to produce watertight reconstructions of whole colon sections. We demonstrate excellent accuracy on phantom imagery. Remarkably, the watertight prior combined with illumination decline, allows to complete the reconstruction of unseen portions of the surface with acceptable accuracy, paving the way to automatic quality assessment of cancer screening explorations, measuring the global percentage of observed mucosa.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1007/978-3-031-43999-5_48
Web of Science ID

WOS:001109641000048

Author(s)
Batlle, Victor
Montiel, José
Fua, Pascal  
Tardos, Juan
Date Issued

2023

Publisher

Cham

Publisher place

Springer International Publishing Ag

Published in
Medical Image Computing And Computer Assisted Intervention, Miccai 2023, Pt X
ISBN of the book

978-3-031-43998-8

978-3-031-43999-5

Volume

14229

Start page

502

End page

512

Subjects

Technology

•

Life Sciences & Biomedicine

•

Reconstruction

•

Photometric multi-view

•

Endoscopy

Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
CVLAB  
Event nameEvent placeEvent date
26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)

Vancouver, Canadda

October 8-12, 2023

FunderGrant Number

EU-H2020 grant

863146

Spanish government

PID2021-127685NB-I00

Aragon government

DGA T45-17R

Available on Infoscience
August 24, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/200031
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés