Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Enabling Uncertainty Estimation in Iterative Neural Networks
 
conference paper

Enabling Uncertainty Estimation in Iterative Neural Networks

Durasov, Nikita  
•
Oner, Doruk  
•
Donier, Jonathan
Show more
May 24, 2024
International Conference on Machine Learning
41st International Conference on Machine Learning (ICML) 2024

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of their successive outputs is highly correlated with the accuracy of the value to which they converge. Thus, we can use the convergence rate as a useful proxy for uncertainty. This results in an approach to uncertainty estimation that provides state-of-the-art estimates at a much lower computational cost than techniques like Ensembles, and without requiring any modifications to the original iterative model. We demonstrate its practical value by embedding it in two application domains: road detection in aerial images and the estimation of aerodynamic properties of 2D and 3D shapes.

  • Files
  • Details
  • Metrics
Type
conference paper
Author(s)
Durasov, Nikita  
Oner, Doruk  
Donier, Jonathan
Lê, Minh Hieu  
Fua, Pascal  
Date Issued

2024-05-24

Publisher

Curran Associates

Published in
International Conference on Machine Learning
ISBN of the book

9798331302238

Series title/Series vol.

Proceedings of Machine Learning Research; 235

ISSN (of the series)

2640-3498

Start page

12172

End page

12189

Subjects

uncertainty estimation

•

neural networks

•

out-of-distribution detection

•

computer vision

•

iterative models

•

calibration

URL

Project page

https://www.norange.io/projects/unc_iter/
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CVLAB  
Event nameEvent acronymEvent placeEvent date
41st International Conference on Machine Learning (ICML) 2024

ICML 2024

Vienna, Austria

2024-07-21 - 2024-07-24

Available on Infoscience
May 24, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/208108
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés