Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Towards Reliable Evaluation of Algorithms for Road Network Reconstruction from Aerial Images
 
conference paper

Towards Reliable Evaluation of Algorithms for Road Network Reconstruction from Aerial Images

Citraro, Leonardo  
•
Kozinski, Mateusz  
•
Fua, Pascal  
2020
[Proceedings of ECCV '20]
European Conference on Computer Vision (ECCV 2020)

Existing connectivity-oriented performance measures rank road delineation algorithms inconsistently, which makes it difficult to decide which one is best for a given application. We show that these inconsistencies stem from design flaws that make the metrics insensitive to whole classes of errors. This insensitivity is undesirable in metrics intended for capturing overall general quality of road reconstructions. In particular, the scores do not reflect the time needed for a human to fix the errors, because each one has to be fixed individually. To provide more reliable evaluation, we design three new metrics that are sensitive to all classes of errors. This sensitivity makes them more consistent even though they use very different approaches to comparing ground-truth and reconstructed road networks. We use both synthetic and real data to demonstrate this and advocate the use of these corrected metrics as a tool to gauge future progress.

  • Files
  • Details
  • Metrics
Type
conference paper
Author(s)
Citraro, Leonardo  
Kozinski, Mateusz  
Fua, Pascal  
Date Issued

2020

Published in
[Proceedings of ECCV '20]
Subjects

Metrics

•

Road delineation

•

Road reconstruction

URL

Code

https://github.com/lcit/metrics_delin
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CVLAB  
Event nameEvent placeEvent date
European Conference on Computer Vision (ECCV 2020)

[Virtual conference]

August 23-28, 2020

Available on Infoscience
October 23, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/172710
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés