Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search
 
conference paper

Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search

Yu, Kaicheng  
•
Ranftl, Rene
•
Salzmann, Mathieu  
January 1, 2021
2021 Ieee/Cvf Conference On Computer Vision And Pattern Recognition, Cvpr 2021
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Weight sharing has become a de facto standard in neural architecture search because it enables the search to be done on commodity hardware. However, recent works have empirically shown a ranking disorder between the performance of stand-alone architectures and that of the corresponding shared-weight networks. This violates the main assumption of weight-sharing NAS algorithms, thus limiting their effectiveness. We tackle this issue by proposing a regularization term that aims to maximize the correlation between the performance rankings of the shared-weight network and that of the standalone architectures using a small set of landmark architectures. We incorporate our regularization term into three different NAS algorithms and show that it consistently improves performance across algorithms, search-spaces, and tasks.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/CVPR46437.2021.01351
Web of Science ID

WOS:000742075003091

Author(s)
Yu, Kaicheng  
Ranftl, Rene
Salzmann, Mathieu  
Date Issued

2021-01-01

Publisher

IEEE COMPUTER SOC

Publisher place

Los Alamitos

Published in
2021 Ieee/Cvf Conference On Computer Vision And Pattern Recognition, Cvpr 2021
ISBN of the book

978-1-6654-4509-2

Series title/Series vol.

IEEE Conference on Computer Vision and Pattern Recognition

Start page

13718

End page

13727

Subjects

Computer Science, Artificial Intelligence

•

Imaging Science & Photographic Technology

•

Computer Science

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CVLAB  
Event nameEvent placeEvent date
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

ELECTR NETWORK

Jun 19-25, 2021

Available on Infoscience
January 31, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/184902
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés