Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Large deviations in the perceptron model and consequences for active learning
 
research article

Large deviations in the perceptron model and consequences for active learning

Cui, H
•
Saglietti, L  
•
Zdeborová, L  
2021
Machine Learning: Science and Technology

Active learning (AL) is a branch of machine learning that deals with problems where unlabeled data is abundant yet obtaining labels is expensive. The learning algorithm has the possibility of querying a limited number of samples to obtain the corresponding labels, subsequently used for supervised learning. In this work, we consider the task of choosing the subset of samples to be labeled from a fixed finite pool of samples. We assume the pool of samples to be a random matrix and the ground truth labels to be generated by a single-layer teacher random neural network. We employ replica methods to analyze the large deviations for the accuracy achieved after supervised learning on a subset of the original pool. These large deviations then provide optimal achievable performance boundaries for any AL algorithm. We show that the optimal learning performance can be efficiently approached by simple message-passing AL algorithms. We also provide a comparison with the performance of some other popular active learning strategies.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1088/2632-2153/abfbbb
Author(s)
Cui, H
Saglietti, L  
Zdeborová, L  
Date Issued

2021

Published in
Machine Learning: Science and Technology
Volume

2

Issue

4

Article Number

045001

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SPOC1  
SPOC2  
Available on Infoscience
February 10, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/185258
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés