Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. EPFL thesis
  4. Leveraging topology, geometry, and symmetries for efficient Machine Learning
 
doctoral thesis

Leveraging topology, geometry, and symmetries for efficient Machine Learning

Defferrard, Michaël  
2022

When learning from data, leveraging the symmetries of the domain the data lies on is a principled way to combat the curse of dimensionality: it constrains the set of functions to learn from. It is more data efficient than augmentation and gives a generalization guarantee. Symmetries might however be unknown or expensive to find; domains might not be homogeneous.

From the building blocks of space (vertices, edges, simplices), an incidence structure, and a metric---the domain's topology and geometry---a linear operator naturally emerges that commutes with any known and unknown symmetry action. We call that equivariant operator the generalized convolution operator. And we use it, designed or learned, to transform data and embed domains. In our generalized setting involving unknown and non-transitive symmetry groups, our convolution is an inner-product with a kernel that is localized instead of moved around by group actions like translations: a bias-variance tradeoff that paves the way to efficient learning on arbitrary discrete domains.

We develop convolutional neural networks that operate on graphs, meshes, and simplicial complexes. Their implementation amounts to the multiplications of data tensors by sparse matrices and pointwise operations, with linear compute, memory, and communication requirements. We demonstrate our method's efficiency by reaching state-of-the-art performance for multiple tasks on large discretizations of the sphere. DeepSphere has been used for studies in cosmology and shall be used for operational weather forecasting---advancing our understanding of the world and impacting billions of individuals.

  • Files
  • Details
  • Metrics
Type
doctoral thesis
DOI
10.5075/epfl-thesis-7398
Author(s)
Defferrard, Michaël  
Advisors
Vandergheynst, Pierre  
Jury

Prof. Pascal Frossard (président) ; Prof. Pierre Vandergheynst (directeur de thèse) ; Prof. Martin Jaggi, Prof. Max Welling, Prof. Yann LeCun (rapporteurs)

Date Issued

2022

Publisher

EPFL

Publisher place

Lausanne

Public defense year

2022-05-31

Thesis number

7398

Total of pages

124

Subjects

Convolutional neural networks

•

graph neural networks

•

network embedding

•

graph signal processing

•

discrete calculus

•

equivariance

•

symmetry groups.

EPFL units
LTS2  
Faculty
STI  
School
IEL  
Doctoral School
EDEE  
Available on Infoscience
May 31, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/188205
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés