Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Robust Classification Using Contractive Hamiltonian Neural ODEs
 
research article

Robust Classification Using Contractive Hamiltonian Neural ODEs

Zakwan, Muhammad  
•
Xu, Liang  
•
Ferrari-Trecate, Giancarlo  
June 28, 2022
Ieee Control Systems Letters

Deep neural networks can be fragile and sensitive to small input perturbations that might cause a significant change in the output. In this letter, we employ contraction theory to improve the robustness of neural ODEs (NODEs). A dynamical system is contractive if all solutions with different initial conditions converge to each other exponentially fast. As a consequence, perturbations in initial conditions become less and less relevant over time. Since in NODEs the input data corresponds to the initial condition of dynamical systems, we show contractivity can mitigate the effect of input perturbations. More precisely, inspired by NODEs with Hamiltonian dynamics, we propose a class of contractive Hamiltonian NODEs (CH-NODEs). By properly tuning a scalar parameter, CH-NODEs ensure contractivity by design and can be trained using standard backpropagation. Moreover, CH-NODEs enjoy built-in guarantees of non-exploding gradients, which ensure a well-posed training process. Finally, we demonstrate the robustness of CH-NODEs on the MNIST image classification problem with noisy test data.

  • Details
  • Metrics
Type
research article
DOI
10.1109/LCSYS.2022.3186959
Web of Science ID

WOS:000824789600004

Author(s)
Zakwan, Muhammad  
Xu, Liang  
Ferrari-Trecate, Giancarlo  
Date Issued

2022-06-28

Published in
Ieee Control Systems Letters
Volume

7

Start page

145

End page

150

Subjects

Automation & Control Systems

•

Automation & Control Systems

•

robustness

•

artificial neural networks

•

training

•

perturbation methods

•

dynamical systems

•

sensitivity

•

trajectory

•

machine learning

•

neural networks

•

stability of nonlinear systems

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SCI-STI-GFT  
Available on Infoscience
August 1, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/189525
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés