Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Universal Approximation Property of Hamiltonian Deep Neural Networks
 
research article

Universal Approximation Property of Hamiltonian Deep Neural Networks

Zakwan, Muhammad  
•
d'Angelo, Massimiliano
•
Ferrari-Trecate, Giancarlo  
January 1, 2023
Ieee Control Systems Letters

This letter investigates the universal approximation capabilities of Hamiltonian Deep Neural Networks (HDNNs) that arise from the discretization of Hamiltonian Neural Ordinary Differential Equations. Recently, it has been shown that HDNNs enjoy, by design, non-vanishing gradients, which provide numerical stability during training. However, although HDNNs have demonstrated state-of-the-art performance in several applications, a comprehensive study to quantify their expressivity is missing. In this regard, we provide a universal approximation theorem for HDNNs and prove that a portion of the flow of HDNNs can approximate arbitrary well any continuous function over a compact domain. This result provides a solid theoretical foundation for the practical use of HDNNs.

  • Details
  • Metrics
Type
research article
DOI
10.1109/LCSYS.2023.3288350
Web of Science ID

WOS:001030633500001

Author(s)
Zakwan, Muhammad  
d'Angelo, Massimiliano
Ferrari-Trecate, Giancarlo  
Date Issued

2023-01-01

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Published in
Ieee Control Systems Letters
Volume

7

Start page

2689

End page

2694

Subjects

Automation & Control Systems

•

Automation & Control Systems

•

residual neural network

•

machine learning

•

universal approximation

•

bounds

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LA  
Available on Infoscience
August 14, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/199764
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés