Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Energy-Aware Decentralized Learning with Intermittent Model Training
 
conference poster

Energy-Aware Decentralized Learning with Intermittent Model Training

de Vos, Marinus Abraham  
•
Dhasade, Akash Balasaheb  
•
Dini, Paolo
Show more
May 27, 2024
38th IEEE International Parallel & Distributed Processing Symposium

SKIPTRAIN is a novel Decentralized Learning (DL) algorithm, which minimizes energy consumption in decentralized learning by strategically skipping some training rounds and substituting them with synchronization rounds. These trainingsilent periods, besides saving energy, also allow models to better mix and produce models with superior accuracy than typical DL algorithms. Our empirical evaluations with 256 nodes demonstrate that SKIPTRAIN reduces energy consumption by 50% and increases model accuracy by up to 12% compared to D-PSGD, the conventional DL algorithm.

  • Files
  • Details
  • Metrics
Type
conference poster
DOI
10.1109/IPDPSW63119.2024.00196
Author(s)
de Vos, Marinus Abraham  

EPFL

Dhasade, Akash Balasaheb  

EPFL

Dini, Paolo
Guerra, Elia
Miozzo, Marco
Pereira Pires, Rafael  

EPFL

Kermarrec, Anne-Marie  

EPFL

Sharma, Rishi  

EPFL

Date Issued

2024-05-27

Publisher

IEEE

Subjects

Decentralized Learning

•

Energy Efficiency

•

Peerto-Peer Learning Systems

URL

2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)

https://ieeexplore.ieee.org/xpl/conhome/10596331/proceeding
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SACS  
Event nameEvent acronymEvent placeEvent date
38th IEEE International Parallel & Distributed Processing Symposium

IPDPS 2024

San Francisco, California, USA

2024-05-27 - 2024-05-31

FunderFunding(s)Grant NumberGrant URL

European Union

GREENEDGE

953775

https://doi.org/10.3030/953775
Available on Infoscience
July 30, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/240497
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés