Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. COMMUNICATION LOWER BOUNDS AND OPTIMAL ALGORITHMS FOR MULTIPLE TENSOR-TIMES-MATRIX COMPUTATION
 
research article

COMMUNICATION LOWER BOUNDS AND OPTIMAL ALGORITHMS FOR MULTIPLE TENSOR-TIMES-MATRIX COMPUTATION

AL Daas, Hussam
•
Ballard, Grey
•
Grigori, Laura  
Show more
January 1, 2024
Siam Journal On Matrix Analysis And Applications

Multiple tensor-times-matrix (Multi-TTM) is a key computation in algorithms for computing and operating with the Tucker tensor decomposition, which is frequently used in multidimensional data analysis. We establish communication lower bounds that determine how much data movement is required (under mild conditions) to perform the Multi-TTM computation in parallel. The crux of the proof relies on analytically solving a constrained, nonlinear optimization problem. We also present a parallel algorithm to perform this computation that organizes the processors into a logical grid with twice as many modes as the input tensor. We show that, with correct choices of grid dimensions, the communication cost of the algorithm attains the lower bounds and is therefore communication optimal. Finally, we show that our algorithm can significantly reduce communication compared to the straightforward approach of expressing the computation as a sequence of tensor-times-matrix operations when the input and output tensors vary greatly in size.

  • Details
  • Metrics
Type
research article
DOI
10.1137/22M1510443
Web of Science ID

WOS:001174947800013

Author(s)
AL Daas, Hussam
Ballard, Grey
Grigori, Laura  
Kumar, Suraj
Rouse, Kathryn
Date Issued

2024-01-01

Publisher

Siam Publications

Published in
Siam Journal On Matrix Analysis And Applications
Volume

45

Issue

1

Start page

450

End page

477

Subjects

Physical Sciences

•

Communication Lower Bounds

•

Multi-Ttm

•

Tensor Computations

•

Parallel Algo- Rithms

•

Hbl-Inequalities

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
HPNALGS  
FunderGrant Number

National Science Foundation

CCF-1942892

US Department of Energy, Office of Science, Advanced Scientific Computing Research program

DE-SC-0023296

European Research Council (ERC) under the European Union

810367

Available on Infoscience
April 3, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/206835
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés