Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems
 
research article

Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems

Besta, Maciej
•
Fischer, Marc
•
Kalavri, Vasiliki
Show more
June 1, 2023
Ieee Transactions On Parallel And Distributed Systems

Graphs processing has become an important part of various areas of computing, including machine learning, medical applications, social network analysis, computational sciences, and others. A growing amount of the associated graph processing workloads are dynamic, with millions of edges added or removed per second. Graph streaming frameworks are specifically crafted to enable the processing of such highly dynamic workloads. Recent years have seen the development of many such frameworks. However, they differ in their general architectures (with key details such as the support for the concurrent execution of graph updates and queries, or the incorporated graph data organization), the types of updates and workloads allowed, and many others. To facilitate the understanding of this growing field, we provide the first analysis and taxonomy of dynamic and streaming graph processing. We focus on identifying the fundamental system designs and on understanding their support for concurrency, and for different graph updates as well as analytics workloads. We also crystallize the meaning of different concepts associated with streaming graph processing, such as dynamic, temporal, online, and time-evolving graphs, edge-centric processing, models for the maintenance of updates, and graph databases. Moreover, we provide a bridge with the very rich landscape of graph streaming theory by giving a broad overview of recent theoretical related advances, and by discussing which graph streaming models and settings could be helpful in developing more powerful streaming frameworks and designs. We also outline graph streaming workloads and research challenges.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TPDS.2021.3131677
Web of Science ID

WOS:000992499400014

Author(s)
Besta, Maciej
•
Fischer, Marc
•
Kalavri, Vasiliki
•
Kapralov, Michael  
•
Hoefler, Torsten
Date Issued

2023-06-01

Published in
Ieee Transactions On Parallel And Distributed Systems
Volume

34

Issue

6

Start page

1860

End page

1876

Subjects

Computer Science, Theory & Methods

•

Engineering, Electrical & Electronic

•

Computer Science

•

Engineering

•

heuristic algorithms

•

taxonomy

•

analytical models

•

data models

•

computational modeling

•

distributed databases

•

social networking (online)

•

streaming graphs

•

dynamic graphs

•

evolving graphs

•

streaming graph processing

•

dynamic graph processing

•

evolving graph processing

•

online graph processing

•

graph streaming frameworks

•

graph databases

Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
THL4  
Available on Infoscience
July 3, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/198718
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés