Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Scale-up Graph Processing in the Cloud: Challenges and Solutions
 
conference paper

Scale-up Graph Processing in the Cloud: Challenges and Solutions

Malicevic, Jasmina  
•
Roy, Amitabha  
•
Zwaenepoel, Willy  
2014
Proceedings of the Fourth International Workshop on Cloud Data and Platforms
CloudDP’14: Fourth International Workshop on Cloud Data and Platforms

Processing large graphs is an important part of the big-data problem. Recently a number of scale-up systems such as X-Stream, Graphchi and Turbograph have been proposed for processing large graphs using secondary storage on a single machine. The design and evaluation of these systems however have focused on physical machines. We expect that a natural evolution of such systems is to the cloud where a virtual machine would run the graph processing algorithm and access the graph from secondary storage remotely connected through the network. We evaluate a state of the art graph processing system called X-Stream in EC2 to identify challenges in this space. Our primary finding is that the network bandwidth between a virtual machine and remote storage becomes the limiter for performance. We show that this bottleneck can be somewhat alleviated through the use of VM local instance storage, network provisioning and compression.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1145/2592784.2592789
Author(s)
Malicevic, Jasmina  
Roy, Amitabha  
Zwaenepoel, Willy  
Date Issued

2014

Publisher

ACM New York, NY, USA ©2014

Published in
Proceedings of the Fourth International Workshop on Cloud Data and Platforms
ISBN of the book

978-1-4503-2714-5

Subjects

x-stream

•

large scale graph processing

•

cloud computing

•

storage

•

compression

Editorial or Peer reviewed

NON-REVIEWED

Written at

EPFL

EPFL units
LABOS  
Event nameEvent placeEvent date
CloudDP’14: Fourth International Workshop on Cloud Data and Platforms

Amsterdam, Netherlands

April 13-16,2014

Available on Infoscience
October 14, 2014
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/107408
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés