Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Scale-up Graph Processing in the Cloud: Challenges and Solutions
 
conference paper

Scale-up Graph Processing in the Cloud: Challenges and Solutions

Malicevic, Jasmina  
•
Roy, Amitabha  
•
Zwaenepoel, Willy  
2014
Proceedings of the Fourth International Workshop on Cloud Data and Platforms
CloudDP’14: Fourth International Workshop on Cloud Data and Platforms

Processing large graphs is an important part of the big-data problem. Recently a number of scale-up systems such as X-Stream, Graphchi and Turbograph have been proposed for processing large graphs using secondary storage on a single machine. The design and evaluation of these systems however have focused on physical machines. We expect that a natural evolution of such systems is to the cloud where a virtual machine would run the graph processing algorithm and access the graph from secondary storage remotely connected through the network. We evaluate a state of the art graph processing system called X-Stream in EC2 to identify challenges in this space. Our primary finding is that the network bandwidth between a virtual machine and remote storage becomes the limiter for performance. We show that this bottleneck can be somewhat alleviated through the use of VM local instance storage, network provisioning and compression.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Scale_up graph processing in the cloud_updated.pdf

Access type

openaccess

Size

571.7 KB

Format

Adobe PDF

Checksum (MD5)

f6754552355511981fbe0676ac591cec

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés