Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement
 
conference paper

Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement

Psaroudakis, Iraklis  
•
Scheuer, Tobias
•
May, Norman
Show more
2015
The Proceedings of the VLDB Endowment
41st International Conference on Very Large Data Bases

Main-memory column-stores are called to efficiently use modern non-uniform memory access (NUMA) architectures to service concurrent clients on big data. The efficient usage of NUMA architectures depends on the data placement and scheduling strategy of the column-store. Most column-stores choose a static strategy that involves partitioning all data across the NUMA architecture, and employing a stealing-based task scheduler. In this paper, we implement different strategies for data placement and task scheduling for the case of concurrent scans. We compare these strategies with an extensive sensitivity analysis. Our most significant findings include that unnecessary partitioning can hurt throughput by up to 70%, and that stealing memory-intensive tasks can hurt throughput by up to 58%. Based on our analysis, we envision a design that adapts the data placement and task scheduling strategy to the workload.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.14778/2824032.2824043
Author(s)
Psaroudakis, Iraklis  
Scheuer, Tobias
May, Norman
Sellami, Abdelkader
Ailamaki, Anastasia  
Date Issued

2015

Published in
The Proceedings of the VLDB Endowment
Volume

8

Issue

12

Start page

1442

End page

1453

URL

URL

http://www.vldb.org/pvldb/vol8.html
Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
DIAS  
Event nameEvent placeEvent date
41st International Conference on Very Large Data Bases

Kohala Coast, Hawaii, USA

August 31 - September 4, 2015

Available on Infoscience
August 19, 2015
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/117144
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés