Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. FloDB: Unlocking Memory in Persistent Key-Value Stores
 
conference paper

FloDB: Unlocking Memory in Persistent Key-Value Stores

Balmau, Oana Maria  
•
Guerraoui, Rachid  
•
Trigonakis, Vasileios  
Show more
April 23, 2017
Proceedings of the Twelfth European Conference on Computer Systems
EuroSys

Log-structured merge (LSM) data stores enable to store and process large volumes of data while maintaining good performance. They mitigate the I/O bottleneck by absorbing updates in a memory layer and transferring them to the disk layer in sequential batches. Yet, the LSM architecture fundamentally requires elements to be in sorted order. As the amount of data in memory grows, maintaining this sorted order becomes increasingly costly. Contrary to intuition, existing LSM systems could actually lose throughput with larger memory components. In this paper, we introduce FloDB, an LSM memory component architecture which allows throughput to scale on modern multicore machines with ample memory sizes. The main idea underlying FloDB is essentially to bootstrap the traditional LSM architecture by adding a small in-memory buffer layer on top of the memory component. This buffer offers low-latency operations, masking the write latency of the sorted memory component. Integrating this buffer in the classic LSM memory component to obtain FloDB is not trivial and requires revisiting the algorithms of the user-facing LSM operations (search, update, scan). FloDB's two layers can be implemented with state-of-the-art, highly-concurrent data structures. This way, as we show in the paper, FloDB eliminates significant synchronization bottlenecks in classic LSM designs, while offering a rich LSM API. We implement FloDB as an extension of LevelDB, Google's popular LSM key-value store. We compare FloDB's performance to that of state-of-the-art LSMs. In short, FloDB's performance is up to one order of magnitude higher than that of the next best-performing competitor in a wide range of multi-threaded workloads.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3064176.3064193
Author(s)
Balmau, Oana Maria  
Guerraoui, Rachid  
Trigonakis, Vasileios  
Zablotchi, Mihail Igor  
Date Issued

2017-04-23

Published in
Proceedings of the Twelfth European Conference on Computer Systems
Total of pages

15

Subjects

key-value stores

•

log-structured merge

•

LSM

•

memory

•

persistence

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LABOS  
DCL  
Event nameEvent placeEvent date
EuroSys

Belgrade, Serbia

April 23-26, 2017

Available on Infoscience
July 13, 2018
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/147260
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés