Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Shore-MT: A Scalable Storage Manager for the Multicore Era
 
conference paper

Shore-MT: A Scalable Storage Manager for the Multicore Era

Johnson, Ryan
•
Pandis, Ippokratis
•
Hardavellas, Nikos
Show more
2009
Proceedings of the 12th International Conference on Extending Database Technology
12th International Conference on Extending Database Technology

Database storage managers have long been able to efficiently handle multiple concurrent requests. Until recently, however, a computer contained only a few single-core CPUs, and therefore only a few transactions could simultaneously access the storage manager's internal structures. This allowed storage managers to use non-scalable approaches without any penalty. With the arrival of multicore chips, however, this situation is rapidly changing. More and more threads can run in parallel, stressing the internal scalability of the storage manager. Systems optimized for high performance at a limited number of cores are not assured similarly high performance at a higher core count, because unanticipated scalability obstacles arise. We benchmark four popular open-source storage managers (Shore, BerkeleyDB, MySQL, and PostgreSQL) on a modern multicore machine, and find that they all suffer in terms of scalability. We briefly examine the bottlenecks in the various storage engines. We then present Shore-MT, a multithreaded and highly scalable version of Shore which we developed by identifying and successively removing internal bottlenecks. When compared to other DBMS, Shore-MT exhibits superior scalability and 2--4 times higher absolute throughput than its peers. We also show that designers should favor scalability to single-thread performance, and highlight important principles for writing scalable storage engines, illustrated with real examples from the development of Shore-MT.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1145/1516360.1516365
Author(s)
Johnson, Ryan
Pandis, Ippokratis
Hardavellas, Nikos
Ailamaki, Anastasia  
Falsafi, Babak
Date Issued

2009

Publisher

ACM

Published in
Proceedings of the 12th International Conference on Extending Database Technology
Volume

360

Start page

24

End page

35

Note

SYSTEMS PUBLICATION_SHORE_MT

URL

URL

http://www.math.spbu.ru/edbticdt/
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
DIAS  
Event nameEvent placeEvent date
12th International Conference on Extending Database Technology

Saint Petersburg, Russia

March 24-26

Available on Infoscience
June 23, 2009
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/40805
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés