Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Skadi: Building a Distributed Runtime for Data Systems in Disaggregated Data Centers
 
conference paper

Skadi: Building a Distributed Runtime for Data Systems in Disaggregated Data Centers

Hu, Cunchen
•
Wang, Chenxi
•
Wang, Sa
Show more
January 1, 2023
Proceedings Of The 19Th Workshop On Hot Topics In Operating Systems, Hotos 2023
19th ACM Workshop on Hot Topics in Operating Systems (HotOS)

Data-intensive systems are the backbone of today's computing and are responsible for shaping data centers. Over the years, cloud providers have relied on three principles to maintain cost-effective data systems: use disaggregation to decouple scaling, use domain-specific computing to battle waning laws, and use serverless to lower costs. Although they work well individually, they fail to work in harmony: an issue amplified by emerging data system workloads. In this paper, we envision a distributed runtime to mitigate current shortcomings. The distributed runtime has a tiered access layer exposing declarative APIs, underpinned by a stateful serverless runtime with a distributed task execution model. It will be the narrow waist between data systems and hardware. Users are oblivious to data location, concurrency, disaggregation style, or even the hardware to do the computing. The underlying stateful serverless runtime transparently evolves with novel data-center architectures, such as disaggregation and tightly-coupled clusters. We prototype Skadi to showcase that the distributed runtime is practical.

  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3593856.3595897
Web of Science ID

WOS:001119203300012

Author(s)
Hu, Cunchen
Wang, Chenxi
Wang, Sa
Sun, Ninghui
Bao, Yungang
Zhao, Jieru
Kashyap, Sanidhya  
Zuo, Pengfei
Chen, Xusheng
Xu, Liangliang
Show more
Corporate authors
ACM
Date Issued

2023-01-01

Publisher

Assoc Computing Machinery

Publisher place

New York

Published in
Proceedings Of The 19Th Workshop On Hot Topics In Operating Systems, Hotos 2023
ISBN of the book

979-8-4007-0195-5

Start page

94

End page

102

Subjects

Technology

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
RS3LAB  
Event nameEvent placeEvent date
19th ACM Workshop on Hot Topics in Operating Systems (HotOS)

Providence, RI

JUN 22-24, 2023

FunderGrant Number

National Key Research and Development Plan of China

2022YFB4500400

Strategic Priority Research Program of Chinese Academy of Sciences

XDA0320000

National Natural Science Foundation of China

62090022

Show more
Available on Infoscience
February 20, 2024
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/204732
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés