Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Scalable Far Memory: Balancing Faults and Evictions
 
conference paper

Scalable Far Memory: Balancing Faults and Evictions

Pan, Yueyang  
•
Lala, Yash
•
Unal, Musa  
Show more
October 12, 2025
Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles
ACM SIGOPS 31st Symposium on Operating Systems Principles

Page-based far memory systems transparently expand an application's memory capacity beyond a single machine without modifying application code. However, existing systems are tailored to scenarios with low application thread counts, and fail to scale on today's multi-core machines. This makes them unsuitable for data-intensive applications that both rely on far memory support and scale with increasing thread count. Our analysis reveals that this poor scalability stems from inefficient holistic coordination between page fault-in and eviction operations. As thread count increases, current systems encounter scalability bottlenecks in TLB shootdowns, page accounting, and memory allocation. This paper presents three design principles that address these scalability challenges and enable efficient memory offloading. These principles are always-asynchronous decoupling to handle eviction operations as asynchronously as possible, cross-batch pipelined execution to avoid idle waiting periods, and scalability prioritization to avoid synchronization overheads at high thread counts at the cost of eviction accuracy. We implement these principles in both the Linux kernel and a library OS. Our evaluation shows that this approach increases throughput for batch-processing applications by up to 4.2× and reduces 99th percentile latency for a latency-critical memcached application by 94.5%.

  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3731569.3764842
Author(s)
Pan, Yueyang  

École Polytechnique Fédérale de Lausanne

Lala, Yash

Yale University

Unal, Musa  

École Polytechnique Fédérale de Lausanne

Ren, Yujie  

École Polytechnique Fédérale de Lausanne

Lee, Seung-seob

Yale University

Bhattacharjee, Abhishek

Yale University

Khandelwal, Anurag

Yale University

Kashyap, Sanidhya  

École Polytechnique Fédérale de Lausanne

Date Issued

2025-10-12

Publisher

ACM

Publisher place

New York, NY, USA

Published in
Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles
ISBN of the book

979-8-4007-1870-0

Start page

136

End page

152

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
RS3LAB  
Event nameEvent acronymEvent placeEvent date
ACM SIGOPS 31st Symposium on Operating Systems Principles

SOSP '25

Seoul, Republic of Korea

2025-10-13 - 2025-10-16

FunderFunding(s)Grant NumberGrant URL

National Science Foundation

2047220,2112562,2147946,2444660

Available on Infoscience
October 8, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/254799
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés