Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Transparent Multicore Scaling of Single-threaded Network Functions
 
conference paper

Transparent Multicore Scaling of Single-threaded Network Functions

Yan, Lei  
•
Pan, Yueyang  
•
Zhou, Diyu  
Show more
April 22, 2024
EuroSys '24: Proceedings of the Nineteenth European Conference on Computer Systems
19th European Conference on Computer Systems

This paper presents NFOS, a programming model, runtime, and profiler for productively developing software network functions (NFs) that scale on multicore machines. Writing shared-state concurrent systems that are both correct and scalable is still a serious challenge, which is why NFOS insulates developers from writing concurrent code. In the NFOS programming model, developers write their NF as a sequential program, concerning themselves with the NF logic instead of parallelism and shared-state synchronization. The NFOS abstractions are both familiar to the NF programmer and convey to the NFOS runtime crucial information that enables it to correctly execute the NF's packet processing in parallel on multiple cores. Paired with NFOS's domain-specific concurrent data structures, this parallelism scales the NF transparently, obviating the need for developers to write concurrent code. We show that serial, stateful NFs run atop NFOS achieve scalability on par with their concurrent, hand-optimized counterparts in Cisco VPP [8]. Some scalability bottlenecks are inherent to the NF's semantics, and thus cannot be resolved while preserving those semantics. NFOS identifies the root causes of such bottlenecks and provides scalability recipes that guide developers in relaxing the NF's semantics to eliminate these bottlenecks. We present examples where such NFOS-guided relaxation of NF semantics further improves scalability by 2x to 91x.

  • Details
  • Metrics
Type
conference paper
DOI
10.1145/3627703.3629591
Web of Science ID

WOS:001482612800067

Author(s)
Yan, Lei  

École Polytechnique Fédérale de Lausanne

Pan, Yueyang  

École Polytechnique Fédérale de Lausanne

Zhou, Diyu  

École Polytechnique Fédérale de Lausanne

Candea, George  

École Polytechnique Fédérale de Lausanne

Kashyap, Sanidhya  

École Polytechnique Fédérale de Lausanne

Date Issued

2024-04-22

Publisher

Assoc Computing Machinery

Publisher place

New York

Published in
EuroSys '24: Proceedings of the Nineteenth European Conference on Computer Systems
ISBN of the book

979-8-4007-0437-6

Start page

1142

End page

1159

Subjects

Network functions

•

Transparent scaling

•

Concurrency

•

Performance profiling and debugging

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
DSLAB  
RS3LAB  
Event nameEvent acronymEvent placeEvent date
19th European Conference on Computer Systems

EuroSys 2024

Athens, Greece

2024-04-22 - 2024-04-25

Available on Infoscience
June 9, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/251163
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés