Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Locality-Aware Request Distribution in Cluster-Based Network Servers
 
conference paper

Locality-Aware Request Distribution in Cluster-Based Network Servers

Pai, V.S.
•
Aron, M.
•
Banga, G.
Show more
1998
ASPLOS VIII: Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
Proceedings of the Eighth Symposium on Architectural Support for Programming Languages and Operating Systems

We consider cluster-based network servers in which a front-end directs incoming requests to one of a number of back-ends. Specifically, we consider content-based request distribution: the front-end uses the content requested, in addition to information about the load on the back-end nodes, to choose which back-end will handle this request. Content-based request distribution can improve locality in the back-ends’ main memory caches, increase secondary storage scalability by partitioning the server’s database, and provide the ability to employ back-end nodes that are specialized for certain types of requests. As a specific policy for content-based request distribution, we introduce a simple, practical strategy for locality-aware request distribution (LARD). With LARD, the front-end distributes incoming requests in a manner that achieves high locality in the back-ends’ main memory caches as well as load balancing. Locality is increased by dynamically subdividing the server’s working set over the back-ends. Trace-based simulation results and measurements on a prototype implementation demonstrate substantial performance improvements over state-of-the-art approaches that use only load information to distribute requests. On workloads with working sets that do not fit in a single server node’s main memory cache, the achieved throughput exceeds that of the state-of-the-art approach by a factor of two to four. With content-based distribution, incoming requests must be handed off to a back-end in a manner transparent to the client, after the front-end has inspected the content of the request. To this end, we introduce an efficient TCP handoflprotocol that can hand off an established TCP connection in a client-transparent manner.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

asplos98.ps.pdf

Access type

openaccess

Size

282.32 KB

Format

Adobe PDF

Checksum (MD5)

97b9ef5632ede66654218d030821cf75

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés