Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Toward Massive Query Optimization in Large-Scale Distributed Stream Systems
 
conference paper

Toward Massive Query Optimization in Large-Scale Distributed Stream Systems

Zhou, Yongluan
•
Aberer, Karl  
•
Tan, Kian-Lee
2008
Middleware 2008, ACM/IFIP/USENIX 9th International Middleware Conference, Proceedings
Middleware 2008, ACM/IFIP/USENIX 9th International Middleware Conference

Existing distributed stream systems adopt a tightly-coupled communication paradigm and focus on fine-tuning of operator placements to achieve communication efficiency. This kind of approach is hard to scale (both to the nodes in the network and the users). In this paper, we propose a fundamentally different approach and present the design of a middleware for optimizing massive queries. Our approach takes the advantages of existing Publish/Subscribe systems (Pub/Sub) to achieve loosely-coupled communication and to “intelligently” exploit the sharing of communication among different queries. To fully exploit the capability of a Pub/Sub, we present a new query distribution algorithm, which can adaptively and rapidly (re)distribute the streaming queries at runtime to achieve both load balancing and low communication cost. Both the simulation studies and the prototype experiments executed on PlanetLab show the effectiveness of our techniques.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

fulltext.pdf

Access type

openaccess

Size

478.63 KB

Format

Adobe PDF

Checksum (MD5)

15123f19b8db58d45c0189b7389f92ce

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés