Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. SQPR: Stream query planning with reuse
 
conference paper

SQPR: Stream query planning with reuse

Kalyvianaki, Evangelia
•
Wiesemann, Wolfram
•
Vu, Quang Hieu
Show more
2011
2011 IEEE 27th International Conference on Data Engineering
2011 IEEE International Conference on Data Engineering (ICDE 2011)

When users submit new queries to a distributed stream processing system (DSPS), a query planner must allocate physical resources, such as CPU cores, memory and network bandwidth, from a set of hosts to queries. Allocation decisions must provide the correct mix of resources required by queries, while achieving an efficient overall allocation to scale in the number of admitted queries. By exploiting overlap between queries and reusing partial results, a query planner can conserve resources but has to carry out more complex planning decisions. In this paper, we describe SQPR, a query planner that targets DSPSs in data centre environments with heterogeneous resources. SQPR models query admission, allocation and reuse as a single constrained optimisation problem and solves an approximate version to achieve scalability. It prevents individual resources from becoming bottlenecks by re-planning past allocation decisions and supports different allocation objectives. As our experimental evaluation in comparison with a state-of-the-art planner shows SQPR makes efficient resource allocation decisions, even with a high utilisation of resources, with acceptable overheads.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ICDE.2011.5767851
Author(s)
Kalyvianaki, Evangelia
Wiesemann, Wolfram
Vu, Quang Hieu
Kuhn, Daniel  
Pietzuch, Peter
Date Issued

2011

Publisher

IEEE

Published in
2011 IEEE 27th International Conference on Data Engineering
ISBN of the book

978-1-4244-8959-6

Start page

840

End page

851

Subjects

Bandwidth

•

Digital signal processing

•

Load modeling

•

Optimization

•

Planning

•

Relays

•

Resource management

URL

URL

http://ieeexplore.ieee.org/xpl/abstractKeywords.jsp?arnumber=5767851
Editorial or Peer reviewed

NON-REVIEWED

Written at

OTHER

EPFL units
RAO  
Event nameEvent placeEvent date
2011 IEEE International Conference on Data Engineering (ICDE 2011)

Hannover, Germany

11-16 04 2011

Available on Infoscience
January 29, 2014
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/100236
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés