Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Distributed top-k aggregation queries at large
 
research article

Distributed top-k aggregation queries at large

Neumann, Thomas
•
Bender, Matthias
•
Michel, Sebastian
Show more
2009
Distributed And Parallel Databases

Top-k query processing is a fundamental building block for efficient ranking in a large number of applications. Efficiency is a central issue, especially for distributed settings, when the data is spread across different nodes in a network. This paper introduces novel optimization methods for top-k aggregation queries in such distributed environments. The optimizations can be applied to all algorithms that fall into the frameworks of the prior TPUT and KLEE methods. The optimizations address three degrees of freedom: 1) hierarchically grouping input lists into top-k operator trees and optimizing the tree structure, 2) computing data-adaptive scan depths for different input sources, and 3) data-adaptive sampling of a small subset of input sources in scenarios with hundreds or thousands of query-relevant network nodes. All optimizations are based on a statistical cost model that utilizes local synopses, e.g., in the form of histograms, efficiently computed convolutions, and estimators based on order statistics. The paper presents comprehensive experiments, with three different real-life datasets and using the ns-2 network simulator for a packet-level simulation of a large Internet-style network.

  • Details
  • Metrics
Type
research article
DOI
10.1007/s10619-009-7041-z
Web of Science ID

WOS:000268190800002

Author(s)
Neumann, Thomas
Bender, Matthias
Michel, Sebastian
Schenkel, Ralf
Triantafillou, Peter
Weikum, Gerhard
Date Issued

2009

Published in
Distributed And Parallel Databases
Volume

26

Start page

3

End page

27

Subjects

Top-k

•

Distributed queries

•

Query optimization

•

Cost models

•

Relational Databases

•

Selection Queries

•

Optimization

•

Networks

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LSIR  
Available on Infoscience
November 30, 2010
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/60034
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés