Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Adaptive Recursive Query Optimization
 
conference paper

Adaptive Recursive Query Optimization

Herlihy, Anna  
•
Martres, Guillaume  
•
Ailamaki, Anastasia  
Show more
May 13, 2024
2024 IEEE 40th International Conference on Data Engineering (ICDE)
IEEE 40th International Conference on Data Engineering (ICDE)

Performance-critical industrial applications, including large-scale program, network, and distributed system analyses, are increasingly reliant on recursive queries for data analysis. Yet traditional relational algebra-based query optimization techniques do not scale well to recursive query processing due to the iterative nature of query evaluation, where relation cardinalities can change unpredictably during the course of a single query execution. To avoid error-prone cardinality estimation, adaptive query processing techniques use runtime information to inform query optimization, but these systems are not optimized for the specific needs of recursive query processing. In this paper, we introduce Adaptive Metaprogramming, an innovative technique that shifts recursive query optimization and code generation from compile-time to runtime using principled metaprogramming, enabling dynamic optimization and re-optimization before and after query execution has begun. We present a custom join-ordering optimization applicable at multiple stages during query compilation and execution. Through Carac, a custom Datalog engine, we evaluate the optimization potential of Adaptive Metaprogramming and show unoptimized recursive query execution time can be improved by three orders of magnitude and hand-optimized queries by 6x.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ICDE60146.2024.00035
Author(s)
Herlihy, Anna  

EPFL

Martres, Guillaume  
Ailamaki, Anastasia  

EPFL

Odersky, Martin  

EPFL

Date Issued

2024-05-13

Publisher

IEEE

Published in
2024 IEEE 40th International Conference on Data Engineering (ICDE)
ISBN of the book

979-8-3503-1715-2

Published in
2024 IEEE 40th International Conference on Data Engineering (ICDE)
Start page

368

End page

381

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
DIAS  
LAMP1  
Event nameEvent acronymEvent placeEvent date
IEEE 40th International Conference on Data Engineering (ICDE)

ICDE

Utrecht, Netherlands

2024-05-13 - 2024-05-17

FunderFunding(s)Grant NumberGrant URL

Swiss National Science Foundation

TMAG-2_209506/1

Available on Infoscience
January 22, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/243194
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés