Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. AiiDA 1.0, a scalable computational infrastructure for automated reproducible workflows and data provenance
 
Loading...
Thumbnail Image
research article

AiiDA 1.0, a scalable computational infrastructure for automated reproducible workflows and data provenance

Huber, Sebastiaan P.  
•
Zoupanos, Spyros  
•
Uhrin, Martin  
Show more
September 8, 2020
Scientific Data

The ever-growing availability of computing power and the sustained development of advanced computational methods have contributed much to recent scientific progress. These developments present new challenges driven by the sheer amount of calculations and data to manage. Next-generation exascale supercomputers will harden these challenges, such that automated and scalable solutions become crucial. In recent years, we have been developing AiiDA (aiida.net), a robust open-source high-throughput infrastructure addressing the challenges arising from the needs of automated workflow management and data provenance recording. Here, we introduce developments and capabilities required to reach sustained performance, with AiiDA supporting throughputs of tens of thousands processes/hour, while automatically preserving and storing the full data provenance in a relational database making it queryable and traversable, thus enabling high-performance data analytics. AiiDA's workflow language provides advanced automation, error handling features and a flexible plugin model to allow interfacing with external simulation software. The associated plugin registry enables seamless sharing of extensions, empowering a vibrant user community dedicated to making simulations more robust, user-friendly and reproducible.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

s41597-020-00638-4.pdf

Type

Publisher's Version

Access type

openaccess

License Condition

CC BY

Size

1.77 MB

Format

Adobe PDF

Checksum (MD5)

9aa047fb25b3ca504f5bc18ab380e094

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés