Minisymposium Presentation

With the increase in simulation resolution, climate and weather models are now potentially outputting petabytes of data so that the largest projects now require complex workflows tightly integrating preprocessing, postprocessing, potential downstream applications and archiving. We present here Sirocco, a climate and weather workflow tool currently under development written in python in collaboration between ETHZ, CSCS and PSI. It builds on top of the low-level generic workflow tool library AiiDA and the AiiDA-workgraph layer. Sirocco defines a user-friendly yaml based configuration format describing the workflow graph in which, equally to tasks, data nodesnaturally become first class citizens by using AiiDA objects. The graph is first generated as an internal representation, then translated to an aiida-workgraph object and finally orchestrated by AiiDA. Sitting on top of AiiDA, Sirocco can naturally target different HPC systems. Still the current effort focuses on the Alps system and the ICON model with the aim of not only making complex workflows possible but also make the ICON users life overall easier on Alps by integrating specifics of ICON and the advanced HPC management of Alps involving technologies like user environments and FirecREST.