Minisymposium Presentation

We introduce Autosubmit, a workflow management tool developed to support Earth Sciences research and operations in HPC environments. In constant development to follow the FAIR-by-design principles, Autosubmit enables seamless management, execution, and sharing of scientific experiments and workflows while ensuring that the resulting data is easily discoverable, accessible, and reproducible across diverse systems. It includes advanced automation features such as meta-scheduling, high-level configuration, and automatic retries, ensuring efficiency and reliability in complex climate modeling tasks. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application. Interoperability is key, with multi-platform support built in Python with a user-friendly GUI built in Javascript. The tool enables single-point access to workflows, ensuring that users can interact with a distributed, scalable database and manage tasks across multiple hosts. Customizable granularity and dynamic task aggregation optimize the makespan of the simulation, while integrated performance metrics offer insights for workflow optimization. Robustness is assured through scalable architecture, automatic recovery mechanisms, and built-in traceability, providing real-time monitoring of task status, logs, and workflow statistics. By supporting reproducibility, traceability, and collaboration, Autosubmit efficiently manages high-performance computing resources in the context of climate research.