Minisymposium Presentation

With Exaflop systems already here, the application communities are eager to leverage these large, heterogeneous and complex systems. Tools to simplify the development, execution, and reuse of workflows are needed, to support the reproducibility, portability and ease of use of complex workflows. COMPSs is a task-based programming environment for distributed computing that supports the easy development of workflows. Thanks to features such as task requirements specification, fault tolerance and task cancellation, the workflows can adapt to heterogeneous infrastructures and change their behaviour at runtime. COMPSs also includes the capacity of recording details of the application’s execution as metadata (Workflow Provenance). With workflow provenance, one is able to share not only the workflow application (i.e. the source code) but also the actual details of the workflow run (i.e. the datasets used as inputs, the outputs generated as results, and details on the environment of the run). The Provenance is generated in COMPSs using a lightweight approach that does not introduce overhead to the workflow execution. This feature enables sharing FAIR workflows in public repositories, enabling their reproducibility. In addition, the COMPSs Reproducibility Service, a tool that enables the automatic re-execution of previously shared experiments, will be also described.