Minisymposium Presentation
HPC Workflows Need More than HPC
Description
Over the last two decades, scientific workflow management systems (WMS) have enabled the execution of complex, multi-task applications on a variety of computational platforms, including today’s exascale systems. They ensure efficient execution of computational and data management tasks, adhering to their data and control dependencies. During workflow execution, WMSs monitor the execution of tasks, detect anomalies and failures, and deploy recovery mechanisms when needed. However, as workflows and cyberinfrastructure grow in scale, heterogeneity, and complexity, traditional WMS approaches face challenges in adaptability and resilience. This talk will provide examples of modern workflow applications from a variety of scientific domains, describe their challenges, and approaches to managing these execution in heterogeneous environments.