BSC project to enable dynamic and intelligent workflows in the European HPC ecosystem

17 March 2021
Coordinated by the Barcelona Supercomputing Center (BSC) and funded by the European High-Performance Computing Joint Undertaking (EuroHPC JU) and the participating states, the eFlows4HPC project will create a European workflow platform for the design of complex applications that integrate HPC processes, data analytics, and artificial intelligence. The project aims to demonstrate the novel technologies through use cases of three application Pillars with high industrial and social relevance: manufacturing, climate, and urgent computing for natural hazards.

Nowadays, developers lack tools that enable the development of complex workflows involving HPC simulation and modelling with data analytics and machine learning. With an overall funding of €7,6M, eFlows4HPC aims to deliver a workflow software stack and an additional set of services for the integration of HPC simulation and modelling with big data analytics and machine learning, applied in scientific and industrial domains.

“The eFlows4HPC workflow platform and software stack will enable the HPC resources in an efficient way with an emphasis on the accessibility and reusability of applications to reduce the time to solution”, said Rosa M. Badia, eFlows4HPC project coordinator at BSC. “BSC aims to deploy the whole eFlows4HPC software stack and the methodology in MareNostrum 5, one of the three pre-exascale systems to be deployed in Europe in the near future and to exploit it, among others, with the workflows developed in eFlows4HPC”, she added.

The project will leverage the COMPSs/PyCOMPSs technologies, developed by Rosa M. Badia’s Workflows and Distributed Computing group at BSC, which have been used in production in the different versions of MareNostrum to implement different scientific workflows and applications. BSC researchers will also be actively involved in the project’s Pillars of natural hazards and climate through its involvement in the ChEESE CoE and ESiWACE2 CoE respectively by engaging state-of-the-art seismic simulations and exploring commercial use of eFlows4HPC results.

Explore the eFlows4HPC channels:

About eFlows4HPC

eFlows4HPC is a European-funded project with a budget of €7.6M that started on 1 January 2021 and will last for three years. Coordinated by BSC (Spain), the project brings together a multidisciplinary consortium: CIMNE (Spain), FZJ (Germany), UPV (Spain), ATOS (France), DtoK (Italy), CMCC (Italy), INRIA (France), SISSA (Italy), PSNC (Poland), UMA (Spain), INGV (Italy), AWI (Germany), ETHZ (Switzerland), Siemens (Germany), NGI (Norway).

The eFlows4HPC project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 955558. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and Spain, Germany, France, Italy, Poland, Switzerland, Norway.