Workflows

COMPSs Matrix Multiplication resourceUsage profiling example.

MN5 MSIZE=20 BSIZE=768 7 Nodes (6 workers) (--num_nodes=7 --worker_in_master_cpus=0).

• Total number of tasks: 20^3 = 8000
• Maximum code parallelism: 20^2 = 400
• Total cores: 112*6 = 672
• Maximum utilisation: 400 / 112 = 3,57 Nodes

Overall stats from "pycompss inspect":

│ └── overall 
│ ├── matmul_tasks 
│ │ └── multiply 
│ │ ├── maxTime = 91,111 ms 
│ │ ├── executions = 8,000 
│ │ ├── avgTime = 84,839 ms 
│ │ └── minTime = 79,278 ms
...

Lysozyme in water full COMPSs application run at MareNostrum IV, using full dataset with two workers

Sample workflow template that combines simulations with data analytics. It is not a real workflow, but it mimics this type of workflows. It illustrates how COMPSs invokes binaries. It can be extended to invoke MPI applications.