Workflows

COMPSs Matrix Multiplication resourceUsage profiling example.

MN5 MSIZE=20 BSIZE=768 7 Nodes (6 workers) (--num_nodes=7 --worker_in_master_cpus=0).

• Total number of tasks: 20^3 = 8000
• Maximum code parallelism: 20^2 = 400
• Total cores: 112*6 = 672
• Maximum utilisation: 400 / 112 = 3,57 Nodes

Overall stats from "pycompss inspect":

│ └── overall 
│ ├── matmul_tasks 
│ │ └── multiply 
│ │ ├── maxTime = 91,111 ms 
│ │ ├── executions = 8,000 
│ │ ├── avgTime = 84,839 ms 
│ │ └── minTime = 79,278 ms
...

Application that perform the multiplication between matrices. In this experiment, a new profiling visualization is available, showing the resource usage such as CPU, memory, data read and written to disk, and data sent and received over the network.

Lysozyme in water full COMPSs application. Added new WRROC profile: Provenance Run Crate

Application that perform the multiplication between matrices.

Name: PhysioNet kNN Kfold Contact Person: [email protected] Access Level: public License Agreement: Apache2 Platform: COMPSs Machine: MareNostrum5

Kfold to evaluate kNN accuracy on PhysioNet dataset (https://b2drop.bsc.es/index.php/s/8Q8MefXX2rrzaWs). This application used dislib-0.9.0

Name: PhysioNet CascadeCSVM Kfold Contact Person: [email protected] Access Level: public License Agreement: Apache2 Platform: COMPSs Machine: MareNostrum5

Kfold to evaluate CascadeCSVM accuracy on PhysioNet dataset (https://b2drop.bsc.es/index.php/s/8Q8MefXX2rrzaWs). This application used dislib-0.9.0

Name: PhysioNet RF Kfold Contact Person: [email protected] Access Level: public License Agreement: Apache2 Platform: COMPSs Machine: MareNostrum5

Kfold to evaluate RandomForest accuracy on PhysioNet dataset (https://b2drop.bsc.es/index.php/s/8Q8MefXX2rrzaWs). This application used dislib-0.9.0

Name: Random Forest Contact Person: [email protected] Access Level: public License Agreement: Apache2 Platform: COMPSs Machine: MareNostrum4 This is an example of Random Forest algorithm from dislib. To show the usage, the code generates a synthetical input matrix. The results are printed by screen. This application used dislib-0.9.0

Name: GridSearchCV Contact Person: [email protected] Access Level: public License Agreement: Apache2 Platform: COMPSs Machine: MareNostrum5

GridSearch of kNN algorithm for the iris.csv dataset (https://gist.githubusercontent.com/netj/8836201/raw/6f9306ad21398ea43cba4f7d537619d0e07d5ae3/iris.csv). This application used dislib-0.9.0