grid is 1 x 2
Sequential: 1.47503 secs (12.2032 GFlop/s)
Root waited for 1.7567e-05 seconds
Populate root node: 0.0171826 secs
Spread from root: 0.0591556 secs
[MC,* ] AllGather: 0.00351946 secs (872.862 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00180345 secs (851.702 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0958235 secs (12.0221 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00317932 secs (966.245 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00142025 secs (1081.5 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0954154 secs (12.0735 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.0027729 secs (1107.87 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00142313 secs (1079.31 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0951477 secs (12.1075 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00277279 secs (1107.91 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00141677 secs (1084.16 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0952331 secs (12.0966 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00271155 secs (1132.93 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00155411 secs (988.348 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0959918 secs (12.001 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00293757 secs (1045.76 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00145406 secs (1056.35 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0962825 secs (11.9648 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00284468 secs (1079.91 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00147096 secs (1044.22 MB/s) for 128 x 1500 local matrix
Local gemm: 0.0956225 secs (12.0474 GFlop/s) for 3000 x 1500 x 128 product
[MC,* ] AllGather: 0.00227361 secs (1097.81 MB/s) for3000 x 104 local matrix
[* ,MR] AllGather: 0.00120648 secs (1034.42 MB/s) for 104 x 1500 local matrix
Local gemm: 0.0773947 secs (12.0938 GFlop/s) for 3000 x 1500 x 104 product
Distributed Gemm: 0.792362 secs
Gathered to root: 0.0723413 secs