grid is 1 x 1
Sequential: 0.742305 secs (24.2488 GFlop/s)
Root waited for 4.435e-06 seconds
Populate root node: 0.0182029 secs
Spread from root: 0.0291814 secs
[MC,* ] AllGather: 0.00122848 secs (2500.64 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00284504 secs (1079.77 MB/s) for 128 x 3000 local matrix
Local gemm: 0.103166 secs (22.333 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000766 secs (4010.44 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00219776 secs (1397.79 MB/s) for 128 x 3000 local matrix
Local gemm: 0.104288 secs (22.0926 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.00078117 secs (3932.56 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00178131 secs (1724.57 MB/s) for 128 x 3000 local matrix
Local gemm: 0.100997 secs (22.8126 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000814015 secs (3773.89 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00181042 secs (1696.84 MB/s) for 128 x 3000 local matrix
Local gemm: 0.101475 secs (22.7052 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000837125 secs (3669.7 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.00181403 secs (1693.47 MB/s) for 128 x 3000 local matrix
Local gemm: 0.100934 secs (22.8269 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000867521 secs (3541.12 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.0018028 secs (1704.01 MB/s) for 128 x 3000 local matrix
Local gemm: 0.102812 secs (22.4099 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000800583 secs (3837.2 MB/s) for3000 x 128 local matrix
[* ,MR] AllGather: 0.0019305 secs (1591.3 MB/s) for 128 x 3000 local matrix
Local gemm: 0.103948 secs (22.1648 GFlop/s) for 3000 x 3000 x 128 product
[MC,* ] AllGather: 0.000628277 secs (3972.77 MB/s) for3000 x 104 local matrix
[* ,MR] AllGather: 0.00155073 secs (1609.56 MB/s) for 104 x 3000 local matrix
Local gemm: 0.0796427 secs (23.505 GFlop/s) for 3000 x 3000 x 104 product
Distributed Gemm: 0.831183 secs
Gathered to root: 0.0257995 secs