Introduction

On this page, all experimental data can be found and downloaded from here.

MNIST

Download csv here

NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP NCS2 FP16 nan 1 3.160000 1.615700 316.199000 618.928000 0.211537 0.414063 97.950000 nan 0.530000 1.200000 1.548000 0.000669 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.003712 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 2 5.080000 1.972300 393.474000 1014.050000 0.263234 0.678399 97.950000 nan 0.530000 1.200000 1.628000 0.001338 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.004531 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 4 8.870000 2.670930 450.727000 1497.600000 0.301536 1.001894 97.950000 nan 0.530000 1.200000 1.670000 0.002676 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.006136 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 8 16.440000 4.186840 486.767000 1910.750000 0.325647 1.278292 97.950000 nan 0.530000 1.200000 1.699000 0.005352 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.009619 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 16 31.790000 7.118470 503.270000 2247.670000 0.336688 1.503691 97.950000 nan 0.530000 1.200000 1.711000 0.010704 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.016354 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 32 62.050000 12.945300 515.686000 2471.930000 0.344994 1.653721 97.950000 nan 0.530000 1.200000 1.735000 0.021408 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.029741 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 64 123.000000 24.005800 520.318000 2666.020000 0.348093 1.783567 97.950000 nan 0.530000 1.200000 1.719000 0.042816 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.055152 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 128 243.200000 45.776600 526.317000 2796.190000 0.352106 1.870651 97.950000 nan 0.530000 1.200000 1.764000 0.085632 12.500000 l3 0.500000 12.800000 0.000700 NCS2_FP16_12.50%_MLP 0.105170 FP16_NCS2 NCS2_FP16_MLP_12.5
MLP NCS2 FP16 nan 1 3.230000 1.666390 309.240000 600.099000 0.575805 1.117384 98.490000 nan 0.530000 1.200000 1.620000 0.001862 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.003828 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 2 5.240000 2.124410 381.922000 941.439000 0.711139 1.752959 98.490000 nan 0.530000 1.200000 1.710000 0.003724 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.004881 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 4 9.330000 3.079350 428.685000 1298.980000 0.798211 2.418701 98.490000 nan 0.530000 1.200000 1.744000 0.007448 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.007075 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 8 17.480000 5.069050 457.574000 1578.210000 0.852003 2.938627 98.490000 nan 0.530000 1.200000 1.779000 0.014896 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.011646 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 16 33.600000 8.648090 476.212000 1850.120000 0.886707 3.444923 98.490000 nan 0.530000 1.200000 1.816000 0.029792 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.019869 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 32 66.100000 16.109900 484.102000 1986.350000 0.901398 3.698584 98.490000 nan 0.530000 1.200000 1.835000 0.059584 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.037012 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 64 129.490000 30.168500 494.267000 2121.420000 0.920325 3.950084 98.490000 nan 0.530000 1.200000 1.837000 0.119168 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.069311 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 128 256.770000 58.250700 498.496000 2197.400000 0.928200 4.091559 98.490000 nan 0.530000 1.200000 1.877000 0.238336 25.000000 l3 0.500000 12.800000 0.001900 NCS2_FP16_25%_MLP 0.133828 FP16_NCS2 NCS2_FP16_MLP_25.0
MLP NCS2 FP16 nan 1 3.530000 1.936630 283.339000 516.360000 1.649033 3.005215 98.750000 nan 0.530000 1.200000 1.809000 0.005820 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.004449 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 2 5.930000 2.762170 337.009000 724.068000 1.961392 4.214076 98.750000 nan 0.530000 1.200000 1.838000 0.011640 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.006346 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 4 10.650000 4.338730 375.488000 921.928000 2.185340 5.365621 98.750000 nan 0.530000 1.200000 1.864000 0.023280 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.009968 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 8 20.030000 7.235350 399.446000 1105.680000 2.324776 6.435058 98.750000 nan 0.530000 1.200000 1.933000 0.046560 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.016623 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 16 38.830000 13.331400 412.007000 1200.170000 2.397881 6.984989 98.750000 nan 0.530000 1.200000 1.926000 0.093120 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.030628 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 32 75.780000 24.590500 422.289000 1301.310000 2.457722 7.573624 98.750000 nan 0.530000 1.200000 1.956000 0.186240 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.056496 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 64 149.820000 47.951400 427.188000 1334.680000 2.486234 7.767838 98.750000 nan 0.530000 1.200000 1.985000 0.372480 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.110166 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 128 297.840000 93.365400 429.768000 1370.960000 2.501250 7.978987 98.750000 nan 0.530000 1.200000 2.010000 0.744960 50.000000 l3 0.500000 12.800000 0.005820 NCS2_FP16_50%_MLP 0.214503 FP16_NCS2 NCS2_FP16_MLP_50.0
MLP NCS2 FP16 nan 1 4.570000 2.892570 218.893000 345.713000 4.384208 6.924286 98.860000 nan 0.530000 1.200000 1.794000 0.020029 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.006646 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 2 8.090000 4.684590 247.308000 426.931000 4.953332 8.551001 98.860000 nan 0.530000 1.200000 1.949000 0.040058 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.010763 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 4 14.840000 8.118210 269.491000 492.719000 5.397635 9.868669 98.860000 nan 0.530000 1.200000 1.946000 0.080116 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.018651 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 8 28.300000 14.803800 282.686000 540.400000 5.661918 10.823672 98.860000 nan 0.530000 1.200000 2.084000 0.160232 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.034011 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 16 54.640000 27.493500 292.848000 581.956000 5.865453 11.655997 98.860000 nan 0.530000 1.200000 2.136000 0.320464 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.063165 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 32 107.390000 53.057200 297.970000 603.122000 5.968041 12.079931 98.860000 nan 0.530000 1.200000 2.135000 0.640928 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.121897 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 64 212.260000 104.435000 301.514000 612.823000 6.039024 12.274232 98.860000 nan 0.530000 1.200000 2.186000 1.281856 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.239935 FP16_NCS2 NCS2_FP16_MLP_100.0
MLP NCS2 FP16 nan 128 421.840000 206.007000 303.434000 621.337000 6.077480 12.444759 98.860000 nan 0.530000 1.200000 2.212000 2.563712 100.000000 l3 0.500000 12.800000 0.020000 NCS2_FP16_100%_MLP 0.473292 FP16_NCS2 NCS2_FP16_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP TX2-maxn FP16 maxn 1 0.430000 0.202777 2343.250000 5325.370000 1.567634 3.562673 97.150000 nan 1.800000 5.700000 8.873000 0.000669 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000466 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 2 0.550000 0.204525 3696.750000 10723.400000 2.473126 7.173955 97.150000 nan 1.800000 5.700000 8.940000 0.001338 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000470 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 4 0.790000 0.213211 5251.280000 21046.100000 3.513106 14.079841 97.150000 nan 1.800000 5.700000 9.075000 0.002676 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000490 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 8 1.280000 0.228156 6606.450000 40997.700000 4.419715 27.427461 97.150000 nan 1.800000 5.700000 9.354000 0.005352 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000524 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 16 1.880000 0.194656 7937.980000 97181.400000 5.310509 65.014357 97.150000 nan 1.800000 5.700000 10.042000 0.010704 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000447 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 32 4.220000 0.362031 8533.330000 175553.000000 5.708798 117.444957 97.150000 nan 1.800000 5.700000 9.901000 0.021408 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.000832 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 64 7.920000 0.507188 8462.810000 231203.000000 5.661620 154.674807 97.150000 nan 1.800000 5.700000 10.323000 0.042816 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.001165 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 128 14.780000 0.625500 8827.590000 297674.000000 5.905658 199.143906 97.150000 nan 1.800000 5.700000 11.000000 0.085632 12.500000 l3 1.330000 59.700000 0.000700 TX2-maxn_FP16_12.50%_MLP 0.001437 FP16_TX2-maxn TX2-maxn_FP16_MLP_12.5
MLP TX2-maxn FP16 maxn 1 0.440000 0.205719 2327.270000 5310.180000 4.333377 9.887555 97.440000 nan 1.800000 5.700000 10.366000 0.001862 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000473 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 2 0.560000 0.210930 3631.210000 10447.200000 6.761313 19.452686 97.440000 nan 1.800000 5.700000 10.331000 0.003724 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000485 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 4 0.790000 0.216309 5224.490000 20955.700000 9.728000 39.019513 97.440000 nan 1.800000 5.700000 10.526000 0.007448 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000497 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 8 1.300000 0.225516 6606.450000 33517.700000 12.301210 62.409957 97.440000 nan 1.800000 5.700000 11.468000 0.014896 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000518 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 16 2.230000 0.251937 7641.790000 65489.900000 14.229013 121.942194 97.440000 nan 1.800000 5.700000 11.606000 0.029792 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000579 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 32 4.310000 0.406750 8325.200000 124711.000000 15.501522 232.211882 97.440000 nan 1.800000 5.700000 11.583000 0.059584 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.000934 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 64 7.930000 0.609187 8393.440000 168504.000000 15.628585 313.754448 97.440000 nan 1.800000 5.700000 11.542000 0.119168 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.001400 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 128 15.160000 0.726750 8827.590000 252155.000000 16.436973 469.512610 97.440000 nan 1.800000 5.700000 11.169000 0.238336 25.000000 l3 1.330000 59.700000 0.001900 TX2-maxn_FP16_25%_MLP 0.001670 FP16_TX2-maxn TX2-maxn_FP16_MLP_25.0
MLP TX2-maxn FP16 maxn 1 0.550000 0.294436 1831.840000 3479.360000 10.661309 20.249875 97.460000 nan 1.800000 5.700000 11.935000 0.005820 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.000676 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 2 0.680000 0.306961 3002.930000 6664.670000 17.477053 38.788379 97.460000 nan 1.800000 5.700000 11.910000 0.011640 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.000705 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 4 0.920000 0.316457 4471.620000 13287.800000 26.024828 77.334996 97.460000 nan 1.800000 5.700000 12.111000 0.023280 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.000727 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 8 1.550000 0.452281 5505.380000 18294.900000 32.041312 106.476318 97.460000 nan 1.800000 5.700000 12.046000 0.046560 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.001039 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 16 2.450000 0.470938 6872.480000 35096.100000 39.997834 204.259302 97.460000 nan 1.800000 5.700000 13.360000 0.093120 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.001082 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 32 4.520000 0.652594 7474.450000 73695.600000 43.501299 428.908392 97.460000 nan 1.800000 5.700000 12.231000 0.186240 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.001499 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 64 8.260000 0.806250 8126.980000 108383.000000 47.299024 630.789060 97.460000 nan 1.800000 5.700000 11.843000 0.372480 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.001852 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 128 15.650000 1.037130 8533.330000 162308.000000 49.663981 944.632560 97.460000 nan 1.800000 5.700000 13.539000 0.744960 50.000000 l3 1.330000 59.700000 0.005820 TX2-maxn_FP16_50%_MLP 0.002383 FP16_TX2-maxn TX2-maxn_FP16_MLP_50.0
MLP TX2-maxn FP16 maxn 1 0.890000 0.627301 1124.040000 1623.380000 22.513397 32.514678 97.300000 nan 1.800000 5.700000 13.557000 0.020029 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.001441 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 2 1.010000 0.646729 1954.200000 3153.500000 39.140672 63.161452 97.300000 nan 1.800000 5.700000 13.507000 0.040058 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.001486 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 4 1.290000 0.675070 2994.150000 6037.660000 59.969830 120.928292 97.300000 nan 1.800000 5.700000 13.827000 0.080116 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.001551 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 8 2.170000 1.020610 3750.920000 8049.180000 75.127177 161.217026 97.300000 nan 1.800000 5.700000 13.112000 0.160232 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.002345 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 16 3.210000 1.127580 5120.000000 14670.500000 102.548480 293.835445 97.300000 nan 1.800000 5.700000 15.017000 0.320464 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.002591 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 32 5.190000 1.140910 6360.250000 34602.800000 127.389447 693.059481 97.300000 nan 1.800000 5.700000 15.274000 0.640928 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.002621 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 64 8.860000 1.205750 7529.410000 65181.400000 150.806553 1305.518261 97.300000 nan 1.800000 5.700000 15.666000 1.281856 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.002770 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP16 maxn 128 16.900000 2.031750 7876.920000 70611.000000 157.766831 1414.267719 97.300000 nan 1.800000 5.700000 16.084000 2.563712 100.000000 l3 1.330000 59.700000 0.020000 TX2-maxn_FP16_100%_MLP 0.004668 FP16_TX2-maxn TX2-maxn_FP16_MLP_100.0
MLP TX2-maxn FP32 maxn 1 0.640000 0.156913 2716.180000 6801.640000 1.817124 4.550297 97.150000 nan 1.800000 5.700000 9.552000 0.000669 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000361 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 2 0.710000 0.168527 4096.000000 13248.100000 2.740224 8.862979 97.150000 nan 1.800000 5.700000 9.362000 0.001338 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000387 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 4 0.980000 0.372281 4697.250000 26152.500000 3.142460 17.496023 97.150000 nan 1.800000 5.700000 9.498000 0.002676 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000855 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 8 1.290000 0.174430 6965.990000 51034.100000 4.660247 34.141813 97.150000 nan 1.800000 5.700000 10.119000 0.005352 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000401 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 16 2.380000 0.407703 7062.070000 99407.800000 4.724525 66.503818 97.150000 nan 1.800000 5.700000 10.162000 0.010704 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000937 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 32 4.240000 0.416687 7937.980000 189630.000000 5.310509 126.862470 97.150000 nan 1.800000 5.700000 10.270000 0.021408 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.000957 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 64 8.020000 0.528625 8393.440000 202292.000000 5.615211 135.333348 97.150000 nan 1.800000 5.700000 10.270000 0.042816 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.001214 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 128 15.420000 0.620625 8827.590000 309646.000000 5.905658 207.153174 97.150000 nan 1.800000 5.700000 11.075000 0.085632 12.500000 l3 0.670000 59.700000 0.000700 TX2-maxn_FP32_12.50%_MLP 0.001426 FP32_TX2-maxn TX2-maxn_FP32_MLP_12.5
MLP TX2-maxn FP32 maxn 1 0.630000 0.161398 2632.390000 6373.630000 4.901510 11.867699 97.440000 nan 1.800000 5.700000 11.117000 0.001862 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.000371 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 2 0.590000 0.167787 3984.440000 12607.400000 7.419027 23.474979 97.440000 nan 1.800000 5.700000 10.854000 0.003724 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.000385 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 4 1.000000 0.273738 5565.220000 21346.200000 10.362440 39.746624 97.440000 nan 1.800000 5.700000 10.985000 0.007448 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.000629 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 8 1.300000 0.241844 6522.290000 33713.000000 12.144504 62.773606 97.440000 nan 1.800000 5.700000 11.425000 0.014896 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.000556 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 16 2.440000 0.472719 6965.990000 65510.800000 12.970673 121.981110 97.440000 nan 1.800000 5.700000 11.638000 0.029792 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.001086 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 32 4.290000 0.283000 8258.060000 126482.000000 15.376508 235.509484 97.440000 nan 1.800000 5.700000 11.577000 0.059584 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.000650 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 64 7.980000 0.618563 8393.440000 158809.000000 15.628585 295.702358 97.440000 nan 1.800000 5.700000 11.444000 0.119168 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.001421 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 128 15.530000 0.776375 8752.140000 227505.000000 16.296485 423.614310 97.440000 nan 1.800000 5.700000 12.599000 0.238336 25.000000 l3 0.670000 59.700000 0.001900 TX2-maxn_FP32_25%_MLP 0.001784 FP32_TX2-maxn TX2-maxn_FP32_MLP_25.0
MLP TX2-maxn FP32 maxn 1 0.660000 0.289018 1896.300000 3415.220000 11.036466 19.876580 97.460000 nan 1.800000 5.700000 12.244000 0.005820 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.000664 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 2 0.800000 0.326082 2976.740000 6159.730000 17.324627 35.849629 97.460000 nan 1.800000 5.700000 12.607000 0.011640 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.000749 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 4 0.910000 0.322668 4452.170000 12405.400000 25.911629 72.199428 97.460000 nan 1.800000 5.700000 12.915000 0.023280 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.000741 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 8 1.710000 0.448250 5505.380000 17847.200000 32.041312 103.870704 97.460000 nan 1.800000 5.700000 13.564000 0.046560 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.001030 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 16 2.480000 0.472750 6826.670000 34829.900000 39.731219 202.710018 97.460000 nan 1.800000 5.700000 13.770000 0.093120 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.001086 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 32 4.570000 0.521469 7757.580000 64760.900000 45.149116 376.908438 97.460000 nan 1.800000 5.700000 13.860000 0.186240 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.001198 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 64 8.600000 1.071250 7816.790000 75111.900000 45.493718 437.151258 97.460000 nan 1.800000 5.700000 15.231000 0.372480 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.002461 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 128 15.920000 1.278380 8393.440000 120414.000000 48.849821 700.809480 97.460000 nan 1.800000 5.700000 14.629000 0.744960 50.000000 l3 0.670000 59.700000 0.005820 TX2-maxn_FP32_50%_MLP 0.002937 FP32_TX2-maxn TX2-maxn_FP32_MLP_50.0
MLP TX2-maxn FP32 maxn 1 0.930000 0.723237 1099.890000 1372.010000 22.029697 27.479988 97.310000 nan 1.800000 5.700000 14.116000 0.020029 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.001662 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 2 1.150000 0.786377 1732.660000 2563.210000 34.703447 51.338533 97.310000 nan 1.800000 5.700000 14.264000 0.040058 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.001807 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 4 1.370000 0.778836 2951.010000 5187.960000 59.105779 103.909651 97.310000 nan 1.800000 5.700000 14.747000 0.080116 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.001789 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 8 2.210000 1.084680 3806.690000 7501.170000 76.244194 150.240934 97.310000 nan 1.800000 5.700000 15.508000 0.160232 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.002492 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 16 3.120000 1.122410 5197.970000 14502.400000 104.110141 290.468570 97.310000 nan 1.800000 5.700000 15.734000 0.320464 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.002579 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 32 5.310000 1.432160 6206.060000 26897.100000 124.301176 538.722016 97.310000 nan 1.800000 5.700000 16.041000 0.640928 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.003290 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 64 10.010000 2.474500 6736.840000 28405.000000 134.932168 568.923745 97.310000 nan 1.800000 5.700000 16.969000 1.281856 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.005685 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
MLP TX2-maxn FP32 maxn 128 17.500000 3.005000 7529.410000 45810.400000 150.806553 917.536502 97.310000 nan 1.800000 5.700000 16.719000 2.563712 100.000000 l3 0.670000 59.700000 0.020000 TX2-maxn_FP32_100%_MLP 0.006904 FP32_TX2-maxn TX2-maxn_FP32_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP TX2-maxq FP16 maxq 1 0.580000 0.284818 1706.670000 3658.410000 1.141762 2.447476 97.150000 nan 1.800000 4.150000 5.221000 0.000669 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000654 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 2 0.740000 0.290838 2687.660000 7297.240000 1.798045 4.881854 97.150000 nan 1.800000 4.150000 5.229000 0.001338 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000668 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 4 1.060000 0.293703 3778.600000 14582.300000 2.527883 9.755559 97.150000 nan 1.800000 4.150000 5.326000 0.002676 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000675 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 8 1.670000 0.305648 4807.510000 28726.100000 3.216224 19.217761 97.150000 nan 1.800000 4.150000 5.466000 0.005352 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000702 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 16 2.930000 0.253531 5535.140000 69726.300000 3.703009 46.646895 97.150000 nan 1.800000 4.150000 5.678000 0.010704 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000582 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 32 5.410000 0.324219 5919.080000 109542.000000 3.959865 73.283598 97.150000 nan 1.800000 4.150000 5.655000 0.021408 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000745 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 64 10.670000 0.430437 6168.670000 170383.000000 4.126840 113.986227 97.150000 nan 1.800000 4.150000 5.757000 0.042816 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.000989 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 128 21.020000 0.800375 6168.670000 227505.000000 4.126840 152.200845 97.150000 nan 1.800000 4.150000 6.046000 0.085632 12.500000 l3 0.870000 59.700000 0.000700 TX2-maxq_FP16_12.50%_MLP 0.001839 FP16_TX2-maxq TX2-maxq_FP16_MLP_12.5
MLP TX2-maxq FP16 maxq 1 0.590000 0.292368 1698.180000 3586.100000 3.162011 6.677318 97.440000 nan 1.800000 4.150000 5.779000 0.001862 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000672 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 2 0.740000 0.292953 2673.630000 7241.250000 4.978299 13.483208 97.440000 nan 1.800000 4.150000 5.673000 0.003724 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000673 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 4 1.070000 0.299227 3710.150000 14373.700000 6.908299 26.763829 97.440000 nan 1.800000 4.150000 5.705000 0.007448 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000687 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 8 1.730000 0.337016 4591.930000 24042.100000 8.550174 44.766390 97.440000 nan 1.800000 4.150000 6.204000 0.014896 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000774 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 16 2.940000 0.327828 5446.810000 49404.200000 10.141960 91.990620 97.440000 nan 1.800000 4.150000 6.399000 0.029792 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000753 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 32 5.560000 0.394719 5851.430000 91103.200000 10.895363 169.634158 97.440000 nan 1.800000 4.150000 6.465000 0.059584 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.000907 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 64 10.670000 0.538438 6023.530000 125229.000000 11.215813 233.176398 97.440000 nan 1.800000 4.150000 6.388000 0.119168 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.001237 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 128 21.050000 0.946500 6168.670000 180187.000000 11.486064 335.508194 97.440000 nan 1.800000 4.150000 6.197000 0.238336 25.000000 l3 0.870000 59.700000 0.001900 TX2-maxq_FP16_25%_MLP 0.002175 FP16_TX2-maxq TX2-maxq_FP16_MLP_25.0
MLP TX2-maxq FP16 maxq 1 0.690000 0.384808 1458.690000 2632.490000 8.489576 15.321092 97.460000 nan 1.800000 4.150000 6.930000 0.005820 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.000884 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 2 0.850000 0.402541 2295.960000 5029.470000 13.362487 29.271515 97.460000 nan 1.800000 4.150000 7.000000 0.011640 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.000925 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 4 1.180000 0.417750 3346.410000 9633.570000 19.476106 56.067377 97.460000 nan 1.800000 4.150000 7.036000 0.023280 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.000960 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 8 2.010000 0.590836 4015.690000 13403.000000 23.371316 78.005460 97.460000 nan 1.800000 4.150000 7.622000 0.046560 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.001357 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 16 3.300000 0.615344 4853.080000 26276.600000 28.244926 152.929812 97.460000 nan 1.800000 4.150000 7.326000 0.093120 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.001414 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 32 5.950000 0.672687 5475.940000 51428.900000 31.869971 299.316198 97.460000 nan 1.800000 4.150000 6.702000 0.186240 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.001545 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 64 11.050000 1.048560 5785.310000 79158.900000 33.670504 460.704798 97.460000 nan 1.800000 4.150000 6.563000 0.372480 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.002409 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 128 21.450000 1.356880 6023.530000 114120.000000 35.056945 664.178400 97.460000 nan 1.800000 4.150000 7.359000 0.744960 50.000000 l3 0.870000 59.700000 0.005820 TX2-maxq_FP16_50%_MLP 0.003117 FP16_TX2-maxq TX2-maxq_FP16_MLP_50.0
MLP TX2-maxq FP16 maxq 1 1.100000 0.812043 902.998000 1235.080000 18.086147 24.737417 97.300000 nan 1.800000 4.150000 7.994000 0.020029 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.001866 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 2 1.300000 0.853039 1526.080000 2359.220000 30.565856 47.252817 97.300000 nan 1.800000 4.150000 7.969000 0.040058 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.001960 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 4 1.630000 0.871484 2455.640000 4643.890000 49.184014 93.012473 97.300000 nan 1.800000 4.150000 8.216000 0.080116 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.002002 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 8 2.780000 1.397150 2884.510000 5725.530000 57.773851 114.676640 97.300000 nan 1.800000 4.150000 7.799000 0.160232 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.003210 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 16 4.080000 1.475390 3968.990000 10921.600000 79.494901 218.748726 97.300000 nan 1.800000 4.150000 8.912000 0.320464 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.003390 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 32 6.650000 1.361030 4946.860000 24139.600000 99.080659 483.492048 97.300000 nan 1.800000 4.150000 8.292000 0.640928 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.003127 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 64 11.610000 1.669870 5505.380000 44900.500000 110.267256 899.312115 97.300000 nan 1.800000 4.150000 8.423000 1.281856 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.003836 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP16 maxq 128 22.770000 2.857500 5657.460000 48789.800000 113.313266 977.210904 97.300000 nan 1.800000 4.150000 8.988000 2.563712 100.000000 l3 0.870000 59.700000 0.020000 TX2-maxq_FP16_100%_MLP 0.006565 FP16_TX2-maxq TX2-maxq_FP16_MLP_100.0
MLP TX2-maxq FP32 maxq 1 0.720000 0.227474 1924.810000 4566.660000 1.287698 3.055096 97.150000 nan 1.800000 4.150000 5.496000 0.000669 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.000523 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 2 0.790000 0.233533 2934.100000 9004.180000 1.962913 6.023796 97.150000 nan 1.800000 4.150000 5.516000 0.001338 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.000537 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 4 1.190000 0.370086 4063.490000 18191.800000 2.718475 12.170314 97.150000 nan 1.800000 4.150000 5.493000 0.002676 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.000850 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 8 1.820000 0.247086 4946.860000 35613.700000 3.309449 23.825565 97.150000 nan 1.800000 4.150000 5.733000 0.005352 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.000568 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 16 3.040000 0.268562 5595.630000 70363.500000 3.743476 47.073181 97.150000 nan 1.800000 4.150000 5.732000 0.010704 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.000617 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 32 5.640000 0.494437 5818.180000 136588.000000 3.892362 91.377372 97.150000 nan 1.800000 4.150000 5.721000 0.021408 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.001136 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 64 10.730000 0.660125 6023.530000 146936.000000 4.029742 98.300184 97.150000 nan 1.800000 4.150000 5.927000 0.042816 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.001517 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 128 20.770000 0.802000 6243.900000 224660.000000 4.177169 150.297540 97.150000 nan 1.800000 4.150000 6.100000 0.085632 12.500000 l3 0.440000 59.700000 0.000700 TX2-maxq_FP32_12.50%_MLP 0.001843 FP32_TX2-maxq TX2-maxq_FP32_MLP_12.5
MLP TX2-maxq FP32 maxq 1 0.580000 0.237484 1889.300000 4490.110000 3.517877 8.360585 97.440000 nan 1.800000 4.150000 6.220000 0.001862 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.000546 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 2 0.680000 0.235680 2917.380000 8988.450000 5.432162 16.736494 97.440000 nan 1.800000 4.150000 6.057000 0.003724 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.000541 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 4 1.110000 0.236754 3835.210000 14936.500000 7.141161 27.811763 97.440000 nan 1.800000 4.150000 6.122000 0.007448 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.000544 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 8 1.710000 0.319398 4675.800000 25243.400000 8.706340 47.003211 97.440000 nan 1.800000 4.150000 6.468000 0.014896 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.000734 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 16 3.230000 0.572922 5333.330000 49420.800000 9.930660 92.021530 97.440000 nan 1.800000 4.150000 6.434000 0.029792 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.001316 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 32 5.660000 0.407187 5919.080000 91723.400000 11.021327 170.788971 97.440000 nan 1.800000 4.150000 6.419000 0.059584 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.000935 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 64 10.880000 0.799125 5851.430000 113387.000000 10.895363 211.126594 97.440000 nan 1.800000 4.150000 6.279000 0.119168 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.001836 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 128 21.060000 1.041500 6095.240000 155718.000000 11.349337 289.946916 97.440000 nan 1.800000 4.150000 6.979000 0.238336 25.000000 l3 0.440000 59.700000 0.001900 TX2-maxq_FP32_25%_MLP 0.002393 FP32_TX2-maxq TX2-maxq_FP32_MLP_25.0
MLP TX2-maxq FP32 maxq 1 0.680000 0.382214 1452.480000 2598.500000 8.453434 15.123270 97.460000 nan 1.800000 4.150000 7.105000 0.005820 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.000878 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 2 1.000000 0.428082 2240.700000 4649.260000 13.040874 27.058693 97.460000 nan 1.800000 4.150000 7.023000 0.011640 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.000983 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 4 1.200000 0.434738 3324.680000 9068.530000 19.349638 52.778845 97.460000 nan 1.800000 4.150000 7.100000 0.023280 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.000999 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 8 2.060000 0.598453 4031.500000 13370.200000 23.463330 77.814564 97.460000 nan 1.800000 4.150000 7.544000 0.046560 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.001375 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 16 3.440000 0.687766 4876.190000 26183.900000 28.379426 152.390298 97.460000 nan 1.800000 4.150000 7.574000 0.093120 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.001580 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 32 5.750000 0.665937 5535.140000 48526.200000 32.214515 282.422484 97.460000 nan 1.800000 4.150000 7.565000 0.186240 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.001530 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 64 11.580000 1.380190 5535.140000 55910.500000 32.214515 325.399110 97.460000 nan 1.800000 4.150000 8.349000 0.372480 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.003171 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 128 21.730000 1.801500 5988.300000 68660.300000 34.851906 399.602946 97.460000 nan 1.800000 4.150000 7.789000 0.744960 50.000000 l3 0.440000 59.700000 0.005820 TX2-maxq_FP32_50%_MLP 0.004139 FP32_TX2-maxq TX2-maxq_FP32_MLP_50.0
MLP TX2-maxq FP32 maxq 1 1.250000 0.957507 796.887000 1037.740000 15.960850 20.784894 97.310000 nan 1.800000 4.150000 8.462000 0.020029 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.002200 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 2 1.490000 1.038680 1343.830000 1918.300000 26.915571 38.421631 97.310000 nan 1.800000 4.150000 8.423000 0.040058 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.002386 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 4 1.790000 1.035660 2221.260000 3851.590000 44.489617 77.143496 97.310000 nan 1.800000 4.150000 8.415000 0.080116 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.002379 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 8 2.820000 1.432520 2852.370000 5597.400000 57.130119 112.110325 97.310000 nan 1.800000 4.150000 8.796000 0.160232 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.003291 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 16 4.110000 1.491950 3938.460000 10829.700000 78.883415 216.908061 97.310000 nan 1.800000 4.150000 8.948000 0.320464 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.003428 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 32 6.760000 1.633630 4785.050000 20225.200000 95.839766 405.090531 97.310000 nan 1.800000 4.150000 9.117000 0.640928 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.003753 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 64 13.260000 3.230190 4853.080000 21240.000000 97.202339 425.415960 97.310000 nan 1.800000 4.150000 9.721000 1.281856 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.007421 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
MLP TX2-maxq FP32 maxq 128 24.490000 4.409500 5278.350000 30758.100000 105.720072 616.053985 97.310000 nan 1.800000 4.150000 8.738000 2.563712 100.000000 l3 0.440000 59.700000 0.020000 TX2-maxq_FP32_100%_MLP 0.010131 FP32_TX2-maxq TX2-maxq_FP32_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP TX2-maxp FP16 maxp 1 0.570000 0.278080 1759.450000 3864.970000 1.177072 2.585665 97.150000 nan 1.800000 4.700000 6.661000 0.000669 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000639 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 2 0.750000 0.285041 2716.180000 7639.510000 1.817124 5.110832 97.150000 nan 1.800000 4.700000 6.510000 0.001338 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000655 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 4 1.100000 0.290605 3849.620000 15091.200000 2.575396 10.096013 97.150000 nan 1.800000 4.700000 6.643000 0.002676 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000668 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 8 1.640000 0.306844 4785.050000 29828.100000 3.201198 19.954999 97.150000 nan 1.800000 4.700000 7.353000 0.005352 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000705 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 16 3.120000 0.342703 5657.460000 71794.200000 3.784841 48.030320 97.150000 nan 1.800000 4.700000 7.652000 0.010704 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000787 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 32 5.610000 0.317250 6023.530000 121789.000000 4.029742 81.476841 97.150000 nan 1.800000 4.700000 7.543000 0.021408 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.000729 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 64 9.110000 0.463625 6206.060000 192120.000000 4.151854 128.528280 97.150000 nan 1.800000 4.700000 7.886000 0.042816 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.001065 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 128 21.570000 0.665250 6360.250000 278034.000000 4.255007 186.004746 97.150000 nan 1.800000 4.700000 8.382000 0.085632 12.500000 l3 1.150000 59.700000 0.000700 TX2-maxp_FP16_12.50%_MLP 0.001528 FP16_TX2-maxp TX2-maxp_FP16_MLP_12.5
MLP TX2-maxp FP16 maxp 1 0.590000 0.278191 1750.430000 3848.740000 3.259301 7.166354 97.440000 nan 1.800000 4.700000 7.334000 0.001862 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.000639 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 2 0.730000 0.259730 2820.940000 8504.140000 5.252590 15.834709 97.440000 nan 1.800000 4.700000 7.364000 0.003724 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.000597 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 4 1.090000 0.287484 3792.590000 15125.300000 7.061803 28.163309 97.440000 nan 1.800000 4.700000 7.284000 0.007448 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.000660 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 8 1.790000 0.307859 4697.250000 29380.500000 8.746279 54.706491 97.440000 nan 1.800000 4.700000 8.149000 0.014896 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.000707 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 16 3.310000 0.363625 5171.720000 56844.700000 9.629743 105.844831 97.440000 nan 1.800000 4.700000 8.354000 0.029792 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.000835 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 32 6.150000 0.526344 5919.080000 115863.000000 11.021327 215.736906 97.440000 nan 1.800000 4.700000 8.161000 0.059584 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.001209 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 64 11.140000 0.661312 5988.300000 145166.000000 11.150215 270.299092 97.440000 nan 1.800000 4.700000 8.740000 0.119168 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.001519 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 128 21.250000 0.800375 6243.900000 220832.000000 11.626142 411.189184 97.440000 nan 1.800000 4.700000 8.066000 0.238336 25.000000 l3 1.150000 59.700000 0.001900 TX2-maxp_FP16_25%_MLP 0.001839 FP16_TX2-maxp TX2-maxp_FP16_MLP_25.0
MLP TX2-maxp FP16 maxp 1 0.670000 0.335562 1526.080000 3009.650000 8.881786 17.516163 97.460000 nan 1.800000 4.700000 8.718000 0.005820 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.000771 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 2 0.860000 0.356855 2386.950000 5676.310000 13.892049 33.036124 97.460000 nan 1.800000 4.700000 8.650000 0.011640 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.000820 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 4 1.200000 0.354211 3482.990000 11532.100000 20.271002 67.116822 97.460000 nan 1.800000 4.700000 8.868000 0.023280 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.000814 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 8 2.010000 0.509430 4179.590000 15901.400000 24.325214 92.546148 97.460000 nan 1.800000 4.700000 8.795000 0.046560 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.001170 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 16 3.340000 0.527234 5044.330000 30770.200000 29.358001 179.082564 97.460000 nan 1.800000 4.700000 9.686000 0.093120 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.001211 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 32 6.210000 0.628219 5505.380000 62458.100000 32.041312 363.506142 97.460000 nan 1.800000 4.700000 9.003000 0.186240 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.001443 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 64 11.480000 0.898875 5851.430000 94587.100000 34.055323 550.496922 97.460000 nan 1.800000 4.700000 8.679000 0.372480 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.002065 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 128 21.560000 1.126880 6168.670000 141671.000000 35.901659 824.525220 97.460000 nan 1.800000 4.700000 9.883000 0.744960 50.000000 l3 1.150000 59.700000 0.005820 TX2-maxp_FP16_50%_MLP 0.002589 FP16_TX2-maxp TX2-maxp_FP16_MLP_50.0
MLP TX2-maxp FP16 maxp 1 1.030000 0.698266 976.168000 1466.410000 19.551669 29.370726 97.300000 nan 1.800000 4.700000 9.881000 0.020029 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.001604 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 2 1.250000 0.739980 1635.780000 2785.550000 32.763038 55.791781 97.300000 nan 1.800000 4.700000 9.903000 0.040058 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.001700 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 4 1.610000 0.766234 2515.970000 5392.600000 50.392363 108.008385 97.300000 nan 1.800000 4.700000 10.262000 0.080116 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.001760 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 8 2.650000 1.161670 3093.660000 7027.460000 61.962916 140.752996 97.300000 nan 1.800000 4.700000 9.645000 0.160232 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.002669 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 16 4.050000 1.248630 4112.450000 13008.000000 82.368261 260.537232 97.300000 nan 1.800000 4.700000 11.359000 0.320464 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.002869 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 32 6.610000 1.201560 5044.330000 29751.900000 101.032886 595.900805 97.300000 nan 1.800000 4.700000 10.959000 0.640928 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.002761 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 64 11.720000 1.370560 5688.890000 56369.000000 113.942778 1129.014701 97.300000 nan 1.800000 4.700000 11.215000 1.281856 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.003149 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP16 maxp 128 23.070000 2.305000 5885.060000 61409.300000 117.871867 1229.966870 97.300000 nan 1.800000 4.700000 12.142000 2.563712 100.000000 l3 1.150000 59.700000 0.020000 TX2-maxp_FP16_100%_MLP 0.005296 FP16_TX2-maxp TX2-maxp_FP16_MLP_100.0
MLP TX2-maxp FP32 maxp 1 0.600000 0.216087 2019.720000 4963.280000 1.351193 3.320434 97.150000 nan 1.800000 4.700000 7.411000 0.000669 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.000496 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 2 0.870000 0.287818 3002.930000 9745.510000 2.008960 6.519746 97.150000 nan 1.800000 4.700000 7.265000 0.001338 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.000661 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 4 1.220000 0.369457 4129.030000 19384.000000 2.762321 12.967896 97.150000 nan 1.800000 4.700000 7.309000 0.002676 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.000849 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 8 1.690000 0.237187 5019.610000 36867.700000 3.358119 24.664491 97.150000 nan 1.800000 4.700000 7.732000 0.005352 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.000545 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 16 3.190000 0.410703 5688.890000 72480.200000 3.805867 48.489254 97.150000 nan 1.800000 4.700000 7.861000 0.010704 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.000944 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 32 5.710000 0.453156 5851.430000 140466.000000 3.914607 93.971754 97.150000 nan 1.800000 4.700000 7.759000 0.021408 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.001041 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 64 10.870000 0.591562 6095.240000 173530.000000 4.077716 116.091570 97.150000 nan 1.800000 4.700000 7.935000 0.042816 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.001359 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 128 21.530000 0.684250 6320.990000 264873.000000 4.228742 177.200037 97.150000 nan 1.800000 4.700000 8.310000 0.085632 12.500000 l3 0.570000 59.700000 0.000700 TX2-maxp_FP32_12.50%_MLP 0.001572 FP32_TX2-maxp TX2-maxp_FP32_MLP_12.5
MLP TX2-maxp FP32 maxp 1 0.510000 0.222530 1980.660000 4836.440000 3.687989 9.005451 97.440000 nan 1.800000 4.700000 8.068000 0.001862 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.000511 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 2 0.810000 0.227563 2968.120000 9610.870000 5.526639 17.895440 97.440000 nan 1.800000 4.700000 7.972000 0.003724 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.000523 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 4 1.090000 0.235293 4063.490000 18903.800000 7.566218 35.198876 97.440000 nan 1.800000 4.700000 8.158000 0.007448 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.000541 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 8 1.980000 0.282313 4923.080000 29516.000000 9.166775 54.958792 97.440000 nan 1.800000 4.700000 8.505000 0.014896 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.000649 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 16 3.260000 0.514938 5120.000000 56496.600000 9.533440 105.196669 97.440000 nan 1.800000 4.700000 8.612000 0.029792 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.001183 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 32 5.950000 0.532937 5688.890000 105938.000000 10.592713 197.256556 97.440000 nan 1.800000 4.700000 8.547000 0.059584 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.001224 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 64 11.180000 0.692438 5953.490000 134489.000000 11.085398 250.418518 97.440000 nan 1.800000 4.700000 8.318000 0.119168 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.001591 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 128 21.700000 0.872125 6168.670000 193866.000000 11.486064 360.978492 97.440000 nan 1.800000 4.700000 9.199000 0.238336 25.000000 l3 0.570000 59.700000 0.001900 TX2-maxp_FP32_25%_MLP 0.002004 FP32_TX2-maxp TX2-maxp_FP32_MLP_25.0
MLP TX2-maxp FP32 maxp 1 0.650000 0.334122 1560.980000 2952.860000 9.084904 17.185645 97.460000 nan 1.800000 4.700000 9.321000 0.005820 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.000768 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 2 0.860000 0.377549 2398.130000 5282.050000 13.957117 30.741531 97.460000 nan 1.800000 4.700000 9.532000 0.011640 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.000867 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 4 1.170000 0.380160 3482.990000 10581.100000 20.271002 61.582002 97.460000 nan 1.800000 4.700000 9.563000 0.023280 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.000873 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 8 2.260000 0.660625 4047.430000 15793.700000 23.556043 91.919334 97.460000 nan 1.800000 4.700000 10.240000 0.046560 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.001518 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 16 3.510000 0.749047 4807.510000 30638.500000 27.979708 178.316070 97.460000 nan 1.800000 4.700000 10.356000 0.093120 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.001721 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 32 6.100000 0.790344 5446.810000 57302.700000 31.700434 333.501714 97.460000 nan 1.800000 4.700000 10.371000 0.186240 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.001816 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 64 11.670000 1.198060 5720.670000 66823.300000 33.294299 388.911606 97.460000 nan 1.800000 4.700000 11.478000 0.372480 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.002752 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 128 21.950000 1.454250 6095.240000 103759.000000 35.474297 603.877380 97.460000 nan 1.800000 4.700000 11.120000 0.744960 50.000000 l3 0.570000 59.700000 0.005820 TX2-maxp_FP32_50%_MLP 0.003341 FP32_TX2-maxp TX2-maxp_FP32_MLP_50.0
MLP TX2-maxp FP32 maxp 1 1.140000 0.819372 877.464000 1231.270000 17.574726 24.661107 97.310000 nan 1.800000 4.700000 10.895000 0.020029 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.001882 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 2 1.380000 0.894066 1376.340000 1991.410000 27.566714 39.885951 97.310000 nan 1.800000 4.700000 10.915000 0.040058 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.002054 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 4 1.850000 0.958605 2115.700000 4023.290000 42.375355 80.582475 97.310000 nan 1.800000 4.700000 11.193000 0.080116 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.002202 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 8 2.700000 1.204900 3002.930000 6766.270000 60.145685 135.521622 97.310000 nan 1.800000 4.700000 11.915000 0.160232 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.002768 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 16 4.240000 1.252610 4129.030000 13126.400000 82.700342 262.908666 97.310000 nan 1.800000 4.700000 12.021000 0.320464 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.002878 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 32 6.900000 1.519840 4697.250000 24259.700000 94.081220 485.897531 97.310000 nan 1.800000 4.700000 12.271000 0.640928 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.003492 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 64 13.300000 2.768870 4899.520000 25678.300000 98.132486 514.310671 97.310000 nan 1.800000 4.700000 12.950000 1.281856 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.006361 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
MLP TX2-maxp FP32 maxp 128 24.100000 3.442500 5475.940000 39802.500000 109.677602 797.204273 97.310000 nan 1.800000 4.700000 12.366000 2.563712 100.000000 l3 0.570000 59.700000 0.020000 TX2-maxp_FP32_100%_MLP 0.007909 FP32_TX2-maxp TX2-maxp_FP32_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP U96-Quadcore-A53 INT2 nan 2 nan 2.599000 nan 769.526741 nan 0.514813 96.850000 nan 9.200000 14.300000 15.392657 0.001338 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.005971 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 4 nan 2.577000 nan 1552.192472 nan 1.038417 96.850000 nan 9.200000 14.300000 15.393918 0.002676 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.005921 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 8 nan 2.566000 nan 3117.692907 nan 2.085737 96.850000 nan 9.200000 14.300000 15.393484 0.005352 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.005895 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 16 nan 3.458000 nan 4626.951995 nan 3.095431 96.850000 nan 9.200000 14.300000 15.396590 0.010704 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.007945 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 32 nan 5.027000 nan 6365.625622 nan 4.258604 96.850000 nan 9.200000 14.300000 15.398132 0.021408 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.011549 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 64 nan 8.325000 nan 7687.687688 nan 5.143063 96.850000 nan 9.200000 14.300000 15.397998 0.042816 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.019126 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 128 nan 15.070000 nan 8493.696085 nan 5.682283 96.850000 nan 9.200000 14.300000 15.399641 0.085632 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT2_12.50%_MLP 0.034623 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_12.5
MLP U96-Quadcore-A53 INT2 nan 2 nan 7.754000 nan 257.931390 nan 0.480268 98.040000 nan 9.200000 14.300000 15.338248 0.003724 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.017814 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 4 nan 7.841000 nan 510.139013 nan 0.949879 98.040000 nan 9.200000 14.300000 15.337409 0.007448 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.018014 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 8 nan 7.850000 nan 1019.108280 nan 1.897580 98.040000 nan 9.200000 14.300000 15.338295 0.014896 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.018035 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 16 nan 10.115000 nan 1581.809194 nan 2.945329 98.040000 nan 9.200000 14.300000 15.342816 0.029792 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.023239 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 32 nan 14.387000 nan 2224.230208 nan 4.141517 98.040000 nan 9.200000 14.300000 15.338731 0.059584 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.033054 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 64 nan 23.176000 nan 2761.477390 nan 5.141871 98.040000 nan 9.200000 14.300000 15.336141 0.119168 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.053246 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 128 nan 41.228000 nan 3104.686136 nan 5.780926 98.040000 nan 9.200000 14.300000 15.336937 0.238336 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT2_25%_MLP 0.094720 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_25.0
MLP U96-Quadcore-A53 INT2 nan 2 nan 26.684000 nan 74.951282 nan 0.436216 98.490000 nan 9.200000 14.300000 15.357660 0.011640 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.061305 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 4 nan 27.236000 nan 146.864444 nan 0.854751 98.490000 nan 9.200000 14.300000 15.358208 0.023280 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.062574 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 8 nan 26.752000 nan 299.043062 nan 1.740431 98.490000 nan 9.200000 14.300000 15.367722 0.046560 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.061462 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 16 nan 33.614000 nan 475.992146 nan 2.770274 98.490000 nan 9.200000 14.300000 15.367203 0.093120 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.077227 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 32 nan 46.919000 nan 682.026471 nan 3.969394 98.490000 nan 9.200000 14.300000 15.364860 0.186240 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.107794 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 64 nan 74.500000 nan 859.060403 nan 4.999732 98.490000 nan 9.200000 14.300000 15.367707 0.372480 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.171160 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 128 nan 129.915000 nan 985.259593 nan 5.734211 98.490000 nan 9.200000 14.300000 15.365400 0.744960 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT2_50%_MLP 0.298474 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_50.0
MLP U96-Quadcore-A53 INT2 nan 2 nan 100.792000 nan 19.842845 nan 0.397432 98.750000 nan 9.200000 14.300000 15.323613 0.040058 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.231565 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 4 nan 101.204000 nan 39.524129 nan 0.791629 98.750000 nan 9.200000 14.300000 15.334228 0.080116 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.232512 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 8 nan 100.627000 nan 79.501525 nan 1.592336 98.750000 nan 9.200000 14.300000 15.327745 0.160232 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.231186 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 16 nan 125.092000 nan 127.905861 nan 2.561826 98.750000 nan 9.200000 14.300000 15.311869 0.320464 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.287393 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 32 nan 170.559000 nan 187.618361 nan 3.757808 98.750000 nan 9.200000 14.300000 15.309146 0.640928 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.391852 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 64 nan 253.599000 nan 252.366926 nan 5.054657 98.750000 nan 9.200000 14.300000 15.318727 1.281856 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 0.582633 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT2 nan 128 nan 435.264000 nan 294.074401 nan 5.890016 98.750000 nan 9.200000 14.300000 15.312922 2.563712 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT2_100%_MLP 1.000000 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 2 nan 2.536000 nan 788.643533 nan 0.527603 97.540000 nan 9.200000 14.300000 15.403571 0.001338 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.005826 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 4 nan 2.555000 nan 1565.557730 nan 1.047358 97.540000 nan 9.200000 14.300000 15.405612 0.002676 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.005870 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 8 nan 2.608000 nan 3067.484663 nan 2.052147 97.540000 nan 9.200000 14.300000 15.409585 0.005352 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.005992 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 16 nan 3.405000 nan 4698.972100 nan 3.143612 97.540000 nan 9.200000 14.300000 15.420983 0.010704 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.007823 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 32 nan 5.066000 nan 6316.620608 nan 4.225819 97.540000 nan 9.200000 14.300000 15.395697 0.021408 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.011639 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 64 nan 8.577000 nan 7461.816486 nan 4.991955 97.540000 nan 9.200000 14.300000 15.393603 0.042816 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.019705 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 128 nan 14.996000 nan 8535.609496 nan 5.710323 97.540000 nan 9.200000 14.300000 15.393147 0.085632 12.500000 l3 0.192000 4.260000 0.000700 U96-Quadcore-A53_INT4_12.50%_MLP 0.034453 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_12.5
MLP U96-Quadcore-A53 INT4 nan 2 nan 7.828000 nan 255.493102 nan 0.475728 98.290000 nan 9.200000 14.300000 15.348214 0.003724 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.017984 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 4 nan 7.848000 nan 509.683996 nan 0.949032 98.290000 nan 9.200000 14.300000 15.348087 0.007448 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.018030 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 8 nan 7.853000 nan 1018.718961 nan 1.896855 98.290000 nan 9.200000 14.300000 15.346164 0.014896 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.018042 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 16 nan 10.063000 nan 1589.983106 nan 2.960549 98.290000 nan 9.200000 14.300000 15.354819 0.029792 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.023119 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 32 nan 14.395000 nan 2222.994095 nan 4.139215 98.290000 nan 9.200000 14.300000 15.356949 0.059584 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.033072 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 64 nan 23.355000 nan 2740.312567 nan 5.102462 98.290000 nan 9.200000 14.300000 15.353874 0.119168 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.053657 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 128 nan 41.156000 nan 3110.117601 nan 5.791039 98.290000 nan 9.200000 14.300000 15.352365 0.238336 25.000000 l3 0.192000 4.260000 0.001900 U96-Quadcore-A53_INT4_25%_MLP 0.094554 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_25.0
MLP U96-Quadcore-A53 INT4 nan 2 nan 26.779000 nan 74.685388 nan 0.434669 98.620000 nan 9.200000 14.300000 15.353571 0.011640 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.061524 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 4 nan 26.904000 nan 148.676777 nan 0.865299 98.620000 nan 9.200000 14.300000 15.359184 0.023280 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.061811 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 8 nan 27.285000 nan 293.201393 nan 1.706432 98.620000 nan 9.200000 14.300000 15.370554 0.046560 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.062686 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 16 nan 33.679000 nan 475.073488 nan 2.764928 98.620000 nan 9.200000 14.300000 15.363093 0.093120 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.077376 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 32 nan 47.012000 nan 680.677274 nan 3.961542 98.620000 nan 9.200000 14.300000 15.362243 0.186240 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.108008 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 64 nan 74.628000 nan 857.586965 nan 4.991156 98.620000 nan 9.200000 14.300000 15.363118 0.372480 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.171455 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 128 nan 129.957000 nan 984.941173 nan 5.732358 98.620000 nan 9.200000 14.300000 15.360483 0.744960 50.000000 l3 0.192000 4.260000 0.005820 U96-Quadcore-A53_INT4_50%_MLP 0.298571 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_50.0
MLP U96-Quadcore-A53 INT4 nan 2 nan 101.382000 nan 19.727368 nan 0.395119 98.770000 nan 9.200000 14.300000 15.314286 0.040058 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.232921 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 4 nan 102.873000 nan 38.882894 nan 0.778785 98.770000 nan 9.200000 14.300000 15.320663 0.080116 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.236346 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 8 nan 100.440000 nan 79.649542 nan 1.595301 98.770000 nan 9.200000 14.300000 15.320353 0.160232 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.230757 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 16 nan 124.383000 nan 128.634942 nan 2.576429 98.770000 nan 9.200000 14.300000 15.321807 0.320464 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.285765 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 32 nan 170.250000 nan 187.958884 nan 3.764628 98.770000 nan 9.200000 14.300000 15.310865 0.640928 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.391142 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 64 nan 253.227000 nan 252.737662 nan 5.062083 98.770000 nan 9.200000 14.300000 15.320570 1.281856 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.581778 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
MLP U96-Quadcore-A53 INT4 nan 128 nan 434.834000 nan 294.365206 nan 5.895841 98.770000 nan 9.200000 14.300000 15.322039 2.563712 100.000000 l3 0.192000 4.260000 0.020000 U96-Quadcore-A53_INT4_100%_MLP 0.999012 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP ZCU104-Bismo INT2 nan 2 nan 0.177743 nan 11252.188550 nan 7.527714 96.850000 nan 9.200000 14.300000 15.375000 0.001338 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.000408 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 4 nan 0.237272 nan 16858.317640 nan 11.278215 96.850000 nan 9.200000 14.300000 15.400000 0.002676 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.000545 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 8 nan 0.352492 nan 22695.544100 nan 15.183319 96.850000 nan 9.200000 14.300000 15.350000 0.005352 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.000810 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 16 nan 0.588134 nan 27204.670770 nan 18.199925 96.850000 nan 9.200000 14.300000 15.375000 0.010704 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.001351 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 32 nan 1.049068 nan 30503.274480 nan 20.406691 96.850000 nan 9.200000 14.300000 15.400000 0.021408 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.002410 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 64 nan 1.952913 nan 32771.555480 nan 21.924171 96.850000 nan 9.200000 14.300000 15.375000 0.042816 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.004487 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 128 nan 3.816102 nan 33542.080370 nan 22.439652 96.850000 nan 9.200000 14.300000 15.400000 0.085632 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-Bismo_INT2_12.50%_MLP 0.008767 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_12.5
MLP ZCU104-Bismo INT2 nan 2 nan 0.378882 nan 5278.693924 nan 9.828928 98.040000 nan 9.200000 14.300000 15.350000 0.003724 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.000870 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 4 nan 0.511098 nan 7826.287718 nan 14.572548 98.040000 nan 9.200000 14.300000 15.325000 0.007448 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.001174 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 8 nan 0.783952 nan 10204.712920 nan 19.001175 98.040000 nan 9.200000 14.300000 15.275000 0.014896 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.001801 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 16 nan 1.346831 nan 11879.742850 nan 22.120081 98.040000 nan 9.200000 14.300000 15.400000 0.029792 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.003094 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 32 nan 2.448887 nan 13067.161250 nan 24.331054 98.040000 nan 9.200000 14.300000 15.375000 0.059584 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.005626 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 64 nan 4.681727 nan 13670.169150 nan 25.453855 98.040000 nan 9.200000 14.300000 15.325000 0.119168 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.010756 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 128 nan 9.032107 nan 14171.665590 nan 26.387641 98.040000 nan 9.200000 14.300000 15.225000 0.238336 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-Bismo_INT2_25%_MLP 0.020751 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_25.0
MLP ZCU104-Bismo INT2 nan 2 nan 0.849005 nan 2355.697897 nan 13.710162 98.490000 nan 9.200000 14.300000 15.350000 0.011640 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.001951 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 4 nan 1.227849 nan 3257.728513 nan 18.959980 98.490000 nan 9.200000 14.300000 15.225000 0.023280 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.002821 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 8 nan 2.001101 nan 3997.798612 nan 23.267188 98.490000 nan 9.200000 14.300000 15.375000 0.046560 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.004597 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 16 nan 3.562573 nan 4491.135663 nan 26.138410 98.490000 nan 9.200000 14.300000 15.400000 0.093120 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.008185 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 32 nan 6.650998 nan 4811.308017 nan 28.001813 98.490000 nan 9.200000 14.300000 15.325000 0.186240 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.015280 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 64 nan 12.741983 nan 5022.766080 nan 29.232499 98.490000 nan 9.200000 14.300000 15.400000 0.372480 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.029274 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 128 nan 25.079286 nan 5103.813562 nan 29.704195 98.490000 nan 9.200000 14.300000 15.400000 0.744960 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-Bismo_INT2_50%_MLP 0.057619 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_50.0
MLP ZCU104-Bismo INT2 nan 2 nan 2.147294 nan 931.404959 nan 18.655110 98.750000 nan 9.200000 14.300000 15.175000 0.040058 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.004933 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 4 nan 3.365645 nan 1188.479510 nan 23.804056 98.750000 nan 9.200000 14.300000 15.425000 0.080116 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.007732 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 8 nan 5.782697 nan 1383.437545 nan 27.708871 98.750000 nan 9.200000 14.300000 15.550000 0.160232 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.013285 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 16 nan 10.675147 nan 1498.808400 nan 30.019633 98.750000 nan 9.200000 14.300000 15.350000 0.320464 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.024526 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 32 nan 20.320172 nan 1574.789820 nan 31.541465 98.750000 nan 9.200000 14.300000 15.175000 0.640928 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.046685 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 64 nan 39.836965 nan 1606.548089 nan 32.177552 98.750000 nan 9.200000 14.300000 15.400000 1.281856 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.091524 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT2 nan 128 nan 79.756498 nan 1604.884909 nan 32.144240 98.750000 nan 9.200000 14.300000 15.225000 2.563712 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-Bismo_INT2_100%_MLP 0.183237 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_MLP_100.0
MLP ZCU104-Bismo INT4 nan 2 nan 0.221656 nan 9022.990580 nan 6.036381 97.540000 nan 9.200000 14.300000 15.375000 0.001338 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.000509 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 4 nan 0.326347 nan 12256.884690 nan 8.199856 97.540000 nan 9.200000 14.300000 15.350000 0.002676 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.000750 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 8 nan 0.519242 nan 15407.065260 nan 10.307327 97.540000 nan 9.200000 14.300000 15.250000 0.005352 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.001193 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 16 nan 0.928151 nan 17238.574330 nan 11.532606 97.540000 nan 9.200000 14.300000 15.775000 0.010704 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.002132 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 32 nan 1.779600 nan 17981.563840 nan 12.029666 97.540000 nan 9.200000 14.300000 15.425000 0.021408 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.004089 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 64 nan 3.351983 nan 19093.175590 nan 12.773334 97.540000 nan 9.200000 14.300000 15.400000 0.042816 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.007701 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 128 nan 6.721276 nan 19044.002950 nan 12.740438 97.540000 nan 9.200000 14.300000 15.400000 0.085632 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-Bismo_INT4_12.50%_MLP 0.015442 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_12.5
MLP ZCU104-Bismo INT4 nan 2 nan 0.488890 nan 4090.899793 nan 7.617255 98.290000 nan 9.200000 14.300000 15.350000 0.003724 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.001123 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 4 nan 0.733966 nan 5449.841498 nan 10.147605 98.290000 nan 9.200000 14.300000 15.375000 0.007448 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.001686 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 8 nan 1.242979 nan 6436.147982 nan 11.984108 98.290000 nan 9.200000 14.300000 15.225000 0.014896 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.002856 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 16 nan 2.257038 nan 7088.935974 nan 13.199599 98.290000 nan 9.200000 14.300000 15.325000 0.029792 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.005185 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 32 nan 4.331067 nan 7388.479559 nan 13.757349 98.290000 nan 9.200000 14.300000 15.400000 0.059584 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.009950 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 64 nan 8.464694 nan 7560.816729 nan 14.078241 98.290000 nan 9.200000 14.300000 15.375000 0.119168 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.019447 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 128 nan 16.747152 nan 7643.090598 nan 14.231435 98.290000 nan 9.200000 14.300000 15.550000 0.238336 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-Bismo_INT4_25%_MLP 0.038476 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_25.0
MLP ZCU104-Bismo INT4 nan 2 nan 1.190105 nan 1680.524129 nan 9.780650 98.620000 nan 9.200000 14.300000 15.275000 0.011640 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.002734 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 4 nan 1.907534 nan 2096.948426 nan 12.204240 98.620000 nan 9.200000 14.300000 15.200000 0.023280 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.004382 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 8 nan 3.340349 nan 2394.959329 nan 13.938663 98.620000 nan 9.200000 14.300000 15.475000 0.046560 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.007674 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 16 nan 6.277260 nan 2548.882793 nan 14.834498 98.620000 nan 9.200000 14.300000 15.375000 0.093120 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.014422 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 32 nan 12.228749 nan 2616.784432 nan 15.229685 98.620000 nan 9.200000 14.300000 15.350000 0.186240 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.028095 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 64 nan 23.566854 nan 2715.678554 nan 15.805249 98.620000 nan 9.200000 14.300000 15.400000 0.372480 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.054144 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 128 nan 46.917617 nan 2728.186302 nan 15.878044 98.620000 nan 9.200000 14.300000 15.400000 0.744960 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-Bismo_INT4_50%_MLP 0.107791 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_50.0
MLP ZCU104-Bismo INT4 nan 2 nan 3.259364 nan 613.616569 nan 12.290126 98.770000 nan 9.200000 14.300000 15.225000 0.040058 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.007488 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 4 nan 5.631140 nan 710.335702 nan 14.227314 98.770000 nan 9.200000 14.300000 15.325000 0.080116 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.012937 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 8 nan 10.265632 nan 779.299316 nan 15.608586 98.770000 nan 9.200000 14.300000 15.300000 0.160232 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.023585 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 16 nan 19.714788 nan 811.573525 nan 16.255006 98.770000 nan 9.200000 14.300000 15.475000 0.320464 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.045294 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 32 nan 38.386224 nan 833.632399 nan 16.696823 98.770000 nan 9.200000 14.300000 15.175000 0.640928 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.088191 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 64 nan 76.340167 nan 838.352895 nan 16.791370 98.770000 nan 9.200000 14.300000 15.300000 1.281856 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.175388 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
MLP ZCU104-Bismo INT4 nan 128 nan 154.567620 nan 828.116523 nan 16.586346 98.770000 nan 9.200000 14.300000 15.300000 2.563712 100.000000 l3 8.800000 19.200000 0.020000 ZCU104-Bismo_INT4_100%_MLP 0.355112 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_MLP_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MLP ZCU104-FINN INT2 nan 1 nan 0.002000 nan 1000000.000000 nan 669.000000 96.850000 nan 9.200000 13.850000 14.182500 0.000669 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000005 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 2 nan 0.002000 nan 1000000.000000 nan 669.000000 96.850000 nan 9.200000 13.850000 14.067500 0.001338 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000005 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 4 nan 0.003000 nan 1333333.333000 nan 892.000000 96.850000 nan 9.200000 13.850000 14.100000 0.002676 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000007 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 8 nan 0.004000 nan 2000000.000000 nan 1338.000000 96.850000 nan 9.200000 13.850000 14.020000 0.005352 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000009 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 16 nan 0.006000 nan 2666666.667000 nan 1784.000000 96.850000 nan 9.200000 13.850000 14.060000 0.010704 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000014 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 32 nan 0.010000 nan 3200000.000000 nan 2140.800000 96.850000 nan 9.200000 13.850000 14.000000 0.021408 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000023 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 64 nan 0.019000 nan 3368421.053000 nan 2253.473684 96.850000 nan 9.200000 13.850000 14.045000 0.042816 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000044 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 128 nan 0.035000 nan 3657142.857000 nan 2446.628571 96.850000 nan 9.200000 13.850000 14.055000 0.085632 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000080 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 256 nan 0.068000 nan 3764705.882000 nan 2518.588235 96.850000 nan 9.200000 13.850000 14.075000 0.171264 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000156 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 512 nan 0.133000 nan 3849624.060000 nan 2575.398496 96.850000 nan 9.200000 13.850000 14.120000 0.342528 12.500000 l3 30.700000 19.200000 0.000700 ZCU104-FINN_INT2_12.50%_MLP 0.000306 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_12.5
MLP ZCU104-FINN INT2 nan 1 nan 0.002000 nan 500000.000000 nan 931.000000 98.040000 nan 9.200000 13.860000 14.130000 0.001862 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000005 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 2 nan 0.003000 nan 666666.667000 nan 1241.333334 98.040000 nan 9.200000 13.860000 14.010000 0.003724 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000007 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 4 nan 0.004000 nan 1000000.000000 nan 1862.000000 98.040000 nan 9.200000 13.860000 13.980000 0.007448 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000009 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 8 nan 0.007000 nan 1142857.143000 nan 2128.000000 98.040000 nan 9.200000 13.860000 14.022500 0.014896 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000016 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 16 nan 0.010000 nan 1600000.000000 nan 2979.200000 98.040000 nan 9.200000 13.860000 14.060000 0.029792 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000023 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 32 nan 0.019000 nan 1684210.526000 nan 3135.999999 98.040000 nan 9.200000 13.860000 14.065000 0.059584 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000044 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 64 nan 0.036000 nan 1777777.778000 nan 3310.222223 98.040000 nan 9.200000 13.860000 14.005000 0.119168 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000083 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 128 nan 0.068000 nan 1882352.941000 nan 3504.941176 98.040000 nan 9.200000 13.860000 14.102500 0.238336 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000156 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 256 nan 0.134000 nan 1910447.761000 nan 3557.253731 98.040000 nan 9.200000 13.860000 14.145000 0.476672 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000308 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 512 nan 0.265000 nan 1932075.472000 nan 3597.524529 98.040000 nan 9.200000 13.860000 14.182500 0.953344 25.000000 l3 30.700000 19.200000 0.001900 ZCU104-FINN_INT2_25%_MLP 0.000609 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_25.0
MLP ZCU104-FINN INT2 nan 1 nan 0.008000 nan 125000.000000 nan 727.500000 98.490000 nan 9.200000 12.760000 13.020000 0.005820 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000018 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 2 nan 0.011000 nan 181818.182000 nan 1058.181819 98.490000 nan 9.200000 12.760000 12.997500 0.011640 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000025 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 4 nan 0.015000 nan 266666.667000 nan 1552.000002 98.490000 nan 9.200000 12.760000 13.005000 0.023280 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000034 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 8 nan 0.023000 nan 347826.087000 nan 2024.347826 98.490000 nan 9.200000 12.760000 12.940000 0.046560 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000053 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 16 nan 0.039000 nan 410256.410000 nan 2387.692306 98.490000 nan 9.200000 12.760000 12.932500 0.093120 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000090 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 32 nan 0.072000 nan 444444.444000 nan 2586.666664 98.490000 nan 9.200000 12.760000 13.020000 0.186240 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000165 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 64 nan 0.138000 nan 463768.116000 nan 2699.130435 98.490000 nan 9.200000 12.760000 13.057500 0.372480 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000317 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 128 nan 0.269000 nan 475836.431000 nan 2769.368028 98.490000 nan 9.200000 12.760000 13.037500 0.744960 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.000618 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 256 nan 0.531000 nan 482109.228000 nan 2805.875707 98.490000 nan 9.200000 12.760000 13.130000 1.489920 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.001220 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 512 nan 1.056000 nan 484848.485000 nan 2821.818183 98.490000 nan 9.200000 12.760000 13.185000 2.979840 50.000000 l3 30.700000 19.200000 0.005820 ZCU104-FINN_INT2_50%_MLP 0.002426 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_50.0
MLP ZCU104-FINN INT2 nan 1 nan 0.023000 nan 43478.261000 nan 870.826090 98.750000 nan 9.200000 13.710000 13.952500 0.020029 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000053 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 2 nan 0.036000 nan 55555.556000 nan 1112.722231 98.750000 nan 9.200000 13.710000 13.905000 0.040058 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000083 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 4 nan 0.061000 nan 65573.770000 nan 1313.377039 98.750000 nan 9.200000 13.710000 13.940000 0.080116 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000140 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 8 nan 0.111000 nan 72072.072000 nan 1443.531530 98.750000 nan 9.200000 13.710000 13.932500 0.160232 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000255 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 16 nan 0.210000 nan 76190.476000 nan 1526.019044 98.750000 nan 9.200000 13.710000 13.987500 0.320464 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000482 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 32 nan 0.408000 nan 78431.373000 nan 1570.901970 98.750000 nan 9.200000 13.710000 13.900000 0.640928 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.000937 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 64 nan 0.806000 nan 79404.467000 nan 1590.392070 98.750000 nan 9.200000 13.710000 14.277500 1.281856 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.001852 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 128 nan 1.600000 nan 80000.000000 nan 1602.320000 98.750000 nan 9.200000 13.710000 14.365000 2.563712 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.003676 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 256 nan 3.190000 nan 80250.784000 nan 1607.342953 98.750000 nan 9.200000 13.710000 14.515000 5.127424 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.007329 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT2 nan 512 nan 6.369000 nan 80389.386000 nan 1610.119012 98.750000 nan 9.200000 13.710000 14.950000 10.254848 100.000000 l3 30.700000 19.200000 0.020000 ZCU104-FINN_INT2_100%_MLP 0.014632 INT2_ZCU104-FINN ZCU104-FINN_INT2_MLP_100.0
MLP ZCU104-FINN INT4 nan 1 nan 0.003000 nan 333333.330000 nan 222.999998 97.540000 nan 9.200000 14.200000 14.650000 0.000669 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000007 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 2 nan 0.004000 nan 500000.000000 nan 334.500000 97.540000 nan 9.200000 14.200000 14.650000 0.001338 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000009 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 4 nan 0.006000 nan 666666.670000 nan 446.000002 97.540000 nan 9.200000 14.200000 14.650000 0.002676 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000014 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 8 nan 0.009000 nan 888888.890000 nan 594.666667 97.540000 nan 9.200000 14.200000 14.650000 0.005352 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000021 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 16 nan 0.016000 nan 1000000.000000 nan 669.000000 97.540000 nan 9.200000 14.200000 14.650000 0.010704 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000037 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 32 nan 0.029000 nan 1103448.280000 nan 738.206899 97.540000 nan 9.200000 14.200000 14.650000 0.021408 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000067 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 64 nan 0.055000 nan 1163636.360000 nan 778.472725 97.540000 nan 9.200000 14.200000 14.650000 0.042816 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000126 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 128 nan 0.109000 nan 1174311.930000 nan 785.614681 97.540000 nan 9.200000 14.200000 14.650000 0.085632 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000250 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 256 nan 0.216000 nan 1185185.190000 nan 792.888892 97.540000 nan 9.200000 14.200000 14.650000 0.171264 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000496 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 512 nan 0.429000 nan 1193473.190000 nan 798.433564 97.540000 nan 9.200000 14.200000 14.650000 0.342528 12.500000 l3 8.800000 19.200000 0.000700 ZCU104-FINN_INT4_12.50%_MLP 0.000986 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_12.5
MLP ZCU104-FINN INT4 nan 1 nan 0.005000 nan 200000.000000 nan 372.400000 98.290000 nan 9.200000 14.200000 14.422500 0.001862 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000011 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 2 nan 0.008000 nan 285714.286000 nan 532.000001 98.290000 nan 9.200000 14.200000 14.327500 0.003724 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000018 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 4 nan 0.012000 nan 400000.000000 nan 744.800000 98.290000 nan 9.200000 14.200000 14.325000 0.007448 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000028 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 8 nan 0.016000 nan 470588.235000 nan 876.235294 98.290000 nan 9.200000 14.200000 14.320000 0.014896 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000037 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 16 nan 0.032000 nan 533333.333000 nan 993.066666 98.290000 nan 9.200000 14.200000 14.352500 0.029792 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000074 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 32 nan 0.064000 nan 561403.509000 nan 1045.333334 98.290000 nan 9.200000 14.200000 14.335000 0.059584 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000147 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 64 nan 0.128000 nan 576576.577000 nan 1073.585586 98.290000 nan 9.200000 14.200000 14.415000 0.119168 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000294 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 128 nan 0.256000 nan 589861.751000 nan 1098.322580 98.290000 nan 9.200000 14.200000 14.467500 0.238336 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.000588 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 256 nan 0.512000 nan 595348.837000 nan 1108.539534 98.290000 nan 9.200000 14.200000 14.530000 0.476672 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.001176 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 512 nan 1.024000 nan 598130.841000 nan 1113.719626 98.290000 nan 9.200000 14.200000 14.595000 0.953344 25.000000 l3 8.800000 19.200000 0.001900 ZCU104-FINN_INT4_25%_MLP 0.002353 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_25.0
MLP ZCU104-FINN INT4 nan 1 nan 0.014000 nan 71428.571000 nan 415.714283 98.620000 nan 9.200000 14.200000 14.475000 0.005820 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000032 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 2 nan 0.018000 nan 105263.158000 nan 612.631580 98.620000 nan 9.200000 14.200000 14.340000 0.011640 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000041 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 4 nan 0.024000 nan 153846.154000 nan 895.384616 98.620000 nan 9.200000 14.200000 14.410000 0.023280 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000055 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 8 nan 0.040000 nan 186046.512000 nan 1082.790700 98.620000 nan 9.200000 14.200000 14.385000 0.046560 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000092 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 16 nan 0.080000 nan 213333.333000 nan 1241.599998 98.620000 nan 9.200000 14.200000 14.432500 0.093120 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000184 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 32 nan 0.128000 nan 226950.355000 nan 1320.851066 98.620000 nan 9.200000 14.200000 14.512500 0.186240 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000294 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 64 nan 0.256000 nan 235294.118000 nan 1369.411767 98.620000 nan 9.200000 14.200000 14.640000 0.372480 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.000588 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 128 nan 0.512000 nan 239252.336000 nan 1392.448596 98.620000 nan 9.200000 14.200000 14.587500 0.744960 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.001176 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 256 nan 1.024000 nan 241737.488000 nan 1406.912180 98.620000 nan 9.200000 14.200000 14.980000 1.489920 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.002353 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0
MLP ZCU104-FINN INT4 nan 512 nan 2.048000 nan 242884.250000 nan 1413.586335 98.620000 nan 9.200000 14.200000 15.112500 2.979840 50.000000 l3 8.800000 19.200000 0.005820 ZCU104-FINN_INT4_50%_MLP 0.004705 INT4_ZCU104-FINN ZCU104-FINN_INT4_MLP_50.0

CIFAR-10

download csv here

NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV NCS2 FP16 nan 1 3.400000 1.900040 293.812000 526.305000 2.355983 4.220269 77.820000 nan 0.530000 1.200000 1.560000 0.008019 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.000130 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 2 5.610000 2.553630 356.569000 783.197000 2.859211 6.280203 77.820000 nan 0.530000 1.200000 1.580000 0.016037 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.000175 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 4 10.090000 3.949310 396.432000 1012.840000 3.178860 8.121636 77.820000 nan 0.530000 1.200000 1.590000 0.032075 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.000271 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 8 19.180000 6.920080 417.172000 1156.060000 3.345167 9.270071 77.820000 nan 0.530000 1.200000 1.590000 0.064149 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.000475 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 16 37.010000 12.604600 432.293000 1269.380000 3.466418 10.178747 77.820000 nan 0.530000 1.200000 1.580000 0.128299 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.000866 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 32 72.740000 23.689600 439.912000 1350.800000 3.527512 10.831628 77.820000 nan 0.530000 1.200000 1.580000 0.256598 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.001627 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 64 143.090000 45.677200 447.278000 1401.140000 3.586577 11.235288 77.820000 nan 0.530000 1.200000 1.590000 0.513195 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.003137 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 128 284.730000 89.225100 449.542000 1434.570000 3.604732 11.503352 77.820000 nan 0.530000 1.200000 1.580000 1.026391 12.500000 l3 0.500000 12.800000 0.010000 NCS2_FP16_12.50%_CNV 0.006128 FP16_NCS2 NCS2_FP16_CNV_12.5
CNV NCS2 FP16 nan 1 3.500000 1.954330 285.517000 511.684000 8.711618 15.612365 83.280000 nan 0.530000 1.200000 1.590000 0.030512 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.000134 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 2 5.800000 2.806340 344.874000 712.672000 10.522703 21.744857 83.280000 nan 0.530000 1.200000 1.620000 0.061023 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.000193 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 4 10.730000 4.625980 372.730000 864.682000 11.372638 26.382945 83.280000 nan 0.530000 1.200000 1.620000 0.122047 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.000318 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 8 20.310000 7.970990 393.913000 1003.640000 12.018968 30.622795 83.280000 nan 0.530000 1.200000 1.630000 0.244094 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.000547 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 16 39.230000 14.640300 407.873000 1092.870000 12.444912 33.345357 83.280000 nan 0.530000 1.200000 1.640000 0.488188 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.001005 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 32 76.520000 27.921000 418.169000 1146.090000 12.759060 34.969191 83.280000 nan 0.530000 1.200000 1.650000 0.976375 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.001918 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 64 151.570000 53.294900 422.250000 1200.870000 12.883579 36.640624 83.280000 nan 0.530000 1.200000 1.650000 1.952751 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.003660 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 128 299.800000 105.630000 426.946000 1211.780000 13.026862 36.973507 83.280000 nan 0.530000 1.200000 1.670000 3.905502 25.000000 l3 0.500000 12.800000 0.030000 NCS2_FP16_25%_CNV 0.007254 FP16_NCS2 NCS2_FP16_CNV_25.0
CNV NCS2 FP16 nan 1 3.970000 2.385490 251.922000 419.201000 29.959480 49.852907 85.550000 nan 0.530000 1.200000 1.655401 0.118924 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.000164 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 2 7.030000 3.939020 284.481000 507.740000 33.831515 60.382287 85.550000 nan 0.530000 1.200000 1.676720 0.237847 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.000271 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 4 12.860000 6.689380 310.979000 597.963000 36.982753 71.111934 85.550000 nan 0.530000 1.200000 1.710000 0.475695 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.000459 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 8 24.890000 12.415300 321.433000 644.367000 38.225981 76.630467 85.550000 nan 0.530000 1.200000 1.730000 0.951389 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.000853 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 16 47.840000 23.136900 334.428000 691.537000 39.771394 82.240094 85.550000 nan 0.530000 1.200000 1.750000 1.902778 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.001589 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 32 94.620000 44.706600 338.178000 715.779000 40.217357 85.123041 85.550000 nan 0.530000 1.200000 1.770000 3.805556 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.003070 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 64 187.070000 87.244400 342.120000 733.571000 40.686154 87.238931 85.550000 nan 0.530000 1.200000 1.780000 7.611113 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.005992 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 128 370.830000 173.158000 345.169000 739.209000 41.048753 87.909422 85.550000 nan 0.530000 1.200000 1.800000 15.222225 50.000000 l3 0.500000 12.800000 0.120000 NCS2_FP16_50%_CNV 0.011892 FP16_NCS2 NCS2_FP16_CNV_50.0
CNV NCS2 FP16 nan 1 6.600000 4.979140 151.555000 200.838000 71.147495 94.283399 87.020000 nan 0.530000 1.200000 1.728796 0.469450 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.000342 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 2 12.290000 8.938290 162.738000 223.757000 76.397354 105.042724 87.020000 nan 0.530000 1.200000 1.780300 0.938900 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.000614 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 4 23.350000 16.847300 171.284000 237.426000 80.409274 111.459636 87.020000 nan 0.530000 1.200000 1.823024 1.877800 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.001157 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 8 45.130000 31.865800 177.259000 251.053000 83.214238 117.856831 87.020000 nan 0.530000 1.200000 1.860921 3.755600 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.002188 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 16 88.100000 61.773200 181.621000 259.012000 85.261978 121.593183 87.020000 nan 0.530000 1.200000 1.879459 7.511200 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.004242 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 32 174.800000 121.825000 183.067000 262.673000 85.940803 123.311840 87.020000 nan 0.530000 1.200000 1.903725 15.022400 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.008366 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 64 348.380000 242.098000 183.706000 264.356000 86.240782 124.101924 87.020000 nan 0.530000 1.200000 1.903671 30.044800 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.016626 FP16_NCS2 NCS2_FP16_CNV_100.0
CNV NCS2 FP16 nan 128 694.750000 481.675000 184.240000 265.739000 86.491468 124.751174 87.020000 nan 0.530000 1.200000 1.911020 60.089600 100.000000 l3 0.500000 12.800000 0.470000 NCS2_FP16_100%_CNV 0.033080 FP16_NCS2 NCS2_FP16_CNV_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV TX2-maxn FP16 maxn 1 0.720000 0.414922 1412.410000 2547.180000 11.325658 20.425011 77.810000 nan 1.800000 5.700000 8.300000 0.008019 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000028 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 2 0.930000 0.438527 2164.900000 5106.670000 17.359632 40.948732 77.810000 nan 1.800000 5.700000 8.400000 0.016037 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000030 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 4 1.290000 0.461734 3121.950000 10037.500000 25.033906 80.487460 77.810000 nan 1.800000 5.700000 8.800000 0.032075 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000032 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 8 2.160000 0.571328 3792.590000 15138.500000 30.411550 121.390727 77.810000 nan 1.800000 5.700000 8.900000 0.064149 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000039 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 16 3.790000 0.812359 4284.520000 21645.800000 34.356178 173.570657 77.810000 nan 1.800000 5.700000 8.800000 0.128299 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000056 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 32 7.010000 1.259780 4633.480000 27253.600000 37.154375 218.537788 77.810000 nan 1.800000 5.700000 8.800000 0.256598 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000087 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 64 13.410000 2.121190 4899.520000 31458.300000 39.287663 252.253915 77.810000 nan 1.800000 5.700000 8.800000 0.513195 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000146 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 128 26.090000 3.799620 5044.330000 34197.200000 40.448848 274.216267 77.810000 nan 1.800000 5.700000 8.900000 1.026391 12.500000 l3 1.330000 59.700000 0.010000 TX2-maxn_FP16_12.50%_CNV 0.000261 FP16_TX2-maxn TX2-maxn_FP16_CNV_12.5
CNV TX2-maxn FP16 maxn 1 0.740000 0.419990 1359.890000 2561.590000 41.492599 78.158548 83.310000 nan 1.800000 5.700000 8.600000 0.030512 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000029 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 2 0.960000 0.457822 2102.670000 4744.450000 64.156104 144.761387 83.310000 nan 1.800000 5.700000 9.300000 0.061023 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000031 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 4 1.510000 0.606527 2745.310000 6864.560000 83.764163 209.449615 83.310000 nan 1.800000 5.700000 9.300000 0.122047 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000042 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 8 2.440000 0.807133 3379.540000 10554.200000 103.115619 322.026922 83.310000 nan 1.800000 5.700000 8.800000 0.244094 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000055 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 16 4.220000 1.186890 3878.790000 14260.100000 118.348601 435.100349 83.310000 nan 1.800000 5.700000 9.100000 0.488188 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000082 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 32 7.760000 1.931720 4179.590000 16810.900000 127.526530 512.929675 83.310000 nan 1.800000 5.700000 9.100000 0.976375 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000133 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 64 14.630000 3.532880 4452.170000 18508.500000 135.843418 564.726392 83.310000 nan 1.800000 5.700000 9.100000 1.952751 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000243 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 128 28.450000 6.372630 4571.430000 20321.500000 139.482247 620.044162 83.310000 nan 1.800000 5.700000 9.100000 3.905502 25.000000 l3 1.330000 59.700000 0.030000 TX2-maxn_FP16_25%_CNV 0.000438 FP16_TX2-maxn TX2-maxn_FP16_CNV_25.0
CNV TX2-maxn FP16 maxn 1 0.870000 0.526068 1164.960000 1953.650000 138.541279 232.335161 85.570000 nan 1.800000 5.700000 9.200000 0.118924 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000036 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 2 1.300000 0.754633 1546.830000 2721.230000 183.954648 323.618566 85.570000 nan 1.800000 5.700000 10.800000 0.237847 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000052 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 4 2.060000 1.130430 1988.350000 3619.860000 236.461812 430.486913 85.570000 nan 1.800000 5.700000 11.400000 0.475695 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000078 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 8 3.430000 1.648170 2403.760000 5038.770000 285.863879 599.228849 85.570000 nan 1.800000 5.700000 11.400000 0.951389 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000113 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 16 5.880000 2.653670 2687.660000 6130.750000 319.626300 729.091081 85.570000 nan 1.800000 5.700000 11.100000 1.902778 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000182 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 32 11.040000 4.842130 2892.660000 6930.860000 344.005645 824.243072 85.570000 nan 1.800000 5.700000 11.300000 3.805556 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000333 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 64 20.870000 8.829060 3103.030000 7445.220000 369.023610 885.412633 85.570000 nan 1.800000 5.700000 11.200000 7.611113 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.000606 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 128 40.010000 16.883000 3240.510000 7707.190000 385.373232 916.567058 85.570000 nan 1.800000 5.700000 11.100000 15.222225 50.000000 l3 1.330000 59.700000 0.120000 TX2-maxn_FP16_50%_CNV 0.001159 FP16_TX2-maxn TX2-maxn_FP16_CNV_50.0
CNV TX2-maxn FP16 maxn 1 1.490000 1.120550 681.758000 906.399000 320.051293 425.509011 87.060000 nan 1.800000 5.700000 11.800000 0.469450 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.000077 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 2 2.450000 1.823710 818.545000 1120.550000 384.265950 526.042197 87.060000 nan 1.800000 5.700000 13.600000 0.938900 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.000125 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 4 3.860000 2.998860 1057.850000 1339.580000 496.607683 628.865831 87.060000 nan 1.800000 5.700000 13.600000 1.877800 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.000206 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 8 6.370000 4.773560 1276.810000 1687.240000 599.398454 792.074818 87.060000 nan 1.800000 5.700000 14.400000 3.755600 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.000328 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 16 11.520000 8.360530 1422.220000 1924.110000 667.661179 903.273439 87.060000 nan 1.800000 5.700000 14.400000 7.511200 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.000574 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 32 21.500000 15.409500 1512.560000 2110.740000 710.071292 990.886893 87.060000 nan 1.800000 5.700000 14.400000 15.022400 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.001058 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 64 41.530000 29.418700 1572.960000 2191.580000 738.426072 1028.837231 87.060000 nan 1.800000 5.700000 14.300000 30.044800 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.002020 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP16 maxn 128 83.610000 57.473600 1549.170000 2231.140000 727.257857 1047.408673 87.060000 nan 1.800000 5.700000 14.800000 60.089600 100.000000 l3 1.330000 59.700000 0.470000 TX2-maxn_FP16_100%_CNV 0.003947 FP16_TX2-maxn TX2-maxn_FP16_CNV_100.0
CNV TX2-maxn FP32 maxn 1 0.690000 0.377367 1454.550000 2845.080000 11.663565 22.813775 77.840000 nan 1.800000 5.700000 8.000000 0.008019 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000026 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 2 0.910000 0.398443 2270.510000 5534.270000 18.206484 44.377518 77.840000 nan 1.800000 5.700000 8.600000 0.016037 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000027 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 4 1.290000 0.439773 3150.770000 9017.970000 25.265004 72.312180 77.840000 nan 1.800000 5.700000 9.100000 0.032075 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000030 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 8 2.260000 0.665305 3592.980000 12436.200000 28.810942 99.721858 77.840000 nan 1.800000 5.700000 9.100000 0.064149 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000046 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 16 4.160000 1.025160 4079.680000 16528.400000 32.713632 132.535884 77.840000 nan 1.800000 5.700000 9.300000 0.128299 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000070 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 32 7.600000 1.674030 4394.850000 19868.800000 35.240878 159.321470 77.840000 nan 1.800000 5.700000 9.300000 0.256598 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000115 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 64 14.560000 3.139440 4571.430000 22136.200000 36.656816 177.503016 77.840000 nan 1.800000 5.700000 8.900000 0.513195 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000216 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 128 27.930000 5.594620 4740.740000 23411.600000 38.014458 187.730035 77.840000 nan 1.800000 5.700000 9.300000 1.026391 12.500000 l3 0.670000 59.700000 0.010000 TX2-maxn_FP32_12.50%_CNV 0.000384 FP32_TX2-maxn TX2-maxn_FP32_CNV_12.5
CNV TX2-maxn FP32 maxn 1 0.670000 0.369688 1497.080000 2898.050000 45.678504 88.424525 83.250000 nan 1.800000 5.700000 9.700000 0.030512 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000025 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 2 1.010000 0.505453 1996.100000 3985.770000 60.904468 121.612746 83.250000 nan 1.800000 5.700000 9.500000 0.061023 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000035 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 4 1.630000 0.789125 2443.910000 5151.040000 74.567927 157.167152 83.250000 nan 1.800000 5.700000 10.400000 0.122047 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000054 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 8 2.700000 1.110290 3020.650000 7464.430000 92.165263 227.752688 83.250000 nan 1.800000 5.700000 10.400000 0.244094 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000076 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 16 4.940000 1.711640 3482.990000 9552.860000 106.272057 291.474304 83.250000 nan 1.800000 5.700000 10.000000 0.488188 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000118 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 32 8.910000 3.050750 3644.130000 11378.400000 111.188718 347.174691 83.250000 nan 1.800000 5.700000 10.200000 0.976375 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000210 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 64 16.830000 5.528500 3908.400000 12100.300000 119.252053 369.201111 83.250000 nan 1.800000 5.700000 10.000000 1.952751 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000380 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 128 32.070000 9.922250 4047.430000 12971.100000 123.494099 395.770727 83.250000 nan 1.800000 5.700000 10.900000 3.905502 25.000000 l3 0.670000 59.700000 0.030000 TX2-maxn_FP32_25%_CNV 0.000681 FP32_TX2-maxn TX2-maxn_FP32_CNV_25.0
CNV TX2-maxn FP32 maxn 1 0.960000 0.649250 1038.540000 1535.230000 123.506953 182.575134 85.600000 nan 1.800000 5.700000 12.400000 0.118924 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000045 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 2 1.560000 1.040060 1278.400000 1936.360000 152.031976 230.278972 85.600000 nan 1.800000 5.700000 12.500000 0.237847 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000071 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 4 2.660000 1.742470 1519.290000 2328.430000 180.679491 276.905362 85.600000 nan 1.800000 5.700000 12.800000 0.475695 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000120 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 8 4.320000 2.669720 1835.130000 3055.740000 218.240332 363.399711 85.600000 nan 1.800000 5.700000 12.800000 0.951389 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000183 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 16 7.650000 4.488780 2120.080000 3622.930000 252.127622 430.852009 85.600000 nan 1.800000 5.700000 12.800000 1.902778 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000308 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 32 14.040000 7.969470 2255.510000 4020.940000 268.233450 478.184805 85.600000 nan 1.800000 5.700000 12.200000 3.805556 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.000547 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 64 26.830000 15.034200 2415.090000 4273.310000 287.211284 508.197563 85.600000 nan 1.800000 5.700000 12.500000 7.611113 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.001032 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 128 52.740000 29.419900 2455.640000 4384.540000 292.033638 521.425439 85.600000 nan 1.800000 5.700000 12.600000 15.222225 50.000000 l3 0.670000 59.700000 0.120000 TX2-maxn_FP32_50%_CNV 0.002020 FP32_TX2-maxn TX2-maxn_FP32_CNV_50.0
CNV TX2-maxn FP32 maxn 1 1.960000 1.687940 511.233000 592.887000 239.998332 278.330802 87.060000 nan 1.800000 5.700000 15.100000 0.469450 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.000116 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 2 3.360000 2.897800 599.883000 690.164000 281.615074 323.997490 87.060000 nan 1.800000 5.700000 16.400000 0.938900 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.000199 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 4 5.790000 4.950600 694.708000 807.383000 326.130671 379.025949 87.060000 nan 1.800000 5.700000 15.900000 1.877800 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.000340 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 8 9.810000 8.248780 819.856000 970.512000 384.881399 455.606858 87.060000 nan 1.800000 5.700000 15.700000 3.755600 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.000566 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 16 17.750000 14.709400 912.656000 1100.020000 428.446359 516.404389 87.060000 nan 1.800000 5.700000 15.700000 7.511200 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.001010 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 32 33.170000 27.224200 967.864000 1188.240000 454.363755 557.819268 87.060000 nan 1.800000 5.700000 15.500000 15.022400 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.001870 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 64 64.720000 52.971200 993.210000 1215.390000 466.262434 570.564836 87.060000 nan 1.800000 5.700000 16.300000 30.044800 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.003638 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
CNV TX2-maxn FP32 maxn 128 126.920000 103.618000 1008.870000 1236.000000 473.614021 580.240200 87.060000 nan 1.800000 5.700000 16.300000 60.089600 100.000000 l3 0.670000 59.700000 0.470000 TX2-maxn_FP32_100%_CNV 0.007116 FP32_TX2-maxn TX2-maxn_FP32_CNV_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV TX2-maxq FP16 maxq 1 1.010000 0.605036 965.127000 1752.160000 7.739041 14.050003 77.810000 nan 1.800000 4.150000 4.000000 0.008019 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000042 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 2 1.290000 0.598490 1542.170000 3480.840000 12.366162 27.911728 77.810000 nan 1.800000 4.150000 4.700000 0.016037 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000041 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 4 1.890000 0.625449 2085.540000 6655.790000 16.723270 53.370624 77.810000 nan 1.800000 4.150000 4.700000 0.032075 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000043 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 8 3.150000 0.769945 2560.000000 10629.400000 20.527811 85.233715 77.810000 nan 1.800000 4.150000 4.900000 0.064149 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000053 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 16 5.740000 1.136080 2797.810000 14520.100000 22.434732 116.431977 77.810000 nan 1.800000 4.150000 4.900000 0.128299 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000078 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 32 10.830000 1.768720 2942.530000 18826.000000 23.595195 150.959594 77.810000 nan 1.800000 4.150000 4.800000 0.256598 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000121 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 64 21.010000 3.039750 3065.870000 21650.900000 24.584218 173.611552 77.810000 nan 1.800000 4.150000 4.800000 0.513195 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000209 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 128 41.150000 5.571250 3121.950000 23300.800000 25.033906 186.841566 77.810000 nan 1.800000 4.150000 4.700000 1.026391 12.500000 l3 0.870000 59.700000 0.010000 TX2-maxq_FP16_12.50%_CNV 0.000383 FP16_TX2-maxq TX2-maxq_FP16_CNV_12.5
CNV TX2-maxq FP16 maxq 1 1.020000 0.606093 961.502000 1714.480000 29.337091 52.311754 83.310000 nan 1.800000 4.150000 4.500000 0.030512 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000042 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 2 1.340000 0.652199 1467.050000 3182.810000 44.762236 97.113046 83.310000 nan 1.800000 4.150000 5.400000 0.061023 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000045 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 4 2.050000 0.807129 1961.690000 5019.240000 59.854560 153.145706 83.310000 nan 1.800000 4.150000 5.400000 0.122047 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000055 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 8 3.460000 1.106410 2301.120000 7396.390000 70.211157 225.676669 83.310000 nan 1.800000 4.150000 5.300000 0.244094 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000076 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 16 6.230000 1.671520 2566.420000 9793.140000 78.305919 298.805663 83.310000 nan 1.800000 4.150000 5.400000 0.488188 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000115 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 32 11.990000 2.969030 2659.740000 11860.800000 81.153274 361.893551 83.310000 nan 1.800000 4.150000 5.400000 0.976375 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000204 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 64 22.790000 5.194370 2797.810000 13017.400000 85.366029 397.183420 83.310000 nan 1.800000 4.150000 5.300000 1.952751 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000357 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 128 44.730000 9.578630 2876.400000 13507.300000 87.763946 412.131118 83.310000 nan 1.800000 4.150000 5.300000 3.905502 25.000000 l3 0.870000 59.700000 0.030000 TX2-maxq_FP16_25%_CNV 0.000658 FP16_TX2-maxq TX2-maxq_FP16_CNV_25.0
CNV TX2-maxq FP16 maxq 1 1.140000 0.720306 872.975000 1399.450000 103.817361 166.427682 85.570000 nan 1.800000 4.150000 5.500000 0.118924 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000049 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 2 1.760000 1.052320 1136.520000 1916.680000 135.159091 227.938555 85.570000 nan 1.800000 4.150000 6.300000 0.237847 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000072 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 4 2.890000 1.606760 1383.780000 2499.540000 164.564149 297.254385 85.570000 nan 1.800000 4.150000 6.200000 0.475695 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000110 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 8 4.720000 2.354260 1698.180000 3408.550000 201.953740 405.357159 85.570000 nan 1.800000 4.150000 6.200000 0.951389 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000162 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 16 8.450000 3.849700 1892.790000 4150.240000 225.097469 493.561631 85.570000 nan 1.800000 4.150000 6.300000 1.902778 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000264 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 32 16.150000 7.109590 1973.030000 4657.040000 234.639902 553.832130 85.570000 nan 1.800000 4.150000 6.300000 3.805556 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000488 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 64 31.000000 13.186400 2068.690000 5004.080000 246.016137 595.103388 85.570000 nan 1.800000 4.150000 6.300000 7.611113 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.000906 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 128 60.700000 24.819700 2115.700000 5110.470000 251.606737 607.755674 85.570000 nan 1.800000 4.150000 6.300000 15.222225 50.000000 l3 0.870000 59.700000 0.120000 TX2-maxq_FP16_50%_CNV 0.001705 FP16_TX2-maxq TX2-maxq_FP16_CNV_50.0
CNV TX2-maxq FP16 maxq 1 2.000000 1.585560 498.054000 630.839000 233.811450 296.147369 87.060000 nan 1.800000 4.150000 8.100000 0.469450 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.000109 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 2 3.280000 2.572960 609.161000 778.398000 285.970631 365.418941 87.060000 nan 1.800000 4.150000 8.200000 0.938900 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.000177 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 4 5.720000 4.452040 697.073000 902.701000 327.240920 423.772984 87.060000 nan 1.800000 4.150000 8.400000 1.877800 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.000306 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 8 9.470000 7.052970 849.088000 1140.850000 398.604362 535.572032 87.060000 nan 1.800000 4.150000 8.300000 3.755600 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.000484 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 16 17.090000 12.430900 937.729000 1307.500000 440.216879 613.805875 87.060000 nan 1.800000 4.150000 8.400000 7.511200 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.000854 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 32 31.710000 22.639600 1001.960000 1429.550000 470.370122 671.102247 87.060000 nan 1.800000 4.150000 8.400000 15.022400 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.001555 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 64 61.160000 43.173300 1045.970000 1484.900000 491.030617 697.086305 87.060000 nan 1.800000 4.150000 8.400000 30.044800 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.002965 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP16 maxq 128 120.570000 84.040300 1063.340000 1520.040000 499.184963 713.582778 87.060000 nan 1.800000 4.150000 8.300000 60.089600 100.000000 l3 0.870000 59.700000 0.470000 TX2-maxq_FP16_100%_CNV 0.005772 FP16_TX2-maxq TX2-maxq_FP16_CNV_100.0
CNV TX2-maxq FP32 maxq 1 0.940000 0.533478 1052.420000 1954.940000 8.439015 15.676030 77.840000 nan 1.800000 4.150000 4.700000 0.008019 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000037 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 2 1.260000 0.567738 1582.690000 3666.600000 12.691078 29.401277 77.840000 nan 1.800000 4.150000 4.900000 0.016037 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000039 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 4 1.890000 0.620289 2133.330000 6496.760000 17.106482 52.095413 77.840000 nan 1.800000 4.150000 4.600000 0.032075 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000043 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 8 3.290000 0.925227 2443.910000 8542.660000 19.596922 68.500823 77.840000 nan 1.800000 4.150000 4.500000 0.064149 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000064 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 16 5.990000 1.424860 2666.670000 11441.600000 21.383163 91.746483 77.840000 nan 1.800000 4.150000 4.500000 0.128299 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000098 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 32 11.630000 2.583470 2737.970000 13338.900000 21.954894 106.960317 77.840000 nan 1.800000 4.150000 4.600000 0.256598 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000177 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 64 22.290000 4.273000 2892.660000 15233.800000 23.195303 122.154906 77.840000 nan 1.800000 4.150000 4.700000 0.513195 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000293 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 128 43.470000 8.044380 2959.540000 16053.200000 23.731592 128.725410 77.840000 nan 1.800000 4.150000 4.800000 1.026391 12.500000 l3 0.440000 59.700000 0.010000 TX2-maxq_FP32_12.50%_CNV 0.000552 FP32_TX2-maxq TX2-maxq_FP32_CNV_12.5
CNV TX2-maxq FP32 maxq 1 0.970000 0.572328 978.967000 1819.130000 29.869979 55.504807 83.250000 nan 1.800000 4.150000 5.100000 0.030512 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000039 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 2 1.360000 0.681039 1462.860000 2932.920000 44.634392 89.488469 83.250000 nan 1.800000 4.150000 5.900000 0.061023 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000047 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 4 2.300000 1.070930 1729.730000 3750.520000 52.777058 114.434861 83.250000 nan 1.800000 4.150000 5.700000 0.122047 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000074 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 8 3.890000 1.543500 2060.360000 5164.910000 62.865152 157.590350 83.250000 nan 1.800000 4.150000 5.800000 0.244094 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000106 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 16 6.980000 2.389390 2250.550000 6753.150000 68.668178 206.050303 83.250000 nan 1.800000 4.150000 5.900000 0.488188 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000164 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 32 13.310000 4.149280 2426.540000 7714.330000 74.037938 235.377570 83.250000 nan 1.800000 4.150000 5.800000 0.976375 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000285 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 64 25.550000 7.713750 2503.670000 8374.770000 76.391308 255.528738 83.250000 nan 1.800000 4.150000 5.800000 1.952751 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.000530 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 128 50.130000 14.575900 2547.260000 8820.210000 77.721314 269.119884 83.250000 nan 1.800000 4.150000 5.700000 3.905502 25.000000 l3 0.440000 59.700000 0.030000 TX2-maxq_FP32_25%_CNV 0.001001 FP32_TX2-maxq TX2-maxq_FP32_CNV_25.0
CNV TX2-maxq FP32 maxq 1 1.320000 0.901056 757.957000 1104.430000 90.139002 131.342831 85.600000 nan 1.800000 4.150000 6.100000 0.118924 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000062 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 2 2.170000 1.473710 920.036000 1352.410000 109.414026 160.833515 85.600000 nan 1.800000 4.150000 7.300000 0.237847 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000101 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 4 3.810000 2.526250 1054.580000 1583.680000 125.414488 188.336984 85.600000 nan 1.800000 4.150000 7.200000 0.475695 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000173 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 8 6.210000 3.865880 1281.600000 2069.230000 152.412532 246.080355 85.600000 nan 1.800000 4.150000 7.300000 0.951389 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000265 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 16 11.160000 6.581360 1412.410000 2436.310000 167.968933 289.734844 85.600000 nan 1.800000 4.150000 7.400000 1.902778 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000452 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 32 20.970000 11.830200 1508.100000 2704.650000 179.348735 321.646812 85.600000 nan 1.800000 4.150000 7.400000 3.805556 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.000812 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 64 40.560000 22.590400 1575.380000 2851.300000 187.349918 339.086963 85.600000 nan 1.800000 4.150000 7.300000 7.611113 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.001551 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 128 79.800000 43.828000 1605.020000 2928.610000 190.874814 348.280950 85.600000 nan 1.800000 4.150000 7.300000 15.222225 50.000000 l3 0.440000 59.700000 0.120000 TX2-maxq_FP32_50%_CNV 0.003010 FP32_TX2-maxq TX2-maxq_FP32_CNV_50.0
CNV TX2-maxq FP32 maxq 1 2.870000 2.442570 347.708000 408.868000 163.231521 191.943083 87.060000 nan 1.800000 4.150000 8.600000 0.469450 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.000168 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 2 4.960000 4.240580 402.358000 470.616000 188.886963 220.930681 87.060000 nan 1.800000 4.150000 9.200000 0.938900 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.000291 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 4 8.500000 7.208510 470.805000 553.543000 221.019407 259.860761 87.060000 nan 1.800000 4.150000 9.400000 1.877800 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.000495 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 8 14.520000 12.019200 554.413000 664.521000 260.269183 311.959383 87.060000 nan 1.800000 4.150000 9.400000 3.755600 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.000825 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 16 26.170000 21.499300 605.201000 745.108000 284.111609 349.790951 87.060000 nan 1.800000 4.150000 9.400000 7.511200 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.001476 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 32 49.510000 40.226600 646.465000 797.360000 303.482994 374.320652 87.060000 nan 1.800000 4.150000 9.400000 15.022400 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.002763 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 64 96.610000 78.480800 661.926000 818.764000 310.741161 384.368760 87.060000 nan 1.800000 4.150000 9.400000 30.044800 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.005390 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
CNV TX2-maxq FP32 maxq 128 190.290000 153.728000 671.916000 832.648000 315.430966 390.886604 87.060000 nan 1.800000 4.150000 9.300000 60.089600 100.000000 l3 0.440000 59.700000 0.470000 TX2-maxq_FP32_100%_CNV 0.010557 FP32_TX2-maxq TX2-maxq_FP32_CNV_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV TX2-maxp FP16 maxp 1 0.960000 0.552353 1051.330000 1888.200000 8.430275 15.140864 77.810000 nan 1.800000 4.700000 5.700000 0.008019 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000038 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 2 1.290000 0.593285 1590.060000 3644.020000 12.750176 29.220216 77.810000 nan 1.800000 4.700000 5.600000 0.016037 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000041 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 4 1.800000 0.614004 2295.960000 7367.220000 18.410559 59.075350 77.810000 nan 1.800000 4.700000 5.500000 0.032075 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000042 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 8 2.900000 0.654227 2860.340000 12703.000000 22.936140 101.861241 77.810000 nan 1.800000 4.700000 5.500000 0.064149 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000045 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 16 5.270000 0.963234 3084.340000 18132.600000 24.732323 145.399444 77.810000 nan 1.800000 4.700000 5.900000 0.128299 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000066 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 32 9.600000 1.466280 3390.730000 23181.600000 27.189165 185.885740 77.810000 nan 1.800000 4.700000 6.300000 0.256598 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000101 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 64 18.360000 2.444440 3555.560000 27244.900000 28.510884 218.468026 77.810000 nan 1.800000 4.700000 6.400000 0.513195 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000168 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 128 36.440000 4.405000 3631.210000 29763.100000 29.117496 238.660656 77.810000 nan 1.800000 4.700000 6.300000 1.026391 12.500000 l3 1.150000 59.700000 0.010000 TX2-maxp_FP16_12.50%_CNV 0.000303 FP16_TX2-maxp TX2-maxp_FP16_CNV_12.5
CNV TX2-maxp FP16 maxp 1 1.000000 0.571742 1025.030000 1869.410000 31.275441 57.038937 83.310000 nan 1.800000 4.700000 6.300000 0.030512 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000039 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 2 1.320000 0.627033 1542.170000 3449.150000 47.054278 105.239540 83.310000 nan 1.800000 4.700000 6.200000 0.061023 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000043 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 4 1.890000 0.709281 2133.330000 5862.890000 65.091593 178.886928 83.310000 nan 1.800000 4.700000 6.800000 0.122047 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000049 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 8 3.240000 0.931445 2534.650000 9056.340000 77.336562 276.324619 83.310000 nan 1.800000 4.700000 6.900000 0.244094 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000064 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 16 5.670000 1.401970 2813.190000 12232.400000 85.835299 373.231711 83.310000 nan 1.800000 4.700000 7.000000 0.488188 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000096 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 32 10.510000 2.365910 3084.340000 14952.400000 94.108555 456.223622 83.310000 nan 1.800000 4.700000 6.900000 0.976375 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000162 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 64 19.950000 4.128690 3230.280000 16486.900000 98.561438 503.043874 83.310000 nan 1.800000 4.700000 6.900000 1.952751 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000284 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 128 38.900000 7.459370 3335.500000 17483.400000 101.771882 533.448815 83.310000 nan 1.800000 4.700000 7.000000 3.905502 25.000000 l3 1.150000 59.700000 0.030000 TX2-maxp_FP16_25%_CNV 0.000512 FP16_TX2-maxp TX2-maxp_FP16_CNV_25.0
CNV TX2-maxp FP16 maxp 1 1.030000 0.608011 965.127000 1740.870000 114.776412 207.030590 85.570000 nan 1.800000 4.700000 7.800000 0.118924 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000042 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 2 1.580000 0.862916 1272.050000 2359.870000 151.276811 280.644321 85.570000 nan 1.800000 4.700000 7.700000 0.237847 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000059 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 4 2.630000 1.312840 1568.150000 3121.110000 186.490100 371.173750 85.570000 nan 1.800000 4.700000 8.400000 0.475695 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000090 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 8 4.220000 1.890530 1906.890000 4365.680000 226.774292 519.182539 85.570000 nan 1.800000 4.700000 8.400000 0.951389 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000130 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 16 7.570000 3.090030 2155.790000 5392.770000 256.374385 641.327817 85.570000 nan 1.800000 4.700000 7.600000 1.902778 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000212 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 32 13.750000 5.447190 2316.740000 6025.160000 275.515144 716.533935 85.570000 nan 1.800000 4.700000 7.500000 3.805556 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000374 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 64 26.790000 10.151100 2432.300000 6478.430000 289.257960 770.438451 85.570000 nan 1.800000 4.700000 7.500000 7.611113 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.000697 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 128 51.160000 19.256300 2528.400000 6618.150000 300.686521 787.054462 85.570000 nan 1.800000 4.700000 8.400000 15.222225 50.000000 l3 1.150000 59.700000 0.120000 TX2-maxp_FP16_50%_CNV 0.001322 FP16_TX2-maxp TX2-maxp_FP16_CNV_50.0
CNV TX2-maxp FP16 maxp 1 1.780000 1.304400 567.942000 785.639000 266.620372 368.818229 87.060000 nan 1.800000 4.700000 10.300000 0.469450 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.000090 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 2 2.890000 2.086500 695.180000 976.935000 326.352251 458.622136 87.060000 nan 1.800000 4.700000 10.400000 0.938900 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.000143 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 4 4.680000 3.468830 867.797000 1153.660000 407.387302 541.585687 87.060000 nan 1.800000 4.700000 10.100000 1.877800 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.000238 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 8 7.780000 5.500290 1048.110000 1454.760000 492.035239 682.937082 87.060000 nan 1.800000 4.700000 10.900000 3.755600 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.000378 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 16 14.140000 9.843110 1149.270000 1666.980000 539.524801 782.563761 87.060000 nan 1.800000 4.700000 10.900000 7.511200 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.000676 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 32 26.190000 17.631200 1232.250000 1831.750000 578.479762 859.915037 87.060000 nan 1.800000 4.700000 10.900000 15.022400 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.001211 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 64 50.400000 33.654900 1286.430000 1909.280000 603.914563 896.311496 87.060000 nan 1.800000 4.700000 10.900000 30.044800 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.002311 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP16 maxp 128 101.610000 66.364800 1302.800000 1939.600000 611.599460 910.545220 87.060000 nan 1.800000 4.700000 10.800000 60.089600 100.000000 l3 1.150000 59.700000 0.470000 TX2-maxp_FP16_100%_CNV 0.004558 FP16_TX2-maxp TX2-maxp_FP16_CNV_100.0
CNV TX2-maxp FP32 maxp 1 0.950000 0.508646 1116.680000 2095.260000 8.954295 16.801211 77.840000 nan 1.800000 4.700000 5.500000 0.008019 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000035 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 2 1.200000 0.526775 1706.670000 4135.700000 13.685234 33.162838 77.840000 nan 1.800000 4.700000 6.300000 0.016037 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000036 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 4 1.700000 0.537918 2386.950000 8205.260000 19.140179 65.795321 77.840000 nan 1.800000 4.700000 6.900000 0.032075 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000037 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 8 3.010000 0.781062 2737.970000 10589.700000 21.954894 84.915373 77.840000 nan 1.800000 4.700000 6.800000 0.064149 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000054 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 16 5.410000 1.148410 3065.870000 14488.200000 24.584218 116.176182 77.840000 nan 1.800000 4.700000 6.200000 0.128299 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000079 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 32 10.260000 2.177810 3210.030000 16511.900000 25.740191 132.403576 77.840000 nan 1.800000 4.700000 6.300000 0.256598 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000150 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 64 19.360000 3.606190 3368.420000 18975.300000 27.010269 152.156783 77.840000 nan 1.800000 4.700000 6.200000 0.513195 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000248 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 128 38.410000 6.471000 3471.190000 20283.300000 27.834348 162.645211 77.840000 nan 1.800000 4.700000 6.100000 1.026391 12.500000 l3 0.570000 59.700000 0.010000 TX2-maxp_FP32_12.50%_CNV 0.000444 FP32_TX2-maxp TX2-maxp_FP32_CNV_12.5
CNV TX2-maxp FP32 maxp 1 0.920000 0.513143 1109.430000 2075.170000 33.850631 63.317031 83.250000 nan 1.800000 4.700000 6.800000 0.030512 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000035 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 2 1.230000 0.563732 1635.780000 3575.820000 49.910481 109.104462 83.250000 nan 1.800000 4.700000 7.400000 0.061023 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000039 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 4 2.130000 0.901777 1917.600000 4504.010000 58.509297 137.425146 83.250000 nan 1.800000 4.700000 7.100000 0.122047 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000062 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 8 3.480000 1.271340 2327.270000 6430.590000 71.009039 196.208439 83.250000 nan 1.800000 4.700000 7.300000 0.244094 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000087 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 16 6.330000 1.979410 2572.860000 8374.360000 78.502415 255.516228 83.250000 nan 1.800000 4.700000 7.400000 0.488188 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000136 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 32 11.560000 3.308250 2852.370000 9900.220000 87.030749 302.072859 83.250000 nan 1.800000 4.700000 7.300000 0.976375 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000227 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 64 22.180000 6.260000 2925.710000 10667.300000 89.268479 325.477799 83.250000 nan 1.800000 4.700000 7.300000 1.952751 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000430 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 128 42.800000 11.409000 3038.580000 11247.100000 92.712339 343.168501 83.250000 nan 1.800000 4.700000 7.200000 3.905502 25.000000 l3 0.570000 59.700000 0.030000 TX2-maxp_FP32_25%_CNV 0.000784 FP32_TX2-maxp TX2-maxp_FP32_CNV_25.0
CNV TX2-maxp FP32 maxp 1 1.180000 0.751665 853.333000 1327.070000 101.481463 157.819990 85.600000 nan 1.800000 4.700000 8.500000 0.118924 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000052 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 2 1.910000 1.201480 1058.950000 1675.520000 125.934184 199.258931 85.600000 nan 1.800000 4.700000 9.200000 0.237847 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000083 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 4 3.250000 2.028070 1245.740000 2001.730000 148.147930 238.053010 85.600000 nan 1.800000 4.700000 9.200000 0.475695 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000139 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 8 5.420000 3.060010 1508.100000 2638.560000 179.348735 313.787149 85.600000 nan 1.800000 4.700000 9.100000 0.951389 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000210 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 16 9.520000 5.215470 1678.690000 3124.470000 199.635919 371.573333 85.600000 nan 1.800000 4.700000 9.300000 1.902778 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000358 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 32 17.460000 9.299470 1818.830000 3455.320000 216.301877 410.919218 85.600000 nan 1.800000 4.700000 9.200000 3.805556 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.000639 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 64 33.530000 17.423000 1903.350000 3713.930000 226.353303 441.674059 85.600000 nan 1.800000 4.700000 9.300000 7.611113 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.001197 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 128 65.090000 33.716400 1943.070000 3744.290000 231.076949 445.284581 85.600000 nan 1.800000 4.700000 9.300000 15.222225 50.000000 l3 0.570000 59.700000 0.120000 TX2-maxp_FP32_50%_CNV 0.002316 FP32_TX2-maxp TX2-maxp_FP32_CNV_50.0
CNV TX2-maxp FP32 maxp 1 2.350000 1.940500 430.252000 515.510000 201.981801 242.006169 87.060000 nan 1.800000 4.700000 11.100000 0.469450 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.000133 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 2 3.990000 3.345520 501.224000 598.786000 235.299607 281.100088 87.060000 nan 1.800000 4.700000 12.400000 0.938900 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.000230 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 4 6.860000 5.684520 585.812000 703.573000 275.009443 330.292345 87.060000 nan 1.800000 4.700000 11.800000 1.877800 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.000390 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 8 11.610000 9.380380 691.425000 851.171000 324.589466 399.582226 87.060000 nan 1.800000 4.700000 11.800000 3.755600 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.000644 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 16 21.170000 16.990300 757.396000 954.766000 355.559552 448.214899 87.060000 nan 1.800000 4.700000 11.700000 7.511200 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.001167 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 32 39.810000 31.282800 809.486000 1031.790000 380.013203 484.373816 87.060000 nan 1.800000 4.700000 11.600000 15.022400 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.002148 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 64 77.630000 61.085700 829.822000 1057.700000 389.559938 496.537265 87.060000 nan 1.800000 4.700000 12.400000 30.044800 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.004195 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
CNV TX2-maxp FP32 maxp 128 152.630000 119.453000 839.344000 1072.660000 394.030041 503.560237 87.060000 nan 1.800000 4.700000 12.400000 60.089600 100.000000 l3 0.570000 59.700000 0.470000 TX2-maxp_FP32_100%_CNV 0.008204 FP32_TX2-maxp TX2-maxp_FP32_CNV_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV U96-Quadcore-A53 INT2 nan 2 nan 3.651000 nan 547.795125 nan 4.392592 73.640000 nan 9.200000 nan 14.500000 0.016037 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.000251 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 4 nan 6.306000 nan 634.316524 nan 5.086379 73.640000 nan 9.200000 nan 14.500000 0.032075 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.000433 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 8 nan 11.731000 nan 681.953798 nan 5.468367 73.640000 nan 9.200000 nan 14.500000 0.064149 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.000806 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 16 nan 22.210000 nan 720.396218 nan 5.776624 73.640000 nan 9.200000 nan 14.500000 0.128299 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.001525 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 32 nan 43.493000 nan 735.750581 nan 5.899746 73.640000 nan 9.200000 nan 14.500000 0.256598 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.002987 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 64 nan 85.127000 nan 751.817872 nan 6.028584 73.640000 nan 9.200000 nan 14.500000 0.513195 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.005846 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 128 nan 167.092000 nan 766.045053 nan 6.142667 73.640000 nan 9.200000 nan 14.500000 1.026391 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT2_12.50%_CNV 0.011475 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_12.5
CNV U96-Quadcore-A53 INT2 nan 2 nan 8.433000 nan 237.163524 nan 7.236270 79.890000 nan 9.200000 nan 14.500000 0.061023 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.000579 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 4 nan 14.103000 nan 283.627597 nan 8.653969 79.890000 nan 9.200000 nan 14.500000 0.122047 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.000969 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 8 nan 24.808000 nan 322.476620 nan 9.839320 79.890000 nan 9.200000 nan 14.500000 0.244094 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.001704 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 16 nan 46.974000 nan 340.613957 nan 10.392722 79.890000 nan 9.200000 nan 14.500000 0.488188 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.003226 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 32 nan 90.564000 nan 353.341283 nan 10.781055 79.890000 nan 9.200000 nan 14.500000 0.976375 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.006220 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 64 nan 178.144000 nan 359.259925 nan 10.961643 79.890000 nan 9.200000 nan 14.500000 1.952751 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.012234 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 128 nan 351.970000 nan 363.667358 nan 11.096121 79.890000 nan 9.200000 nan 14.500000 3.905502 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT2_25%_CNV 0.024172 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_25.0
CNV U96-Quadcore-A53 INT2 nan 2 nan 34.132000 nan 58.596039 nan 6.968454 84.290000 nan 9.200000 nan 14.500000 0.237847 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.002344 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 4 nan 52.668000 nan 75.947444 nan 9.031946 84.290000 nan 9.200000 nan 14.500000 0.475695 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.003617 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 8 nan 89.495000 nan 89.390469 nan 10.630640 84.290000 nan 9.200000 nan 14.500000 0.951389 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.006146 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 16 nan 164.939000 nan 97.005560 nan 11.536254 84.290000 nan 9.200000 nan 14.500000 1.902778 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.011327 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 32 nan 320.240000 nan 99.925056 nan 11.883451 84.290000 nan 9.200000 nan 14.500000 3.805556 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.021993 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 64 nan 620.131000 nan 103.204000 nan 12.273395 84.290000 nan 9.200000 nan 14.500000 7.611113 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.042588 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT2 nan 128 nan 1227.069000 nan 104.313612 nan 12.405354 84.290000 nan 9.200000 nan 14.500000 15.222225 50.000000 l3 0.192000 4.260000 0.120000 U96-Quadcore-A53_INT2_50%_CNV 0.084270 INT2_U96-Quadcore-A53 U96-Quadcore-A53_INT2_CNV_50.0
CNV U96-Quadcore-A53 INT4 nan 2 nan 3.625000 nan 551.724138 nan 4.424097 75.850000 nan 9.200000 nan 14.500000 0.016037 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.000249 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 4 nan 6.410000 nan 624.024961 nan 5.003854 75.850000 nan 9.200000 nan 14.500000 0.032075 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.000440 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 8 nan 11.712000 nan 683.060109 nan 5.477238 75.850000 nan 9.200000 nan 14.500000 0.064149 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.000804 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 16 nan 22.370000 nan 715.243630 nan 5.735307 75.850000 nan 9.200000 nan 14.500000 0.128299 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.001536 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 32 nan 43.397000 nan 737.378160 nan 5.912797 75.850000 nan 9.200000 nan 14.500000 0.256598 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.002980 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 64 nan 85.380000 nan 749.590068 nan 6.010720 75.850000 nan 9.200000 nan 14.500000 0.513195 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.005864 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 128 nan 168.071000 nan 761.582903 nan 6.106887 75.850000 nan 9.200000 nan 14.500000 1.026391 12.500000 l3 0.192000 4.260000 0.010000 U96-Quadcore-A53_INT4_12.50%_CNV 0.011542 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_12.5
CNV U96-Quadcore-A53 INT4 nan 2 nan 8.550000 nan 233.918129 nan 7.137247 81.090000 nan 9.200000 nan 14.500000 0.061023 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.000587 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 4 nan 14.137000 nan 282.945462 nan 8.633156 81.090000 nan 9.200000 nan 14.500000 0.122047 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.000971 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 8 nan 25.200000 nan 317.460317 nan 9.686264 81.090000 nan 9.200000 nan 14.500000 0.244094 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.001731 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 16 nan 46.580000 nan 343.495062 nan 10.480629 81.090000 nan 9.200000 nan 14.500000 0.488188 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.003199 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 32 nan 90.412000 nan 353.935318 nan 10.799180 81.090000 nan 9.200000 nan 14.500000 0.976375 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.006209 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 64 nan 178.848000 nan 357.845769 nan 10.918494 81.090000 nan 9.200000 nan 14.500000 1.952751 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.012283 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
CNV U96-Quadcore-A53 INT4 nan 128 nan 353.671000 nan 361.918280 nan 11.042754 81.090000 nan 9.200000 nan 14.500000 3.905502 25.000000 l3 0.192000 4.260000 0.030000 U96-Quadcore-A53_INT4_25%_CNV 0.024289 INT4_U96-Quadcore-A53 U96-Quadcore-A53_INT4_CNV_25.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV ZCU104-Bismo INT2 nan 2 nan 2.664596 nan 750.582799 nan 6.018680 73.640000 nan 9.200000 nan 14.850000 0.016037 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.000183 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 4 nan 4.831999 nan 827.814775 nan 6.637978 73.640000 nan 9.200000 nan 14.775000 0.032075 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.000332 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 8 nan 9.481912 nan 843.711735 nan 6.765451 73.640000 nan 9.200000 nan 14.875000 0.064149 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.000651 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 16 nan 19.575715 nan 817.339260 nan 6.553979 73.640000 nan 9.200000 nan 15.125000 0.128299 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.001344 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 32 nan 37.490798 nan 853.542770 nan 6.844283 73.640000 nan 9.200000 nan 15.475000 0.256598 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.002575 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 64 nan 76.311300 nan 838.670023 nan 6.725023 73.640000 nan 9.200000 nan 15.475000 0.513195 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.005241 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 128 nan 144.856425 nan 883.633570 nan 7.085571 73.640000 nan 9.200000 nan 15.500000 1.026391 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-Bismo_INT2_12.50%_CNV 0.009948 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_12.5
CNV ZCU104-Bismo INT2 nan 2 nan 4.206040 nan 475.506641 nan 14.508531 79.890000 nan 9.200000 nan 14.825000 0.061023 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.000289 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 4 nan 7.654349 nan 522.578719 nan 15.944782 79.890000 nan 9.200000 nan 14.975000 0.122047 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.000526 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 8 nan 15.170309 nan 527.345897 nan 16.090237 79.890000 nan 9.200000 nan 15.000000 0.244094 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.001042 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 16 nan 27.868153 nan 574.132053 nan 17.517763 79.890000 nan 9.200000 nan 15.275000 0.488188 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.001914 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 32 nan 55.855311 nan 572.908811 nan 17.480440 79.890000 nan 9.200000 nan 15.475000 0.976375 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.003836 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 64 nan 114.312915 nan 559.866750 nan 17.082504 79.890000 nan 9.200000 nan 15.475000 1.952751 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.007851 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 128 nan 220.039205 nan 581.714518 nan 17.749117 79.890000 nan 9.200000 nan 15.500000 3.905502 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-Bismo_INT2_25%_CNV 0.015111 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_25.0
CNV ZCU104-Bismo INT2 nan 2 nan 9.114334 nan 219.434577 nan 26.095958 84.290000 nan 9.200000 nan 15.000000 0.237847 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.000626 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 4 nan 16.680774 nan 239.797026 nan 28.517534 84.290000 nan 9.200000 nan 15.150000 0.475695 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.001146 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 8 nan 31.695208 nan 252.404088 nan 30.016812 84.290000 nan 9.200000 nan 15.250000 0.951389 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.002177 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 16 nan 63.422265 nan 252.277334 nan 30.001738 84.290000 nan 9.200000 nan 15.475000 1.902778 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.004356 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 32 nan 121.255614 nan 263.905307 nan 31.384579 84.290000 nan 9.200000 nan 15.475000 3.805556 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.008327 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 64 nan 247.773838 nan 258.300071 nan 30.717984 84.290000 nan 9.200000 nan 15.600000 7.611113 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.017016 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT2 nan 128 nan 498.197604 nan 256.926165 nan 30.554594 84.290000 nan 9.200000 nan 15.750000 15.222225 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-Bismo_INT2_50%_CNV 0.034214 INT2_ZCU104-Bismo ZCU104-Bismo_INT2_CNV_50.0
CNV ZCU104-Bismo INT4 nan 2 nan 4.180616 nan 478.398456 nan 3.836122 75.850000 nan 9.200000 nan 14.850000 0.016037 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.000287 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 4 nan 7.281409 nan 549.344265 nan 4.405014 75.850000 nan 9.200000 nan 14.825000 0.032075 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.000500 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 8 nan 14.385140 nan 556.129466 nan 4.459422 75.850000 nan 9.200000 nan 14.950000 0.064149 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.000988 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 16 nan 31.355124 nan 510.283428 nan 4.091797 75.850000 nan 9.200000 nan 15.275000 0.128299 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.002153 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 32 nan 56.983773 nan 561.563375 nan 4.502995 75.850000 nan 9.200000 nan 15.475000 0.256598 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.003913 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 64 nan 119.823216 nan 534.120199 nan 4.282937 75.850000 nan 9.200000 nan 15.500000 0.513195 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.008229 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 128 nan 211.559943 nan 605.029469 nan 4.851535 75.850000 nan 9.200000 nan 15.525000 1.026391 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-Bismo_INT4_12.50%_CNV 0.014529 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_12.5
CNV ZCU104-Bismo INT4 nan 2 nan 6.862861 nan 291.423671 nan 8.891841 81.090000 nan 9.200000 nan 14.975000 0.061023 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.000471 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 4 nan 12.062617 nan 331.603010 nan 10.117782 81.090000 nan 9.200000 nan 15.025000 0.122047 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.000828 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 8 nan 25.337448 nan 315.738192 nan 9.633719 81.090000 nan 9.200000 nan 15.225000 0.244094 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.001740 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 16 nan 44.035643 nan 363.342036 nan 11.086195 81.090000 nan 9.200000 nan 15.400000 0.488188 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.003024 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 32 nan 88.454574 nan 361.767614 nan 11.038156 81.090000 nan 9.200000 nan 15.500000 0.976375 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.006075 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 64 nan 188.719159 nan 339.128260 nan 10.347391 81.090000 nan 9.200000 nan 15.475000 1.952751 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.012960 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
CNV ZCU104-Bismo INT4 nan 128 nan 347.028579 nan 368.845703 nan 11.254121 81.090000 nan 9.200000 nan 15.650000 3.905502 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-Bismo_INT4_25%_CNV 0.023833 INT4_ZCU104-Bismo ZCU104-Bismo_INT4_CNV_25.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
CNV ZCU104-FINN INT2 nan 1 0.050000 0.086000 nan 23255.814000 nan 186.480838 73.640000 nan 9.200000 11.000000 13.225000 0.008019 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000006 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 2 nan 0.126000 nan 31746.032000 nan 254.561145 73.640000 nan 9.200000 11.000000 12.875000 0.016037 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000009 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 4 nan 0.200000 nan 40201.006000 nan 322.358842 73.640000 nan 9.200000 11.000000 13.150000 0.032075 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000014 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 8 nan 0.328000 nan 48484.848000 nan 388.784287 73.640000 nan 9.200000 11.000000 12.775000 0.064149 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000023 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 16 nan 0.592000 nan 53962.900000 nan 432.711011 73.640000 nan 9.200000 11.000000 12.750000 0.128299 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000041 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 32 nan 1.120000 nan 57296.330000 nan 459.440706 73.640000 nan 9.200000 11.000000 12.675000 0.256598 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000077 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 64 nan 2.176000 nan 59095.106000 nan 473.864508 73.640000 nan 9.200000 11.000000 12.625000 0.513195 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000149 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 128 nan 4.224000 nan 60037.524000 nan 481.421453 73.640000 nan 9.200000 11.000000 12.675000 1.026391 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000290 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 256 nan 8.448000 nan 60512.942000 nan 485.233676 73.640000 nan 9.200000 11.000000 12.725000 2.052781 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.000580 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 512 nan 16.896000 nan 60757.090000 nan 487.191419 73.640000 nan 9.200000 11.000000 12.675000 4.105562 12.500000 l3 30.700000 19.200000 0.010000 ZCU104-FINN_INT2_12.50%_CNV 0.001160 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_12.5
CNV ZCU104-FINN INT2 nan 1 nan 0.119000 nan 8403.361000 nan 256.401099 79.890000 nan 9.200000 11.500000 13.475000 0.030512 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000008 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 2 nan 0.164000 nan 12195.122000 nan 372.094294 79.890000 nan 9.200000 11.500000 13.375000 0.061023 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000011 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 4 nan 0.252000 nan 15936.255000 nan 486.242742 79.890000 nan 9.200000 11.500000 13.075000 0.122047 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000017 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 8 nan 0.384000 nan 20942.408000 nan 638.989140 79.890000 nan 9.200000 11.500000 13.075000 0.244094 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000026 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 16 nan 0.640000 nan 24844.720000 nan 758.055438 79.890000 nan 9.200000 11.500000 13.025000 0.488188 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000044 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 32 nan 1.184000 nan 27373.824000 nan 835.222782 79.890000 nan 9.200000 11.500000 12.950000 0.976375 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000081 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 64 nan 2.240000 nan 28854.824000 nan 880.410657 79.890000 nan 9.200000 11.500000 13.075000 1.952751 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000154 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 128 nan 4.352000 nan 29657.090000 nan 904.889182 79.890000 nan 9.200000 11.500000 13.225000 3.905502 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000299 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 256 nan 8.448000 nan 30075.188000 nan 917.646076 79.890000 nan 9.200000 11.500000 13.325000 7.811003 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.000580 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 512 nan 16.896000 nan 30286.897000 nan 924.105684 79.890000 nan 9.200000 11.500000 13.825000 15.622007 25.000000 l3 30.700000 19.200000 0.030000 ZCU104-FINN_INT2_25%_CNV 0.001160 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_25.0
CNV ZCU104-FINN INT2 nan 1 nan 0.270000 nan 3703.704000 nan 440.457946 84.290000 nan 9.200000 12.000000 13.750000 0.118924 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000019 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 2 nan 0.366000 nan 5449.591000 nan 648.085176 84.290000 nan 9.200000 12.000000 13.725000 0.237847 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000025 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 4 nan 0.528000 nan 7575.758000 nan 900.936687 84.290000 nan 9.200000 12.000000 13.475000 0.475695 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000036 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 8 nan 0.776000 nan 10309.278000 nan 1226.016824 84.290000 nan 9.200000 12.000000 13.475000 0.951389 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000053 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 16 nan 1.248000 nan 12892.828000 nan 1533.261984 84.290000 nan 9.200000 12.000000 13.675000 1.902778 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000086 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 32 nan 2.176000 nan 14739.751000 nan 1752.904783 84.290000 nan 9.200000 12.000000 13.500000 3.805556 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000149 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 64 nan 4.032000 nan 15880.893000 nan 1888.613538 84.290000 nan 9.200000 12.000000 13.775000 7.611113 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000277 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 128 nan 7.808000 nan 16516.129000 nan 1964.158113 84.290000 nan 9.200000 12.000000 14.100000 15.222225 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.000536 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 256 nan 15.104000 nan 16855.412000 nan 2004.506881 84.290000 nan 9.200000 12.000000 14.875000 30.444451 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.001037 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 512 nan 30.208000 nan 17029.769000 nan 2025.242050 84.290000 nan 9.200000 12.000000 15.775000 60.888902 50.000000 l3 30.700000 19.200000 0.120000 ZCU104-FINN_INT2_50%_CNV 0.002075 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_50.0
CNV ZCU104-FINN INT2 nan 1 nan 1.299000 nan 769.823000 nan 361.393407 86.860000 nan 9.200000 11.600000 14.300000 0.469450 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000089 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 2 nan 1.784000 nan 1121.076000 nan 526.289128 86.860000 nan 9.200000 11.600000 14.425000 0.938900 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000123 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 4 nan 2.600000 nan 1539.053000 nan 722.508431 86.860000 nan 9.200000 11.600000 14.475000 1.877800 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000179 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 8 nan 3.928000 nan 2034.588000 nan 955.137337 86.860000 nan 9.200000 11.600000 14.350000 3.755600 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000270 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 16 nan 6.592000 nan 2425.345000 nan 1138.578210 86.860000 nan 9.200000 11.600000 14.825000 7.511200 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000453 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 32 nan 11.936000 nan 2682.763000 nan 1259.423090 86.860000 nan 9.200000 11.600000 14.950000 15.022400 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.000820 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 64 nan 22.592000 nan 2832.987000 nan 1329.945747 86.860000 nan 9.200000 11.600000 15.925000 30.044800 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.001552 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 128 nan 43.904000 nan 2914.655000 nan 1368.284790 86.860000 nan 9.200000 11.600000 17.175000 60.089600 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.003015 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 256 nan 86.528000 nan 2957.315000 nan 1388.311527 86.860000 nan 9.200000 11.600000 17.175000 120.179200 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.005942 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT2 nan 512 nan 172.032000 nan 2979.082000 nan 1398.530045 86.860000 nan 9.200000 11.600000 17.175000 240.358400 100.000000 l3 30.700000 19.200000 0.470000 ZCU104-FINN_INT2_100%_CNV 0.011814 INT2_ZCU104-FINN ZCU104-FINN_INT2_CNV_100.0
CNV ZCU104-FINN INT4 nan 1 0.070000 0.072000 nan 13888.889000 nan 111.370501 75.850000 nan 9.200000 11.000000 13.700000 0.008019 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000005 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 2 nan 0.120000 nan 16666.667000 nan 133.644603 75.850000 nan 9.200000 11.000000 13.350000 0.016037 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000008 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 4 nan 0.208000 nan 19138.756000 nan 153.467483 75.850000 nan 9.200000 11.000000 13.300000 0.032075 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000014 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 8 nan 0.368000 nan 21739.130000 nan 174.319040 75.850000 nan 9.200000 11.000000 13.550000 0.064149 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000025 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 16 nan 0.688000 nan 23357.664000 nan 187.297540 75.850000 nan 9.200000 11.000000 13.225000 0.128299 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000047 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 32 nan 1.312000 nan 24242.424000 nan 194.392144 75.850000 nan 9.200000 11.000000 13.150000 0.256598 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000090 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 64 nan 2.560000 nan 24719.969000 nan 198.221422 75.850000 nan 9.200000 11.000000 13.175000 0.513195 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000176 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 128 nan 5.120000 nan 24960.998000 nan 200.154156 75.850000 nan 9.200000 11.000000 13.275000 1.026391 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000352 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 256 nan 10.240000 nan 25085.742000 nan 201.154437 75.850000 nan 9.200000 11.000000 13.400000 2.052781 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.000703 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 512 nan 20.480000 nan 25146.113000 nan 201.638533 75.850000 nan 9.200000 11.000000 13.500000 4.105562 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.001406 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 10000 nan 396.730000 nan 25206.016000 nan 202.118876 75.850000 nan 9.200000 11.000000 14.347500 80.186760 12.500000 l3 8.800000 19.200000 0.010000 ZCU104-FINN_INT4_12.50%_CNV 0.027246 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_12.5
CNV ZCU104-FINN INT4 nan 1 nan 0.161000 nan 6211.180000 nan 189.513860 81.090000 nan 9.200000 11.500000 13.850000 0.030512 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000011 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 2 nan 0.244000 nan 8163.265000 nan 249.075354 81.090000 nan 9.200000 11.500000 13.850000 0.061023 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000017 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 4 nan 0.396000 nan 10075.567000 nan 307.423000 81.090000 nan 9.200000 11.500000 14.200000 0.122047 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000027 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 8 nan 0.664000 nan 12121.212000 nan 369.839172 81.090000 nan 9.200000 11.500000 13.800000 0.244094 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000046 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 16 nan 1.184000 nan 13547.841000 nan 413.368094 81.090000 nan 9.200000 11.500000 13.875000 0.488188 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000081 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 32 nan 2.240000 nan 14388.489000 nan 439.017720 81.090000 nan 9.200000 11.500000 13.925000 0.976375 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000154 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 64 nan 4.288000 nan 14852.634000 nan 453.179588 81.090000 nan 9.200000 11.500000 13.900000 1.952751 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000294 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 128 nan 8.448000 nan 15094.340000 nan 460.554457 81.090000 nan 9.200000 11.500000 14.250000 3.905502 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.000580 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 256 nan 16.896000 nan 15219.071000 nan 464.360216 81.090000 nan 9.200000 11.500000 14.950000 7.811003 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.001160 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 512 nan 33.280000 nan 15282.214000 nan 466.286818 81.090000 nan 9.200000 11.500000 15.400000 15.622007 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.002286 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 10000 nan 651.779000 nan 15342.620000 nan 468.129910 81.090000 nan 9.200000 11.500000 16.625000 305.117320 25.000000 l3 8.800000 19.200000 0.030000 ZCU104-FINN_INT4_25%_CNV 0.044762 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_25.0
CNV ZCU104-FINN INT4 nan 1 nan 0.507000 nan 1972.387000 nan 234.563434 84.880000 nan 9.200000 12.000000 14.675000 0.118924 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000035 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 2 nan 0.680000 nan 2941.176000 nan 349.775344 84.880000 nan 9.200000 12.000000 14.475000 0.237847 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000047 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 4 nan 0.972000 nan 4115.226000 nan 489.397639 84.880000 nan 9.200000 12.000000 14.750000 0.475695 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000067 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 8 nan 1.456000 nan 5486.968000 nan 652.530185 84.880000 nan 9.200000 12.000000 15.000000 0.951389 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000100 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 16 nan 2.432000 nan 6576.243000 nan 782.070729 84.880000 nan 9.200000 12.000000 14.975000 1.902778 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000167 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 32 nan 4.384000 nan 7304.268000 nan 868.650109 84.880000 nan 9.200000 12.000000 14.975000 3.805556 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000301 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 64 nan 8.250000 nan 7732.270000 nan 919.549663 84.880000 nan 9.200000 12.000000 15.800000 7.611113 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.000567 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 128 nan 16.128000 nan 7965.152000 nan 947.244837 84.880000 nan 9.200000 12.000000 17.125000 15.222225 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.001108 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 256 nan 31.744000 nan 8086.935000 nan 961.727714 84.880000 nan 9.200000 12.000000 20.275000 30.444451 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.002180 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 512 nan 62.976000 nan 8149.233000 nan 969.136419 84.880000 nan 9.200000 12.000000 21.175000 60.888902 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.004325 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 10000 nan 1218.125000 nan 8209.332000 nan 976.283611 84.880000 nan 9.200000 12.000000 21.357500 1189.236360 50.000000 l3 8.800000 19.200000 0.120000 ZCU104-FINN_INT4_50%_CNV 0.083656 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_50.0
CNV ZCU104-FINN INT4 nan 1 nan 4.874000 nan 205.170000 nan 96.317057 87.420000 nan 9.200000 11.800000 15.025000 0.469450 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.000335 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 2 nan 6.872000 nan 291.078000 nan 136.646567 87.420000 nan 9.200000 11.800000 15.400000 0.938900 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.000472 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 4 nan 9.884000 nan 404.694000 nan 189.983598 87.420000 nan 9.200000 11.800000 15.875000 1.877800 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.000679 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 8 nan 15.704000 nan 509.359000 nan 239.118583 87.420000 nan 9.200000 11.800000 16.700000 3.755600 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.001078 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 16 nan 27.344000 nan 584.988000 nan 274.622617 87.420000 nan 9.200000 11.800000 17.575000 7.511200 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.001878 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 32 nan 50.656000 nan 631.874000 nan 296.633249 87.420000 nan 9.200000 11.800000 19.250000 15.022400 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.003479 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 64 nan 97.216000 nan 658.267000 nan 309.023443 87.420000 nan 9.200000 11.800000 19.300000 30.044800 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.006676 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 128 nan 190.336000 nan 672.301000 nan 315.611704 87.420000 nan 9.200000 11.800000 19.275000 60.089600 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.013072 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 256 nan 376.832000 nan 679.548000 nan 319.013809 87.420000 nan 9.200000 11.800000 19.350000 120.179200 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.025879 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 512 nan 749.568000 nan 683.229000 nan 320.741854 87.420000 nan 9.200000 11.800000 19.375000 240.358400 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 0.051477 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0
CNV ZCU104-FINN INT4 nan 10000 nan 14561.129000 nan 686.760000 nan 322.399482 87.420000 nan 9.200000 11.800000 19.762500 4694.500000 100.000000 l3 8.800000 19.200000 0.470000 ZCU104-FINN_INT4_100%_CNV 1.000000 INT4_ZCU104-FINN ZCU104-FINN_INT4_CNV_100.0

ImageNet

download csv here

NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
EfficientNet-S EdgeTPU-fast INT8 fast 1 49.99852 4.996300 20.001000 200.148000 0.000000 0.000000 77.622837 93.766004 0.809600 0.809600 1.998990 0.000000 100.000000 l3 4.000000 25.600000 4.700000 EdgeTPU-fast_INT8_100%_EfficientNet-S 0.555244 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_EfficientNet-S_100.0
EfficientNet-M EdgeTPU-fast INT8 fast 1 53.01476 8.999820 18.863000 111.113000 0.000000 0.000000 78.975272 94.510245 0.809600 0.809600 2.018040 0.000000 100.000000 l3 4.000000 25.600000 7.400000 EdgeTPU-fast_INT8_100%_EfficientNet-M 0.644758 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_EfficientNet-M_100.0
EfficientNet-L EdgeTPU-fast INT8 fast 1 65.00292 25.999550 15.384000 38.462000 0.000000 0.000000 80.473751 95.188463 0.809600 0.809600 2.881480 0.000000 100.000000 l3 4.000000 25.600000 19.400000 EdgeTPU-fast_INT8_100%_EfficientNet-L 0.722205 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_EfficientNet-L_100.0
GoogLeNetv1 EdgeTPU-fast INT8 fast 1 7.4 3.648520 135.087000 274.084000 422.822310 857.882920 69.243400 88.445800 0.253000 0.253000 0.538000 3.130000 100.000000 l3 4.000000 25.600000 3.100000 EdgeTPU-fast_INT8_100%_GoogLeNetv1 0.003038 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_GoogLeNetv1_100.0
MobileNetv1 EdgeTPU-fast INT8 fast 1 6 2.570470 166.533000 389.034000 189.847620 443.498760 69.567400 87.705800 0.253000 0.253000 0.532000 1.140000 100.000000 l3 4.000000 25.600000 1.100000 EdgeTPU-fast_INT8_100%_MobileNetv1 0.076032 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_MobileNetv1_100.0
ResNet-50v15 EdgeTPU-fast INT8 fast 1 nan 40.441510 10.552000 24.727000 86.526400 202.761400 nan nan nan nan 1.190000 8.200000 100.000000 l3 4.000000 25.600000 10000000.000000 EdgeTPU-fast_INT8_100%_ResNet-50v15 0.954757 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_ResNet-50v15_100.0
ResNet-50v15 EdgeTPU-fast INT8 fast 1 nan 40.585040 10.589000 24.640000 86.829800 202.048000 nan nan nan nan 1.490000 8.200000 100.000000 l3 4.000000 25.600000 10000000.000000 EdgeTPU-fast_INT8_100%_ResNet-50v15 0.958145 INT8_EdgeTPU-fast EdgeTPU-fast_INT8_ResNet-50v15_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
EfficientNet-S EdgeTPU-slow INT8 slow 1 58.99477 8.998390 16.951000 111.131000 0.000000 0.000000 77.622837 93.766004 0.833250 0.833250 1.488880 0.000000 100.000000 l3 2.000000 25.600000 4.700000 EdgeTPU-slow_INT8_100%_EfficientNet-S 1.000000 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_EfficientNet-S_100.0
EfficientNet-M EdgeTPU-slow INT8 slow 1 58.02965 13.958450 17.233000 71.641000 0.000000 0.000000 78.975272 94.510245 0.833250 0.833250 1.683040 0.000000 100.000000 l3 2.000000 25.600000 7.400000 EdgeTPU-slow_INT8_100%_EfficientNet-M 1.000000 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_EfficientNet-M_100.0
EfficientNet-L EdgeTPU-slow INT8 slow 1 76.98822 36.000250 12.989000 27.778000 0.000000 0.000000 80.473751 95.188463 0.833250 0.833250 1.631500 0.000000 100.000000 l3 2.000000 25.600000 19.400000 EdgeTPU-slow_INT8_100%_EfficientNet-L 1.000000 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_EfficientNet-L_100.0
GoogLeNetv1 EdgeTPU-slow INT8 slow 1 10.03 5.721310 99.741000 174.785000 312.189330 547.077050 69.243400 88.445800 0.253000 0.253000 0.463000 3.130000 100.000000 l3 2.000000 25.600000 3.100000 EdgeTPU-slow_INT8_100%_GoogLeNetv1 0.004763 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_GoogLeNetv1_100.0
MobileNetv1 EdgeTPU-slow INT8 slow 1 7.86 4.082490 127.256000 244.949000 145.071840 279.241860 69.567400 87.705800 0.253000 0.253000 0.462000 1.140000 100.000000 l3 2.000000 25.600000 1.100000 EdgeTPU-slow_INT8_100%_MobileNetv1 0.120757 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_MobileNetv1_100.0
ResNet-50v15 EdgeTPU-slow INT8 slow 1 nan 42.357920 10.075000 23.608000 82.615000 193.585600 nan nan nan nan 0.962300 8.200000 100.000000 l3 2.000000 25.600000 10000000.000000 EdgeTPU-slow_INT8_100%_ResNet-50v15 1.000000 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_ResNet-50v15_100.0
ResNet-50v15 EdgeTPU-slow INT8 slow 1 nan 41.695590 7.111000 23.983000 58.310200 196.660600 nan nan nan nan 1.020000 8.200000 100.000000 l3 2.000000 25.600000 10000000.000000 EdgeTPU-slow_INT8_100%_ResNet-50v15 0.984363 INT8_EdgeTPU-slow EdgeTPU-slow_INT8_ResNet-50v15_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
GoogLeNetv1 TX2-maxn FP16 maxn 1 8.15 5.238070 123.686000 194.270000 387.137180 608.065100 66.928000 87.832000 1.800000 5.700000 11.520000 3.130000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.004361 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 2 14.02 9.292110 142.025000 220.442000 444.538250 689.983460 66.928000 87.832000 1.800000 5.700000 11.400000 6.260000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.007736 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 4 26.69 16.449300 146.642000 244.909000 458.989460 766.565170 66.928000 87.832000 1.800000 5.700000 12.000000 12.520000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.013695 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 8 47.5 31.008100 155.081000 258.908000 485.403530 810.382040 66.928000 87.832000 1.800000 5.700000 12.210000 25.040000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.025816 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 16 91.27 59.777900 161.311000 268.110000 504.903430 839.184300 66.928000 87.832000 1.800000 5.700000 12.340000 50.080000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.049768 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 32 191.29 117.904000 166.966000 271.947000 522.603580 851.194110 66.928000 87.832000 1.800000 5.700000 11.850000 100.160000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.098162 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 64 413.94 232.993000 152.200000 274.780000 476.386000 860.061400 66.928000 87.832000 1.800000 5.700000 11.620000 200.320000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.193980 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP16 maxn 128 868.4 462.066000 147.529000 276.264000 461.765770 864.706320 66.928000 87.832000 1.800000 5.700000 11.290000 400.640000 100.000000 l3 1.330000 59.700000 3.100000 TX2-maxn_FP16_100%_GoogLeNetv1 0.384696 FP16_TX2-maxn TX2-maxn_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 1 12.26 8.785070 81.121800 114.873000 253.911234 359.552490 66.956000 87.844000 1.800000 5.700000 12.790000 3.130000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.007314 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 2 21.52 15.730400 92.443800 129.041000 289.349094 403.898330 66.956000 87.844000 1.800000 5.700000 13.060000 6.260000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.013096 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 4 39.45 28.679400 101.106000 139.985000 316.461780 438.153050 66.956000 87.844000 1.800000 5.700000 13.350000 12.520000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.023877 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 8 74.8 54.353600 106.711000 147.581000 334.005430 461.928530 66.956000 87.844000 1.800000 5.700000 13.560000 25.040000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.045252 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 16 145.19 105.581000 110.096000 151.638000 344.600480 474.626940 66.956000 87.844000 1.800000 5.700000 13.700000 50.080000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.087902 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 32 284.2 207.731000 111.913000 154.109000 350.287690 482.361170 66.956000 87.844000 1.800000 5.700000 13.770000 100.160000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.172948 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 64 592.89 412.349000 107.529000 155.170000 336.565770 485.682100 66.956000 87.844000 1.800000 5.700000 13.530000 200.320000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.343304 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxn FP32 maxn 128 1,216.02 814.869000 103.455000 156.718000 323.814150 490.527340 66.956000 87.844000 1.800000 5.700000 13.170000 400.640000 100.000000 l3 0.670000 59.700000 3.100000 TX2-maxn_FP32_100%_GoogLeNetv1 0.678424 FP32_TX2-maxn TX2-maxn_FP32_GoogLeNetv1_100.0
ResNet-50 TX2-maxn FP16 maxn 1 14.23 10.688300 70.238000 94.117600 542.237360 726.587872 75.142000 92.118000 1.800000 5.700000 12.570000 7.720000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.001523 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 2 24.05 18.205900 82.988900 111.230000 640.674308 858.695600 75.142000 92.118000 1.800000 5.700000 13.570000 15.440000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.002594 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 4 44.71 33.966100 89.276400 118.045000 689.213808 911.307400 75.142000 92.118000 1.800000 5.700000 13.760000 30.880000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.004839 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 8 86.26 65.665200 92.678100 121.962000 715.474932 941.546640 75.142000 92.118000 1.800000 5.700000 13.920000 61.760000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.009355 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 16 165.93 126.022000 96.132200 127.085000 742.140584 981.096200 75.142000 92.118000 1.800000 5.700000 13.690000 123.520000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.017954 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 32 324.6 246.861000 98.471000 129.699000 760.196120 1001.276280 75.142000 92.118000 1.800000 5.700000 13.700000 247.040000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.035170 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 64 629.92 489.585000 101.376000 130.705000 782.622720 1009.042600 75.142000 92.118000 1.800000 5.700000 13.760000 494.080000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.069750 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP16 maxn 128 1,254.03 978.640000 102.708000 130.898000 792.905760 1010.532560 75.142000 92.118000 1.800000 5.700000 13.820000 988.160000 100.000000 l3 1.330000 59.700000 7.700000 TX2-maxn_FP16_100%_ResNet-50 0.139425 FP16_TX2-maxn TX2-maxn_FP16_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 1 22.49 18.918500 44.325200 52.950500 342.190544 408.777860 75.148000 92.114000 1.800000 5.700000 14.580000 7.720000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.002695 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 2 38.76 32.952500 51.446900 61.106900 397.170068 471.745268 75.148000 92.114000 1.800000 5.700000 15.020000 15.440000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.004695 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 4 73.64 62.926700 54.271800 63.657600 418.978296 491.436672 75.148000 92.114000 1.800000 5.700000 15.050000 30.880000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.008965 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 8 142.57 121.979000 56.097300 65.759500 433.071156 507.663340 75.148000 92.114000 1.800000 5.700000 15.190000 61.760000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.017378 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 16 274.97 235.178000 58.142200 68.049800 448.857784 525.344456 75.148000 92.114000 1.800000 5.700000 15.340000 123.520000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.033505 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 32 536.91 459.314000 59.555700 69.649800 459.770004 537.696456 75.148000 92.114000 1.800000 5.700000 15.390000 247.040000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.065438 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 64 1,046.99 909.875000 61.046900 70.366700 471.282068 543.230924 75.148000 92.114000 1.800000 5.700000 15.510000 494.080000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.129628 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
ResNet-50 TX2-maxn FP32 maxn 128 2,159.30 1810.440000 59.214700 70.699100 457.137484 545.797052 75.148000 92.114000 1.800000 5.700000 15.210000 988.160000 100.000000 l3 0.670000 59.700000 7.700000 TX2-maxn_FP32_100%_ResNet-50 0.257931 FP32_TX2-maxn TX2-maxn_FP32_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
GoogLeNetv1 TX2-maxq FP16 maxq 1 12.66 7.784560 78.197800 133.348000 244.759114 417.379240 66.928000 87.832000 1.800000 4.150000 5.880000 3.130000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.006481 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 2 22.01 13.434400 90.045700 151.416000 281.843041 473.932080 66.928000 87.832000 1.800000 4.150000 6.010000 6.260000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.011185 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 4 40.05 24.073000 99.863500 166.861000 312.572755 522.274930 66.928000 87.832000 1.800000 4.150000 6.130000 12.520000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.020042 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 8 76.28 45.516400 104.703000 176.058000 327.720390 551.061540 66.928000 87.832000 1.800000 4.150000 6.200000 25.040000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.037895 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 16 147.48 88.065400 108.682000 181.916000 340.174660 569.397080 66.928000 87.832000 1.800000 4.150000 6.240000 50.080000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.073319 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 32 288.64 172.672000 110.476000 185.182000 345.789880 579.619660 66.928000 87.832000 1.800000 4.150000 6.240000 100.160000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.143759 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 64 597.86 341.608000 106.224000 187.247000 332.481120 586.083110 66.928000 87.832000 1.800000 4.150000 6.090000 200.320000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.284408 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP16 maxq 128 1,234.82 681.072000 103.205000 187.846000 323.031650 587.957980 66.928000 87.832000 1.800000 4.150000 6.030000 400.640000 100.000000 l3 0.870000 59.700000 3.100000 TX2-maxq_FP16_100%_GoogLeNetv1 0.567031 FP16_TX2-maxq TX2-maxq_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 1 17.95 12.912900 55.357300 79.228000 173.268349 247.983640 66.956000 87.844000 1.800000 4.150000 6.700000 3.130000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.010751 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 2 31.61 22.917000 63.019300 88.397200 197.250409 276.683236 66.956000 87.844000 1.800000 4.150000 6.890000 6.260000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.019080 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 4 58.19 42.067800 68.660300 95.397700 214.906739 298.594801 66.956000 87.844000 1.800000 4.150000 7.020000 12.520000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.035024 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 8 110.11 79.665800 72.567500 100.627000 227.136275 314.962510 66.956000 87.844000 1.800000 4.150000 7.110000 25.040000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.066326 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 16 214.93 154.982000 74.564900 103.293000 233.388137 323.307090 66.956000 87.844000 1.800000 4.150000 7.160000 50.080000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.129031 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 32 420.74 304.500000 75.992600 105.070000 237.856838 328.869100 66.956000 87.844000 1.800000 4.150000 7.180000 100.160000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.253513 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 64 858.86 604.782000 74.100900 105.806000 231.935817 331.172780 66.956000 87.844000 1.800000 4.150000 7.080000 200.320000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 0.503515 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxq FP32 maxq 128 1,759.91 1201.120000 72.526400 106.564000 227.007632 333.545320 66.956000 87.844000 1.800000 4.150000 7.020000 400.640000 100.000000 l3 0.440000 59.700000 3.100000 TX2-maxq_FP32_100%_GoogLeNetv1 1.000000 FP32_TX2-maxq TX2-maxq_FP32_GoogLeNetv1_100.0
ResNet-50 TX2-maxq FP16 maxq 1 20.77 15.900400 47.841500 64.023100 369.336380 494.258332 75.142000 92.118000 1.800000 4.150000 6.830000 7.720000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.002265 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 2 35.49 26.813100 56.091100 75.156800 433.023292 580.210496 75.142000 92.118000 1.800000 4.150000 6.940000 15.440000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.003820 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 4 66.37 50.246600 60.055100 79.847900 463.625372 616.425788 75.142000 92.118000 1.800000 4.150000 7.000000 30.880000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.007159 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 8 127.96 97.130600 62.507600 82.466100 482.558672 636.638292 75.142000 92.118000 1.800000 4.150000 7.060000 61.760000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.013838 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 16 246.59 186.437000 64.806000 85.821600 500.302320 662.542752 75.142000 92.118000 1.800000 4.150000 7.130000 123.520000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.026561 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 32 480.65 365.233000 66.541000 87.624100 513.696520 676.458052 75.142000 92.118000 1.800000 4.150000 7.120000 247.040000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.052034 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 64 949.12 722.507000 67.333000 88.579100 519.810760 683.830652 75.142000 92.118000 1.800000 4.150000 7.130000 494.080000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.102934 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP16 maxq 128 1,886.15 1432.710000 67.819100 89.378600 523.563452 690.002792 75.142000 92.118000 1.800000 4.150000 7.150000 988.160000 100.000000 l3 0.870000 59.700000 7.700000 TX2-maxq_FP16_100%_ResNet-50 0.204116 FP16_TX2-maxq TX2-maxq_FP16_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 1 33.1 28.049000 30.087600 36.028100 232.276272 278.136932 75.148000 92.114000 1.800000 4.150000 7.600000 7.720000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.003996 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 2 57.08 48.326900 34.990600 41.587000 270.127432 321.051640 75.148000 92.114000 1.800000 4.150000 7.790000 15.440000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.006885 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 4 108.05 92.173400 36.972800 43.470100 285.430016 335.589172 75.148000 92.114000 1.800000 4.150000 7.770000 30.880000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.013132 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 8 209.96 179.301000 38.069700 44.677400 293.898084 344.909528 75.148000 92.114000 1.800000 4.150000 7.850000 61.760000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.025545 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 16 403.67 344.932000 39.594800 46.423600 305.671856 358.390192 75.148000 92.114000 1.800000 4.150000 7.970000 123.520000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.049142 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 32 789.77 674.897000 40.503100 47.428300 312.683932 366.146476 75.148000 92.114000 1.800000 4.150000 7.990000 247.040000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.096152 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 64 1,564.04 1336.340000 40.863600 47.954300 315.466992 370.207196 75.148000 92.114000 1.800000 4.150000 8.030000 494.080000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.190386 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
ResNet-50 TX2-maxq FP32 maxq 128 3,172.73 2652.980000 40.231000 48.211000 310.583320 372.188920 75.148000 92.114000 1.800000 4.150000 7.930000 988.160000 100.000000 l3 0.440000 59.700000 7.700000 TX2-maxq_FP32_100%_ResNet-50 0.377966 FP32_TX2-maxq TX2-maxq_FP32_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
GoogLeNetv1 TX2-maxp FP16 maxp 1 9.93 6.163370 99.824500 169.338000 312.450685 530.027940 66.928000 87.832000 1.800000 4.700000 8.070000 3.130000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.005131 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 2 17.06 10.619700 108.360000 192.363000 339.166800 602.096190 66.928000 87.832000 1.800000 4.700000 8.280000 6.260000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.008841 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 4 30.77 18.940800 120.117000 212.503000 375.966210 665.134390 66.928000 87.832000 1.800000 4.700000 8.470000 12.520000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.015769 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 8 59.85 35.751200 126.529000 224.570000 396.035770 702.904100 66.928000 87.832000 1.800000 4.700000 8.610000 25.040000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.029765 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 16 112.43 68.795800 135.845000 232.794000 425.194850 728.645220 66.928000 87.832000 1.800000 4.700000 8.690000 50.080000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.057276 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 32 234.31 135.189000 135.468000 236.700000 424.014840 740.871000 66.928000 87.832000 1.800000 4.700000 8.350000 100.160000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.112552 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 64 507.56 267.321000 124.802000 239.278000 390.630260 748.940140 66.928000 87.832000 1.800000 4.700000 8.070000 200.320000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.222560 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP16 maxp 128 1,090.82 532.179000 115.890000 240.699000 362.735700 753.387870 66.928000 87.832000 1.800000 4.700000 7.740000 400.640000 100.000000 l3 1.150000 59.700000 3.100000 TX2-maxp_FP16_100%_GoogLeNetv1 0.443069 FP16_TX2-maxp TX2-maxp_FP16_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 1 14.66 10.246500 67.515000 100.033000 211.321950 313.103290 66.956000 87.844000 1.800000 4.700000 9.150000 3.130000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.008531 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 2 25.75 18.046800 77.259700 112.349000 241.822861 351.652370 66.956000 87.844000 1.800000 4.700000 9.370000 6.260000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.015025 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 4 47.16 32.917100 84.509400 121.937000 264.514422 381.662810 66.956000 87.844000 1.800000 4.700000 9.560000 12.520000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.027405 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 8 84.8 62.403400 88.881200 128.575000 278.198156 402.439750 66.956000 87.844000 1.800000 4.700000 9.710000 25.040000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.051954 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 16 174.47 121.707000 91.764500 131.840000 287.222885 412.659200 66.956000 87.844000 1.800000 4.700000 9.750000 50.080000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.101328 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 32 338.86 238.447000 94.299700 134.274000 295.158061 420.277620 66.956000 87.844000 1.800000 4.700000 9.770000 100.160000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.198521 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 64 716.89 473.498000 88.489500 135.156000 276.972135 423.038280 66.956000 87.844000 1.800000 4.700000 9.500000 200.320000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.394214 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
GoogLeNetv1 TX2-maxp FP32 maxp 128 1,501.33 938.024000 84.796300 136.319000 265.412419 426.678470 66.956000 87.844000 1.800000 4.700000 9.160000 400.640000 100.000000 l3 0.570000 59.700000 3.100000 TX2-maxp_FP32_100%_GoogLeNetv1 0.780958 FP32_TX2-maxp TX2-maxp_FP32_GoogLeNetv1_100.0
ResNet-50 TX2-maxp FP16 maxp 1 16.86 12.515900 58.935300 81.654100 454.980516 630.369652 75.142000 92.118000 1.800000 4.700000 9.380000 7.720000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.001783 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 2 28.82 21.016000 69.086500 96.135600 533.347780 742.166832 75.142000 92.118000 1.800000 4.700000 9.590000 15.440000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.002994 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 4 53.55 39.207700 74.510700 102.305000 575.222604 789.794600 75.142000 92.118000 1.800000 4.700000 9.710000 30.880000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.005586 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 8 102.85 75.837600 77.487700 105.720000 598.205044 816.158400 75.142000 92.118000 1.800000 4.700000 9.810000 61.760000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.010804 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 16 198.03 145.373000 80.725300 110.253000 623.199316 851.153160 75.142000 92.118000 1.800000 4.700000 9.790000 123.520000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.020711 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 32 384.42 283.944000 83.015800 112.591000 640.881976 869.202520 75.142000 92.118000 1.800000 4.700000 9.790000 247.040000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.040453 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 64 750.35 564.202000 85.255200 113.390000 658.170144 875.370800 75.142000 92.118000 1.800000 4.700000 9.810000 494.080000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.080381 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP16 maxp 128 1,505.03 1122.970000 85.971000 114.033000 663.696120 880.334760 75.142000 92.118000 1.800000 4.700000 9.860000 988.160000 100.000000 l3 1.150000 59.700000 7.700000 TX2-maxp_FP16_100%_ResNet-50 0.159988 FP16_TX2-maxp TX2-maxp_FP16_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 1 26.6 22.111700 37.461100 45.816500 289.199692 353.703380 75.148000 92.114000 1.800000 4.700000 10.540000 7.720000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.003150 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 2 45.71 37.930000 43.661800 53.023600 337.069096 409.342192 75.148000 92.114000 1.800000 4.700000 10.830000 15.440000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.005404 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 4 86.5 72.207400 46.186500 55.496200 356.559780 428.430664 75.148000 92.114000 1.800000 4.700000 10.860000 30.880000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.010287 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 8 167.74 140.401000 47.663400 57.008900 367.961448 440.108708 75.148000 92.114000 1.800000 4.700000 11.010000 61.760000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.020003 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 16 323.77 270.671000 49.389900 59.131100 381.290028 456.492092 75.148000 92.114000 1.800000 4.700000 11.130000 123.520000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.038562 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 32 630.79 529.398000 50.665500 60.480800 391.137660 466.911776 75.148000 92.114000 1.800000 4.700000 11.150000 247.040000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.075422 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 64 1,237.70 1046.480000 51.615500 61.105500 398.471660 471.734460 75.148000 92.114000 1.800000 4.700000 11.240000 494.080000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.149090 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
ResNet-50 TX2-maxp FP32 maxp 128 2,566.91 2080.780000 49.858800 61.514100 384.909936 474.888852 75.148000 92.114000 1.800000 4.700000 10.880000 988.160000 100.000000 l3 0.570000 59.700000 7.700000 TX2-maxp_FP32_100%_ResNet-50 0.296445 FP32_TX2-maxp TX2-maxp_FP32_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
GoogLeNetv1 Ultra96-DPU INT8 nan 1 19.83 16.791300 50.447000 59.575200 157.899110 186.470376 69.410000 89.310000 2.500000 6.800000 8.028990 3.130000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.013980 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 2 33.41 29.948300 59.933900 66.509500 187.593107 208.174735 69.410000 89.310000 2.500000 6.800000 8.238710 6.260000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.024934 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 3 50.72 47.348200 59.677400 nan 186.790262 nan 69.410000 89.310000 2.500000 6.800000 8.338540 9.390000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.039420 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 4 66.76 63.206100 59.752300 nan 187.024699 nan 69.410000 89.310000 2.500000 6.800000 8.238470 12.520000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.052623 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 5 83.64 81.108000 59.535500 nan 186.346115 nan 69.410000 89.310000 2.500000 6.800000 8.229450 15.650000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.067527 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 6 101.58 99.308000 57.367600 nan 179.560588 nan 69.410000 89.310000 2.500000 6.800000 8.223590 18.780000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.082679 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 7 118.88 116.474000 58.816000 nan 184.094080 nan 69.410000 89.310000 2.500000 6.800000 8.499680 21.910000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.096971 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 Ultra96-DPU INT8 nan 8 138.01 129.952000 59.466900 62.008800 186.131397 194.087544 69.410000 89.310000 2.500000 6.800000 8.232020 25.040000 100.000000 l3 0.960000 4.260000 3.100000 Ultra96-DPU_INT8_100%_GoogLeNetv1 0.108192 INT8_Ultra96-DPU Ultra96-DPU_INT8_GoogLeNetv1_100.0
ResNet-50 Ultra96-DPU INT8 nan 1 24.75 21.749100 40.308300 45.985100 98.755335 112.663495 68.830000 90.160000 2.500000 6.800000 8.096950 2.450000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.003099 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 2 43.3 40.501600 46.163000 49.580100 113.099350 121.471245 68.830000 90.160000 2.500000 6.800000 8.251800 4.900000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.005770 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 3 65.1 62.615500 45.944200 48.170300 112.563290 118.017235 68.830000 90.160000 2.500000 6.800000 8.233840 7.350000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.008921 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 4 86.63 83.627300 46.066400 47.641200 112.862680 116.720940 68.830000 90.160000 2.500000 6.800000 8.239520 9.800000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.011914 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 5 108.52 105.423000 45.888900 47.864000 112.427805 117.266800 68.830000 90.160000 2.500000 6.800000 8.237720 12.250000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.015019 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 6 130.29 126.833000 45.775600 47.738300 112.150220 116.958835 68.830000 90.160000 2.500000 6.800000 8.244510 14.700000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.018070 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 7 151.77 149.926000 45.865100 47.729400 112.369495 116.937030 68.830000 90.160000 2.500000 6.800000 8.241920 17.150000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.021360 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 8 174.11 170.095000 45.685600 47.720800 111.929720 116.915960 68.830000 90.160000 2.500000 6.800000 8.232890 19.600000 30.000000 l3 0.960000 4.260000 2.500000 Ultra96-DPU_INT8_30.00%_ResNet-50 0.024233 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_30.0
ResNet-50 Ultra96-DPU INT8 nan 1 29.87 26.907400 28.483900 37.245800 106.814625 139.671750 69.490000 91.000000 2.500000 6.800000 8.146570 3.750000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.003833 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 2 53.43 50.483100 37.273800 39.620000 139.776750 148.575000 69.490000 91.000000 2.500000 6.800000 8.278120 7.500000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.007192 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 3 80.15 77.445800 37.387900 38.672700 140.204625 145.022625 69.490000 91.000000 2.500000 6.800000 8.274800 11.250000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.011034 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 4 106.94 103.928000 37.302000 38.460900 139.882500 144.228375 69.490000 91.000000 2.500000 6.800000 8.285150 15.000000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.014806 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 5 134.06 130.709000 37.315300 38.606900 139.932375 144.775875 69.490000 91.000000 2.500000 6.800000 8.306130 18.750000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.018622 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 6 160.18 157.586000 37.297500 38.498600 139.865625 144.369750 69.490000 91.000000 2.500000 6.800000 8.290050 22.500000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.022451 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 7 186.78 184.134000 37.347900 38.490600 140.054625 144.339750 69.490000 91.000000 2.500000 6.800000 8.290930 26.250000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.026233 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 8 213.6 210.719000 37.231100 38.415800 139.616625 144.059250 69.490000 91.000000 2.500000 6.800000 8.291070 30.000000 50.000000 l3 0.960000 4.260000 3.800000 Ultra96-DPU_INT8_50%_ResNet-50 0.030021 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_50.0
ResNet-50 Ultra96-DPU INT8 nan 1 38.72 35.674000 22.033500 27.958700 144.099090 182.849898 73.300000 91.400000 2.500000 6.800000 8.022200 6.540000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.005082 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 2 71 68.182300 28.165900 29.396800 184.204986 192.255072 73.300000 91.400000 2.500000 6.800000 8.287280 13.080000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.009714 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 3 106.4 103.579000 28.104300 28.964800 183.802122 189.429792 73.300000 91.400000 2.500000 6.800000 8.298450 19.620000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.014757 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 4 142.64 139.307000 28.151200 28.658700 184.108848 187.427898 73.300000 91.400000 2.500000 6.800000 8.311200 26.160000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.019847 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 5 177.23 174.540000 28.148500 28.774700 184.091190 188.186538 73.300000 91.400000 2.500000 6.800000 8.319110 32.700000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.024866 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 6 212.72 209.512000 28.070100 28.741800 183.578454 187.971372 73.300000 91.400000 2.500000 6.800000 8.324750 39.240000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.029849 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 7 248.48 244.859000 28.100200 28.718800 183.775308 187.820952 73.300000 91.400000 2.500000 6.800000 8.328310 45.780000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.034885 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 8 284.13 281.150000 28.133900 28.702400 183.995706 187.713696 73.300000 91.400000 2.500000 6.800000 8.332770 52.320000 80.000000 l3 0.960000 4.260000 6.500000 Ultra96-DPU_INT8_80%_ResNet-50 0.040055 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_80.0
ResNet-50 Ultra96-DPU INT8 nan 1 42.35 39.276000 23.652400 25.426100 182.596528 196.289492 73.290000 91.260000 2.500000 6.800000 8.250720 7.720000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.005596 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 2 78.27 75.275200 25.504400 26.564100 196.893968 205.074852 73.290000 91.260000 2.500000 6.800000 8.354800 15.440000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.010724 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 3 117.24 114.327000 25.530300 26.211000 197.093916 202.348920 73.290000 91.260000 2.500000 6.800000 8.351100 23.160000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.016288 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 4 156.5 153.429000 25.510200 26.013500 196.938744 200.824220 73.290000 91.260000 2.500000 6.800000 8.355540 30.880000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.021859 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 5 195.55 192.398000 25.533600 26.011900 197.119392 200.811868 73.290000 91.260000 2.500000 6.800000 8.355590 38.600000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.027411 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 6 238.1 235.284000 25.117600 25.571200 193.907872 197.409664 73.290000 91.260000 2.500000 6.800000 8.367900 46.320000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.033521 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 7 277.54 275.017000 25.003200 25.614000 193.024704 197.740080 73.290000 91.260000 2.500000 6.800000 8.360650 54.040000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.039181 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
ResNet-50 Ultra96-DPU INT8 nan 8 313.04 309.125000 25.392000 26.052800 196.026240 201.127616 73.290000 91.260000 2.500000 6.800000 8.362560 61.760000 100.000000 l3 0.960000 4.260000 7.700000 Ultra96-DPU_INT8_100%_ResNet-50 0.044041 INT8_Ultra96-DPU Ultra96-DPU_INT8_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
GoogLeNetv1 ZCU102-DPU INT8 nan 1 9.63 6.655700 103.431000 150.391000 323.739030 470.723830 69.490000 89.260000 20.000000 29.000000 31.450000 3.130000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.005541 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 2 9.87048 6.848720 202.476000 290.497000 633.749880 909.255610 69.490000 89.260000 20.000000 29.000000 33.900000 6.260000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.005702 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 3 10.0871 7.175870 296.555000 424.312000 928.217150 1328.096560 69.490000 89.260000 20.000000 29.000000 36.400000 9.390000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.005974 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 4 11.5514 8.613150 341.354000 462.215000 1068.438020 1446.732950 69.490000 89.260000 20.000000 29.000000 37.900000 12.520000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.007171 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 5 13.533 10.362700 364.868000 529.573000 1142.036840 1657.563490 69.490000 89.260000 20.000000 29.000000 38.900000 15.650000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.008628 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 6 15.7128 12.832400 371.273000 544.702000 1162.084490 1704.917260 69.490000 89.260000 20.000000 29.000000 37.400000 18.780000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.010684 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 7 18.3435 15.445600 377.010000 536.201000 1180.041300 1678.309130 69.490000 89.260000 20.000000 29.000000 38.500000 21.910000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.012859 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
GoogLeNetv1 ZCU102-DPU INT8 nan 8 20.8812 17.822400 379.109000 535.491000 1186.611170 1676.086830 69.490000 89.260000 20.000000 29.000000 39.000000 25.040000 100.000000 l3 6.710000 19.200000 3.100000 ZCU102-DPU_INT8_100%_GoogLeNetv1 0.014838 INT8_ZCU102-DPU ZCU102-DPU_INT8_GoogLeNetv1_100.0
ResNet-50 ZCU102-DPU INT8 nan 1 17.78 14.816800 43.747800 67.642700 337.733016 522.201644 72.530000 90.850000 20.000000 29.000000 31.800000 7.720000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.002111 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 2 18.59 15.567400 107.373000 127.657000 828.919560 985.512040 72.530000 90.850000 20.000000 29.000000 34.400000 15.440000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.002218 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 3 20.69 17.610700 120.665000 169.744000 931.533800 1310.423680 72.530000 90.850000 20.000000 29.000000 37.500000 23.160000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.002509 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 4 24.62 21.522900 161.764000 183.805000 1248.818080 1418.974600 72.530000 90.850000 20.000000 29.000000 39.700000 30.880000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.003066 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 5 29.96 27.047300 165.987000 193.019000 1281.419640 1490.106680 72.530000 90.850000 20.000000 29.000000 40.100000 38.600000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.003853 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 6 35.5 32.481000 167.636000 193.787000 1294.149920 1496.035640 72.530000 90.850000 20.000000 29.000000 40.300000 46.320000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.004628 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 7 41.59 38.551000 168.132000 190.786000 1297.979040 1472.867920 72.530000 90.850000 20.000000 29.000000 40.500000 54.040000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.005492 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU102-DPU INT8 nan 8 47.61 44.406200 167.292000 191.908000 1291.494240 1481.529760 72.530000 90.850000 20.000000 29.000000 40.600000 61.760000 100.000000 l3 6.710000 19.200000 7.700000 ZCU102-DPU_INT8_100%_ResNet-50 0.006326 INT8_ZCU102-DPU ZCU102-DPU_INT8_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
MobileNetv1 ZCU104-DPU INT8 nan 8 38.08276832 33.807596 210.130758 236.642053 239.549064 269.771940 68.130000 87.626000 nan 15.720000 17.600000 9.120000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 1.000000 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 7 33.93144965 29.643530 206.410323 236.156816 235.307768 269.218770 68.130000 87.626000 nan 15.720000 17.500000 7.980000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.876830 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 6 29.6451959 25.482758 202.503510 235.470347 230.854001 268.436196 68.130000 87.626000 nan 15.720000 17.600000 6.840000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.753758 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 5 25.50485432 21.313983 196.202459 234.603609 223.670803 267.448114 68.130000 87.626000 nan 15.720000 17.600000 5.700000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.630450 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 4 21.26583904 17.127269 188.234089 233.575940 214.586862 266.276572 68.130000 87.626000 nan 15.720000 17.600000 4.560000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.506610 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 3 17.0441255 12.928530 176.205388 232.067764 200.874143 264.557251 68.130000 87.626000 nan 15.720000 17.600000 3.420000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.382415 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 2 13.25202793 8.763307 151.193536 228.277431 172.360631 260.236271 68.130000 87.626000 nan 15.720000 17.500000 2.280000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.259211 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
MobileNetv1 ZCU104-DPU INT8 nan 1 8.875291348 4.443876 113.045224 225.045547 128.871555 256.551923 68.130000 87.626000 nan 15.720000 17.600000 1.140000 100.000000 l3 4.600000 19.200000 1.100000 ZCU104-DPU_INT8_100%_MobileNetv1 0.131446 INT8_ZCU104-DPU ZCU104-DPU_INT8_MobileNetv1_100.0
ResNet-50 ZCU104-DPU INT8 nan 1 17.96 14.962200 42.086900 66.848600 324.910868 516.071192 72.530000 90.850000 9.200000 nan 21.411100 7.720000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.002132 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 2 19.69 16.631000 101.877000 120.612000 786.490440 931.124640 72.530000 90.850000 9.200000 nan 25.783500 15.440000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.002369 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 3 25.37 22.456800 117.459000 133.331000 906.783480 1029.315320 72.530000 90.850000 9.200000 nan 26.394300 23.160000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.003199 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 4 33.46 30.479700 118.944000 131.841000 918.247680 1017.812520 72.530000 90.850000 9.200000 nan 26.531600 30.880000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.004342 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 5 40.28 37.259400 122.261000 138.253000 943.854920 1067.313160 72.530000 90.850000 9.200000 nan 26.817900 38.600000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.005308 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 6 47.95 45.265000 122.665000 136.837000 946.973800 1056.381640 72.530000 90.850000 9.200000 nan 26.833800 46.320000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.006449 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 7 56.74 53.611800 122.198000 135.730000 943.368560 1047.835600 72.530000 90.850000 9.200000 nan 26.857200 54.040000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.007638 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
ResNet-50 ZCU104-DPU INT8 nan 8 64.88 62.296600 122.805000 135.247000 948.054600 1044.106840 72.530000 90.850000 9.200000 nan 26.894200 61.760000 100.000000 l3 4.600000 19.200000 7.700000 ZCU104-DPU_INT8_100%_ResNet-50 0.008875 INT8_ZCU104-DPU ZCU104-DPU_INT8_ResNet-50_100.0
NN_Topology HWType Datatype Op mode batch/thread/stream lat-sys [msec] lat-comp [msec] fps-system [fps] fps-comp [fps] tp-system [TOP/sec] tp-comp [TOP/sec] top1 [%] top5 [%] Base_Pwr [W] Idle_Pwr [W] Full_Pwr [W] GOPS PruningFactor level hw_peak_perf [TOP/sec] hw_bandwidth [GBps] nn_total_operations hw_datatype_prun_net norm-lat-comp datatype_model tag
ResNet-50 NCS2 FP16 nan 1 59.0438 56.318900 16.936600 17.756000 130.750552 137.076320 75.172000 92.010000 0.530000 1.200000 1.873000 7.720000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.008024 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 2 116.196 110.751000 17.212300 18.058600 132.878956 139.412392 75.172000 92.010000 0.530000 1.200000 1.899000 15.440000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.015779 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 4 231.346 220.978000 17.323900 18.136700 133.740508 140.015324 75.172000 92.010000 0.530000 1.200000 1.925000 30.880000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.031482 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 8 461.168 440.286000 17.381100 18.205500 134.182092 140.546460 75.172000 92.010000 0.530000 1.200000 1.925000 61.760000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.062727 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 16 921.238 878.950000 17.401900 18.239100 134.342668 140.805852 75.172000 92.010000 0.530000 1.200000 1.975000 123.520000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.125223 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 32 1840.64 1755.280000 17.419200 18.266300 134.476224 141.015836 75.172000 92.010000 0.530000 1.200000 2.000000 247.040000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.250072 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 64 3673.91 3510.880000 17.454200 18.264700 134.746424 141.003484 75.172000 92.010000 0.530000 1.200000 1.975000 494.080000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 0.500189 FP16_NCS2 NCS2_FP16_ResNet-50_100.0
ResNet-50 NCS2 FP16 nan 128 7340.08 7019.100000 17.472600 18.271600 134.888472 141.056752 75.172000 92.010000 0.530000 1.200000 2.000000 988.160000 100.000000 l3 0.500000 12.800000 7.700000 NCS2_FP16_100%_ResNet-50 1.000000 FP16_NCS2 NCS2_FP16_ResNet-50_100.0

Note: We could not reproduce Google's accuracies stated here for EfficientNets on the EdgeTPU.