Awesome
cvm-runtime
CVM Runtime
Latency
| model | Jetson Nano - Cortex-A57(s) | Intel E5-2650(s) | Jetson Nano - GPU(128 CUDA Cores)(s) | 1080Ti(3584 CUDA Cores)(s) |
|---|---|---|---|---|
| yolo_tfm | 1.076 | 0.043 | ||
| resnet50_mxg | 1.2076 | 0.3807 | 0.147 | 0.009 |
| resnet18_v1 | 0.055 | 0.004 | ||
| qd10_resnet20_v2 | 0.064 | 0.010 | ||
| resnet50_v2 | 1.4674 | 0.5005 | 0.185 | 0.010 |
| qd10_resnet20_v2 | 0.2944 | 0.1605 | 0.065 | 0.012 |
| trec | 0.0075 | 0.0028 | 0.002 | 0.001 |
| dcnet_mnist_v1 | 0.0062 | 0.0057 | 0.002 | 0.001 |
| mobilenetv1.0_imagenet | 0.3508 | 0.1483 | 0.039 | 0.002 |
| resnet50_v1_imagenet | 1.2453 | 0.3429 | 0.150 | 0.009 |
| animal10 | 0.3055 | 0.1466 | 0.065 | 0.010 |
| vgg16_gcv | 4.3787 | 0.6092 | 0.713 | 0.021 |
| sentiment_trec | 0.0047 | 0.0022 | 0.002 | 0.001 |
| vgg19_gcv | 5.1753 | 0.7513 | 0.788 | 0.023 |
| squeezenet_gcv1.1 | 0.3889 | 0.0895 | 0.044 | 0.002 |
| squeezenet_gcv1.0 | 0.1987 | 0.1319 | 0.064 | 0.003 |
| shufflenet | 1.4575 | 0.7697 | 0.140 | 0.004 |
| ssd | 0.773 | 0.030 | ||
| ssd_512_mobilenet1.0_coco_tfm | 0.311 | 0.016 | ||
| ssd_512_mobilenet1.0_voc_tfm | 0.220 | 0.014 |