Target information

Description	Value
Number of instances	1
Number of app types	2
Number of engines	3

Target Instances

c-jetsonorinnano-0001-0000

App Type: TYPE1

Test Failed Across Instances

Instance	ort	tflite	trt
c-jetsonorinnano-000…	1/22	2/23	10/22

Inference Time Across Instances

Engine: ort

Instance	efficientnet_b0_Opset16.onnx	efficientnet-lite4-11-int8.onnx	mobilenetv2-12-int8.onnx	mobilenetv2-12.onnx	mobilenetv3_large_100_miil_in21k_Opset17_timm.onnx	resnet50-v1-12-int8.onnx	dla60_res2net_Opset16.onnx	resnet34_Opset16.onnx	squeezenet1.0-12-int8.onnx	mnist-12-int8.onnx	mnist-7.onnx	bvlcalexnet-12-int8.onnx	tinyyolov2-8.onnx	ssd_mobilenet_v1_12-int8.onnx	ssd-12-int8.onnx	st_movenet_lightning_heatmaps_192.onnx	udnie-8.onnx	pointilism-9.onnx	candy-8.onnx	arcfaceresnet100-11-int8.onnx	age_googlenet.onnx	keypoint_classifier.tflite
c-jetsonorinnano-000…	17.00 ms	36.58 ms	16.94 ms	10.77 ms	13.94 ms	51.35 ms	27.45 ms	14.58 ms	21.23 ms	1.73 ms	0.66 ms	24.18 ms	14.02 ms	192.98 ms	1345.73 ms	12.34 ms	20.76 ms	20.48 ms	20.46 ms	186.54 ms	15.95 ms	N/A

Engine: tflite

Instance	keypoint_classifier.tflite	st_efficientnet_lc_v1_128_tfs_int8.tflite	fdmobilenet_0.25_128_tfs_int8.tflite	st_fdmobilenet_v1_224_tfs_int8.tflite	mobilenet_v1_0.5_224_tfs_int8.tflite	mobilenet_v2_0.35_224_tl_int8.tflite	resnet_v1_32_32_tfs_int8.tflite	squeezenetv1.1_224_tfs_int8.tflite	miniresnet_2stacks_64x50_tl_int8.tflite	miniresnetv2_2stacks_64x50_tl_int8.tflite	yamnet_256_64x96_tl_int8.tflite	ssd_mobilenet_v2_fpnlite_100_416_int8.tflite	st_yolo_lc_v1_256_int8.tflite	tiny_yolo_v2_416_int8.tflite	YOLOv5.tflite	st_ssd_mobilenet_v1_025_256_int8.tflite	movenet_singlepose_lightning_192_float.tflite	movenet_singlepose_lightning_192_int8.tflite	movenet_lightning_heatmaps_256_int8_pt.tflite	movenet_singlepose_thunder_256_float.tflite	deeplab_v3_mobilenetv2_05_16_512_asppv1_int8.tflite	deeplab_v3_mobilenetv2_05_16_512_asppv1_int8_f32.tflite	efficientnet_b0_Opset16.onnx
c-jetsonorinnano-000…	0.06 ms	N/A	1.35 ms	3.60 ms	6.69 ms	7.23 ms	3.12 ms	5.83 ms	0.64 ms	3.42 ms	0.60 ms	55.85 ms	6.53 ms	35.85 ms	91.14 ms	11.86 ms	32.66 ms	21.91 ms	59.29 ms	71.30 ms	51.59 ms	53.96 ms	N/A

Engine: trt

Instance	efficientnet_b0_Opset16.onnx	efficientnet-lite4-11-int8.onnx	mobilenetv2-12-int8.onnx	mobilenetv2-12.onnx	mobilenetv3_large_100_miil_in21k_Opset17_timm.onnx	resnet50-v1-12-int8.onnx	dla60_res2net_Opset16.onnx	resnet34_Opset16.onnx	squeezenet1.0-12-int8.onnx	mnist-12-int8.onnx	mnist-7.onnx	bvlcalexnet-12-int8.onnx	tinyyolov2-8.onnx	ssd_mobilenet_v1_12-int8.onnx	ssd-12-int8.onnx	st_movenet_lightning_heatmaps_192.onnx	udnie-8.onnx	pointilism-9.onnx	candy-8.onnx	arcfaceresnet100-11-int8.onnx	age_googlenet.onnx	keypoint_classifier.tflite
c-jetsonorinnano-000…	3.78 ms	N/A	N/A	1.68 ms	3.09 ms	N/A	6.53 ms	3.20 ms	N/A	N/A	0.14 ms	N/A	3.78 ms	N/A	N/A	1.80 ms	13.28 ms	13.26 ms	13.20 ms	N/A	2.74 ms	N/A

App Type: TYPE2

Test Failed Across Instances

Instance	tflite
c-jetsonorinnano-000…	0/1

Inference Time Across Instances

Engine: tflite

Instance	st_efficientnet_lc_v1_128_tfs_int8.tflite
c-jetsonorinnano-000…	0.00 ms

Accuracy Across Instances

Engine: tflite

Instance	st_efficientnet_lc_v1_128_tfs_int8.tflite
c-jetsonorinnano-000…	99.87 %

Inference time across applications