rpi4b
Target information
| Description | Value |
|---|---|
| Number of instances | 4 |
| Number of app types | 1 |
| Number of engines | 3 |
Target Instances
App Type: TYPE1
Test Failed Across Instances
| Instance | ort | tflite | aidge |
|---|---|---|---|
| rpi4b-0002-0000 | 1/9 | 1/9 | - |
| rpi4b-0002-0001 | 1/9 | 1/9 | - |
| rpi4b-0002-0002 | 1/9 | 1/9 | 8/9 |
| rpi4b-0002-0003 | 1/9 | 1/9 | - |
Inference Time Across Instances
Engine: ort
Inference Time: Significant variance in inference time across instances detected.
| Instance | DSCNN.onnx | DSCNN_int8.onnx | MobileNetV1.onnx | MobileNetV1_int8.onnx | Resnet.onnx | Resnet_int8.onnx | DeepAutoEncoder.onnx | DeepAutoEncoder_int8.onnx | DSCNN.tflite |
|---|---|---|---|---|---|---|---|---|---|
| rpi4b-0002-0000 | 2.78 ms | 1.04 ms | 4.47 ms | 2.17 ms | 3.06 ms | 1.84 ms | 0.71 ms | 0.58 ms | N/A |
| rpi4b-0002-0001 | 1.95 ms | 1.01 ms | 4.61 ms | 2.18 ms | 2.48 ms | 1.35 ms | 0.68 ms | 0.55 ms | N/A |
| rpi4b-0002-0002 | 2.03 ms | 1.69 ms | 4.47 ms | 2.14 ms | 3.17 ms | 1.36 ms | 0.73 ms | 0.46 ms | N/A |
| rpi4b-0002-0003 | 1.94 ms | 1.18 ms | 4.79 ms | 2.20 ms | 2.65 ms | 1.61 ms | 0.71 ms | 0.47 ms | N/A |
Engine: tflite
Inference Time: High variance in inference time across instances detected.
| Instance | DSCNN.tflite | DSCNN_int8.tflite | MobileNetV1.tflite | MobileNetV1_int8.tflite | Resnet.tflite | Resnet_int8.tflite | DeepAutoEncoder.tflite | DeepAutoEncoder_int8.tflite | DSCNN.onnx |
|---|---|---|---|---|---|---|---|---|---|
| rpi4b-0002-0000 | 3.24 ms | 0.34 ms | 1.26 ms | 0.69 ms | 1.17 ms | 0.70 ms | 0.31 ms | 0.05 ms | N/A |
| rpi4b-0002-0001 | 16.64 ms | 0.40 ms | 1.44 ms | 1.21 ms | 1.13 ms | 1.28 ms | 0.35 ms | 0.11 ms | N/A |
| rpi4b-0002-0002 | 16.84 ms | 0.38 ms | 1.26 ms | 1.33 ms | 1.16 ms | 1.27 ms | 0.32 ms | 0.11 ms | N/A |
| rpi4b-0002-0003 | 16.99 ms | 0.39 ms | 1.31 ms | 1.20 ms | 1.18 ms | 1.33 ms | 0.35 ms | 0.11 ms | N/A |
Engine: aidge
Inference Time: Inference time across instances.
| Instance | DSCNN.onnx | DSCNN_int8.onnx | MobileNetV1.onnx | MobileNetV1_int8.onnx | Resnet.onnx | Resnet_int8.onnx | DeepAutoEncoder.onnx | DeepAutoEncoder_int8.onnx | DSCNN.tflite |
|---|---|---|---|---|---|---|---|---|---|
| rpi4b-0002-0002 | N/A | N/A | N/A | N/A | N/A | N/A | 0.51 ms | N/A | N/A |