Yolo-v5: Optimized for Qualcomm Devices

YoloV5 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-v5 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for Yolo-v5 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YoloV5-M
  • Input resolution: 640x640
  • Number of parameters: 21.2M
  • Model size (float): 81.1 MB
  • Model size (w8a16): 21.8 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Yolo-v5 ONNX float Snapdragon® X2 Elite 7.251 ms 5 - 5 MB NPU
Yolo-v5 ONNX float Snapdragon® X Elite 13.566 ms 47 - 47 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 3 Mobile 9.623 ms 5 - 247 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Gen 1 Mobile 27.699 ms 5 - 274 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 12.897 ms 0 - 54 MB NPU
Yolo-v5 ONNX float Qualcomm® QCS8450 27.699 ms 5 - 274 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-9075 20.405 ms 5 - 12 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Elite Gen 5 Mobile 5.778 ms 1 - 212 MB NPU
Yolo-v5 ONNX float Snapdragon® 8 Elite Mobile 7.475 ms 3 - 204 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ Q-8750 7.475 ms 3 - 204 MB NPU
Yolo-v5 ONNX float Qualcomm® Dragonwing™ IQ-X7181 13.566 ms 47 - 47 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X2 Elite 5.047 ms 2 - 2 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® X Elite 10.324 ms 23 - 23 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 6.406 ms 3 - 304 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 13.832 ms 3 - 304 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 50.671 ms 2 - 5 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 9.851 ms 0 - 29 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® QCS8450 13.832 ms 3 - 304 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 12.535 ms 2 - 5 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 14.146 ms 3 - 272 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 4.362 ms 0 - 271 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 132.687 ms 3 - 293 MB NPU
Yolo-v5 ONNX w8a16 Snapdragon® 8 Elite Mobile 5.558 ms 40 - 302 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 14.146 ms 3 - 272 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 5.558 ms 40 - 302 MB NPU
Yolo-v5 ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 10.324 ms 23 - 23 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X2 Elite 6.781 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® X Elite 12.216 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 3 Mobile 8.578 ms 5 - 242 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Gen 1 Mobile 25.897 ms 5 - 265 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® QCS8275 63.868 ms 1 - 193 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.424 ms 5 - 146 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8775P 17.499 ms 1 - 195 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8650P 17.499 ms 1 - 195 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8255P 17.499 ms 1 - 195 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® QCS8450 25.897 ms 5 - 265 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 17.546 ms 5 - 11 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 5.016 ms 5 - 211 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA7255P 63.868 ms 1 - 193 MB NPU
Yolo-v5 QNN_DLC float Snapdragon® 8 Elite Mobile 6.502 ms 5 - 202 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® SA8295P 22.245 ms 0 - 219 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ Q-8750 6.502 ms 5 - 202 MB NPU
Yolo-v5 QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 12.216 ms 5 - 5 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X2 Elite 4.295 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® X Elite 9.526 ms 2 - 2 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 5.828 ms 2 - 277 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 13.472 ms 2 - 279 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 48.39 ms 3 - 7 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® QCS8275 20.984 ms 2 - 233 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.739 ms 2 - 4 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8775P 8.995 ms 1 - 233 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8650P 8.995 ms 1 - 233 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8255P 8.995 ms 1 - 233 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® QCS8450 13.472 ms 2 - 279 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 8.707 ms 4 - 8 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 12.679 ms 2 - 251 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 3.349 ms 2 - 245 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 126.898 ms 2 - 271 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA7255P 20.984 ms 2 - 233 MB NPU
Yolo-v5 QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 4.242 ms 2 - 240 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® SA8295P 12.573 ms 0 - 234 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 12.679 ms 2 - 251 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 4.242 ms 2 - 240 MB NPU
Yolo-v5 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 9.526 ms 2 - 2 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 3 Mobile 8.25 ms 0 - 287 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Gen 1 Mobile 25.592 ms 0 - 312 MB NPU
Yolo-v5 TFLITE float Qualcomm® QCS8275 63.146 ms 0 - 222 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.196 ms 0 - 3 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8775P 17.005 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8650P 17.005 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8255P 17.005 ms 0 - 223 MB NPU
Yolo-v5 TFLITE float Qualcomm® QCS8450 25.592 ms 0 - 312 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ IQ-9075 17.519 ms 0 - 57 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 4.618 ms 0 - 233 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA7255P 63.146 ms 0 - 222 MB NPU
Yolo-v5 TFLITE float Snapdragon® 8 Elite Mobile 6.173 ms 0 - 228 MB NPU
Yolo-v5 TFLITE float Qualcomm® SA8295P 21.628 ms 0 - 249 MB NPU
Yolo-v5 TFLITE float Qualcomm® Dragonwing™ Q-8750 6.173 ms 0 - 228 MB NPU

License

  • The license for the original implementation of Yolo-v5 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support