YOLOv9-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv9-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv9-T
  • Input resolution: 640x640
  • Model size (float): 8.84 MB
  • Model size (w8a8): 3.23 MB
  • Model size (w8a8_mixed_int16): 3.74 MB
  • Model size (w8a16): 3.25 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.231 ms 2 - 238 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X2 Elite 3.62 ms 3 - 3 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X Elite 10.581 ms 5 - 5 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 7.511 ms 5 - 299 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8550 (Proxy) 10.042 ms 3 - 139 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS9075 10.331 ms 5 - 7 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite For Galaxy Mobile 4.217 ms 1 - 242 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 101.049 ms 9 - 139 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X2 Elite 100.896 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X Elite 308.612 ms 2 - 2 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 224.223 ms 3 - 166 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS6490 466.97 ms 81 - 87 MB CPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8550 (Proxy) 294.787 ms 2 - 9 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS9075 184.316 ms 2 - 5 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCM6690 217.243 ms 82 - 99 MB CPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 99.285 ms 0 - 118 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 198.818 ms 81 - 94 MB CPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.465 ms 1 - 97 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X2 Elite 110.813 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X Elite 187.332 ms 2 - 2 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 136.188 ms 1 - 120 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS6490 101.457 ms 22 - 35 MB CPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8550 (Proxy) 179.559 ms 0 - 7 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS9075 190.565 ms 1 - 4 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCM6690 61.922 ms 24 - 45 MB CPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 112.596 ms 2 - 89 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 57.178 ms 23 - 40 MB CPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.765 ms 4 - 211 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X2 Elite 3.464 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X Elite 8.667 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.93 ms 5 - 239 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8275 (Proxy) 21.618 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8550 (Proxy) 8.077 ms 5 - 7 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8775P 10.449 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS9075 8.972 ms 7 - 13 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8450 (Proxy) 13.882 ms 3 - 233 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA7255P 21.618 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8295P 13.358 ms 1 - 202 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 3.144 ms 0 - 207 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 79.662 ms 2 - 101 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 80.173 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X Elite 224.295 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 165.719 ms 0 - 120 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS6490 405.509 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 447.506 ms 0 - 91 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 214.342 ms 3 - 116 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8775P 235.299 ms 1 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS9075 182.865 ms 2 - 6 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCM6690 562.162 ms 2 - 203 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 357.776 ms 2 - 121 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA7255P 447.506 ms 0 - 91 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8295P 301.743 ms 0 - 96 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 115.239 ms 0 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 285.746 ms 12 - 225 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.434 ms 1 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 100.681 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X Elite 175.55 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 136.243 ms 1 - 83 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS6490 405.69 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 347.725 ms 1 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 166.956 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8775P 170.725 ms 1 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS9075 189.231 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCM6690 510.461 ms 1 - 186 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 237.983 ms 1 - 82 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA7255P 347.725 ms 1 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8295P 202.93 ms 1 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.426 ms 2 - 68 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 176.253 ms 1 - 64 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.278 ms 0 - 114 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 5.592 ms 0 - 126 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8275 (Proxy) 21.013 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8550 (Proxy) 7.7 ms 0 - 3 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8775P 10.192 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS9075 8.523 ms 0 - 14 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8450 (Proxy) 11.968 ms 0 - 109 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA7255P 21.013 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8295P 12.89 ms 0 - 76 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 2.96 ms 0 - 89 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.534 ms 0 - 66 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 136.393 ms 0 - 83 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS6490 376.687 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 347.675 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 167.178 ms 0 - 94 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8775P 182.841 ms 0 - 62 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS9075 190.315 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCM6690 500.151 ms 0 - 187 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 238.089 ms 0 - 79 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA7255P 347.675 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8295P 202.73 ms 0 - 58 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.132 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 179.094 ms 0 - 59 MB NPU

License

  • The license for the original implementation of YOLOv9-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support