qaihm-bot commited on
Commit
64ba0be
·
verified ·
1 Parent(s): 9d83c34

See https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.

.gitattributes CHANGED
@@ -35,3 +35,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  SAMEncoder.so filter=lfs diff=lfs merge=lfs -text
37
  SAMDecoder.so filter=lfs diff=lfs merge=lfs -text
 
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  SAMEncoder.so filter=lfs diff=lfs merge=lfs -text
37
  SAMDecoder.so filter=lfs diff=lfs merge=lfs -text
38
+ MobileSam_SAMDecoder.dlc filter=lfs diff=lfs merge=lfs -text
39
+ MobileSam_SAMEncoder.dlc filter=lfs diff=lfs merge=lfs -text
MobileSam_SAMDecoder.dlc ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa79bc1cd6513fcb13b016294a8fa515e4a68bbea733f5bace84a5ed757d7646
3
+ size 25498103
MobileSam_SAMEncoder.dlc ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0012c9729402eea7941f86a7a7f6b0a7648a810af25a0d56d47e42416108a1ea
3
+ size 28167883
README.md CHANGED
@@ -35,62 +35,64 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1242.255 ms | 33 - 377 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
39
- | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 1006.865 ms | 4 - 13 MB | NPU | Use Export Script |
40
- | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 591.137 ms | 33 - 730 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
41
- | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 489.819 ms | 15 - 623 MB | NPU | Use Export Script |
42
- | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 429.812 ms | 21 - 47 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
43
- | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 274.837 ms | 12 - 14 MB | NPU | Use Export Script |
44
- | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 424.245 ms | 33 - 380 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
45
- | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 279.142 ms | 0 - 11 MB | NPU | Use Export Script |
46
- | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1242.255 ms | 33 - 377 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
47
- | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 1006.865 ms | 4 - 13 MB | NPU | Use Export Script |
48
- | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 438.945 ms | 33 - 63 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
49
- | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 274.665 ms | 12 - 14 MB | NPU | Use Export Script |
50
- | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 585.38 ms | 33 - 382 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
51
- | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 437.657 ms | 0 - 16 MB | NPU | Use Export Script |
52
- | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 434.96 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
53
- | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 274.743 ms | 12 - 14 MB | NPU | Use Export Script |
54
- | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 424.245 ms | 33 - 380 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
55
- | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 279.142 ms | 0 - 11 MB | NPU | Use Export Script |
56
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 447.282 ms | 33 - 65 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 273.574 ms | 12 - 87 MB | NPU | Use Export Script |
58
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 410.209 ms | 60 - 147 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 334.716 ms | 33 - 724 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 205.413 ms | 12 - 2429 MB | NPU | Use Export Script |
61
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 310.435 ms | 98 - 821 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 173.559 ms | 12 - 1181 MB | NPU | Use Export Script |
63
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 265.591 ms | 99 - 502 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
64
- | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 279.386 ms | 12 - 12 MB | NPU | Use Export Script |
65
- | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 424.572 ms | 130 - 130 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
66
- | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 52.985 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
67
- | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 48.324 ms | 4 - 13 MB | NPU | Use Export Script |
68
- | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.298 ms | 0 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
69
- | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 8.517 ms | 4 - 54 MB | NPU | Use Export Script |
70
- | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.286 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
71
- | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 6.146 ms | 4 - 6 MB | NPU | Use Export Script |
72
- | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.453 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
73
- | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 7.099 ms | 1 - 13 MB | NPU | Use Export Script |
74
- | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 52.985 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
75
- | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 48.324 ms | 4 - 13 MB | NPU | Use Export Script |
76
- | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.307 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
77
- | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 6.068 ms | 4 - 6 MB | NPU | Use Export Script |
78
- | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.681 ms | 0 - 51 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
79
- | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 7.557 ms | 0 - 17 MB | NPU | Use Export Script |
80
- | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.292 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
81
- | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 6.127 ms | 4 - 8 MB | NPU | Use Export Script |
82
- | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.453 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
83
- | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 7.099 ms | 1 - 13 MB | NPU | Use Export Script |
84
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.292 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
85
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 6.076 ms | 4 - 20 MB | NPU | Use Export Script |
86
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.215 ms | 1 - 63 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
87
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.057 ms | 0 - 63 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
88
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 4.088 ms | 4 - 55 MB | NPU | Use Export Script |
89
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.91 ms | 5 - 75 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
90
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 3.727 ms | 4 - 49 MB | NPU | Use Export Script |
91
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 4.526 ms | 0 - 61 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
92
- | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 6.531 ms | 4 - 4 MB | NPU | Use Export Script |
93
- | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.187 ms | 12 - 12 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
 
 
94
 
95
 
96
 
@@ -154,8 +156,8 @@ Profiling Results
154
  SAMEncoder
155
  Device : cs_8275 (ANDROID 14)
156
  Runtime : TFLITE
157
- Estimated inference time (ms) : 1242.3
158
- Estimated peak memory usage (MB): [33, 377]
159
  Total # Ops : 592
160
  Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
161
 
@@ -163,8 +165,8 @@ Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
163
  SAMDecoder
164
  Device : cs_8275 (ANDROID 14)
165
  Runtime : TFLITE
166
- Estimated inference time (ms) : 53.0
167
- Estimated peak memory usage (MB): [0, 54]
168
  Total # Ops : 846
169
  Compute Unit(s) : npu (846 ops) gpu (0 ops) cpu (0 ops)
170
  ```
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 763.405 ms | 33 - 381 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
39
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 510.611 ms | 5 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
40
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 626.456 ms | 33 - 731 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
41
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 478.836 ms | 12 - 618 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
42
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 434.778 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
43
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 272.46 ms | 12 - 83 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
44
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 423.426 ms | 33 - 379 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
45
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 277.611 ms | 1 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
46
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 763.405 ms | 33 - 381 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
47
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 510.611 ms | 5 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
48
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 441.613 ms | 33 - 76 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
49
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 273.174 ms | 12 - 88 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
50
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 586.065 ms | 33 - 382 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
51
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 436.442 ms | 5 - 651 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
52
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 437.511 ms | 33 - 61 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
53
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 271.999 ms | 12 - 89 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
54
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 423.426 ms | 33 - 379 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
55
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 277.611 ms | 1 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
56
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 443.612 ms | 25 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 272.764 ms | 12 - 74 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
58
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 417.326 ms | 80 - 166 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 339.38 ms | 33 - 712 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 206.041 ms | 12 - 2423 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
61
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 315.956 ms | 97 - 824 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 236.15 ms | 31 - 378 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
63
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 173.015 ms | 12 - 1181 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
64
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 266.659 ms | 97 - 501 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
65
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 298.206 ms | 85 - 85 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
66
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 464.538 ms | 130 - 130 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
67
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 16.509 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
68
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.893 ms | 4 - 47 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
69
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.268 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
70
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.385 ms | 4 - 54 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
71
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.236 ms | 0 - 30 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
72
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 6.11 ms | 4 - 21 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
73
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.435 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
74
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 7.283 ms | 1 - 44 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
75
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 16.509 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
76
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.893 ms | 4 - 47 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
77
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.262 ms | 0 - 30 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
78
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 6.084 ms | 4 - 21 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
79
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.689 ms | 0 - 50 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
80
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.485 ms | 0 - 59 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
81
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.3 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
82
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 6.095 ms | 4 - 20 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
83
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.435 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
84
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.283 ms | 1 - 44 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
85
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.277 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
86
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 6.101 ms | 4 - 24 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
87
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.409 ms | 1 - 62 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
88
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.104 ms | 0 - 61 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
89
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.201 ms | 0 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
90
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.975 ms | 0 - 76 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
91
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 5.075 ms | 0 - 57 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
92
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 3.695 ms | 4 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
93
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.382 ms | 0 - 61 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
94
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 7.965 ms | 4 - 4 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
95
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.122 ms | 11 - 11 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
96
 
97
 
98
 
 
156
  SAMEncoder
157
  Device : cs_8275 (ANDROID 14)
158
  Runtime : TFLITE
159
+ Estimated inference time (ms) : 763.4
160
+ Estimated peak memory usage (MB): [33, 381]
161
  Total # Ops : 592
162
  Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
163
 
 
165
  SAMDecoder
166
  Device : cs_8275 (ANDROID 14)
167
  Runtime : TFLITE
168
+ Estimated inference time (ms) : 16.5
169
+ Estimated peak memory usage (MB): [0, 55]
170
  Total # Ops : 846
171
  Compute Unit(s) : npu (846 ops) gpu (0 ops) cpu (0 ops)
172
  ```