administrator/frigate
1
0
Fork 0
mirror of https://github.com/blakeblackshear/frigate.git synced 2026-05-09 15:05:26 +03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Add more inference time examples

Browse Source
This commit is contained in:
Nicolas Mowen 2025-03-23 13:26:17 -06:00
parent 2c5c8df6e9
commit 405d21b6ac
1 changed files with 25 additions and 28 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

49
docs/docs/frigate/hardware.md
View File

@ -107,23 +107,20 @@ More information is available [in the detector docs](/configuration/object_detec
Inference speeds vary greatly depending on the CPU or GPU used, some known examples of GPU inference times are below: Inference speeds vary greatly depending on the CPU or GPU used, some known examples of GPU inference times are below:
| Name | MobileNetV2 Inference Time | YOLO-NAS Inference Time | Notes | | Name | MobileNetV2 Inference Time | YOLO-NAS Inference Time | RF-DETR Inference Time | Notes |
| -------------------- | -------------------------- | ------------------------- | -------------------------------------- | | -------------------- | -------------------------- | ------------------------- | ------------------------- | -------------------------------------- |
| Intel Celeron J4105 | ~ 25 ms | | Can only run one detector instance | | Intel i3 6100T | 15 - 35 ms | | | Can only run one detector instance |
| Intel Celeron N3060 | 130 - 150 ms | | Can only run one detector instance | | Intel i3 8100 | ~ 15 ms | | | |
| Intel Celeron N3205U | ~ 120 ms | | Can only run one detector instance | | Intel i5 4590 | ~ 20 ms | | | |
| Intel Celeron N4020 | 50 - 200 ms | | Inference speed depends on other loads | | Intel i5 6500 | ~ 15 ms | | | |
| Intel i3 6100T | 15 - 35 ms | | Can only run one detector instance | | Intel i5 7200u | 15 - 25 ms | | | |
| Intel i3 8100 | ~ 15 ms | | | | Intel i5 7500 | ~ 15 ms | | | |
| Intel i5 4590 | ~ 20 ms | | | | Intel i5 1135G7 | 10 - 15 ms | | | |
| Intel i5 6500 | ~ 15 ms | | | | Intel i3 12000 | | 320: ~ 19 ms 640: ~ 54 ms | | |
| Intel i5 7200u | 15 - 25 ms | | | | Intel i5 12600K | ~ 15 ms | 320: ~ 20 ms 640: ~ 46 ms | | |
| Intel i5 7500 | ~ 15 ms | | | | Intel i7 12650H | ~ 15 ms | 320: ~ 20 ms 640: ~ 42 ms | 336: 50 ms | |
| Intel i5 1135G7 | 10 - 15 ms | | | | Intel Arc A380 | ~ 6 ms | 320: ~ 10 ms | | |
| Intel i3 12000 | | 320: ~ 19 ms 640: ~ 54 ms | | | Intel Arc A750 | ~ 4 ms | 320: ~ 8 ms | | |
| Intel i5 12600K | ~ 15 ms | 320: ~ 20 ms 640: ~ 46 ms | |
| Intel Arc A380 | ~ 6 ms | 320: ~ 10 ms | |
| Intel Arc A750 | ~ 4 ms | 320: ~ 8 ms | |
### TensorRT - Nvidia GPU ### TensorRT - Nvidia GPU
@ -132,15 +129,15 @@ The TensortRT detector is able to run on x86 hosts that have an Nvidia GPU which
Inference speeds will vary greatly depending on the GPU and the model used. Inference speeds will vary greatly depending on the GPU and the model used.
`tiny` variants are faster than the equivalent non-tiny model, some known examples are below: `tiny` variants are faster than the equivalent non-tiny model, some known examples are below:
| Name | YoloV7 Inference Time | YOLO-NAS Inference Time | | Name | YoloV7 Inference Time | YOLO-NAS Inference Time | RF-DETR Inference Time |
| --------------- | --------------------- | ------------------------- | | --------------- | --------------------- | ------------------------- | ------------------------- |
| GTX 1060 6GB | ~ 7 ms | | | GTX 1060 6GB | ~ 7 ms | | |
| GTX 1070 | ~ 6 ms | | | GTX 1070 | ~ 6 ms | | |
| GTX 1660 SUPER | ~ 4 ms | | | GTX 1660 SUPER | ~ 4 ms | | |
| RTX 3050 | 5 - 7 ms | 320: ~ 10 ms 640: ~ 16 ms | | RTX 3050 | 5 - 7 ms | 320: ~ 10 ms 640: ~ 16 ms | 336: ~ 16 ms 560: ~ 40 ms |
| RTX 3070 Mobile | ~ 5 ms | | | RTX 3070 Mobile | ~ 5 ms | | |
| Quadro P400 2GB | 20 - 25 ms | | | Quadro P400 2GB | 20 - 25 ms | | |
| Quadro P2000 | ~ 12 ms | | | Quadro P2000 | ~ 12 ms | | |
### AMD GPUs ### AMD GPUs