administrator/frigate
1
0
Fork 0
mirror of https://github.com/blakeblackshear/frigate.git synced 2026-02-05 18:55:23 +03:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
46787b25e2
frigate/requirements-tensorrt.txt

9 lines
472 B
Plaintext
Raw Normal View History

Nvidia TensorRT detector (#4718) * Initial WIP dockerfile and scripts to add tensorrt support * Add tensorRT detector * WIP attempt to install TensorRT 8.5 * Updates to detector for cuda python library * TensorRT Cuda library rework WIP Does not run * Fixes from rebase to detector factory * Fix parsing output memory pointer * Handle TensorRT logs with the python logger * Use non-async interface and convert input data to float32. Detection runs without error. * Make TensorRT a separate build from the base Frigate image. * Add script and documentation for generating TRT Models * Add support for TensorRT devcontainer * Add labelmap to trt model script and docs. Cleanup of old scripts. * Update detect to normalize input tensor using model input type * Add config for selecting GPU. Fix Async inference. Update documentation. * Update some CUDA libraries to clean up version warning * Add CI stage to build TensorRT tag * Add note in docs for image tag and model support
2022-12-30 19:53:17 +03:00
# NVidia TensorRT Support (amd64 only)
nvidia-pyindex; platform_machine == 'x86_64'
Update to latest tensorrt (8.6.1) release
2023-06-18 06:57:08 +03:00
tensorrt == 8.6.1; platform_machine == 'x86_64'
cuda-python == 12.1; platform_machine == 'x86_64'
Nvidia TensorRT detector (#4718) * Initial WIP dockerfile and scripts to add tensorrt support * Add tensorRT detector * WIP attempt to install TensorRT 8.5 * Updates to detector for cuda python library * TensorRT Cuda library rework WIP Does not run * Fixes from rebase to detector factory * Fix parsing output memory pointer * Handle TensorRT logs with the python logger * Use non-async interface and convert input data to float32. Detection runs without error. * Make TensorRT a separate build from the base Frigate image. * Add script and documentation for generating TRT Models * Add support for TensorRT devcontainer * Add labelmap to trt model script and docs. Cleanup of old scripts. * Update detect to normalize input tensor using model input type * Add config for selecting GPU. Fix Async inference. Update documentation. * Update some CUDA libraries to clean up version warning * Add CI stage to build TensorRT tag * Add note in docs for image tag and model support
2022-12-30 19:53:17 +03:00
cython == 0.29.*; platform_machine == 'x86_64'
Update to latest tensorrt (8.6.1) release
2023-06-18 06:57:08 +03:00
nvidia-cuda-runtime-cu12 == 12.1.*; platform_machine == 'x86_64'
nvidia-cublas-cu12 == 12.1.*; platform_machine == 'x86_64'
nvidia-cudnn-cu12 == 8.9.*; platform_machine == 'x86_64'
nvidia-cuda-nvrtc-cu12 == 12.1.*; platform_machine == 'x86_64'
Reference in New Issue Copy Permalink