Commit Graph

3 Commits

Author SHA1 Message Date
dependabot[bot]
88e81d8ed0
Bump cuda-python from 11.7 to 12.1.0
Bumps [cuda-python](https://github.com/NVIDIA/cuda-python) from 11.7 to 12.1.0.
- [Release notes](https://github.com/NVIDIA/cuda-python/releases)
- [Changelog](https://github.com/NVIDIA/cuda-python/blob/main/docs/release.html)
- [Commits](https://github.com/NVIDIA/cuda-python/compare/v11.7.0...v12.1.0)

---
updated-dependencies:
- dependency-name: cuda-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-01 12:08:51 +00:00
Nate Meyer
60b2315028
Update library loading for tensorrt (#5087)
* Update library loading for tensorrt

* Add symlink to libnvrtc
2023-01-14 13:14:27 -06:00
Nate Meyer
3f05f74ecb
Nvidia TensorRT detector (#4718)
* Initial WIP dockerfile and scripts to add tensorrt support

* Add tensorRT detector

* WIP attempt to install TensorRT 8.5

* Updates to detector for cuda python library

* TensorRT Cuda library rework WIP

Does not run

* Fixes from rebase to detector factory

* Fix parsing output memory pointer

* Handle TensorRT logs with the python logger

* Use non-async interface and convert input data to float32. Detection runs without error.

* Make TensorRT a separate build from the base Frigate image.

* Add script and documentation for generating TRT Models

* Add support for TensorRT devcontainer

* Add labelmap to trt model script and docs.  Cleanup of old scripts.

* Update detect to normalize input tensor using model input type

* Add config for selecting GPU. Fix Async inference. Update documentation.

* Update some CUDA libraries to clean up version warning

* Add CI stage to build TensorRT tag

* Add note in docs for image tag and model support
2022-12-30 10:53:17 -06:00