Commit Graph

4481 Commits

Author SHA1 Message Date
Chirayu Rai
deb73549c1 Added guard clause for empty inference reponse 2025-08-25 17:40:05 -07:00
Chirayu Rai
46c0eb1713 Updating requirements to build dev container 2025-08-25 17:40:04 -07:00
Chirayu Rai
57334347d4 Added optimized version of degirum plugin + updated docs 2025-08-25 17:39:28 -07:00
Chirayu Rai
9656dc4a4f Version that detects model and can begin using @local 2025-08-25 17:39:27 -07:00
Chirayu Rai
d006e63a32 Made it so openvino prioritizes using GPU and NPU over CPU 2025-08-25 17:35:28 -07:00
Chirayu Rai
3b2bdabf34 Fixed broken link 2025-08-25 17:35:28 -07:00
Chirayu Rai
7cffafca6e Added degirum plugin, updated documentation for degirum detector usage, updated requirements with degirum_headless 2025-08-25 17:35:26 -07:00
Nicolas Mowen
5871ba397c Cleanup filename sanitization 2025-08-16 09:06:50 -06:00
Nicolas Mowen
f73424b307 Improve natural language of prompt (#19515)
* Make sequence details human-readable so they are used in natural language response

* Cleanup

* Improve prompt and image selection

* Adjust

* Adjust sligtly

* Format time

* Adjust frame selection logic

* Debug save response

* Ignore extra fields

* Adjust docs
2025-08-16 09:06:49 -06:00
Nicolas Mowen
19c0ee29bc Update GenAI docs for new review summaries feature (#19493)
* Remove old genai docs

* Separate existing genai docs to separate sections

* Add docs for genai features

* Update reference config

* Update link

* Move to bottom
2025-08-16 09:06:49 -06:00
Nicolas Mowen
d4732e1e1b Add ability to pass additional args to Ollama (#19484)
* Call out recognized objects more specifically

* Cleanup

* Make keep_alive and options configurable

* Generalize

* Use for other providers
2025-08-16 09:06:49 -06:00
Nicolas Mowen
d017f331b9 Genai review summaries (#19473)
* Generate review item summaries with requests

* Adjust logic to only send important items

* Don't mention ladder

* Adjust prompt to be more specific

* Add more relaxed nature for normal activity

* Cleanup summary

* Update ollama client

* Add more directions to analyze the frames in order

* Remove environment from prompt
2025-08-16 09:06:49 -06:00
markfrancisonly
83f0993d7d Added total camera fps, total processed fps, and total skipped fps to stats api (#19469)
Co-authored-by: Mark Francis <markfrancisonly@gmail.com>
2025-08-16 09:06:49 -06:00
Nicolas Mowen
175b9bcb71 Add config for users to define additional concerns that GenAI should make note of in review summary (#19463)
* Don't default to openai

* Improve UI

* Allow configuring additional concerns that users may want the AI to note

* Formatting

* Add preferred language config

* Remove unused
2025-08-16 09:06:49 -06:00
Nicolas Mowen
8b0f141c04 Use preview frames for Review Descriptions (#19450)
* Use preview frames for genai

* Cleanup

* Adjust
2025-08-16 09:06:49 -06:00
Nicolas Mowen
f0b6b0cd06 Review genai updates (#19448)
* Include extra level for normal activity

* Add dynamic toggling

* Update docs

* Add different threshold for genai

* Adjust webUI for object and review description feature

* Adjust config

* Send on startup

* Cleanup config setting

* Set config

* Fix config name
2025-08-16 09:06:49 -06:00
Nicolas Mowen
96b998f9b9 Review Item GenAI metadata (#19442)
* Rename existing function

* Keep track of thumbnial updates

* Tinkering with genai prompt

* Adjust input format

* Create model for review description output

* testing prompt changes

* Prompt improvements and image saving

* Add config for review items genai

* Use genai review config

* Actual config usage

* Adjust debug image saving

* Fix

* Fix review creation

* Adjust prompt

* Prompt adjustment

* Run genai in thread

* Fix detections block

* Adjust prompt

* Prompt changes

* Save genai response to metadata model

* Handle metadata

* Send review update to dispatcher

* Save review metadata to DB

* Send review notification updates

* Quick fix

* Fix name

* Fix update type

* Correctly dump model

* Add card

* Add card

* Remove message

* Cleanup typing and UI

* Adjust prompt

* Formatting

* Add log

* Formatting

* Add inference speed and keep alive
2025-08-16 09:06:49 -06:00
Nicolas Mowen
0428509c89 Migrate object genai configuration (#19437)
* Move genAI object to objects section

* Adjust config propogation behavior

* Refactor genai config usage

* Automatic migration

* Always start the embeddings process

* Always init embeddings

* Config fixes

* Adjust reference config

* Adjust docs

* Formatting

* Fix
2025-08-16 09:06:49 -06:00
Nicolas Mowen
b7c318241b Enable mypy for DB and fix types (#19434)
* Install peewee type hints

* Models now have proper types

* Fix iterator type

* Enable debug builds with dev reqs installed

* Install as wheel

* Fix cast type
2025-08-16 09:06:49 -06:00
Nicolas Mowen
6da5925f92 Adjust loitering behavior based on object type (#19433)
* Adjust loitering behavior based on object

* Update docs

* Grammar
2025-08-16 09:06:49 -06:00
Josh Hawkins
c6a48abc75 Ensure alertVideos persistence is loaded before displaying thumb or preview (#19432)
The default value of true would cause previews to be loaded in the background even if the local storage value was false
2025-08-16 09:06:49 -06:00
Nicolas Mowen
b7095028d0 Improve comms typing (#18599)
* Enable mypy for comms

* Make zmq data types consistent

* Cleanup inter process typing issues

* Cleanup embeddings typing

* Cleanup config updater

* Cleanup recordings updator

* Make publisher have a generic type

* Cleanup event metadata updater

* Cleanup event metadata updater

* Cleanup detections updater

* Cleanup websocket

* Cleanup mqtt

* Cleanup webpush

* Cleanup dispatcher

* Formatting

* Remove unused

* Add return type

* Fix tests

* Fix semantic triggers config typing

* Cleanup
2025-08-16 09:06:49 -06:00
Nicolas Mowen
6500c538e6 Cleanup 2025-08-16 09:06:49 -06:00
Nicolas Mowen
690cd6fa53 Implement start for review item description processor (#19352)
* Add review item data transmission

* Publish review updates

* Add review item subscriber

* Basic implementation for testing review processor

* Formatting
2025-08-16 09:06:49 -06:00
Nicolas Mowen
590ae02da4 Improve the tablet layout (#19320)
* Improve the tablet layout

* Update imports sort

* Fix more imports
2025-08-16 09:06:49 -06:00
Steve Smith
a13a6825ef Add bookworm-backports to the rocm images and upgrade mesa/vaapi to support RDNA4 GPUs (#19312) 2025-08-16 09:06:49 -06:00
Nicolas Mowen
3b7d9fe9ee Require setting process priority for FrigateProcess (#19207) 2025-08-16 09:06:49 -06:00
Nicolas Mowen
8fc78f4bc7 Object attribute classification (#19205)
* Add enum for type of classification for objects

* Update recognized license plate topic to be used as attribute updater

* Update attribute for attribute type object classification

* Cleanup
2025-08-16 09:06:49 -06:00
Nicolas Mowen
2be24e40de Classification train updates (#19173)
* Improve model train button

* Add filters for classification

* Cleanup

* Don't run classification on false positives

* Cleanup filter

* Fix icon color
2025-08-16 09:06:49 -06:00
Josh Hawkins
a19d9d44d4 Dynamically enable/disable GenAI (#19139)
* config

* dispatcher and mqtt

* docs

* use config updater

* add switch to frontend
2025-08-16 09:06:49 -06:00
Josh Hawkins
11ca401fff Optionally show tracked object paths in debug view (#19025) 2025-08-16 09:06:49 -06:00
Josh Hawkins
a209668c17 Semantic Search Triggers (#18969)
* semantic trigger test

* database and model

* config

* embeddings maintainer and trigger post-processor

* api to create, edit, delete triggers

* frontend and i18n keys

* use thumbnail and description for trigger types

* image picker tweaks

* initial sync

* thumbnail file management

* clean up logs and use saved thumbnail on frontend

* publish mqtt messages

* webpush changes to enable trigger notifications

* add enabled switch

* add triggers from explore

* renaming and deletion fixes

* fix typing

* UI updates and add last triggering event time and link

* log exception instead of return in endpoint

* highlight entry in UI when triggered

* save and delete thumbnails directly

* remove alert action for now and add descriptions

* tweaks

* clean up

* fix types

* docs

* docs tweaks

* docs

* reuse enum
2025-08-16 09:06:49 -06:00
Nicolas Mowen
3ed12918a1 Classification improvements (#19020)
* Move classification training to full process

* Sort class images
2025-08-16 09:06:49 -06:00
Nicolas Mowen
8139bc9bbd Improve classification UI (#18910)
* Move threhsold to base model config

* Improve score handling

* Add back button
2025-08-16 09:06:49 -06:00
Nicolas Mowen
2159d40ad5 Remove TFLite init logs 2025-08-16 09:06:49 -06:00
Nicolas Mowen
99bf29ab6b Improve object classification (#18908)
* Ui improvements

* Improve image cropping and model saving

* Improve naming

* Add logs for training

* Improve model labeling

* Don't set sub label for none object classification

* Cleanup
2025-08-16 09:06:49 -06:00
Nicolas Mowen
4080220aa6 0.17 tweaks (#18892)
* Set version

* Cleanup more logs

* Don't log matplotlib
2025-08-16 09:06:48 -06:00
Josh Hawkins
d414452333 Add ONVIF focus support (#18883)
* backend

* frontend and i18n
2025-08-16 09:06:30 -06:00
Nicolas Mowen
2b6033ed80 Improve logging (#18867)
* Ignore numpy get limits warning

* Add function wrapper to redirect stdout and stderr to logpipe

* Save stderr too

* Add more to catch

* run logpipe

* Use other logging redirect class

* Use other logging redirect class

* add decorator for redirecting c/c++ level output to logger

* fix typing

---------

Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-16 09:06:30 -06:00
Josh Hawkins
326fac2e9d Don't try to close or join mp manager queues (#18866)
Multiprocessing Manager queues don't have a close() or join_thread() method, and the Manager will clean it up appropriately after we empty it. This prevents an infinite loop when an AttributeError exception fires for Manager AutoProxy queue objects.
2025-08-16 09:06:30 -06:00
Nicolas Mowen
671bd0e7d1 Handle SIGINT with forkserver (#18860)
* Pass stopevent from main start

* Share stop event across processes

* preload modules

* remove explicit os._exit call

---------

Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-16 09:06:30 -06:00
Nicolas Mowen
2467b512b9 Fix process name 2025-08-16 09:06:30 -06:00
Nicolas Mowen
2ae2c5c56a Classification model cover images (#18843)
* Move to separate component

* Add cover images for clssification models
2025-08-16 09:06:30 -06:00
Josh Hawkins
fa9c35a871 Catch invalid character index in lpr CTC decoder (#18825) 2025-08-16 09:06:30 -06:00
Josh Hawkins
e20c1499b9 Fix birdseye crash when dynamically adding a camera (#18821) 2025-08-16 09:06:30 -06:00
Nicolas Mowen
109308850f Catch unpickling error 2025-08-16 09:06:30 -06:00
Nicolas Mowen
cb464162ca Don't fail on unicode debug for config updates 2025-08-16 09:06:30 -06:00
Nicolas Mowen
e7682e83e8 Don't use staticmethod 2025-08-16 09:06:30 -06:00
Nicolas Mowen
6f27d1c2fb Reduce tf initialization 2025-08-16 09:06:30 -06:00
Nicolas Mowen
582563eedb Fix go2rtc init (#18708)
* Cleanup process handling

* Adjust process name
2025-08-16 09:06:30 -06:00