Commit Graph

4461 Commits

Author SHA1 Message Date
Nicolas Mowen
f9c0999ad3 Adjust docs 2025-08-15 06:29:43 -06:00
Nicolas Mowen
16fb68d859 Ignore extra fields 2025-08-15 06:20:46 -06:00
Nicolas Mowen
dfcad959c5 Debug save response 2025-08-15 06:19:17 -06:00
Nicolas Mowen
9db1ccb3f9 Adjust frame selection logic 2025-08-15 06:17:40 -06:00
Nicolas Mowen
9d2f5e5db5 Format time 2025-08-14 18:30:58 -06:00
Nicolas Mowen
973eb54d2d Adjust sligtly 2025-08-14 17:41:31 -06:00
Nicolas Mowen
96bc1e36f3 Adjust 2025-08-14 17:19:08 -06:00
Nicolas Mowen
c4a5ec90e4 Improve prompt and image selection 2025-08-14 17:13:11 -06:00
Nicolas Mowen
c995b078b6 Cleanup 2025-08-14 16:15:19 -06:00
Nicolas Mowen
55d2f4a411 Make sequence details human-readable so they are used in natural language response 2025-08-14 16:01:14 -06:00
Nicolas Mowen
6bcaea00ed
Update GenAI docs for new review summaries feature (#19493)
* Remove old genai docs

* Separate existing genai docs to separate sections

* Add docs for genai features

* Update reference config

* Update link

* Move to bottom
2025-08-13 15:37:00 -06:00
Nicolas Mowen
4b33e3765e
Add ability to pass additional args to Ollama (#19484)
* Call out recognized objects more specifically

* Cleanup

* Make keep_alive and options configurable

* Generalize

* Use for other providers
2025-08-13 09:28:01 -06:00
Nicolas Mowen
34bf1b21df
Genai review summaries (#19473)
* Generate review item summaries with requests

* Adjust logic to only send important items

* Don't mention ladder

* Adjust prompt to be more specific

* Add more relaxed nature for normal activity

* Cleanup summary

* Update ollama client

* Add more directions to analyze the frames in order

* Remove environment from prompt
2025-08-12 16:27:35 -06:00
markfrancisonly
c52c03ddfd
Added total camera fps, total processed fps, and total skipped fps to stats api (#19469)
Co-authored-by: Mark Francis <markfrancisonly@gmail.com>
2025-08-12 10:49:53 -06:00
Nicolas Mowen
2a7525ef20
Add config for users to define additional concerns that GenAI should make note of in review summary (#19463)
* Don't default to openai

* Improve UI

* Allow configuring additional concerns that users may want the AI to note

* Formatting

* Add preferred language config

* Remove unused
2025-08-11 14:17:25 -05:00
Nicolas Mowen
6678d167f4
Use preview frames for Review Descriptions (#19450)
* Use preview frames for genai

* Cleanup

* Adjust
2025-08-10 10:24:08 -06:00
Nicolas Mowen
6c50e69172
Review genai updates (#19448)
* Include extra level for normal activity

* Add dynamic toggling

* Update docs

* Add different threshold for genai

* Adjust webUI for object and review description feature

* Adjust config

* Send on startup

* Cleanup config setting

* Set config

* Fix config name
2025-08-10 07:38:04 -06:00
Nicolas Mowen
f8ca91643e
Review Item GenAI metadata (#19442)
* Rename existing function

* Keep track of thumbnial updates

* Tinkering with genai prompt

* Adjust input format

* Create model for review description output

* testing prompt changes

* Prompt improvements and image saving

* Add config for review items genai

* Use genai review config

* Actual config usage

* Adjust debug image saving

* Fix

* Fix review creation

* Adjust prompt

* Prompt adjustment

* Run genai in thread

* Fix detections block

* Adjust prompt

* Prompt changes

* Save genai response to metadata model

* Handle metadata

* Send review update to dispatcher

* Save review metadata to DB

* Send review notification updates

* Quick fix

* Fix name

* Fix update type

* Correctly dump model

* Add card

* Add card

* Remove message

* Cleanup typing and UI

* Adjust prompt

* Formatting

* Add log

* Formatting

* Add inference speed and keep alive
2025-08-10 06:57:54 -05:00
Nicolas Mowen
52295fcac4
Migrate object genai configuration (#19437)
* Move genAI object to objects section

* Adjust config propogation behavior

* Refactor genai config usage

* Automatic migration

* Always start the embeddings process

* Always init embeddings

* Config fixes

* Adjust reference config

* Adjust docs

* Formatting

* Fix
2025-08-08 17:33:11 -05:00
Nicolas Mowen
6d078e565a
Enable mypy for DB and fix types (#19434)
* Install peewee type hints

* Models now have proper types

* Fix iterator type

* Enable debug builds with dev reqs installed

* Install as wheel

* Fix cast type
2025-08-08 11:25:39 -06:00
Nicolas Mowen
9b2f84d3e9
Adjust loitering behavior based on object type (#19433)
* Adjust loitering behavior based on object

* Update docs

* Grammar
2025-08-08 08:14:59 -06:00
Josh Hawkins
c75d30d902
Ensure alertVideos persistence is loaded before displaying thumb or preview (#19432)
The default value of true would cause previews to be loaded in the background even if the local storage value was false
2025-08-08 07:52:58 -05:00
Nicolas Mowen
687b68246b
Improve comms typing (#18599)
* Enable mypy for comms

* Make zmq data types consistent

* Cleanup inter process typing issues

* Cleanup embeddings typing

* Cleanup config updater

* Cleanup recordings updator

* Make publisher have a generic type

* Cleanup event metadata updater

* Cleanup event metadata updater

* Cleanup detections updater

* Cleanup websocket

* Cleanup mqtt

* Cleanup webpush

* Cleanup dispatcher

* Formatting

* Remove unused

* Add return type

* Fix tests

* Fix semantic triggers config typing

* Cleanup
2025-08-08 07:08:37 -05:00
Nicolas Mowen
5d2328599f Cleanup 2025-08-07 21:06:42 -06:00
Nicolas Mowen
6db70dc101 Implement start for review item description processor (#19352)
* Add review item data transmission

* Publish review updates

* Add review item subscriber

* Basic implementation for testing review processor

* Formatting
2025-08-07 20:58:34 -06:00
Nicolas Mowen
cd97a8618c Improve the tablet layout (#19320)
* Improve the tablet layout

* Update imports sort

* Fix more imports
2025-08-07 20:58:34 -06:00
Steve Smith
44232d31d8 Add bookworm-backports to the rocm images and upgrade mesa/vaapi to support RDNA4 GPUs (#19312) 2025-08-07 20:58:34 -06:00
Nicolas Mowen
b098a5442e Require setting process priority for FrigateProcess (#19207) 2025-08-07 20:58:34 -06:00
Nicolas Mowen
71e18ae888 Object attribute classification (#19205)
* Add enum for type of classification for objects

* Update recognized license plate topic to be used as attribute updater

* Update attribute for attribute type object classification

* Cleanup
2025-08-07 20:58:34 -06:00
Nicolas Mowen
d5553edd9f Classification train updates (#19173)
* Improve model train button

* Add filters for classification

* Cleanup

* Don't run classification on false positives

* Cleanup filter

* Fix icon color
2025-08-07 20:58:34 -06:00
Josh Hawkins
a8404d6ee1 Dynamically enable/disable GenAI (#19139)
* config

* dispatcher and mqtt

* docs

* use config updater

* add switch to frontend
2025-08-07 20:58:33 -06:00
Josh Hawkins
32f547ab59 Optionally show tracked object paths in debug view (#19025) 2025-08-07 20:57:36 -06:00
Josh Hawkins
ef406ba647 Semantic Search Triggers (#18969)
* semantic trigger test

* database and model

* config

* embeddings maintainer and trigger post-processor

* api to create, edit, delete triggers

* frontend and i18n keys

* use thumbnail and description for trigger types

* image picker tweaks

* initial sync

* thumbnail file management

* clean up logs and use saved thumbnail on frontend

* publish mqtt messages

* webpush changes to enable trigger notifications

* add enabled switch

* add triggers from explore

* renaming and deletion fixes

* fix typing

* UI updates and add last triggering event time and link

* log exception instead of return in endpoint

* highlight entry in UI when triggered

* save and delete thumbnails directly

* remove alert action for now and add descriptions

* tweaks

* clean up

* fix types

* docs

* docs tweaks

* docs

* reuse enum
2025-08-07 20:57:35 -06:00
Nicolas Mowen
397777e176 Classification improvements (#19020)
* Move classification training to full process

* Sort class images
2025-08-07 20:56:54 -06:00
Nicolas Mowen
ece5ac6d77 Improve classification UI (#18910)
* Move threhsold to base model config

* Improve score handling

* Add back button
2025-08-07 20:56:54 -06:00
Nicolas Mowen
09c6c3129e Remove TFLite init logs 2025-08-07 20:56:54 -06:00
Nicolas Mowen
7cfef18f4c Improve object classification (#18908)
* Ui improvements

* Improve image cropping and model saving

* Improve naming

* Add logs for training

* Improve model labeling

* Don't set sub label for none object classification

* Cleanup
2025-08-07 20:56:54 -06:00
Nicolas Mowen
c354b4d110 0.17 tweaks (#18892)
* Set version

* Cleanup more logs

* Don't log matplotlib
2025-08-07 20:56:54 -06:00
Josh Hawkins
1af0f530ff Add ONVIF focus support (#18883)
* backend

* frontend and i18n
2025-08-07 20:56:54 -06:00
Nicolas Mowen
bdbbfada53 Improve logging (#18867)
* Ignore numpy get limits warning

* Add function wrapper to redirect stdout and stderr to logpipe

* Save stderr too

* Add more to catch

* run logpipe

* Use other logging redirect class

* Use other logging redirect class

* add decorator for redirecting c/c++ level output to logger

* fix typing

---------

Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-07 20:56:54 -06:00
Josh Hawkins
61407b90ee Don't try to close or join mp manager queues (#18866)
Multiprocessing Manager queues don't have a close() or join_thread() method, and the Manager will clean it up appropriately after we empty it. This prevents an infinite loop when an AttributeError exception fires for Manager AutoProxy queue objects.
2025-08-07 20:56:54 -06:00
Nicolas Mowen
ae12b430db Handle SIGINT with forkserver (#18860)
* Pass stopevent from main start

* Share stop event across processes

* preload modules

* remove explicit os._exit call

---------

Co-authored-by: Josh Hawkins <32435876+hawkeye217@users.noreply.github.com>
2025-08-07 20:56:52 -06:00
Nicolas Mowen
680a141e23 Fix process name 2025-08-07 20:56:08 -06:00
Nicolas Mowen
da2d52645f Classification model cover images (#18843)
* Move to separate component

* Add cover images for clssification models
2025-08-07 20:56:08 -06:00
Josh Hawkins
b17f0c4a30 Catch invalid character index in lpr CTC decoder (#18825) 2025-08-07 20:56:08 -06:00
Josh Hawkins
52e5429b33 Fix birdseye crash when dynamically adding a camera (#18821) 2025-08-07 20:56:08 -06:00
Nicolas Mowen
54bee5ed85 Catch unpickling error 2025-08-07 20:56:08 -06:00
Nicolas Mowen
b142a69c89 Don't fail on unicode debug for config updates 2025-08-07 20:56:08 -06:00
Nicolas Mowen
f6db714016 Don't use staticmethod 2025-08-07 20:56:08 -06:00
Nicolas Mowen
d4ebf467fb Reduce tf initialization 2025-08-07 20:56:08 -06:00