frigate/frigate
Josh Hawkins 6dc36fcbb4 Audio transcription support (#18398)
* install new packages for transcription support

* add config options

* audio maintainer modifications to support transcription

* pass main config to audio process

* embeddings support

* api and transcription post processor

* embeddings maintainer support for post processor

* live audio transcription with sherpa and faster-whisper

* update dispatcher with live transcription topic

* frontend websocket

* frontend live transcription

* frontend changes for speech events

* i18n changes

* docs

* mqtt docs

* fix linter

* use float16 and small model on gpu for real-time

* fix return value and use requestor to embed description instead of passing embeddings

* run real-time transcription in its own thread

* tweaks

* publish live transcriptions on their own topic instead of tracked_object_update

* config validator and docs

* clarify docs
2025-08-16 10:20:33 -05:00
..
api Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
camera Fixes (#18893) 2025-06-26 09:25:47 -05:00
comms Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
config Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
data_processing Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
db Improve face recognition (#15205) 2025-02-08 12:47:01 -06:00
detectors RKNN: Fix broken models for Toolkit v2.3.2 (#19189) 2025-07-18 06:26:41 -06:00
embeddings Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
events Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
genai Catch crash when openai compatible endpoints don't return results correctly (#17572) 2025-04-07 06:59:39 -06:00
images Replace green screen with error message and force camera_fps to 0 (#4544) 2022-11-28 21:47:20 -06:00
motion Dynamically update masks and zones for cameras (#18359) 2025-08-16 10:20:33 -05:00
object_detection Fix video MP typing (#17880) 2025-04-23 17:59:02 -06:00
output Dynamic Config Updates (#18353) 2025-08-16 10:20:33 -05:00
ptz Fixes (#18877) 2025-06-25 16:45:24 -05:00
record Dynamic Config Updates (#18353) 2025-08-16 10:20:33 -05:00
review Dynamic Config Updates (#18353) 2025-08-16 10:20:33 -05:00
service_manager Add metrics page for embeddings and face / license plate processing times (#15818) 2025-02-08 12:47:01 -06:00
stats Replaces sriov flag with explicit path to the Intel GPU device (#19136) 2025-07-14 07:11:25 -05:00
test Dynamically update masks and zones for cameras (#18359) 2025-08-16 10:20:33 -05:00
track Dynamically update masks and zones for cameras (#18359) 2025-08-16 10:20:33 -05:00
util Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
__init__.py app container and config schema 2021-01-26 21:40:33 -06:00
__main__.py Add basic config editor when Frigate can't startup (#18383) 2025-08-16 10:20:33 -05:00
app.py Audio transcription support (#18398) 2025-08-16 10:20:33 -05:00
const.py Rockchip: add FFmpeg 7.1 to image (#19227) 2025-07-21 06:07:51 -06:00
ffmpeg_presets.py Rockchip: add FFmpeg 7.1 to image (#19227) 2025-07-21 06:07:51 -06:00
log.py Logging bugfix (#18465) 2025-05-29 09:02:17 -06:00
models.py Review items per user (#17137) 2025-03-13 14:20:09 -06:00
mypy.ini Add metrics page for embeddings and face / license plate processing times (#15818) 2025-02-08 12:47:01 -06:00
plus.py Add ability to update Frigate+ model to latest from UI (#17324) 2025-03-24 09:19:58 -06:00
storage.py Cap storage bandwidth (#15473) 2024-12-12 14:46:00 -06:00
timeline.py Fix various typing issues (#18187) 2025-05-13 08:27:20 -06:00
types.py Add face and lpr to tracked object update topic (#17940) 2025-04-28 16:43:03 -06:00
video.py Dynamically update masks and zones for cameras (#18359) 2025-08-16 10:20:33 -05:00
watchdog.py Improve async object detector support (#17712) 2025-04-15 08:55:38 -05:00