administrator/frigate
1
0
Fork 0
mirror of https://github.com/blakeblackshear/frigate.git synced 2026-08-04 18:08:50 +03:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

update docs

Browse Source
This commit is contained in:
Nicolas Mowen
2026-07-19 17:25:16 -06:00
parent 761a431c55
commit 45d3c6389e
1 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/docs/configuration/genai/config.md
+4 -2
View File
@@ -78,7 +78,7 @@ All llama.cpp native options can be passed through `provider_options`, including
- Set **Provider** to `llamacpp` - Set **Provider** to `llamacpp`
- Set **Base URL** to your llama.cpp server address (e.g., `http://localhost:8080`) - Set **Base URL** to your llama.cpp server address (e.g., `http://localhost:8080`)
- Set **Model** to the name of your model - Set **Model** to the name of your model
- Under **Provider Options**, set `context_size` to tell Frigate your context size so it can send the appropriate amount of information - Optionally, under **Provider Options**, set `context_size` to override the context size Frigate detects from the server
</TabItem> </TabItem>
<TabItem value="yaml"> <TabItem value="yaml">
@@ -89,12 +89,14 @@ genai:
base_url: http://localhost:8080 base_url: http://localhost:8080
model: your-model-name model: your-model-name
provider_options: provider_options:
context_size: 16000 # Tell Frigate your context size so it can send the appropriate amount of information. context_size: 16000 # Optional, overrides the context size reported by the server.
``` ```
</TabItem> </TabItem>
</ConfigTabs> </ConfigTabs>
Frigate queries the llama.cpp server for the model's context size at startup and logs it along with the other detected capabilities. If `context_size` is set in `provider_options`, that value is always used instead, even when the server reports its own.
### Ollama ### Ollama
[Ollama](https://ollama.com/) allows you to self-host large language models and keep everything running locally. It is highly recommended to host this server on a machine with an Nvidia graphics card, or on a Apple silicon Mac for best performance. [Ollama](https://ollama.com/) allows you to self-host large language models and keep everything running locally. It is highly recommended to host this server on a machine with an Nvidia graphics card, or on a Apple silicon Mac for best performance.