Handle other fields for context size from api providers

This commit is contained in:
Nicolas Mowen
2026-11-18 14:19:07 -07:00
parent f4e9fe6d3b
commit 313009aa11
3 changed files with 97 additions and 4 deletions
+2 -2
View File
@@ -225,7 +225,7 @@ Frigate supports any provider that implements the OpenAI API standard. This incl
:::tip
For OpenAI-compatible servers (such as llama.cpp) that don't expose the configured context size in the API response, you can manually specify the context size in `provider_options`:
Frigate reads the model's context size from the server when it is reported (such as by vLLM or OpenRouter). For OpenAI-compatible servers (such as llama.cpp) that don't expose the configured context size in the API response, you can manually specify the context size in `provider_options`:
```yaml
genai:
@@ -427,7 +427,7 @@ To use a different OpenAI-compatible API endpoint, set the `OPENAI_BASE_URL` env
:::tip
For OpenAI-compatible servers (such as llama.cpp) that don't expose the configured context size in the API response, you can manually specify the context size in `provider_options`:
Frigate reads the model's context size from the server when it is reported (such as by vLLM or OpenRouter). For OpenAI-compatible servers (such as llama.cpp) that don't expose the configured context size in the API response, you can manually specify the context size in `provider_options`:
```yaml {6,7}
genai: