administrator/frigate
1
0
Fork 0
mirror of https://github.com/blakeblackshear/frigate.git synced 2026-08-02 17:12:16 +03:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Refactor Review GenAI Prompt (#22353)
CI / AMD64 Build (push) Waiting to run
Details
CI / Assemble and push default build (push) Blocked by required conditions
Details
CI / ARM Build (push) Waiting to run
Details
CI / Jetson Jetpack 6 (push) Waiting to run
Details
CI / AMD64 Extra Build (push) Blocked by required conditions
Details
CI / ARM Extra Build (push) Blocked by required conditions
Details
CI / Synaptics Build (push) Blocked by required conditions
Details

Browse Source 
* Improve title to better capture activity

* Improve efficiency of prompt

* Use json format for llama.cpp

* Cleanup prompt

* Add output format for other LLMs
This commit is contained in:
Nicolas Mowen
2026-03-09 19:47:37 -05:00
committed by GitHub
parent e75b8ca6cc
commit 5254bfd00e
7 changed files with 102 additions and 40 deletions
Download Patch File Download Diff File Expand all files Collapse all files
frigate/genai/llama_cpp.py
+9 -1
View File
@@ -57,7 +57,12 @@ class LlamaCppClient(GenAIClient):
else None
)
def _send(self, prompt: str, images: list[bytes]) -> Optional[str]:
def _send(
self,
prompt: str,
images: list[bytes],
response_format: Optional[dict] = None,
) -> Optional[str]:
"""Submit a request to llama.cpp server."""
if self.provider is None:
logger.warning(
@@ -96,6 +101,9 @@ class LlamaCppClient(GenAIClient):
**self.provider_options,
}
if response_format:
payload["response_format"] = response_format
response = requests.post(
f"{self.provider}/v1/chat/completions",
json=payload,