feat: default to qwen2.5-vl-3b and cap tool schema length constraints
Rebuild & Deploy / rebuild (push) Successful in 54s
Rebuild & Deploy / rebuild (push) Successful in 54s
- Default LLM_MODEL to qwen2.5-vl-3b across agent, task worker, tests, compose, workflow, and docs - Cap min/max length-style constraints in tool schemas to 1000 before LLM requests; llama.cpp rejects grammar repetitions >= 2000 and the memory MCP's update_note body maxLength (200000) broke qwen2.5-vl-3b with 'Failed to initialize samplers: failed to parse grammar'
This commit is contained in:
1 parent
a66f09eb28
commit
a4ae96f01b
7 files changed
+39
-8
No files matched your search
@@ -39,7 +39,7 @@ class TaskWorker:
|
||||
model = (
|
||||
os.environ.get("LLM_MODEL")
|
||||
or os.environ.get("GEMMA_MODEL")
|
||||
or "gemma-4-e4b"
|
||||
or "qwen2.5-vl-3b"
|
||||
)
|
||||
api_key = (
|
||||
os.environ.get("LLM_API_KEY")
|
||||
|
||||
Reference in new issue
Block a user