feat: default to qwen2.5-vl-3b and cap tool schema length constraints
Rebuild & Deploy / rebuild (push) Successful in 54s

- Default LLM_MODEL to qwen2.5-vl-3b across agent, task worker, tests,
  compose, workflow, and docs
- Cap min/max length-style constraints in tool schemas to 1000 before
  LLM requests; llama.cpp rejects grammar repetitions >= 2000 and the
  memory MCP's update_note body maxLength (200000) broke qwen2.5-vl-3b
  with 'Failed to initialize samplers: failed to parse grammar'
This commit is contained in:
snowspeeder committed 2026-08-29 12:46:20 -04:00
1 parent a66f09eb28
commit a4ae96f01b
7 files changed
+39 -8

No files matched your search

+1 -1
View File
@@ -39,7 +39,7 @@ class TaskWorker:
model = (
os.environ.get("LLM_MODEL")
or os.environ.get("GEMMA_MODEL")
or "gemma-4-e4b"
or "qwen2.5-vl-3b"
)
api_key = (
os.environ.get("LLM_API_KEY")