39 lines
1.8 KiB
Markdown
39 lines
1.8 KiB
Markdown
# Hope test suite
|
||
|
||
End-to-end tests that drive the **actual running container** — no mocks.
|
||
They run on the host and hit the live web UI, token endpoint, LLM API, MCP
|
||
tool servers, and agent process.
|
||
|
||
## Prerequisites
|
||
|
||
- The container is up: `docker compose up -d` (and healthy)
|
||
- Host deps installed: `pip install -r tests/requirements.txt`
|
||
(or `uv pip install -r tests/requirements.txt`)
|
||
- The LLM at `GEMMA_BASE_URL` (default `http://192.168.86.2:8023/v1`) is reachable
|
||
- Internet access for the weather tool tests (wttr.in)
|
||
|
||
## Run
|
||
|
||
```bash
|
||
cd /home/shane/dev/voice
|
||
python -m pytest tests/ -v # everything
|
||
python -m pytest tests/ -v -m "not slow" # skip LLM/network-heavy tests
|
||
```
|
||
|
||
## What each file covers
|
||
|
||
| File | Target | Notes |
|
||
|------|--------|-------|
|
||
| `test_web_ui.py` | nginx HTTPS UI (:9178) + token endpoint (:8091) | static assets, `/token` (direct + via nginx), `/livekit/` proxy |
|
||
| `test_llm_api.py` | Gemma LLM API directly | completion, tool calling, `enable_thinking=false` latency, streaming |
|
||
| `test_mcp_tools.py` | MCP servers via `docker exec` | weather/time, authenticated remote memory save/recall/delete, and local skills — probes are cleaned up |
|
||
| `test_agent_integration.py` | running container | agent process alive, worker registered with LiveKit, all 4 supervised processes up, container health, LiveKit HTTP API |
|
||
| `test_compaction.py` | `GemmaLLM._compact_context` in-container | compaction triggers >24 items, system prompt preserved, short context untouched |
|
||
|
||
## Notes
|
||
|
||
- LLM and MCP tests are marked `@pytest.mark.slow` (1–30s each).
|
||
- The token endpoint is **POST** `/token` → `{"token": "<JWT>"}`.
|
||
- Process checks use `/proc/*/cmdline` because the container image has no
|
||
`ps`, and the supervisorctl unix socket is not exposed in this build.
|