b8efe4732d
Accumulated uncommitted infra changes: - Caddyfile: repoint HA/Zabbix to 192.168.1.4/.3, add ~20 new site routes - Immich: move media to /mnt/smsg, enable CUDA ML, mem limits, rewrite backup.sh - Add service stacks: agap-mcp, anki, family, freshrss, iperf3, kanboard, linkwarden, qbittorrent, radicale, syncthing, vikunja, windows - openwebui: enable API keys; ollama: drop CPU fallback - seafile/zabbix: extra_hosts entries; matrix: add user juris - Remove pihole stack and stale wiki/migrate.py - Ignore marketplace-mcp (standalone repo) and linkwarden runtime data Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LeqyaxJF2nbRXJtae2kNB2
19 lines
564 B
YAML
19 lines
564 B
YAML
services:
|
|
ollama:
|
|
image: ollama/ollama
|
|
container_name: ollama
|
|
ports:
|
|
- "11436:11434"
|
|
volumes:
|
|
- /mnt/ssd/ai/ollama:/root/.ollama
|
|
restart: always
|
|
environment:
|
|
# Allow qwen3:8b + qwen2.5:1.5b to coexist in VRAM (~6.7-7.7 GB on 8 GB GPU)
|
|
- OLLAMA_MAX_LOADED_MODELS=2
|
|
# One GPU inference at a time — prevents compute contention between models
|
|
- OLLAMA_NUM_PARALLEL=1
|
|
# Force all layers to GPU — fail instead of falling back to CPU
|
|
- OLLAMA_NUM_GPU=999
|
|
runtime: nvidia
|
|
mem_limit: 4g
|