85033136d8
- LiteLLM proxy with langfuse callbacks, postgres backends, and OpenRouter fallbacks. - Langfuse observability UI. - Pipecat voice pipeline (LiveKit + STT + TTS + LLM) and Silero TTS build contexts. - Ollama tuned for GPU (OLLAMA_NUM_GPU=999, mem_limit=4g, max 2 loaded models). - open-webui wired to litellm + faster-whisper + silero for voice. - litellm-config.yaml publishes oO's model aliases (tip-generator, embedder, judge) pointing at the host ollama on :11434 so ml/serving can call them via LiteLLM. .env skipped (secrets). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
16 lines
483 B
Docker
16 lines
483 B
Docker
FROM python:3.11-slim
|
|
|
|
RUN apt-get update && apt-get install -y --no-install-recommends ffmpeg && rm -rf /var/lib/apt/lists/*
|
|
|
|
# CPU-only torch keeps image ~500MB vs ~2GB for CUDA
|
|
RUN pip install --no-cache-dir torch --index-url https://download.pytorch.org/whl/cpu
|
|
RUN pip install --no-cache-dir fastapi uvicorn scipy numpy pydub omegaconf
|
|
|
|
WORKDIR /app
|
|
COPY server.py .
|
|
|
|
ENV TORCH_HOME=/cache/torch
|
|
|
|
EXPOSE 8881
|
|
CMD ["uvicorn", "server:app", "--host", "0.0.0.0", "--port", "8881"]
|