85033136d8
- LiteLLM proxy with langfuse callbacks, postgres backends, and OpenRouter fallbacks. - Langfuse observability UI. - Pipecat voice pipeline (LiveKit + STT + TTS + LLM) and Silero TTS build contexts. - Ollama tuned for GPU (OLLAMA_NUM_GPU=999, mem_limit=4g, max 2 loaded models). - open-webui wired to litellm + faster-whisper + silero for voice. - litellm-config.yaml publishes oO's model aliases (tip-generator, embedder, judge) pointing at the host ollama on :11434 so ml/serving can call them via LiteLLM. .env skipped (secrets). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
19 lines
525 B
Docker
19 lines
525 B
Docker
FROM python:3.11-slim
|
|
|
|
RUN apt-get update && apt-get install -y --no-install-recommends gcc g++ && rm -rf /var/lib/apt/lists/*
|
|
|
|
# CPU torch first — prevents silero-vad from pulling in the CUDA variant
|
|
RUN pip install --no-cache-dir torch --index-url https://download.pytorch.org/whl/cpu
|
|
|
|
RUN pip install --no-cache-dir \
|
|
"pipecat-ai[openai,livekit,silero]" \
|
|
"livekit-api" \
|
|
fastapi \
|
|
"uvicorn[standard]"
|
|
|
|
WORKDIR /app
|
|
COPY . .
|
|
|
|
EXPOSE 8882
|
|
CMD ["uvicorn", "bot:app", "--host", "0.0.0.0", "--port", "8882"]
|