Skip to content

Commit afbfee3

Browse files
committed
Fix model endpoint URL to match Docker Model Runner API
1 parent e0735cb commit afbfee3

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

docker-compose.rag.yml

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,13 +9,12 @@ services:
99
- '8080:8080'
1010
- '9090:9090' # Metrics port
1111
environment:
12-
# Use host.docker.internal instead of service name
13-
- BASE_URL=http://host.docker.internal:12434/engines/llama.cpp/v1/
12+
# Fix the endpoint path to match what Docker Model Runner actually provides
13+
- BASE_URL=http://host.docker.internal:12434/v1/
1414
- MODEL=llama3.2:1B-Q8_0
1515
- API_KEY=ollama
1616
- LOG_LEVEL=info
1717
- LOG_PRETTY=true
18-
# Disable tracing completely since we removed Jaeger
1918
- TRACING_ENABLED=false
2019
- VECTOR_DB_URL=http://vectordb:8000
2120
healthcheck:

0 commit comments

Comments
 (0)