Help with .env file, port configuration for ollama (wsl) in a LightRAG docker installation (wsl)

[GJoe2]

Hello community
I'm having some issues regarding configuring .env file specifically in port and networking of services.

My host is wsl, which has docker
I have ollama installed via wsl, it is a systemd service

$ ps aux | grep ollama
ollama       235  0.1  1.7 54303480 577308 ?     Ssl  01:17   1:21 /usr/local/bin/ollama serve
rmk_spe+  300610  0.0  0.0   4092  1760 pts/0    S+   22:15   0:00 grep --color=auto ollama

I have LighRAG in a docker container
I also have memgraph and qdrant in different docker services

$docker ps
CONTAINER ID   IMAGE                                COMMAND                  CREATED          STATUS                  PORTS                                                                                      NAMES
8cdc64734809   ghcr.io/hkuds/lightrag:latest        "python -m lightrag.…"   13 minutes ago   Up 13 minutes           0.0.0.0:9621->9621/tcp, [::]:9621->9621/tcp                                                lightrag
153671302a9f   memgraph/lab:latest                  "docker-entrypoint.s…"   9 hours ago      Up 9 hours              0.0.0.0:3000->3000/tcp, [::]:3000->3000/tcp                                                memgraph-lab
0ca21554ee43   memgraph/memgraph-mage:latest        "/usr/lib/memgraph/m…"   9 hours ago      Up 9 hours              0.0.0.0:7444->7444/tcp, [::]:7444->7444/tcp, 0.0.0.0:7687->7687/tcp, [::]:7687->7687/tcp   memgraph-mage
2c93fa96d826   qdrant/qdrant                        "./entrypoint.sh"        30 hours ago     Up 30 hours             0.0.0.0:6333->6333/tcp, [::]:6333->6333/tcp, 6334/tcp                                      qdrant
879ebb764567   ghcr.io/open-webui/open-webui:main   "bash start.sh"          4 days ago       Up 34 hours (healthy) 

My issue is lightrag container is not detecting a localhost:11434

LLM_BINDING_HOST=http://localhost:11434
EMBEDDING_BINDING_HOST=http://localhost:11434
ERROR: Error in ollama_embed: Failed to connect to Ollama. Please check that Ollama is downloaded, running and accessible. https://ollama.com/download

My trick for memgraph and qdrant was to use the hostname of wsl

$ hostname -I
172.19.0.1

And then in the config .env file:

QDRANT_URL=http://172.19.0.1:6333
MEMGRAPH_URI=bolt://172.19.0.1.103:7687

Which wont work for ollama
LLM_BINDING_HOST=http://172.19.0.1.103:11434 (error)

How to solve the issue? Do you recommend getting ollama in a docker service? Do you recommend modifying docker-compose.yml adding network_mode: host . Any idea would be appreciated

[azman-nd]

Hi @GJoe2,
Not sure if you still need answer to your query, but incase you do, I am running ollama, reranker and lightrag all in their individual docker connected to same docker network. That worked for me. ollama and reranker (in vllm) both docker has gpu support.
docker-compose.yml

[s6tiger]

Try to replace localhost with host.docker.internal
so it looks like http://host.docker.internal:11434
it is normally when you try to access local ollama service from docker service.
Hope it helps.

Hello community
I'm having some issues regarding configuring .env file specifically in port and networking of services.

My host is wsl, which has docker
I have ollama installed via wsl, it is a systemd service

$ ps aux | grep ollama
ollama       235  0.1  1.7 54303480 577308 ?     Ssl  01:17   1:21 /usr/local/bin/ollama serve
rmk_spe+  300610  0.0  0.0   4092  1760 pts/0    S+   22:15   0:00 grep --color=auto ollama

I have LighRAG in a docker container
I also have memgraph and qdrant in different docker services

$docker ps
CONTAINER ID   IMAGE                                COMMAND                  CREATED          STATUS                  PORTS                                                                                      NAMES
8cdc64734809   ghcr.io/hkuds/lightrag:latest        "python -m lightrag.…"   13 minutes ago   Up 13 minutes           0.0.0.0:9621->9621/tcp, [::]:9621->9621/tcp                                                lightrag
153671302a9f   memgraph/lab:latest                  "docker-entrypoint.s…"   9 hours ago      Up 9 hours              0.0.0.0:3000->3000/tcp, [::]:3000->3000/tcp                                                memgraph-lab
0ca21554ee43   memgraph/memgraph-mage:latest        "/usr/lib/memgraph/m…"   9 hours ago      Up 9 hours              0.0.0.0:7444->7444/tcp, [::]:7444->7444/tcp, 0.0.0.0:7687->7687/tcp, [::]:7687->7687/tcp   memgraph-mage
2c93fa96d826   qdrant/qdrant                        "./entrypoint.sh"        30 hours ago     Up 30 hours             0.0.0.0:6333->6333/tcp, [::]:6333->6333/tcp, 6334/tcp                                      qdrant
879ebb764567   ghcr.io/open-webui/open-webui:main   "bash start.sh"          4 days ago       Up 34 hours (healthy) 

My issue is lightrag container is not detecting a localhost:11434

LLM_BINDING_HOST=http://localhost:11434
EMBEDDING_BINDING_HOST=http://localhost:11434
ERROR: Error in ollama_embed: Failed to connect to Ollama. Please check that Ollama is downloaded, running and accessible. https://ollama.com/download

My trick for memgraph and qdrant was to use the hostname of wsl

$ hostname -I
172.19.0.1

And then in the config .env file:

QDRANT_URL=http://172.19.0.1:6333
MEMGRAPH_URI=bolt://172.19.0.1.103:7687

Which wont work for ollama
LLM_BINDING_HOST=http://172.19.0.1.103:11434 (error)

How to solve the issue? Do you recommend getting ollama in a docker service? Do you recommend modifying docker-compose.yml adding network_mode: host . Any idea would be appreciated

[GJoe2]

It works:

LLM_BINDING_HOST=http://host.docker.internal:11434

Just to be sure I modify the dockerfile:

    extra_hosts:
      - "host.docker.internal:host-gateway"