No endpoints in Docker

[regularRandom]

Here is the issue: open-webui doesn't detect pipelines. I installed open-webui & pipelines as Docker images and they are accessible through the host.docker.internal address. But: open-webui says Ollama: Network Problem when I click on refresh button in connection setup. Logs from pipelines:

RESET_PIPELINES_DIR is not set to true. No action taken.
requirements.txt not found at /app. Skipping installation of requirements.
Downloading pipeline files from https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py to ./pipelines...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 2870 100 2870 0 0 6944 0 --:--:-- --:--:-- --:--:-- 6944
INFO: Started server process [14]
INFO: Waiting for application startup.
Requirement already satisfied: detoxify in /usr/local/lib/python3.11/site-packages (0.5.2)
Requirement already satisfied: transformers in /usr/local/lib/python3.11/site-packages (from detoxify) (4.47.1)
Requirement already satisfied: torch>=1.7.0 in /usr/local/lib/python3.11/site-packages (from detoxify) (2.5.1+cpu)
Requirement already satisfied: sentencepiece>=0.1.94 in /usr/local/lib/python3.11/site-packages (from detoxify) (0.2.0)
Requirement already satisfied: filelock in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.13.1)
Requirement already satisfied: typing-extensions>=4.8.0 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (4.9.0)
Requirement already satisfied: networkx in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.2.1)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.1.3)
Requirement already satisfied: fsspec in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (2024.2.0)
Requirement already satisfied: sympy==1.13.1 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (1.13.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.11/site-packages (from sympy==1.13.1->torch>=1.7.0->detoxify) (1.3.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.24.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.27.0)
Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (1.26.3)
Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2024.11.6)
Requirement already satisfied: requests in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2.32.2)
Requirement already satisfied: tokenizers<0.22,>=0.21 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.21.0)
Requirement already satisfied: safetensors>=0.4.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.5.0)
Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (4.67.1)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.11/site-packages (from jinja2->torch>=1.7.0->detoxify) (2.1.5)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2.3.0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2024.12.14)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:9099 (Press CTRL+C to quit)
Installing requirement: detoxify
Loaded module: detoxify_filter_pipeline
on_startup:detoxify_filter_pipeline
INFO: 172.17.0.1:48096 - "GET /api/version HTTP/1.1" 404 Not Found

Logs of open-webui:

ERROR [open_webui.routers.ollama] Unexpected error: HTTP Error: 404
Traceback (most recent call last):
File "/app/backend/open_webui/routers/ollama.py", line 204, in verify_connection
raise Exception(detail)
Exception: HTTP Error: 404
INFO: 192.168.0.94:54262 - "POST /ollama/verify HTTP/1.1" 500 Internal Server Error

I tried /info, /api/version - nothing, Unicorn is completely blank.

My docker command:

docker run -d -p 9099:9099 \
  -e PIPELINES_REQUIREMENTS_PATH=/app \
  -e PIPELINES_URLS="https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py" \
  --add-host=host.docker.internal:host-gateway \
  -v /opt/ai/pipelines:/app/pipelines \
  --name pipelines \
  --restart always \
  ghcr.io/open-webui/pipelines:main

open-webui v0.5.7

What I missed?

[algowifi]

Also with open-webui v0.5.10

[algowifi]

Resolve: put http://host.docker.internal:9099 inside API OpenAI not in Ollama API.

[regularRandom]

@algowifi yes, that works, thank you! But why OpenAI?

[iwoork]

Why does this only work on OpenAI section and not on Ollama?