Strongly not advised to run Ollama locally on a (bare metal) host and Open WebUI with cloudron on a production server.
But if you do, you need to open ports by creating /home/yellowtent/platformdata/firewall/ports.json. on the host and add this to open the standard Port for Ollama:
{
"allowed_tcp_ports": [11434],
"allowed_udp_ports": []
}
Afterwards restart firewall on the host
sudo systemctl restart cloudron-firewall
Also ensure that ollama listens to all (NOT encouraged):
In Bash on Host:
# create override
sudo mkdir -p /etc/systemd/system/ollama.service.d
# set Environment Variable
echo '[Service]
Environment="OLLAMA_HOST=0.0.0.0:11434"' | sudo tee /etc/systemd/system/ollama.service.d/override.conf
# Systemd reload and Ollama restart
sudo systemctl daemon-reload
sudo systemctl restart ollama
# verify
ss -tuln | grep 11434
# should now listen on 0.0.0.0 like this:
# tcp LISTEN 0 4096 0.0.0.0:11434 0.0.0.0:*
Then switch to the Open WebUI app, in the settings, set this as the connection:
http://172.18.0.1:11434
Strongly not advise to run Ollama in parallel as described here for Production servers. Updates can break things, in worst case Cloudron but at least Ollama driver incompatibilities.
1
