Ollama is now available

[nebulon]

Ollama is now packaged as a standalone app.

The app package is as usual still published as unstable until we get some feedback how it works and iron out any initial issues.

Forum category is at https://forum.cloudron.io/category/212/ollama so please report any issues there
The docs will be at https://docs.cloudron.io/packages/ollama/
Package repo is https://git.cloudron.io/packages/ollama-app

[firmansi]

Finally...hopefully it can be detached with openwebui in next update

[nebulon]

Yes that was the plan, we will remove it from OpenWebUI once the standalone package gets stable.

[abuyuy]

Is it able to use graphics card?

[james]

Hello @abuyuy
Currently, the Ollama app does not include the capability to access vaapi devices (gpus).
We can add this capability to the Ollama app but how to configure it needs to be researched then.

[abuyuy]

Thanks James for the quick answer.
I think having GPU support for Ollama would be tremendously helpful for the performance and usability of the app.

[nebulon]

@abuyuy yes fully agree, we will first focus on getting the app to a stable package state and then investigate what all is required for hardware support.