Just for everyone who is trying the same approach:
I strongly discourage to use Ollama self managed next to Cloudron as a prod server.
After updating the GPU drivers, the server is not bootable anymore.
One must be more discerning and careful about installing certain driver packages as some come with GUI tweaking utilities which then pull in an entire desktop environment vs only installing the driver component needed.