CUDA not permitted

[natzilla]

my Quadro P400 can't be used by jellyfin

How do we configure this for cloudron to use it?

[natzilla]

Do you only plan on supporting VAAPI?

The documentation is indicating that this was added for 5.6, but we are in 7.3.4 at this point.

It would be good to know what the goal is here so I can plan accordingly

[nebulon]

vaapi is supported with that last package update. Regarding CUDA I guess we simply have no devices to test this with easily.

[natzilla]

@nebulon I can provide access to mine if you think that will help to implement it? I'm sure a fair amount of people would love to use CUDA features with it.

[nebulon]

@natzilla that might indeed be helpful. If you don't mind us installing a jellyfin test instance on your system, then please enable remote SSH support for us and send us a mail with the dashboard domain to support@cloudron.io

[natzilla]

@nebulon I don't mind at all, I will make some edits to my ACL's rules to allow ssh and send you the details in the email.

[natzilla]

@nebulon
I have sent the email titled "Jellyfin test instance for CUDA" all the details for access are in it.

[nebulon]

After some investigation, it turns out that one has to use a custom docker version provided by nvidia to add support for this. https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#getting-started and https://github.com/NVIDIA/nvidia-docker

So this means that we have to somehow add support on the Cloudron platform side as well as make sure things are working in nvidia and then also non-nvidia case, given that docker parts have to be compatible with whatever the server currently provides hardware wise.

So this is a bit out of scope for the coming release but hopefully we can get this supported afterwards.

[natzilla]

@nebulon

I'm surprised I missed that, but I'm also surprised Nvidia had to make this difficult. Going forward I'm willing to provide you the access you need for testing implementation whenever that can happen. I'll have to live with none hardware acceleration for now.

[robi]

@nebulon this appears to use a docker configuration in privileged mode to get access to the hardware device, which goes against the cloudron use case and security posture.

A better approach would be to use a different runc such as sysbox-runc that can solve that issue without requiring privileged mode.

[natzilla]

@nebulon

Hi, it's been a little while since this was last looked into. With the suggestion from robi do you think this is something we can look at doing soon? I am still willing to provide access for testing CUDA.