Cloudron on Runpod: a template to quick start your cloudron

[LoudLemur]

Would the Cloudron team like to setup an official / semi-official Cloudron template on Runpod?

https://runpod.io

Runpod lets you rent hardware by the hour and has a speciality in GPU enabled systems which are very useful for AI.

The idea would be to have a Cloudron pod template which you could use to instantly turn on a cloudron with all the tools that cloudron makes available. Currently we have eg Ollama, and in the future we might have many more.

What do you think, @staff ?

[timconsidine]

Koyeb is another in this space, as recommended by one of the regulars on here (sorry, don’t recall who).

I haven’t compared Runpod to Koyeb, just mentioning for completeness.

[marcusquinn]

@timconsidine The world is moving to AI-enabled, whether we do or not.

Given the Cloudron primary purpose is self-hosting, I expect that will need to move to including with GPUs and local models.

I expect ARM is going to be significant in this, too, for smaller focused models.

[scooke]

So, use (and pay for) an infrastructure host to run an infrastructure host??

[LoudLemur]

@scooke It is a bit like buying a fancy car. Having the luxury of that car is brilliant when you are actually driving it but when you need to sleep or park, it is a total waste.

Generally, the high end video cards with huge amounts of VRAM are a luxury for most people, who instead make do with buying a much more humble piece of kit. However, if instead of buying the hardware outright, they pay for the car only when they need it, they can enjoy a much more luxurious and capable experience.

So many new AI applications are being created these days, I think I shall start a discussion thread on it and what Cloudron could do to support it.