Cloudron on Runpod: a template to quick start your cloudron
-
Would the Cloudron team like to setup an official / semi-official Cloudron template on Runpod?
Runpod lets you rent hardware by the hour and has a speciality in GPU enabled systems which are very useful for AI.
The idea would be to have a Cloudron pod template which you could use to instantly turn on a cloudron with all the tools that cloudron makes available. Currently we have eg Ollama, and in the future we might have many more.
What do you think, @staff ?
-
Koyeb is another in this space, as recommended by one of the regulars on here (sorry, don’t recall who).
I haven’t compared Runpod to Koyeb, just mentioning for completeness.
@timconsidine The world is moving to AI-enabled, whether we do or not.
Given the Cloudron primary purpose is self-hosting, I expect that will need to move to including with GPUs and local models.
I expect ARM is going to be significant in this, too, for smaller focused models.
-
@scooke It is a bit like buying a fancy car. Having the luxury of that car is brilliant when you are actually driving it but when you need to sleep or park, it is a total waste.
Generally, the high end video cards with huge amounts of VRAM are a luxury for most people, who instead make do with buying a much more humble piece of kit. However, if instead of buying the hardware outright, they pay for the car only when they need it, they can enjoy a much more luxurious and capable experience.
So many new AI applications are being created these days, I think I shall start a discussion thread on it and what Cloudron could do to support it.
