Cloudron Forum

Big thanks to the brilliant @timconsidine for his interest and vigilance and for immediately notifying we were initially on an older base image of cloudron. This crawl4ai is now on Cloudron 5.1 and we will be moving the rest of our fleet to the new base when they need updates, too.

vLLM package 0.3.0 (upstream vLLM 0.29.0) check your model before this one updates This release is labelled a minor rather than a patch on purpose: vLLM 0.29 removes ten model architectures and makes Model Runner V2 the default engine. Most installs are unaffected, the package's default model (Qwen/Qwen3-0.6B) and mainstream families like Llama, Qwen, Mistral, DeepSeek and Gemma all continue to work. But if your LLM_MODEL points at one of the removed architectures, the app will fail to start rather than degrade gracefully: Arctic, Chameleon, Cheers, Fairseq2Llama, FireRedLID, GritLM, HCXVision, MPT, the RWForCausalLM/StableLMEpochForCausalLM aliases, or PrithviGeoSpatialMAE. The same applies if you pass the now-removed VLLM_TEST_FORCE_FP8_MARLIN or VLLM_ROCM_USE_AITER_FP4_ASM_GEMM through LLM_EXTRA_ARGS, or rely on the PyAV video decoder backend (use OpenCV or Torchcodec instead). If you have auto-updates enabled, check the LLM_MODEL value in your app's Environment section now. If it names one of the above, switch to a supported model before the update reaches you. If it has already updated and the app will not start, Cloudron takes a backup immediately before every update, so restoring that backup returns you to the previous version while you pick a replacement model.

@LoudLemur well done Be aware that windmill push out releases like their pants on fire. Almost daily at times. My windmill community package has fallen behind, and I’m not much motivated to be constantly re-packaging it for Cloudron. I’m likely to do one update then freeze it or hand the baton over. So very pleased to see your package as alternative. It would likely save you some hassle to decide an upgrade policy for Windmill. Once per week or whatever. Otherwise you might be forever publishing.

Update: 0.10.0 (Langfuse 4.43.0) is out. It moves to Cloudron base 5.1.0 and applies two Postgres migrations and one small Click House migration automatically on first start. Something to know: a vulnerability scanner will report four CRITICAL findings, all in the bundled MinIO and its mc client. No fixed MinIO build exists yet, and the affected parts (AMQP notifications, a gRPC server) aren't used by this packag e. Replacing MinIO is next on the list. We expect to move to a slower cadence for Langfuse updates or security-only, because upstream releases almost daily.

@loudlemur I didn't write the skills . But @james is a good candidate for feedback .

@robi said: @LoudLemur would it be more discoverable if it was published as a blog or docs site and then include llms.txt and llms-full.txt to make parsing easier for the agents? Thanks, @robi You can see the blog here: https://wanderingmonster.dev/blog/cloudron-packaging-assessment-toolkit/

I have a new offline solution with llamafile that runs on n M1 really well. Should see how it runs on CPU only VPSs.

@scooke It is a bit like buying a fancy car. Having the luxury of that car is brilliant when you are actually driving it but when you need to sleep or park, it is a total waste. Generally, the high end video cards with huge amounts of VRAM are a luxury for most people, who instead make do with buying a much more humble piece of kit. However, if instead of buying the hardware outright, they pay for the car only when they need it, they can enjoy a much more luxurious and capable experience. So many new AI applications are being created these days, I think I shall start a discussion thread on it and what Cloudron could do to support it.

@LoudLemur late reply not sure I understand your question so this answer may not be what you want but in picture form ... [image: mermaid-diagram-2026-01-13-185009.png]

@marcusquinn Thanks for that. Looks like my post is a duplicate of: https://forum.cloudron.io/topic/13141/litellm-openrouter-self-hosted-alternative-proxy-provides-access-to-openai-bedrock-anthropic-gemini-etc?_=1759700788590 (I posted 3 apps, checked the first one, and then forgot to check if the other two had already been requested!) @girish What is the procedure to merge this dupe with @jagan 's earlier request here? https://forum.cloudron.io/topic/13141/litellm-openrouter-self-hosted-alternative-proxy-provides-access-to-openai-bedrock-anthropic-gemini-etc?_=1759700788590 I can see the topic tools, merge option, but it is a bit confusing on how to paste/include jagan's thread.

@LoudLemur thank you !

Not a bad concept. Doesn't need dedicated hardware, might be able to run on the build/demo server or other sponsoring org. Integrate with CCAI upgraded to a distributed DB or some master/share topology to keep a running list of all custom packages successfully installed and make them available to everyone else.