AI on Cloudron

[LoudLemur]

StabilityMatrix

If you use a lot of inferencing software, one thing this can do is have the models kept in one folder, which saves storage and bandwidth.

https://github.com/LykosAI/StabilityMatrix/releases/tag/v2.14.0

[LoudLemur]

AI Search with Lepton
This helps you have an ai language model which makes internet searches.

An interesting feature that Cloudron might like is its one-click deployment tool.

https://github.com/leptonai/search_with_lepton?tab=readme-ov-file

[jdaviescoates]

Apparently this is one of the best open source models yet:

https://qwenlm.github.io/blog/qwen3/

[LoudLemur]

LLM VRAM Calculator

If you would like to know what models your VRAM can handle, you can check with this online tool:

https://apxml.com/tools/vram-calculator

[LoudLemur]

@jdaviescoates I just tried it.
Qwen 3 is very good!