AI on Cloudron

[robi]

It would be great to have additional MCP support in OWUI.
@girish or @nebulon can you take a look?

It requires a few things added to the package it seems.

https://github.com/open-webui/openapi-servers

Also, the import functions feature seems to be broken, although one can use the +
Add function manually and copy/paste the code from https://openwebui.com/functions

[robi]

For those that want to experience how simple it is to build an agent and imagine implementing it on Cloudron.. read on: https://github.com/voxmenthe/coding-agent/blob/main/tutorial.md

[LoudLemur]

RAG with documents in a Docker
https://github.com/SciPhi-AI/R2R

[LoudLemur]

StabilityMatrix

If you use a lot of inferencing software, one thing this can do is have the models kept in one folder, which saves storage and bandwidth.

https://github.com/LykosAI/StabilityMatrix/releases/tag/v2.14.0

[LoudLemur]

AI Search with Lepton
This helps you have an ai language model which makes internet searches.

An interesting feature that Cloudron might like is its one-click deployment tool.

https://github.com/leptonai/search_with_lepton?tab=readme-ov-file

[jdaviescoates]

Apparently this is one of the best open source models yet:

https://qwenlm.github.io/blog/qwen3/

[LoudLemur]

LLM VRAM Calculator

If you would like to know what models your VRAM can handle, you can check with this online tool:

https://apxml.com/tools/vram-calculator

[LoudLemur]

@jdaviescoates I just tried it.
Qwen 3 is very good!

[LoudLemur]

Live Search is available on Grok's API without charge for a limited time for beta testing:

https://docs.x.ai/docs/guides/live-search

search through realtime data from 𝕏, the internet, trending news, RSS feeds,

[necrevistonnezr]

@LoudLemur said in AI on Cloudron:

Live Search is available on Grok's API without charge for a limited time for beta testing:

https://docs.x.ai/docs/guides/live-search

search through realtime data from 𝕏, the internet, trending news, RSS feeds,

In the US, Musk is simply walking into the authorities with a presidential power of attorney and copying everything he can. Once the files are copied, they end up in the system of Musk's X AI. Or they are poured into Palantir software with the aim of creating deportation lists.
So please boycott this PoS and his PoS endeavors.

[marcusquinn]

@necrevistonnezr Interesting take. Companies are already more powerful that governments in many ways.