AI on Cloudron

[LoudLemur]

https://forum.cloudron.io/topic/13231/open-deep-research-on-cloudron-self-hosted-ai-agent

[LoudLemur]

48GB VRAM from China

https://wccftech.com/chinese-gpu-manufacturers-push-out-support-for-running-deepseek-ai-models-on-local-systems/

[robi]

@LoudLemur are these on Alibaba?

[LoudLemur]

@robi I haven't seen them there. A Chinese ID like a wechat or phone might be needed. I'd be wary of knock offs and consider what people who have bought Chinese steel have had to say.

[LoudLemur]

MCP (Model Context Protocol)
https://modelcontextprotocol.io/introduction

According to the CEO of Anthropic, this is what is going to be writing 90% of code in 6 months, and almost all of it by the end of the year.

You can see some uses here:
https://github.com/punkpeye/awesome-mcp-servers

The brilliant "Fireship" has a fast introduction to MCP:
https://odysee.com/@fireship:6/i-gave-claude-root-access-to-my:b

It would require somebody with something like @robi or @Kubernetes skill levels to be able to use it or make worth of it on Cloudron.

[robi]

Aww, thanks @LoudLemur

Actually it's already part of the update for OpenWebUI which can use it.

There are also many MCP directory websites out there who are keeping lists of many as well as some better ones who are letting you run them remotely. One such is Smithery.ai

[jdaviescoates]

@robi said in AI on Cloudron:

One such is Smithery.com

I think you mean https://smithery.ai/

[robi]

@jdaviescoates Thanks again for the correction.

[necrevistonnezr]

@LoudLemur said in AI on Cloudron:

MCP (Model Context Protocol)
https://modelcontextprotocol.io/introduction

According to the CEO of Anthropic, this is what is going to be writing 90% of code in 6 months, and almost all of it by the end of the year.

MCP has been adopted by OpenAI and will hence be the de-facto standard https://techcrunch.com/2025/03/26/openai-adopts-rival-anthropics-standard-for-connecting-ai-models-to-data/

In a post on X on Wednesday, OpenAI CEO Sam Altman said that OpenAI will add support for Anthropic’s Model Context Protocol, or MCP, across its products, including the desktop app for ChatGPT. MCP is an open source standard that helps AI models produce better, more relevant responses to certain queries.

[robi]

It would be great to have additional MCP support in OWUI.

It requires a few things added to the package it seems.

https://github.com/open-webui/openapi-servers

Also, the import functions feature seems to be broken, although one can use the +
Add function manually and copy/paste the code from https://openwebui.com/functions