AI on Cloudron
-
MCP (Model Context Protocol)
https://modelcontextprotocol.io/introductionAccording to the CEO of Anthropic, this is what is going to be writing 90% of code in 6 months, and almost all of it by the end of the year.
You can see some uses here:
https://github.com/punkpeye/awesome-mcp-serversThe brilliant "Fireship" has a fast introduction to MCP:
https://odysee.com/@fireship:6/i-gave-claude-root-access-to-my:bIt would require somebody with something like @robi or @Kubernetes skill levels to be able to use it or make worth of it on Cloudron.
@LoudLemur said in AI on Cloudron:
MCP (Model Context Protocol)
https://modelcontextprotocol.io/introductionAccording to the CEO of Anthropic, this is what is going to be writing 90% of code in 6 months, and almost all of it by the end of the year.
MCP has been adopted by OpenAI and will hence be the de-facto standard https://techcrunch.com/2025/03/26/openai-adopts-rival-anthropics-standard-for-connecting-ai-models-to-data/
In a post on X on Wednesday, OpenAI CEO Sam Altman said that OpenAI will add support for Anthropicโs Model Context Protocol, or MCP, across its products, including the desktop app for ChatGPT. MCP is an open source standard that helps AI models produce better, more relevant responses to certain queries.
-
It would be great to have additional MCP support in OWUI.
@girish or @nebulon can you take a look?It requires a few things added to the package it seems.
https://github.com/open-webui/openapi-servers
Also, the import functions feature seems to be broken, although one can use the +
Add function manually and copy/paste the code from https://openwebui.com/functions -
For those that want to experience how simple it is to build an agent and imagine implementing it on Cloudron.. read on: https://github.com/voxmenthe/coding-agent/blob/main/tutorial.md
-
RAG with documents in a Docker
https://github.com/SciPhi-AI/R2R -
StabilityMatrix
If you use a lot of inferencing software, one thing this can do is have the models kept in one folder, which saves storage and bandwidth.
https://github.com/LykosAI/StabilityMatrix/releases/tag/v2.14.0
-
AI Search with Lepton
This helps you have an ai language model which makes internet searches.An interesting feature that Cloudron might like is its one-click deployment tool.
https://github.com/leptonai/search_with_lepton?tab=readme-ov-file
-
Apparently this is one of the best open source models yet:
-
LLM VRAM Calculator
If you would like to know what models your VRAM can handle, you can check with this online tool:
-
Apparently this is one of the best open source models yet:
@jdaviescoates I just tried it.
Qwen 3 is very good! -
Live Search is available on Grok's API without charge for a limited time for beta testing:
https://docs.x.ai/docs/guides/live-search
search through realtime data from ๐, the internet, trending news, RSS feeds,
@LoudLemur said in AI on Cloudron:
Live Search is available on Grok's API without charge for a limited time for beta testing:
https://docs.x.ai/docs/guides/live-search
search through realtime data from ๐, the internet, trending news, RSS feeds,
In the US, Musk is simply walking into the authorities with a presidential power of attorney and copying everything he can. Once the files are copied, they end up in the system of Musk's X AI. Or they are poured into Palantir software with the aim of creating deportation lists.
So please boycott this PoS and his PoS endeavors. -
@LoudLemur said in AI on Cloudron:
Live Search is available on Grok's API without charge for a limited time for beta testing:
https://docs.x.ai/docs/guides/live-search
search through realtime data from ๐, the internet, trending news, RSS feeds,
In the US, Musk is simply walking into the authorities with a presidential power of attorney and copying everything he can. Once the files are copied, they end up in the system of Musk's X AI. Or they are poured into Palantir software with the aim of creating deportation lists.
So please boycott this PoS and his PoS endeavors.@necrevistonnezr Interesting take. Companies are already more powerful that governments in many ways.
