Free Software AI and Cloudron

[LoudLemur]

The Cloudron team have indicated they will be monitoring AI suggestions for a couple of months or more before supporting any, as change is developing so rapidly.

There is an interesting AI comparison tool here:
https://chat.lmsys.org/

You can "battle" AIs beside each other to see how they compare.

There is also an interesting article on AI revealing Big Data's assessment of Free Software AI. (I think I might start calling it Free AI.)

https://www.semianalysis.com/p/google-we-have-no-moat-and-neither

[timconsidine]

It's an interesting article.
For once, open source might be king !

[LoudLemur]

I want to host Vicuna 13B, and then add some training to it based on my own sources, and then see what it has to say (in a beautiful GUI)!

I would also like to try and get DeepFloyd IF going with a nice GUI too.

Hopefully @marcusquinn will have something to say.

[timconsidine]

I don't know about which model yet.
In my limited testing, ChatGPT still delivers the best responses.
But being able to train it on your own material is a big plus.
Give it a few days / weeks (as per article forecast) and the alternatives may be as good as ChatGPT.

[LoudLemur]

There is an attempt at an uncensored vicuna here I would like to try and use with the Serge GUI which @marcusquinn kindly suggested and which I have running. I wonder how tricky it would be to get going...

https://huggingface.co/reeducator/vicuna-13b-free

[marcusquinn]

@LoudLemur Brilliant article - thanks for sharing!

[robi]

Here's how someone hacked together a brilliant text editor with connectivity to an LLM, BYO-K -- API_key

https://novel.sh

Check out the tweet thread too!

[robi]

https://youai.ai is a platform to mix up various LLMs as private Apps to further integrate into other things towards an LLM OS if you will.

Let's see what integrations we can make with Cloudron.

Link to their videos

[micmc]

@robi said in Free Software AI and Cloudron:

https://youai.ai is a platform to mix up various LLMs as private Apps to further integrate into other things towards an LLM OS if you will.

Let's see what integrations we can make with Cloudron.

The video does not work at the moment, though the app looks great it's not open source right?

Anyway, here's another one in the like that could be good to consider too.
It's OpenRouter and this one operates differently I guess... Already, several apps that I know are adding access to API to OpenRouter. Worth taking a look and cheap as well.

[robi]

@micmc wasn't meant to be a video but a link to their list of them.. I fixed the link.