AI on Cloudron

robi

@micmc Well we already have a company named in the same space.

LoudLemur

Talking of companies, here is an AI that makes AI companies...
https://github.com/OpenBMB/ChatDev
There is a post about it on Reddit:
https://old.reddit.com/r/OpenAI/comments/16pk8hp/build_an_entire_ai_workforce_with_chatdev_ai/

LoudLemur

InflectionAI boss says that over the next 18 months they will be working on models 10 times the size of ChatGPT4 and then 100 times the size. You can chat with pi.ai here:
https://pi.ai/talk

Google have been giving their Gemini AI (Generalized Multi-Modal Intelligence Network) to selected companies to try. It is particularly good at noticing hidden messages and patterns. Google's team are concerned about ethical issues and are generating a big legal layer of staff to help "keep us safe".

GPT5 - (Generalized Pre-Trained Transformers version 5) It is speculated that this will be preceded by GPT4.5. Their legal team is concerned with banning textbooks from training. So, if you found a perfect recipe for a chocolate chip cookie in a book, this book would be removed, and the recipe would kind of not be there. Google's legal team is making sure we are not harmed by AI chococlate chip cookie recipes.

There is automated AI jailbreaking of bubble-wrapped AI now, but Big Data corporate teams are working hard to keep the bubblewrapped AI bubblewrapped for our safety.

https://inv.tux.pizza/watch?v=JnO7smIlYIM

micmc

@LoudLemur said in AI on Cloudron:

Talking of companies, here is an AI that makes AI companies...
https://github.com/OpenBMB/ChatDev
There is a post about it on Reddit:
https://old.reddit.com/r/OpenAI/comments/16pk8hp/build_an_entire_ai_workforce_with_chatdev_ai/

Wow, that's fascinating!

micmc

Craze AI race keeps going on at fast pace, after MS invested 10B in OpenAI and mixed their LLM with Bing and Azure now Amazon (AWS) strikes in too.

"Amazon has plans to invest up to $4bn in Anthropic, the artificial intelligence start-up behind ChatGPT competitor Claude, as it looks to take on Microsoft and Google in the AI race."

LoudLemur

OpenAI's DALL.E 3 is now available on research preview:
https://openai.com/dall-e-3

LoudLemur

https://videodirectorgpt.github.io/
https://arxiv.org/abs/2309.15091

LoudLemur

Chroma https://www.trychroma.com/

"the AI-native open-source embedding database"

What do you do with it? For example, throw in your medical books and query it with an AI.

Apache 2.0
Has Docker
They hope to have hosting soon.

I hope somebody who likes database tech might have a look at this.

https://github.com/chroma-core/chroma
https://www.trychroma.com/

LoudLemur

Ollama.ai
Download and run language models locally:
https://www.ollama.ai/

You can see a video here where somebody integrated an AI into their editor using Ollama:
https://yt.artemislena.eu/watch?v=FIZt7MinpMY&si=fLRMYyhss0hOO1ZQ&quality=dash

LoudLemur

Axolotl
A tool to help you fine-tune models.
Apache 2.0
https://github.com/OpenAccess-AI-Collective/axolotl

Axolotl was used to help create the following, for example:
Minotaur 13b
Manticore 13b
Hippogriff 30b

marcusquinn

@LoudLemur Chroma post here: https://forum.cloudron.io/topic/9078/chroma-open-source-vector-database-for-ai-long-term-memory-and-local-data-alternative-to-pinecone

robi

@LoudLemur et'all

I've got ollama working in the LAMP app on the Demo server (if it's still there)

Use the terminal to run llama2.sh or llama2uncesored.sh and see how it runs.

There may be a web/desktop client for it too.

LoudLemur

@robi said in AI on Cloudron:

llama2uncesored.sh

Thank you very much for doing that, @robi. From where do we run the command? The ollama application doesn't seem to have a terminal in Cloudron. I tried from the LAMP application's terminal and that didn't work either.

robi

@LoudLemur it's linked in my post.. it's installed in the LAMP app labeled php-8.2. It cannot be installed in the proxy app named ollama.

ankitpr89

Check: https://n8n.io/langchain/

marcusquinn

@ankitpr89 V cool!

LoudLemur

GPUs for AI comparison spreadsheet:
https://www.edlabs.it/gpus4ai

micmc

Amazon (AWS) recently made a big announcement: a service Bedrock was finally released.

If you missed the news:
Amazon decided to enter massively into the generative AI field and invested in the company Anthropic for $4 billion so they can get into the race and compete with popular AI services like ChatGPT, Dall-E, MidJourney, etc.

The first proposal of Amazon is Bedrock, a fully managed AI service that offers multiple foundational models such as Claude, Jurassic, Titan, and Stable Diffusion XL, among others.

I've started to test Bedrock myself, what's interesting is being able to test and use different FMs from different vendors from the same web UI from inside your AWS account BUT, from a unique API too!

That means, AWS is creating a single API access that can be used to access all the actual avaialable FMs through its Bedrock service, and any new ones they will eventually add. Interesting approach.

Some has already made a video here,