AI on Cloudron

[LoudLemur]

RTX3090 and Llama 70b @ 20 tokens/second:
https://old.reddit.com/r/Oobabooga/comments/16gxqzt/exllamav2_20_tokenss_for_llama270bchat_on_a_rtx/

Haven't yet verified

https://github.com/turboderp/exllamav2

[LoudLemur]

@marcusquinn Somebody just created a Lora which they trained on all of the art they created at school, pencil drawings. The AI can now make art as though it were their younger self.

[marcusquinn]

@LoudLemur We're being uploaded to the Matrix! Maybe we'll become the aliens popping in on other planets

[micmc]

@marcusquinn said in AI on Cloudron:

@LoudLemur We're being uploaded to the Matrix! Maybe we'll become the aliens popping in on other planets

That's why we 'start' lurking in the IPFS direction

[marcusquinn]

Here's a fun one!

• https://labs.heygen.com/video-translate

[micmc]

Here's an AMAZING one.

Are you ready for NExT GPT?
https://www.marktechpost.com/2023/09/14/meet-next-gpt-an-end-to-end-general-purpose-any-to-any-multimodal-large-language-models-mm-llms/

Make sure to look at the video on that page.
We knew it, we ain't seen nothing yet (here's something you never will forget... bbb baby you ain't seen nothing yet )

[LoudLemur]

Agents - a framework for Autonomous Language AI Agents:
https://github.com/aiwaves-cn/agents

There is a very popular demo and a website:
http://www.aiwaves-agents.com/

[LoudLemur]

"Can my GPU run this?" tool (I thought this would be more useful, but maybe somebody else can get more mileage out of it.)

https://rahulschand.github.io/gpu_poor/
https://github.com/RahulSChand/gpu_poor

LoLLMS WebUI (Lord of Large Language Models: One tool to rule them all) (Elevated privileges might be needed for proper installation. After you install a model, you need to click that tick to select it for use.)

https://github.com/ParisNeo/lollms-webui
TheBloke says this is great, with many unique features. I like it because its licence is clear and Apache 2.0

[micmc]

@LoudLemur said in AI on Cloudron:

LoLLMS WebUI (Lord of Large Language Models: One tool to rule them all)

I thought it was: Laughing Out Loud at Large Language Models

[robi]

@micmc Well we already have a company named in the same space.

[LoudLemur]

Talking of companies, here is an AI that makes AI companies...
https://github.com/OpenBMB/ChatDev
There is a post about it on Reddit:
https://old.reddit.com/r/OpenAI/comments/16pk8hp/build_an_entire_ai_workforce_with_chatdev_ai/

[LoudLemur]

InflectionAI boss says that over the next 18 months they will be working on models 10 times the size of ChatGPT4 and then 100 times the size. You can chat with pi.ai here:
https://pi.ai/talk

Google have been giving their Gemini AI (Generalized Multi-Modal Intelligence Network) to selected companies to try. It is particularly good at noticing hidden messages and patterns. Google's team are concerned about ethical issues and are generating a big legal layer of staff to help "keep us safe".

GPT5 - (Generalized Pre-Trained Transformers version 5) It is speculated that this will be preceded by GPT4.5. Their legal team is concerned with banning textbooks from training. So, if you found a perfect recipe for a chocolate chip cookie in a book, this book would be removed, and the recipe would kind of not be there. Google's legal team is making sure we are not harmed by AI chococlate chip cookie recipes.

There is automated AI jailbreaking of bubble-wrapped AI now, but Big Data corporate teams are working hard to keep the bubblewrapped AI bubblewrapped for our safety.

https://inv.tux.pizza/watch?v=JnO7smIlYIM

[micmc]

@LoudLemur said in AI on Cloudron:

Talking of companies, here is an AI that makes AI companies...
https://github.com/OpenBMB/ChatDev
There is a post about it on Reddit:
https://old.reddit.com/r/OpenAI/comments/16pk8hp/build_an_entire_ai_workforce_with_chatdev_ai/

Wow, that's fascinating!

[micmc]

Craze AI race keeps going on at fast pace, after MS invested 10B in OpenAI and mixed their LLM with Bing and Azure now Amazon (AWS) strikes in too.

"Amazon has plans to invest up to $4bn in Anthropic, the artificial intelligence start-up behind ChatGPT competitor Claude, as it looks to take on Microsoft and Google in the AI race."

[LoudLemur]

OpenAI's DALL.E 3 is now available on research preview:
https://openai.com/dall-e-3

[LoudLemur]

https://videodirectorgpt.github.io/
https://arxiv.org/abs/2309.15091

[LoudLemur]

Chroma https://www.trychroma.com/

"the AI-native open-source embedding database"

What do you do with it? For example, throw in your medical books and query it with an AI.

Apache 2.0
Has Docker
They hope to have hosting soon.

I hope somebody who likes database tech might have a look at this.

https://github.com/chroma-core/chroma
https://www.trychroma.com/

[LoudLemur]

Ollama.ai
Download and run language models locally:
https://www.ollama.ai/

You can see a video here where somebody integrated an AI into their editor using Ollama:
https://yt.artemislena.eu/watch?v=FIZt7MinpMY&si=fLRMYyhss0hOO1ZQ&quality=dash

[LoudLemur]

Axolotl
A tool to help you fine-tune models.
Apache 2.0
https://github.com/OpenAccess-AI-Collective/axolotl

Axolotl was used to help create the following, for example:
Minotaur 13b
Manticore 13b
Hippogriff 30b

[marcusquinn]

@LoudLemur Chroma post here: https://forum.cloudron.io/topic/9078/chroma-open-source-vector-database-for-ai-long-term-memory-and-local-data-alternative-to-pinecone