AI on Cloudron

LoudLemur

OpenAI Sora
text to video
Predictably heavy "safety" measures.
Nevertheless, pretty amazing:
https://openai.com/sora

Kubernetes

@LoudLemur Yes, this is another game changer

marcusquinn

@LoudLemur It's gonna be a wild ride into the virtual future...

https://x.com/BrianRoemmele/status/1758495953399771300

LoudLemur

@marcusquinn Hey, thanks for that! This is so uplifting!

LoudLemur

There is a leaderboard for language models here. You can see the context length they support and the required VRAM etc:
https://llm.extractum.io/list/?uncensored=1

There is a review of "uncensored" language models here:
https://scifilogic.com/open-uncensored-llm-model/

LoudLemur

Nvidia release Chat with RTX -
https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/
35GB download

Training Tutorial:
https://vid.puffyan.us/watch?v=y9Gi3UgNA3E&t=79

Which suggests non-Free:
https://customgpt.ai/
(Any Free alternatives?)

Pro-Tip: You should have about 100GB clear for storage. The .zip is 35GB, this then needs to unzip to form the installer, which then goes on to install which then downloads (slowly) a large amount of dependencies. If you don't have space to spare, all the available models won't be installed properly.)
Also, some have been reporting problems when not installing to the default location.

LoudLemur

Claude 3 is now released.

Antrhopic's AI is now available in 3 tiers: Opus is its Big Brain, and available to paying customers. Sonnet is trades brains for speed and powers the tier available gratis. Haiku is the fastest of all.

https://www.anthropic.com/news/claude-3-family

necrevistonnezr

@LoudLemur said in AI on Cloudron:

Claude 3 is now released.
https://www.anthropic.com/news/claude-3-family

Not to the general public. It's "not available in my region" (Germany): https://support.anthropic.com/en/articles/8461763-where-can-i-access-claude-ai

LoudLemur

Finetune / train a 70b language model at home! (on two 24GB GPUs)
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

marcusquinn

@LoudLemur Opus apparently beating GPT-4 for coding. The larger token size is much needed.

marcusquinn

@necrevistonnezr Maybe try ivpn.net

marcusquinn

Now this is a use for AI. Emotional video...

LoudLemur

Devin - from Cognition AI
https://www.cognition-labs.com/

Over 13% code problems solved without assistance, dwarfing its competitors

https://x.com/cognition_labs/status/1767548763134964000?s=20

LoudLemur

Figure 01 from 'Open'AI
https://x.com/BrianRoemmele/status/1767923602895319525?s=20

intelligent, seeing robots

LoudLemur

Grok Weights
It is a dataset.
magnet link, file 320GB
https://academictorrents.com/details/5f96d43576e3d386c9ba65b883210a393b68210e

https://vid.puffyan.us/watch?v=dQn_dj5KJGw&t=21

LoudLemur

Stability AI have released stable video 3d.

It runs on 8GB VRAM. Low poly
https://stability.ai/news/introducing-stable-video-3d?utm_source=Twitter&utm_medium=website&utm_campaign=blog
https://huggingface.co/stabilityai/sv3d

LoudLemur

Anthropic announced Claude 3 with their premiere language model will in a couple of weeks be available on M$FT's Vertex. There is a cost estimator tool there. If you are just using the AI for personal use, say 20 times a day, the cost per month is tiny. They also are offering a sweetener of US$300 credit as a sweetener. You need to link a Google account. It is all non-Free and I doubt there is much privacy.

https://www.anthropic.com/news/google-vertex-general-availability