AI on Cloudron

[marcusquinn]

@LoudLemur Friendly Streaming app on Mac has an Ad Blocker and other neat features. Not found anything similar that I trust the look of for iPhone yet.

[LoudLemur]

@marcusquinn said in AI on Cloudron:

@robi I study the Ads!

I have noticed that the so-called "ads" on TV are absolutely terrible and more like brainwashing propaganda than an attempt to get people to buy.

By great contrast, the adverts on X are excellent! I frequently see something there and think, "Wow, that is cool! I never knew about those. I fancy one of them for myself."

[marcusquinn]

@LoudLemur Know thy enemy! Studying them is helping to understand how the willing victims of such consumerism are thinking, as not only do you have to navigate a world of targeted ads, but of indoctrinated Agent Smiths.

[LoudLemur]

Pinokio - an installer for AI. It is like a cloudron for AI!
It includes pip, git, etc.

https://inv.n8pjl.ca/watch?v=VXiyhl0c1gI&listen=false

https://pinokio.computer/
https://inv.n8pjl.ca/watch?v=mB_bZC8pMDA&quality=dash

[LoudLemur]

https://app.artflow.ai/
non-Free, unfortunately
Create consistent characters easily

[LoudLemur]

OpenAI Sora
text to video
Predictably heavy "safety" measures.
Nevertheless, pretty amazing:
https://openai.com/sora

[Kubernetes]

@LoudLemur Yes, this is another game changer

[marcusquinn]

@LoudLemur It's gonna be a wild ride into the virtual future...

https://x.com/BrianRoemmele/status/1758495953399771300

[LoudLemur]

@marcusquinn Hey, thanks for that! This is so uplifting!

[LoudLemur]

There is a leaderboard for language models here. You can see the context length they support and the required VRAM etc:
https://llm.extractum.io/list/?uncensored=1

There is a review of "uncensored" language models here:
https://scifilogic.com/open-uncensored-llm-model/

[LoudLemur]

Nvidia release Chat with RTX -
https://www.nvidia.com/en-us/ai-on-rtx/chat-with-rtx-generative-ai/
35GB download

Training Tutorial:
https://vid.puffyan.us/watch?v=y9Gi3UgNA3E&t=79

Which suggests non-Free:
https://customgpt.ai/
(Any Free alternatives?)

Pro-Tip: You should have about 100GB clear for storage. The .zip is 35GB, this then needs to unzip to form the installer, which then goes on to install which then downloads (slowly) a large amount of dependencies. If you don't have space to spare, all the available models won't be installed properly.)
Also, some have been reporting problems when not installing to the default location.

[LoudLemur]

Claude 3 is now released.

Antrhopic's AI is now available in 3 tiers: Opus is its Big Brain, and available to paying customers. Sonnet is trades brains for speed and powers the tier available gratis. Haiku is the fastest of all.

https://www.anthropic.com/news/claude-3-family

[necrevistonnezr]

@LoudLemur said in AI on Cloudron:

Claude 3 is now released.
https://www.anthropic.com/news/claude-3-family

Not to the general public. It's "not available in my region" (Germany): https://support.anthropic.com/en/articles/8461763-where-can-i-access-claude-ai

[LoudLemur]

Finetune / train a 70b language model at home! (on two 24GB GPUs)
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

[marcusquinn]

@LoudLemur Opus apparently beating GPT-4 for coding. The larger token size is much needed.

[marcusquinn]

@necrevistonnezr Maybe try ivpn.net

[marcusquinn]

Now this is a use for AI. Emotional video...

[LoudLemur]

Devin - from Cognition AI
https://www.cognition-labs.com/

Over 13% code problems solved without assistance, dwarfing its competitors

https://x.com/cognition_labs/status/1767548763134964000?s=20

[LoudLemur]

Figure 01 from 'Open'AI
https://x.com/BrianRoemmele/status/1767923602895319525?s=20

intelligent, seeing robots

[LoudLemur]

Grok Weights
It is a dataset.
magnet link, file 320GB
https://academictorrents.com/details/5f96d43576e3d386c9ba65b883210a393b68210e

https://vid.puffyan.us/watch?v=dQn_dj5KJGw&t=21