AI on Cloudron

[LoudLemur]

Finetune / train a 70b language model at home! (on two 24GB GPUs)
https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

[marcusquinn]

@LoudLemur Opus apparently beating GPT-4 for coding. The larger token size is much needed.

[marcusquinn]

@necrevistonnezr Maybe try ivpn.net

[marcusquinn]

Now this is a use for AI. Emotional video...

[LoudLemur]

Devin - from Cognition AI
https://www.cognition-labs.com/

Over 13% code problems solved without assistance, dwarfing its competitors

https://x.com/cognition_labs/status/1767548763134964000?s=20

[LoudLemur]

Figure 01 from 'Open'AI
https://x.com/BrianRoemmele/status/1767923602895319525?s=20

intelligent, seeing robots

[LoudLemur]

Grok Weights
It is a dataset.
magnet link, file 320GB
https://academictorrents.com/details/5f96d43576e3d386c9ba65b883210a393b68210e

https://vid.puffyan.us/watch?v=dQn_dj5KJGw&t=21

[LoudLemur]

Stability AI have released stable video 3d.

It runs on 8GB VRAM. Low poly
https://stability.ai/news/introducing-stable-video-3d?utm_source=Twitter&utm_medium=website&utm_campaign=blog
https://huggingface.co/stabilityai/sv3d

[LoudLemur]

Anthropic announced Claude 3 with their premiere language model will in a couple of weeks be available on M$FT's Vertex. There is a cost estimator tool there. If you are just using the AI for personal use, say 20 times a day, the cost per month is tiny. They also are offering a sweetener of US$300 credit as a sweetener. You need to link a Google account. It is all non-Free and I doubt there is much privacy.

https://www.anthropic.com/news/google-vertex-general-availability

[LoudLemur]

OpenEvidence, the non-Free, Medical AI, now is offering its API, for a price. If you give your details, you can try asking it about an ailment:

https://www.openevidence.com/product/api

[micmc]

Just in case you guys have missed it GROK is now OPEN SOURCE!

Grok-1 is a 314B (that's billions of) parameter Mixture-of-Experts model, trained from scratch, and is now open source!
https://twitter.com/elonmusk/status/1767108624038449405
https://www.producthunt.com/posts/grok-1
https://www.producthunt.com/products/grok-ai-assistant

[jdaviescoates]

https://github.com/xai-org/grok-1

[marcusquinn]

@micmc Open-Sources in AIs is a misnomer, given the models are compiled.

Still the right direction, but open-source could be used as a false sense of security given the compute power to compile the models is in the hands of very few.

[micmc]

@marcusquinn said in AI on Cloudron:

@micmc Open-Sources in AIs is a misnomer, given the models are compiled.

Still the right direction, but open-source could be used as a false sense of security given the compute power to compile the models is in the hands of very few.

Yeah, I sure get it, and in that sense you're right. I think, the idea of open source in language models is that you're able to download and privately host and train the model with your own data, to which, theoretically speaking no one else has access. All binary that we cannot examine the code cannot really called 'open source' in the real sense of the term.

[LoudLemur]

Rabbit
https://rabbit.tech

AI Operating System device

[LoudLemur]

Stability AI released Stable Audio 2.0, an AI music generator.
https://stability.ai/news/stable-audio-2-0

There is an open source project related to this:

stable-audio tools:
https://github.com/Stability-AI/stable-audio-tools

[LoudLemur]

Opera Web Browser - now has LLM (Large Language Model) support:
https://press.opera.com/2023/03/22/opera-ai-features-stage1/

[LoudLemur]

Anthropic's Claude AI now can use tools:
https://docs.anthropic.com/claude/docs/tool-use

[LoudLemur]

Google announced Lumiere
Amongst other things, image to video, etc:

https://lumiere-video.github.io/

[LoudLemur]

Anthropic's Claude AI Opus has context large enough to write an entire novel when chained with other AI:
https://threadreaderapp.com/thread/1775543642561597821.html

https://github.com/mshumer/gpt-author/