AI on Cloudron

[LoudLemur]

AI is set to make a lot of advances and appear in unusual places. Cloudron might be able to help.

This thread is to stimulate discussion and form an early focal point for AI related ideas and news for those on Cloudron interested in this topic.

To get the ball rolling, there is now an AI search engine available:

https://you.com

You.com permits you to request that an application be added to improve search results. For example, you could ask that SepiaSearch, (PeerTube's content search) be included. Owncast is federated too, and you could request that be included as an application, also.

https://yousearch.canny.io/feature-requests/

[timconsidine]

@LoudLemur My impression (just impression) is that much AI requires significant computing power. I wonder if that is true, and i wonder how many are running Cloudron on VPS or bare metal with sufficient power.

But interested if it is possible.
I played around with some face generation stuff a while back.
Significant power required for real work.

I have a mixed attitude to AI. Like many, I fear for how it will negatively affect humanity. Equally I wonder if, properly managed, it might be the only thing that arrests or reverses what sometimes seems like humanity's irreversible slide into stupidity !.

[LoudLemur]

@timconsidine A relatively recent "gaming laptop" lets somebody run the stable-diffusion AI to generate art. If you have an nvidia card with a lot of vram, like a 3080, you can get impressive results.

I think old, gaming PCs could be a great use for Cloudron. They would have the RAM and GPU needed to do a lot of AI stuff as a hobby. We would need to show how to setup a Cloudron at home behind a router, and to have some Cloudron AI applications...

[LoudLemur]

@timconsidine, Happy New Year to you! I hope it is a lot better than 2022!

[yeku]

@LoudLemur AI seems immaterial to a service such as Cloudron which essentially packages up FOSS/FLOSS applications so that users can easily install them.

Just as an aside, ChatGPT is proprietary. Microsoft will almost certainly use to ChatGPT to take some of Google Search's market share. Much like Windows OS, Microsoft will probably carefully guard the source code for ChatGPT.

[LoudLemur]

@yeku said in AI on Cloudron:

@LoudLemur AI seems immaterial to a service such as Cloudron which essentially packages up FOSS/FLOSS applications so that users can easily install them.

Just as an aside, ChatGPT is proprietary. Microsoft will almost certainly use to ChatGPT to take some of Google Search's market share. Much like Windows OS, Microsoft will probably carefully guard the source code for ChatGPT.

Hopefully, people will not long from now be running Free Software, federated, self-hosted AIs that help each other learn by sharing crawls and data over a distributed network. That is one way I hope Cloudron could help.

[yeku]

@LoudLemur said in AI on Cloudron:

eople will not long from now be running Free Software, federated, self-hosted

I predict that eventually at least hundreds of millions of people will run FOSS/FLOSS. But there will still be proprietary software too.

[timconsidine]

@LoudLemur said in AI on Cloudron:

Happy New Year to you! I hope it is a lot better than 2022!

thank you ! and for everyone !

[LoudLemur]

@yeku said in AI on Cloudron:

@LoudLemur said in AI on Cloudron:

eople will not long from now be running Free Software, federated, self-hosted

I predict that eventually at least hundreds of millions of people will run FOSS/FLOSS. But there will still be proprietary software too.

Wouldn't that be wonderful?

Cloudron could make that a lot easier for people.

[LoudLemur]

Here is an example of just how fast AI has been developing. credit - https://www.insideofai.com/

[AartJansen]

Does something like localAI seems feasible ?
https://www.reddit.com/r/selfhosted/comments/142uqn4/localai_v1180_release/

[LoudLemur]

Here is Nvidia's CEO giving a Computex keynote speech on AI. Topics include generative AI for robotics, chip design, media, leveraging #chatgpt by #openai and many reveals across every application of artificial intelligence.

While not directly AI related, it offers a sense of what to come and excites you about the prospects of AI.

https://odysee.com/@TickerSymbolYOU:e/nvidia's-huge-ai-breakthroughs-just:4

Upvote, if it blew your mind! haha!

Timestamps for this Nvidia Keynote Supercut:

00:00
Introduction

00:29
AI for Ray Tracing

02:17
Generative AI for Avatars

04:21
Compute for Generative AI

07:14
Newest Generative AI Examples

09:00
Generative AI for Communications

12:44
Generative AI for Digital Twins

16:33
Nvidia Omniverse Cloud Demo

18:42
Generative AI for Advertising

21:30
Generative AI for Manufacturing

24:07
Generative AI for Robotics

[robi]

Using our N8N for automating management of prompts and interfacing with various local AIs is a great idea. This guy on twitter documents how to do this with Langchain & N8N in a smart way:
https://twitter.com/dkarlovi/status/1655944812150013954

Then we can install most AI CLI tools in the LAMP app (llama.cpp and gpt4all) and access it via N8N as the UI.

[marcusquinn]

Imagine that kids are gonna be getting this stuff in school and add a decade of their imaginations with access to all open-source code ever published online to build on. The future's gonna be wild!

[marcusquinn]

Still one of my favs, so far for usefulness:

• https://forum.cloudron.io/topic/8980/ai-shell-natural-language-ai-terminal-commandline

[LoudLemur]

Here is an AI focused on health. It is like an "ask the AI doctor". BTRU (Better You)

https://btru.ai/#/

From https://nitter.net/ezekiel_aleke

1. Summarize YouTube Video → eightify.app
2. Summarize long text → wiseone.io
3. Get Financial Data → Finalle.ai
4. Translate, Explain and Summarize text → monica.im
5. Health → BTRU.ai

[LoudLemur]

LLMs (Large Language Models) are now able to solve games, like Minecraft. This video show how and how incredibly fast progress is. His channel, Two Minute Papers, is a great subscription.

https://yewtu.be/watch?v=VKEA5cJluc0

[LoudLemur]

AI Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

I think that "truthfulness" metric is going to come in for some examination. It claims it measures how likely the AI is to reproduce falsehoods commonly found on the internet...

https://arxiv.org/abs/2109.07958
https://github.com/sylinrl/TruthfulQA

Consumer AI is clearly becoming popular: https://www.bitchute.com/video/tGLUuVc3D5B0/

Does anybody else feel that there seem to have been a whole lot of AI companies setup and ready to race, in their running gear and with running spikes on, poised at the starting blocks, just waiting for the gun to go to start the AI race? It seems a bit... orchestrated. They were all in position and raring to go. Who had them prepared like that?

[LoudLemur]

Text2Video AI - Zeroscope
People are blown away by this and it could run on your machine:
https://yewtu.be/watch?v=L3y2scQ6cr4

https://huggingface.co/cerspense/zeroscope_v2_30x448x256

Follow Camenduru: twitter.com/camenduru
Follow Cerspence: twitter.com/cerspense

[LoudLemur]

Google DeepMind - AlphaDev

AlphaDev is using low-level code to try and find better algorithms. It has already found one to sort 70% faster, and to hash 30% faster than existing methods. These algorithms have been released into the community and are already being used.

Apache Licence!

https://github.com/deepmind/alphadev
https://yewtu.be/watch?v=YoQV5DJR4So&listen=false