AI on Cloudron

[LoudLemur]

@yeku said in AI on Cloudron:

@LoudLemur said in AI on Cloudron:

eople will not long from now be running Free Software, federated, self-hosted

I predict that eventually at least hundreds of millions of people will run FOSS/FLOSS. But there will still be proprietary software too.

Wouldn't that be wonderful?

Cloudron could make that a lot easier for people.

[LoudLemur]

Here is an example of just how fast AI has been developing. credit - https://www.insideofai.com/

[AartJansen]

Does something like localAI seems feasible ?
https://www.reddit.com/r/selfhosted/comments/142uqn4/localai_v1180_release/

[LoudLemur]

Here is Nvidia's CEO giving a Computex keynote speech on AI. Topics include generative AI for robotics, chip design, media, leveraging #chatgpt by #openai and many reveals across every application of artificial intelligence.

While not directly AI related, it offers a sense of what to come and excites you about the prospects of AI.

https://odysee.com/@TickerSymbolYOU:e/nvidia's-huge-ai-breakthroughs-just:4

Upvote, if it blew your mind! haha!

Timestamps for this Nvidia Keynote Supercut:

00:00
Introduction

00:29
AI for Ray Tracing

02:17
Generative AI for Avatars

04:21
Compute for Generative AI

07:14
Newest Generative AI Examples

09:00
Generative AI for Communications

12:44
Generative AI for Digital Twins

16:33
Nvidia Omniverse Cloud Demo

18:42
Generative AI for Advertising

21:30
Generative AI for Manufacturing

24:07
Generative AI for Robotics

[robi]

Using our N8N for automating management of prompts and interfacing with various local AIs is a great idea. This guy on twitter documents how to do this with Langchain & N8N in a smart way:
https://twitter.com/dkarlovi/status/1655944812150013954

Then we can install most AI CLI tools in the LAMP app (llama.cpp and gpt4all) and access it via N8N as the UI.

[marcusquinn]

Imagine that kids are gonna be getting this stuff in school and add a decade of their imaginations with access to all open-source code ever published online to build on. The future's gonna be wild!

[marcusquinn]

Still one of my favs, so far for usefulness:

• https://forum.cloudron.io/topic/8980/ai-shell-natural-language-ai-terminal-commandline

[LoudLemur]

Here is an AI focused on health. It is like an "ask the AI doctor". BTRU (Better You)

https://btru.ai/#/

From https://nitter.net/ezekiel_aleke

1. Summarize YouTube Video → eightify.app
2. Summarize long text → wiseone.io
3. Get Financial Data → Finalle.ai
4. Translate, Explain and Summarize text → monica.im
5. Health → BTRU.ai

[LoudLemur]

LLMs (Large Language Models) are now able to solve games, like Minecraft. This video show how and how incredibly fast progress is. His channel, Two Minute Papers, is a great subscription.

https://yewtu.be/watch?v=VKEA5cJluc0

[LoudLemur]

AI Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

I think that "truthfulness" metric is going to come in for some examination. It claims it measures how likely the AI is to reproduce falsehoods commonly found on the internet...

https://arxiv.org/abs/2109.07958
https://github.com/sylinrl/TruthfulQA

Consumer AI is clearly becoming popular: https://www.bitchute.com/video/tGLUuVc3D5B0/

Does anybody else feel that there seem to have been a whole lot of AI companies setup and ready to race, in their running gear and with running spikes on, poised at the starting blocks, just waiting for the gun to go to start the AI race? It seems a bit... orchestrated. They were all in position and raring to go. Who had them prepared like that?

[LoudLemur]

Text2Video AI - Zeroscope
People are blown away by this and it could run on your machine:
https://yewtu.be/watch?v=L3y2scQ6cr4

https://huggingface.co/cerspense/zeroscope_v2_30x448x256

Follow Camenduru: twitter.com/camenduru
Follow Cerspence: twitter.com/cerspense

[LoudLemur]

Google DeepMind - AlphaDev

AlphaDev is using low-level code to try and find better algorithms. It has already found one to sort 70% faster, and to hash 30% faster than existing methods. These algorithms have been released into the community and are already being used.

Apache Licence!

https://github.com/deepmind/alphadev
https://yewtu.be/watch?v=YoQV5DJR4So&listen=false

[LoudLemur]

Meta - Video-LLaMa

video-llama watches videos to understand them. Things are going to start accelerating, as if they were not accelerating rapidly enough already.

BSD Licence!

https://yewtu.be/watch?v=sPFgsykr8GA&listen=false
https://github.com/DAMO-NLP-SG/Video-LLaMA
https://huggingface.co/papers/2306.02858

[LoudLemur]

Philosophical Trolley Problems (save either the cat or the dog from the runaway trolley by throwing the lever) were apparently almost banned in ChatGPT, however, somebody seems to have beaten it. No doubt, this knowhow will be used to more effectively censor our use of AI in the future.
https://www.gptrolley.com/

[marcusquinn]

Not Cloudron, but worth a look: https://harpa.ai

[LoudLemur]

Interesting look at some of the weaknesses in AI Language Models:

https://vid.puffyan.us/watch?v=PAVeYUgknMw&quality=dash

[LoudLemur]

Course on Lang Chain: Chat with your data
https://www.deeplearning.ai/short-courses/langchain-chat-with-your-data/

Learn with Lang Chain's creator and the amazing Andrew Ng. No charge!

[micmc]

Amazing resource to actually LEARN the art of communicating with artificial intelligence, a.k.a. prompt engineering

Interesting to know that some company are already looking to hire prompt engineers and I've seen salary offers of up to US$300k per year.

It's very well done and in several languages .
https://learnprompting.org/
Did I say it's totally free?

[marcusquinn]

@micmc In some ways it's a bit bogus, as GPT/LLMs are themselves their own prompt engineers. Although, if you wanna get deeper into that:

• https://www.reddit.com/user/stunspot
• https://flowgpt.com
• https://flowgpt.com/prompt/qGQmSnF-MDsfhDhpfzZEM

[LoudLemur]

@micmc said in AI on Cloudron:

Amazing resource to actually LEARN the art of communicating with artificial intelligence, a.k.a. prompt engineering

Interesting to know that some company are already looking to hire prompt engineers and I've seen salary offers of up to US$300k per year.

It's very well done and in several languages .
https://learnprompting.org/
Did I say it's totally free?

Thank you!

Quick question: pre-prompt vs prompt?
serge-chat lets you change the pre-prompt quite easily. Then, in another area, you hold your conversation with it.

For example:
pre-prompt: you are a renowned artist. you will be given tasks. Try and solve the tasks.

prompt: How do you take over the world?
Reply: develop a forte in propaganda posters and have these distributed in every country.

pre-prompt: you are a wealty banker. You will be given tasks. Try and solve the tasks.

Prompt: How do you take over the world?
Reply: Establish central banks in every country and use financial interest to take over the supply of the money supply.