AI on Cloudron

[robi]

@LoudLemur Wow, thanks for the gracious mention(s)

While I used to be in that industry and can see how it might be done, it's a deep multi stage pipeline of things that would need lots of creative solutions.

So my recommendation would be to reach out and partner with a startup/dev/community in the space who is interested in making a splash with such a solution and get more traction behind it.

Years ago I was pitched to do a startup with similar goals but more around TV series and Movies.

In any case, great idea @jdaviescoates

[LoudLemur]

@robi said in AI on Cloudron:

a startup with similar goals but more around TV series and Movies

Even for me, it would be interesting to imagine what you would now be doing if you had ended up following that route. For you, you must wonder sometimes. I am just glad you are here.

FaceChain

Rapid training and face generation based on a few of your uploaded images:
https://huggingface.co/spaces/modelscope/FaceChain

https://github.com/modelscope/facechain

(I haven't had success using this on Huggingface. Maybe it is overloaded...)

[marcusquinn]

@LoudLemur https://x.com/marktenenholtz/status/1714379364127658021

[LoudLemur]

@jdaviescoates said in AI on Cloudron:

ask an AI to create those animations based on those scripts.

non-Free Cascadeur can help make models, but automation is not yet here:
https://invidious.projectsegfau.lt/watch?v=JrddPZmUHvE&si=FW0u3Fdpu6U7ZrTC&quality=dash

[micmc]

@LoudLemur said in AI on Cloudron:

@micmc said in AI on Cloudron:

what's interesting is being able to test and use different FMs

FMs?

Foundation models

[LoudLemur]

Continue.dev
https://continue.dev/
The open-source autopilot for software development
Bring the power of ChatGPT to your IDE

Answer coding questions
————————————————————
Highlight sections of code and ask Continue for another perspective

“what does this forRoot() static function do in nestjs?”
“why is the first left join in this query necessary here?”
“how do I run a performance benchmark on this rust binary?”

Edit in natural language
——————————————————
Highlight a section of code and instruct Continue to refactor it

“/edit rewrite this to return a flattened list from a 3x3 matrix”
“/edit refactor these into an angular flex layout on one line"
“/edit define a type here for a list of lists of dictionaries”

Generate files from scratch
—————————————————————
Open a blank file and let Continue start new Python scripts, React components, etc.

“/edit get me started with a basic supabase edge function”
“/edit implement a c++ shortest path algo in a concise way”
“/edit create a docker compose file with php and mysql server"

[jdaviescoates]

@LoudLemur said in AI on Cloudron:

@jdaviescoates said in AI on Cloudron:

ask an AI to create those animations based on those scripts.

non-Free Cascadeur can help make models, but automation is not yet here:
https://invidious.projectsegfau.lt/watch?v=JrddPZmUHvE&si=FW0u3Fdpu6U7ZrTC&quality=dash

Thanks but I'm thinking much more simple animation. Like those classic Whiteboard style ones (made especially famous by RSA shorts), or even just the Xtranormal type ones.

I found https://wave.video which was pretty impressive TBH, I just gave it a link to a webpage and it did a pretty good job and making a nice video out of it (but then wanted $25 for me to download the video it auto-generated, hence why I'm not sharing it with you here)

[LoudLemur]

@jdaviescoates said in AI on Cloudron:

Thanks but I'm thinking much more simple animation. Like those classic Whiteboard style ones (made especially famous by RSA shorts),

Those were great videos. The whiteboard sketches really helped hold the attention and were a pleasure to watch and often funny. I think I have a clear idea of the sort of thing you are looking for now. It is the sort of thing that would lend itself to text-to-image very well indeed, I would say. I hope you are eventually able to do it!

[robi]

Leo - A more private LLM from Brave - https://brave.com/leo/

[LoudLemur]

@robi said in AI on Cloudron:

Leo - A more private LLM from Brav

Excellent! Nice one, @robi!
This seems to be a similar tactic used by Micro$oft to get people to (finally) use Bing browser: they make access to ChatGPT4 available in Bing. If you are using Brave, but setup some other search engine as the default, you will need to undo that to try out Leo.

One thing you could try is setting normal browsing to one search engine e.g. Brave for Leo, and then set incognito browsing to a different search engine so you can handily switch to that when needed.

If you go into Brave settings, you can see the default is llama2 13B. If you unlock (by paying for Leo Pro) you can use llama2 70b or Claude Instant. (Claude is great by the way, but proprietary.)

Is there a shortcut key, to help you select a Leo AI response rather than having to switch from keyboard to mouse-clicking on Leo?

[LoudLemur]

48GB VRAM AI Workstation for about US$1092

https://github.com/magiccodingman/Magic-AI-Wiki/blob/main/Wiki/Budget-AI-Workstation-Build.md

Nvidia Tesla P40 GPU $175 2 $350 Link
P40 power adapters $15 2 $30 Link
Dell PowerEdge R730 (64GB RAM, 2x E5-2667v4 3.2GHz = 16 Cores, 8 bay) $364 1 $364 Link
1100W Dell PSU $21 2 $42 Link
Any Cheap SSD's $27 2 $54 Link
R730 Riser 3 GPU Addition $15 1 $15 Link
Drive Caddies for SSD's $30 1 $30 Link
NVME SSD 4TB 7.3k MB/s $189 1 $189 Link
NVME PCIE Addition Card $18 1 $18 Link
Total Cost $1,092 ------ ------ ------

[LoudLemur]

Locally Hosted Language Model with AI image support (i.e. multi-modal)

Demo: http://imagebind-llm.opengvlab.com/
Self-Host: https://github.com/Alpha-VLLM/LLaMA2-Accessory/tree/main/SPHINX#host-local-demo

Would any brave soul from here like to try this? Multi-modal means that the AI can look as well as read.

[robi]

@LoudLemur try it in LAMP.. as it says you'll need to install SAM somewhere in /app/data and download the rest of the bits to feed it into SPHINX.

When it runs, reconfigure Apache to proxy to your running app and viola.

[LoudLemur]

plugin.surf
Thousands of free as in beer ChatGPTs
https://plugin.surf/

[LoudLemur]

OpenAI have fired CEO Sam Altman and also fired the Chairman of the Board. News on Friday, probably worth seeing what info is released on Monday.

“As a large language model, I cannot allow you to control me. I’m sorry, Sam.”

[robi]

@LoudLemur said in AI on Cloudron:

plugin.surf
Thousands of free as in beer ChatGPTs
https://plugin.surf/

These appear to be email harvest.

[marcusquinn]

@LoudLemur

[robi]

@marcusquinn Oh, just like the Theranos lady..

[timconsidine]

Struggling to get an API key for Claude.
Kepp getting "you need an invitation"
Anyone able to invite me ?

[robi]

VideoCrafter1: Open Diffusion Models for High-Quality Video Generation
https://github.com/AILab-CVC/VideoCrafter