AI on Cloudron

[humptydumpty]

I was reading through localai.io github pages and it mentions this nifty tool for upscaling images (Upscayl). It converted a 640px image to 2560px and the detail improvement is insane. No more blurriness or pixelation, and it even enhances the colors to make it "pop". I used the ULTRASHARP mode. The first (default) mode in the list does the same job minus the color pop. Here are the images for comparison.

640px ring

---

2560px upscayle + compressed (TinyPNG; forum limits size to 4MB)

[micmc]

Talking about LocalAI.io There is now a OpenAI plugin that can be added to OnlyOffice in NextCloud.
You can use OpenAI API by putting your API key, but it can also be use, and this is what they even recommend, with a LocalAI instance running on the same server as NextCloud.

I guess we should start looking if a local instance of LocalAI could be run smoothly on a LAMP instance on Cloudron, and even be added as an app to Cloudron since it is built to run on Docker already?

[robi]

@micmc https://forum.cloudron.io/topic/9399/how-to-run-ai-models-in-lamp-app

[micmc]

@robi said in AI on Cloudron:

@micmc https://forum.cloudron.io/topic/9399/how-to-run-ai-models-in-lamp-app

Exactly what we need to deepened right!
Thanks mate.

[LoudLemur]

Stackoverflow usage has plummeted with people switching to AI for solutions, so they have now launched Overflow AI:

https://stackoverflow.co/labs/

[LoudLemur]

@micmc said in AI on Cloudron:

Then recently in the latest major release of NextCloud they've added an OpenAI integration module.

Nextcloud have an article on this:
https://nextcloud.com/blog/ai-in-nextcloud-what-why-and-how/

[LoudLemur]

Prompt Engineering World Championships:
https://app.openpipe.ai/world-champs/signup

RoboCup 2023 - AI/Robot football:
https://www.robocup.org/
https://vid.puffyan.us/watch?v=vwIuQKKg-sY&quality=dash

[LoudLemur]

Nvidia reveal new chip:
https://nvidianews.nvidia.com/news/gh200-grace-hopper-superchip-with-hbm3e-memory

[LoudLemur]

Useful collection of AI prompts:
https://huggingface.co/datasets/fka/awesome-chatgpt-prompts

[LoudLemur]

Has anybody had success finetuning a language model so that it becomes an expert on local data? What free software tools were used and was it an enjoyable, fruitful process?

[micmc]

@LoudLemur said in AI on Cloudron:

Has anybody had success finetuning a language model so that it becomes an expert on local data? What free software tools were used and was it an enjoyable, fruitful process?

For my part, I'd been trying to play a little but not much yet, I'm actually busy working on developing and launching a SaaS Web UI through API connections to different LLM providers.
The service makes it very easy to anyone to create content (and well, much more like consulting with powerful coach bots in several fields) with a few clicks, and answering a few questions.
Local data labs is next...

[LoudLemur]

@micmc https://www.deeplearning.ai/short-courses/finetuning-large-language-models

[LoudLemur]

Fine-Tuned CodeLlama-34B now beats ChatGPT4 on HumanEval.
https://www.phind.com/blog/code-llama-beats-gpt4

https://huggingface.co/Phind

https://huggingface.co/sbeall/Phind-CodeLlama-34B-v1-q5_K_M-GGUF/tree/main

You can run it on Ollama today:
https://ollama.ai/library/phind-codellama/tags

OpenRouter allows you cheap access to Free Software Language Model APIs:
https://openrouter.ai/docs#models

[LoudLemur]

Falcon-180b (that is 180 billion parameter) Free Software model has now been released.
This is the chat version:

https://huggingface.co/tiiuae/falcon-180B-chat

The open source dataset was created in the UAE through a process of web crawling and stringent filtering out of "adult" sites based on their URL. It is multi-modal friendly with image tagging.

The main site is being absolutely hammered at the moment. Archive:
https://archive.ph/trCCZ

This is by far the largest Free Software model available at the moment, and it is outperforming Llama 2.

500GB download, 2.8TB storage after unpacking, 400 GB of memory will be needed to swiftly run inference o Falcon-180B.

"I think we are going to need a bigger boat."

Demo: https://huggingface.co/spaces/tiiuae/falcon-180b-demo

[LoudLemur]

Petals.dev

Run large language models, including Falcon-180b, bittorrent style:
https://petals.dev/

[micmc]

@LoudLemur said in AI on Cloudron:

500GB download, 2.8TB storage after unpacking, 400 GB of memory will be needed to swiftly run inference o Falcon-180B.

I'm going to install 2 right away!

[LoudLemur]

OpenAI ChatGPT Enterprise:
https://openai.com/blog/introducing-chatgpt-enterprise

We’re launching ChatGPT Enterprise, which offers enterprise-grade security and privacy, unlimited higher-speed GPT-4 access, longer context windows for processing longer inputs, advanced data analysis capabilities, customization options, and much more.

[LoudLemur]

Talk to President Obama: https://gptcall.net/

[LoudLemur]

Chat with AI Characters Offline.
Runs locally. Zero-configuration.
https://faraday.dev/

This library aims to help make gguf downloading/management easier:
https://github.com/ahoylabs/gguf.js

[nebulon]

@LoudLemur said in AI on Cloudron:

Talk to President Obama: https://gptcall.net/

This is indeed quite fun!