LocalAI on Cloudron: OpenAI compatible API to run LLM (Large language Models) models locally on consumer grade hardware

[LoudLemur]

"Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. LocalAI is a RESTful API to run ggml compatible models: llama.cpp, alpaca.cpp, gpt4all.cpp, rwkv.cpp, whisper.cpp, vicuna, koala, gpt4all-j, cerebras and many others"

MIT Licence
There is a Docker

https://github.com/go-skynet/LocalAI
https://nitter.net/LocalAI_API

Example setup with chatbot-ui
https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui

Example setup with GPT4All
https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui

[marcusquinn]

Much prefer Chatbot UI to to OpenAI's own interface.

[jdaviescoates]

LocalAI is now on v2.27.0 and there have been updates to their All in One images

https://github.com/mudler/LocalAI/releases/tag/v2.27.0