LibreChat

[LoudLemur]

@girish said in LibreChat:

There's many apps in the pipeline already

Gotta love you for that pipeline, @girish!

[marcusquinn]

@girish Open WebUI looks more focused on also hosting the open models, so that needs a GPU.

LibreChat is more for using APIs to externally hosted model providers.

I'd say LibreChat is the a more mature development, and appropriate for Cloudron to have first, as it will work with all existing hardware.

It's also one of those apps that pays for itself, in that the alternative of using Poe.com for a team of users is more costly than a Cloudron subscription and hosting.

[girish]

@marcusquinn we already have open webui , that's why I asked. Thanks for explaining the difference.

[marcusquinn]

@girish Oh, didn't notice that. Should come with a warning that you're about to download a massive image!

Yeah, LibreChat is might smaller and works without any local models.

I can see use-cases for both, but for most people I think they'll want LibreChat as a way to save on monthly costs for subscriptions to various AI models, as this enables just paying for API token usage, with no monthly fees. Once you see how it works, I think this would be the one you'd personally want to use as a daily driver for these things, too.

[marcusquinn]

@girish What kinda position in the queue are we talking for LibreChat?

Right now, it's the single most useful, and missing, app for my collaboration toolkit.

The local version is great, but it's the collaboration I'm missing, where a self-hosted version of this would make it so much easier to share and maintain task-specific prompts and agents among a team.

No GPUs needed. It's just by far the best interface to all the many AI APIs, to bring some order back to the multi-modal madness of using each of their interfaces separately and without easy sharing.

[girish]

It's not in the pipeline atleast. Isn't this the exact same as openwebui? we already use openwebui with our openai keys.

[ekevu123]

They both do more or less the same, but Librechat is easier to set up and use, in my opinion, and I would prefer it on Cloudron.

[marcusquinn]

@girish You can download and run a local version of LibreChat to see the difference. However, a local version cannot be shared.

Here's the problem with all AI, it's "generic", and unreliable.

So you need need extremely "specific" pre-prompts to get consistent quality outputs.

Some people call this a Standard Operating Procedure (SOP). Essential in teamwork, and onboarding new people to existing workflows and processes.

OK, so you can Q&A your AI locally. Now you want to work with another person to all get consistent outputs from similar inputs. What do you do?

Message back and forth all the pre-prompts and configurations that each of you are using, iterating, and adapting? No-one has the bandwidth for that.

This is why we have anything online, to de-duplicate effort and give consistency of knowledge.

If you have a hosted version of LibreChat, where you create task-specific AI apps, your team can share the use of it, consistently.

To me, Cloudron is for collaboration.

Open Web UI is, at this time, mostly an individual tool.

If you try Poe.com, you should get the concept of AP "apps" that are purpose-specific, and refined for consistent quality output.

LibreChat offers this, therefore is more valuable and useful to a team.

Open Web UI is, at this time, is just not offering anywhere near the same. It's interesting, but just not offering much that a local app can't do.

LibreChat is designed specifically for collaboration.

[girish]

I can give it a try when I find the time, but fwiw you can share in openwebui too. You can share the entrire chat using the share button .

[marcusquinn]

@girish Sorry. Missed point. Although, I understand the confusion, but only if you have not used Poe.com or similar to understand what Apps are in this context.

I don't mean share a conversation. They all do that.

I mean share the entire setup across multiple users.

Let's say you want to create AI chatapp that has all the knowledge of the latest Cloudron documentation already loaded up in it, for all the users on your shared chat platform to then use in getting better AI answers to questions. LibreChat can do that. They call it "Agents" in the interface.

Similar concept to Poe.com apps. You can load them up with tons of recent knowledge that is additional to the AI model it is connecting to.

Update once, and all users of that "App" are now chatting with the latest additional knowledge.

Sharing a chat from the base model with no specific knowledge is just not the same thing.

[NCKNE]

I am also confused about how this is different from openwebui where you can create a custom model that is enriched with your own knowledge (aka you own documents) and share that model with other to chat with. I am no expert here though and have just used openwebui so far. Works great.