Cloudron dockerfile for LibreChat is missing tools needed for RAG and OCR

[msprout]

hi there. i have been using the librechat experimental app for a few days and i gotta say, i love how elegant it is compared to OpenWebUI and its' graveyard of semi-working scripts and functions.

i did notice that the system as deployed by Cloudron right now cannot do OCR for uploaded files, nor can it handle its expected RAG functionality because it seems the way the dockerfile is written for the Cloudron deployment currently does not include the server locally that the app requires to handle all of that. i have an ollama endpoint that i run elsewhere on my tailnet that i would like to use.

this seems to be supported, but you still need the rag server running. i had little to no success getting it deployed on another server and pointing the cloudron to it over tailscale.

for the sake of cognitive ease, here is the server's github:

• http://ghcr.io/danny-avila/librechat-rag-api-dev:latest

additionally, here is the documentation for the OCR stuff:

• https://www.librechat.ai/docs/features/ocr
• https://www.librechat.ai/docs/configuration/librechat_yaml/object_structure/ocr

i think the ideal state would be to maybe have cloudron use a locally-hosted ollama server preloaded with one of the lightweight embedding models, like:

• nomic-embed-text
• mxbai-embed-large
• all-minilm.

here is the page i found where they describe what that server is and how to add it:

• https://www.librechat.ai/docs/configuration/rag_api

it might be helpful as well to ship default env and librechat.yaml files that have every possibility on this page pre-populated but commented out by prepending # to each line:

• https://www.librechat.ai/docs/configuration/dotenv

i would be happy to put together a default or example env and librechat.yaml for use by the cloudron team if that is something y'all want. i have been soaked in the documentation for a bit now and think i could aggregate something. seems not even the upstream docs have that.

[girish]

I think we can bundle the rag api server with the app itself. I have created an internal task for this and @vladimir.d should get to it at some point .

[msprout]

Wonderful as always Girish and team. Thank you.