Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content

OpenWebUI

30 Topics 219 Posts
  • OpenWebUI - Package Updates

    Pinned
    57
    1 Votes
    57 Posts
    3k Views
    Package UpdatesP

    [2.5.1]

    Update OpenWebUI to 0.3.22 Full changelog
  • Is the app still unstable?

    3
    1 Votes
    3 Posts
    49 Views
    girishG

    The Open Web UI project initially started out as a Ollama frontend. To run local models, one needs GPU support and Cloudron currently does not have GPU support. Over time, Open Web UI has shifed to be a frontend for OpenAI API compatible services . It is also now possible to configure Ollama in another computer which has a GPU and then point Open Web UI to use that Ollama.

    I guess we can mark this as stable since it's still useful while we figure out GPU support in Cloudron.

  • `NLTK_DATA` variable not working

    1
    0 Votes
    1 Posts
    13 Views
    No one has replied
  • RAG not working anymore

    3
    0 Votes
    3 Posts
    48 Views
    LanhildL

    @vladimir-d In the future, I believe we should let the app handle most of it's configuration, environment-wise.

    Variables such as RAG_EMBEDDING_MODEL, etc. are all set via the application UI and saved in the config.json file.

    Now, for the initial issue of this topic, I've solved it by resetting the embedding model engine.

  • ETA for GPU support? Could we contribute to help it along?

    7
    3 Votes
    7 Posts
    124 Views
    R

    @LoudLemur said in ETA for GPU support? Could we contribute to help it along?:

    @girish said in ETA for GPU support? Could we contribute to help it along?:

    I think the hard part is the GPU support in docker is varied.

    From Arya:

    "As of 2023, GPU support in Docker, particularly for AI applications, has made significant strides but still faces challenges. The main issue is that Docker was originally designed for CPU-based applications and struggled to efficiently utilize GPU resources. ...

    Thanks for that info, I wasn't aware of that challenge but it certainly makes sense.

    The Open WebUI installation page talks about running the Docker image with GPU support but doesn't mention those problems: https://docs.openwebui.com/getting-started/

  • Latest Release 0.3.16

    Solved
    4
    0 Votes
    4 Posts
    63 Views
    J

    @firmansi not needed. apps are packaged as containers that have the right dependencies

  • Problem with JSON rResponse

    1
    0 Votes
    1 Posts
    29 Views
    No one has replied
  • LiteLLM removed from OpenWebUI, requires own separate container

    5
    1 Votes
    5 Posts
    291 Views
    C

    LiteLLM is getting fairly mainstream imo (although things are moving very fast) and does more stuff than just accessing other models (load balancing, logging, spending checks…) so have a LiteLLM process started besides OpenWebUI would be useful.
    In the meantime, I've followed this specific comment (https://github.com/open-webui/open-webui/issues/3288#issuecomment-2219524566) from the thread and I was able to get the anthropic/claude models with just configuration of openwebui, so that's already a bit of a win.

  • is /data/docs the right path ?

    6
    1 Votes
    6 Posts
    650 Views
    nebulonN

    @Jack-613 this is a Cloudron related forum, so if you are not using OpenWebUI on Cloudron, then you should probably ask in the upstream project instead.

  • Something seems broken / can't download models

    Solved
    8
    0 Votes
    8 Posts
    143 Views
    J

    😖

  • Continue.dev and OpenWebUI

    3
    1 Votes
    3 Posts
    103 Views
    marioM

    Ah ok. I was under the impression that ollama was listening just on the localhost inside this app. If its not, this would work then. I'll test.

  • Which models know most about Doughnut Economics?

    10
    3 Votes
    10 Posts
    394 Views
    humptydumptyH

    @eddowding said in Which models know most about Doughnut Economics?:

    Does it matter much if you can add docs to them and have them answer intelligently?

    I tried that yesterday. It didn't help in the slightest.

  • OpenWebUI + Anthropic / Claude

    Moved
    2
    2 Votes
    2 Posts
    320 Views
    E

    Answering my own question - yes - follow this: https://github.com/open-webui/open-webui/issues/3288

  • Web Search with Searxng

    7
    2 Votes
    7 Posts
    150 Views
    J

    @taowang maybe worth reporting upstream? I think config.py is source code and not a configurable file. Even in their docker it's not stashed.

  • Using Mistral API seems broken on cloudron

    Solved
    9
    1 Votes
    9 Posts
    330 Views
    micmcM

    @shrey said in Using Mistral API seems broken on cloudron:

    @nebulon Thanks!
    Indeed, that was it.

    RAM was set at 2GB. Whereas, it seems to require a min. of 5.5GB to function.

    That's right, and if you can provide it with at least 8-16GB of RAM you will see a huge difference. These things are meant to consume large resources for now, but it's getting better.

  • 0 Votes
    3 Posts
    98 Views
    J

    I already have a volume, but I will create one more and mount it!

  • 0 Votes
    2 Posts
    90 Views
    girishG

    Dup of https://forum.cloudron.io/topic/11988/openwebui-permissions-issue-after-last-2-2-5-update-cannot-create-directory-media-ollama-vol

  • When I try to upload documents: Permission denied: '/root/nltk_data'

    3
    1 Votes
    3 Posts
    138 Views
    girishG

    @JOduMonT yeah, I think you are on the old package. Please start another instance. In the latest package, we have fixed the NLTK download directory.

  • Since new update i can't log in anymore

    5
    0 Votes
    5 Posts
    192 Views
    D

    @girish There is no problem. We lost all the content of our conversations on OpenWebUI, but we prefer that it happens now rather than in six months and after six months of use. More stability, we will always be for it and it is better that it is done at the beginning as now.

  • Seems to be some version issues with Ollama and OI

    2
    0 Votes
    2 Posts
    108 Views
    CptPlasticC

    This is what was updated in Cloudron

    image.png