<![CDATA[LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc]]>
  • LiteLLM: LLM Gateway on Cloudron - provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.
  • Summary: LiteLLM exposes an OpenAI compatible API that proxies requests to other LLM API services. This provides a standardized API to interact with both open-source and commercial LLMs.

This can be a self-hosted alternative to OpenRouter.
Any application - including OpenWebUI (on CLoudron) can use this OpenAI compatible API endpoint to access over 100 integrations from OpenAI, Amazon Bedrock, Anthropic models, Google Gemini models, Grok, Deepseek, etc.

  • Notes: This would make any of the AI on cloudron or outside (e.g. Khoj) very powerful, bridge the divide between models as they are released and afford us access easily through a single API.

This is superpower, AI on steroids, giving us access to leverage the comparive advantage of each AI model (e.g. Claude for programming, Deepseek for cheapness and Bedrock for longer context window and memory, etc.

]]>https://forum.cloudron.io/topic/13141/litellm-openrouter-self-hosted-alternative-proxy-provides-access-to-openai-bedrock-anthropic-gemini-etcRSS for NodeSat, 14 Mar 2026 09:25:07 GMTSat, 18 Jan 2025 03:54:48 GMT60<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sat, 21 Feb 2026 20:54:50 GMT]]>@marcusquinn Worth a look? Seems to be better in theory? Did you maybe tried both, does any-llm offer sames functionalities?

]]>https://forum.cloudron.io/post/120565https://forum.cloudron.io/post/120565Sat, 21 Feb 2026 20:54:50 GMT<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sun, 27 Jul 2025 14:50:12 GMT]]>@necrevistonnezr Nice find. That is very interesting!

]]>https://forum.cloudron.io/post/110752https://forum.cloudron.io/post/110752Sun, 27 Jul 2025 14:50:12 GMT<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sun, 27 Jul 2025 05:37:08 GMT]]>LiteLLM is quite interesting as it has a Presidio plugin (https://docs.litellm.ai/docs/proxy/guardrails/pii_masking_v2), i.e. it can mask PII (Personally Identifiable Information), PHI (Protected Health Information), and other sensitive data before sending data to a LLM - think anonymizing a document before having it analyzed by an LLM. That can make Gemini, Claude etc usable under GDPR jurisdiction.

]]>https://forum.cloudron.io/post/110744https://forum.cloudron.io/post/110744Sun, 27 Jul 2025 05:37:08 GMT<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sun, 27 Jul 2025 03:20:40 GMT]]>@jagan Might also be worth a look:

d63514c2-50a9-40a3-82ac-ff6a5cbab621-image.png

]]>https://forum.cloudron.io/post/110739https://forum.cloudron.io/post/110739Sun, 27 Jul 2025 03:20:40 GMT<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sat, 26 Jul 2025 18:23:02 GMT]]>Agreed. This would be a great app IMO.

The ideal set & forget self-hosted AI API routing setup and controller for all the other AI apps we will inevitably start to rely on.

Could do with this to make LibreChat more useful in setup and minimising .yml maintenance, too:

]]>https://forum.cloudron.io/post/110731https://forum.cloudron.io/post/110731Sat, 26 Jul 2025 18:23:02 GMT<![CDATA[Reply to LiteLLM - OpenRouter Self-Hosted Alternative proxy provides access to OpenAI, Bedrock, Anthropic, Gemini, etc on Sat, 18 Jan 2025 04:01:10 GMT]]>LiteLLM was earlier integrated into OpenWebUI and was marvellous.
It was removed recently and I had posted about it here: https://forum.cloudron.io/topic/11957/litellm-removed-from-openwebui-requires-own-separate-container

Now, having successfully tested the docker, wish it could be on Cloudron and can act as proxy for all of our AI applications that require API access to any AI provider.

This would be fantastic - one application to rule them all!

]]>https://forum.cloudron.io/post/100140https://forum.cloudron.io/post/100140Sat, 18 Jan 2025 04:01:10 GMT