Hi @Lanhild sorry to hijack this thread, but can you please have a look at packaging LiteLLM please?
LiteLLM already has Langfuse built in, so this might be interesting to you.
Link to App Wishlist: https://forum.cloudron.io/topic/13141/litellm-openrouter-self-hosted-alternative-proxy-provides-access-to-openai-bedrock-anthropic-gemini-etc?_=1737171723819