AWS Bedrock Access Gateway for OpenWebUi

[jagan]

Nova is here!

Cloudroners, unless you are living under the rock, you might have been hit with the launch of the Amazon Nova - that is matching or beating existing frontier models and is multimodal from the start go.

So, naturally, the only next question is, how do we get access to this emergent model at the lowest cost and ease of use.

OpenWebUi, fortunately has been a great boon. I have typingmind and half a dozen other AI Chat Wrapper Apps, and none of them are as powerful as OpenWebUi - but am preaching to the choir here.

OpenWebUi is, as per my searches, currently, the easiest way to directly access the cheap Nova. What we need is the Amazon Bedrock Access Gateway that we can add to the OpenWebUi that also allows us to access not only Nova, but also Anthropic, Meta, Cohere, Stability and others.

What is Bedrock?

From online:
Amazon Bedrock is a fully managed service that provides access to a wide range of high-performing foundation models (FMs) from leading AI providers like Anthropic, Cohere, and Stability AI. This allows you to select the best model for your specific use case, whether you’re analyzing internal documents, questioning financial records, or processing customer information. Importantly, Amazon Bedrock is designed with a focus on security, privacy, and responsible AI practices, ensuring your sensitive data remains protected.

Here are some reading on how to connect OpenWebUi with Bedrock and other details:

https://gauravve.medium.com/connecting-open-webui-to-aws-bedrock-a1f0082c8cb2
https://jrpospos.blog/posts/2024/08/using-amazon-bedrock-with-openwebui-when-working-with-sensitive-data/

---

Please upvote my entry to the App Wishlist to get Bedrock on Cloudron.
https://forum.cloudron.io/topic/13032/amazon-aws-bedrock-access-gateway-for-connecting-with-webopen-ui-other-applications

Thank you!