Amazon AWS Bedrock Access Gateway - for connecting with WebOpen UI & other applications

jagan

Main Page: https://aws.amazon.com/bedrock/
Git: https://github.com/aws-samples/bedrock-access-gateway/blob/main/src/Dockerfile_ecs
Licence: ? AGPL ? (I am not sure)
Docker: Yes
Demo: https://aistylist.awsplayer.com/

Summary: Now that Amazon Nova is performing at par with Claude Sonnet 3.5 and beating all other leading models from OpenAI, Google Gemini, we need the AWS Bedrock Access Gateway so that we can connect our OpenWebUI to AWS and take advantage of the multimodal capabilities of Nova at low prices (apparently 75% cheaper)

Notes: The AWS Bedrock Access Gateway also provides access to all models of Anthropic, Cohere, as well as Meta's (Llama2/3), Mistral/Mixtral, etc at cheaper cost.
Running Ollama locally is not ideal since most of us don't run our Cloudron on servers with GPU. Instead, we can access Ilama at great cost savings as well as privacy by using AWS Bedrock's Llama.
The application is very stable and enterprise ready (Amazon quality assurance) - so we can jump in right away without waiting for bug fixes and such.

Tutorial on how to connect Bedrock Access Gateway to OpenWebUI: https://jrpospos.blog/posts/2024/08/using-amazon-bedrock-with-openwebui-when-working-with-sensitive-data/

Cloudron Forum