Amazon AWS Bedrock Access Gateway - for connecting with WebOpen UI & other applications
-
- Title: Amazon AWS Bedrock Access Gateway - for connecting with WebOpen UI
- Main Page: https://aws.amazon.com/bedrock/
- Git: https://github.com/aws-samples/bedrock-access-gateway/blob/main/src/Dockerfile_ecs
- Licence: ? AGPL ? (I am not sure)
- Docker: Yes
- Demo: https://aistylist.awsplayer.com/
- Summary: Now that Amazon Nova is performing at par with Claude Sonnet 3.5 and beating all other leading models from OpenAI, Google Gemini, we need the AWS Bedrock Access Gateway so that we can connect our OpenWebUI to AWS and take advantage of the multimodal capabilities of Nova at low prices (apparently 75% cheaper)
- Notes: The AWS Bedrock Access Gateway also provides access to all models of Anthropic, Cohere, as well as Meta's (Llama2/3), Mistral/Mixtral, etc at cheaper cost.
- Running Ollama locally is not ideal since most of us don't run our Cloudron on servers with GPU. Instead, we can access Ilama at great cost savings as well as privacy by using AWS Bedrock's Llama.
- The application is very stable and enterprise ready (Amazon quality assurance) - so we can jump in right away without waiting for bug fixes and such.
- Tutorial on how to connect Bedrock Access Gateway to OpenWebUI: https://jrpospos.blog/posts/2024/08/using-amazon-bedrock-with-openwebui-when-working-with-sensitive-data/
- Screenshots:
-
J jagan referenced this topic on
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login