Amazon Bedrock

Bedrock is wired as the bedrock/* wildcard. Unlike single-key providers it authenticates with AWS IAM credentials.

Activation

An administrator adds the AWS credentials to the gateway configuration and reloads the gateway:

AWS_ACCESS_KEY_ID=AKIA…
AWS_SECRET_ACCESS_KEY=…
AWS_REGION_NAME=us-east-1

AWS-side requirements

  1. The IAM user/role needs the bedrock:InvokeModel permission.
  2. In the AWS Bedrock console → Model access, request/enable each model family you want (Anthropic, Meta, Amazon Titan, …) in the chosen region — Bedrock blocks models until access is granted.

Calling Bedrock models

bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0
bedrock/meta.llama3-1-70b-instruct-v1:0
bedrock/amazon.titan-text-premier-v1:0

Bedrock models can be placed in Auto-Switch tier pools like any other model id.