Notice of Change in Region Specifications for Amazon Bedrock Model Usage
Important notice for customers using Amazon Bedrock's Claude models with AI-Starter.
Following the availability of some Claude 3 series models in ap-northeast-1 (Tokyo region), we are working on corresponding updates for AI-Starter. In the upcoming version (v2.4.5), we will be making the following specification changes.
Changes
| Model | Current Specification | New Specification | Change |
|---|---|---|---|
| Claude 3.5 Sonnet | Fixed to us-east-1 (Northern Virginia region) | Region specified by bedrock_region in the secret | Yes |
| Claude 3 Opus | Fixed to us-west-2 (Oregon region) | Fixed to us-west-2 (Oregon region) | No |
| Claude 3 Sonnet | Region specified by bedrock_pre_region in the secret | Region specified by bedrock_pre_region in the secret | No |
| Claude 3 Haiku | Region specified by bedrock_pre_region in the secret | Region specified by bedrock_region in the secret | Yes |
| Claude 2.1 | Region specified by bedrock_region in the secret | Region specified by bedrock_region in the secret (to be deprecated soon) | Yes |
Secrets are managed in AWS Secrets Manager. For information on how to change the secrets themselves, please contact our designated support desk.
Request
Please check the models you are using and cooperate with the model activation work in the target regions according to the new specifications.
For example, if you are using Claude 3.5 Sonnet, it will refer to the region specified by bedrock_region in the secret.
Therefore, you need to activate the Claude 3.5 Sonnet model in the region specified by bedrock_region.
- The region specified by
bedrock_regionis typically ap-northeast-1 (Tokyo region). - The region specified by
bedrock_pre_regionvaries depending on your environment, so please confirm.
For the model activation process, please refer to the following steps.
Deadline
- By Tuesday, September 10, 2024
- We may implement the changes earlier than the above deadline if all customers complete their work.
Additional Information
Amazon Bedrock's Cross-Region Inference feature was recently released. This feature allows you to use the same model in a different region when a model in one region is throttled. Additionally, this feature has made Claude 3 Opus available in us-east-1 (Northern Virginia region).
The status of Cross-Region Inference feature support in AI-Starter is as follows:
- The current AI-Starter does not support the Cross-Region Inference feature as it requires dedicated system modifications.
- For the time being, you can continue to use Claude 3 Opus with the existing mechanism (using the us-west-2 region).
Our policy regarding the Cross-Region Inference feature support in AI-Starter is as follows:
- We will maintain the existing mechanism while considering possibilities for future improvements.
- We will gradually expand functionality based on the roadmap, taking priorities into account.
We will continue to improve our services to better meet your needs. We welcome your opinions and requests. We appreciate your understanding and cooperation regarding these specification changes and related work.