[FEATURE] Support Amazon Bedrock Claude Sonnet 3.5

[JSON-OBJECT]

Issue

I hope it will be available not only through Anthropic but also through Amazon Bedrock.
https://aws.amazon.com/blogs/aws/anthropics-claude-3-5-sonnet-model-now-available-in-amazon-bedrock-the-most-intelligent-claude-model-yet/

Version and model info

No response

[paul-gauthier]

Thanks for trying aider and filing this issue.

Aider should be able to connect to Bedrock. Aider uses litellm to connect to APIs. See their docs:

https://litellm.vercel.app/docs/providers/bedrock

[JSON-OBJECT]

Thanks for trying aider and filing this issue.

Aider should be able to connect to Bedrock. Aider uses litellm to connect to APIs. See their docs:

https://litellm.vercel.app/docs/providers/bedrock

I successfully executed the process by referring to the linked document. The following steps were necessary. Thank you!

$ nano ~/.bashrc
export AWS_ACCESS_KEY_ID={my-aws-access-key-id}
export AWS_SECRET_ACCESS_KEY={my-aws-secret-access-key}
export AWS_REGION_NAME={my-aws-region}

$ nano ~/.aider.models.yml
- name: "bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0"
  edit_format: "diff"
  use_repo_map: true
  send_undo_reply: true
  accepts_images: true
  lazy: true
  reminder_as_sys_msg: true
  examples_as_sys_msg: false

$ aider --model bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0

[paul-gauthier]

I'm going to close this issue for now, but feel free to add a comment here and I will re-open or file a new issue any time.

[artemptushkin]

For anyone, if you authenticate through the role assumption, i.e. profile then to access Bedrock you simply need to pass AWS profile, e.g. AWS_PROFILE=dev and then aider --model=bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0 will access AWS Bedrock

@paul-gauthier shouldn't this be documented on the page https://aider.chat/docs/llms.html? That includes other platforms (Vertex AI) but not Bedrock currently

[paul-gauthier]

Aider and I turned this GitHub issue into a doc for bedrock. I would appreciate if you could look it over and let me know if it is accurate. I don't have bedrock access, so I'm basing the doc on the info you all shared in this issue.

https://aider.chat/docs/llms/bedrock.html

[artemptushkin]

@paul-gauthier thanks for a quick update, I think it should be AWS_REGION instead of AWS_DEFAULT_REGION given

When I set AWS_DEFAULT_REGION it fails for me but with region works

As well please specify that export of AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY is needed only in case one uses user authentication (not a profile)

[paul-gauthier]

Thanks, I made those changes.

I'm going to close this issue for now, but feel free to add a comment here and I will re-open or file a new issue any time.

[cab938]

A note that this does not work for me. I set AWS_REGION and AWS_PROFILE in my .env file, but aider complains on startup that I do not have AWS_ACCESS_KEY_ID or AWS_SECRET_ACCESS_KEY set. If I set these in my .env and restart things work, but ideally I only need to set the AWS_REGION and then boto picks up all of the other keys it needs directly from my ~/.aws/credentials file.

I'm on aider 0.62.1.