There should be a way to configure AWS Bedrock Key (in addition to regular AWS service keys). AWS Bedrock allows generating its own keys that are limited to just bedrock API keys - Amazon Bedrock
However, custom models in Cursor are quite limited compared to the built-in ones โ features like Tab completion, Apply from Chat, and Agent mode are not available for custom models.
I also think Cursor should have native support for AWS Bedrock API key.