Access Claude 3.5 through Google Vertex AI

Discussion
1

Hi,

I am hosting Claude Sonnet 3.5 on Vertex AI and I want to set that for LLM model, but just setting Google Vertex API key is not enough. How can I specify which model to use which provider?

2 Likes
2

You can use litellm to convert Google Vertex AI’s interface into an OpenAI-compatible API, and then use it in Cursor. I can connect and chat normally, but it cannot generate code. I am currently investigating the reason for this.

2 Likes
3

Have you resolved this?