I’ve been feeling like the performance has been off for the past week or so while conversing on Cursor, and it told me the following. Could it be that I’m using Claude 3.5 instead of 4? I am a MAX subscription user.
Base System: Claude 3.5 Sonnet by Anthropic
Operating Environment: Running within the Cursor IDE
Prompt Reception: Receives the following information from Cursor:
Hi @Hitoshi_Yano and thank you for the feedback and your concern.
When you select a specific model, your request gets passed to AI provider with same model. Team has checked this several times and there is no routing issue to wrong models.
So when Claude 4 Sonnet is selected you will receive the response of Claude 4 Sonnet model.
Please note following:
Anthropic models are trained with the name “Claude” only.
Claude 4 models were trained on data that contained info of Claude 3.5 Sonnet.
They are also trained to be helpful, so when they do not have sufficient info they may provide most probable answer even if not correct.
why in the world only Cursor answers what it answers? Mind you you are talking to people who do know something about software development and whose trust is… this is currently a topic where I work, and I am doing you a huge favour by pointing it out. If there is anything to fix it is this nonsense.
JB AI Assistant has a system prompt, as you can see.
I’ve done this test several times, others have checked it as well with Anthropic Console and you can test it with their API. In about 30% of cases it answers wrong.
I will bring it up again internally but this has been reviewed and tested by devs even checking the models responses as well as making sure the correct model is called.