A new version of GPT-4o has been released. In the Chatbot arena, it is better than Claude 3.5 Sonnet in coding and takes first place. It is also now available through the API.
It looks like I can add this model through the settings page in Cursor, but it would be great if it could also be integrated into the long-context chat.
5 Likes
would be great to hear from devs
It seems itâs possible to use in Long Context Mode already when adding chatgpt-4o-latest-128k to the models and then selecting it in the Long Context Chat!
Same seems to be true for gpt-4o-2024-08-06-128k.
Iâm wondering which one is better. The arena only lists chatgpt-4o-latest atm, and it surpasses Claude Sonnet 3.5 in coding by 30 points, which seems very impressive.
However, this benchmark still lists Sonnet as the winner:
https://livebench.ai/
are you using pro cursor or your API? It doesnât work for me on PRO plan
I switched to API to test these models.
** Update: **
It works for me if I use this model chatgpt-4o-latest and enter my OpenAI API Key.
** Original Post: **
I hadnât added my OpenAI API key or a custom model before.
But just now, to test, I added:
chatgpt-4o-latest-128k
(I also tried gpt-4o-latest and got the same behaviour)
And I created a secret (with âAll Permissionsâ) at:
https://platform.openai.com/api-keys
And I added the secret to Cursor Settings > Models > OpenAI API Key.
I started a new chat (Ctrl + L) in Long Chat Mode and asked:
hello - can you please tell me what model you are using?
I get a message that says:
The model chatgpt-4o-latest-128k does not work with your current plan or api key
Screenshots below show:
- Attempt after adding model, without OpenAI API Key
- Attempt after adding model, with OpenAI API Key
- Developer Tools Console when testing
gpt-4o-latest
3 Likes
It appears that the model used on Livebench AI is âchatgpt-4o-latest ,â which seems to be specifically designed for the ChatGPT interface rather than API calls.
EDIT: Unfortunately, it looks like the issue persists with both model names in long context chat. Still waiting on the development team for a resolution.
Hey @litecode
Could you try entering the name âgpt-4o-2024-08-06â? This should work for now, but not for long contexts.
Hi @deanrie ,
Yes I can confirm the following models work when I have entered my OpenAI API Key and added the additional models in Cursor Settings > Models.
chatgpt-4o-latestgpt-4o-2024-08-06(this one seems to work without OpenAI API Key)
When I select them in Ctrl + L in Normal Chat mode, they both work 
.
Interestingly, the model names which i tried earlier that didnât work, still show up in my usage at https://www.cursor.com/settings:
4 Likes
Yes, I mean in the pro version.
1 Like
This model doesnât work so well with Cursor for me. I donât know if it needs fine tuned to work with Cursorâs backend like the other built in options we get but for now I will avoid it until itâs built in. It is not making coding changes or itâs breaking the code by adding changes without removing other code it should remove. I assume it is because itâs not fine tuned and was just manually added by me.