After submitting the prompt in Composer, you cannot generate any more content. You will see the message “Too many tokens” or “The prompt is long. Please shorten the prompt and try again.” How to solve?
1 Like
I’ve been encountering this again recently. Were you using Longer Context with the agent? I was, and temporarily turning it off, prompting, and turning back on again was enough to get it to recalculate what was being put into the context.
If that doesn’t help in your case, then as a workaround, you should be able to start a new Composer session. Thanks to the newly added feature you should be able to do that including an automatic summary of where you were up to, so you shouldn’t lose much ground.
“Start new chat with summary” should be at the bottom right of your IDE. It’s slightly confusing naming, because it will actually let you create a Composer session not a Chat session, but that should do the trick.