Hello All –
TL;DR – Composer seems to have hit a context limit, but resetting or making a new Composer instance (AND deleting old ones), won’t reset context, leading to progressively worse responses.
Using Composer w/ Claude 3.5 Sonnet via Cursor API.
–
I’m trying to use Composer (via Claude 3.5 Sonnet via Cursor API) to help migrate away from a specific library used on my site.
To do this, we need generate an index of all references to all our lib’s exports.
I’ve tried various prompts, all including basic steps to follow, but I always get incomplete answers.
I also tried adding in a “missing items” check – something like “after done, go back to step 1 and re-run process, if you find new items, repeat until no new items are found” (don’t grill me on verbiage here).
I even tried using ChatGPT o1 directly to revise my prompt for better adherence.
THE MAIN ISSUE IS – every time I re-run Composer – which means
- editing an earlier prompt in the convo to eliminate bad answers / context poisoning
- resetting Composer
- creating a new Composer instance AND deleting all previous ones
– the responses get progressively shorter, the adherence gets worse.
This leads me to think we’ve exhausted the context window, BUT, unlike directly interfacing with LLMs, I don’t have a way to reset it or “start a new convo”.
I even tried a new session, breaking things into smaller chunks (ie, “create a file with all exports from this lib”, starting another new session, then “go through the file and notate references to each export”, etc.)
What can I do? We can’t use o1-mini, Gemini, or anything else with Composer that may have a larger window.
Thanks in advance 