Composer take long time if the chat history is very long

Discussion
1

Hi everyone,

I wanted to share an issue I’ve been experiencing with the composer. It often takes about 30 minutes to receive a reply, which is frustrating. Initially, I thought this delay might be due to my internet connection but it is not.

The long composer chat is the reason behind this.

I opened a new composer window to troubleshoot, and surprisingly, it responded almost instantly. However, the downside is that this new window doesn’t retain the context of my previous work, so it’s unable to identify what needs to be updated.

If anyone has encountered this issue or has suggestions for a workaround, I would greatly appreciate your input!

Thanks!

2

yes i have the exact same problem, when i make my composer chat too long, it takes very annoyingly long time to open

3

I’d recommend routinely moving to a new composer session, especially if there’s a good time to do so such as changing what you are working on inside your codebase.

Not only does this help with the speed of things, but also helps to keep the context clean and relevant for the LLM, and ensures very old messages aren’t lost due to the length of the chat history!

We are looking to improve the performance of long chats in future updates regardless.