Would it be possible to add a feature that tells us we are reaching the limit of a composer chat session?
Right now, in a very long chat, you simply get a message to start a new chat, because the chat is too long.
It would be great to get a message saying you are reaching the limit (2 messages or something like that) so we can tie things off, document and move to a new chat.
Similar to what Claude (website) does. This way, I can update my progress file and have enough context for the LLM to pickup again in a new chat window.
Or just phase out of the context the oldest token first. That’s something that Phind does very well. You see the number let say 10000/32000, when the number grow above 32000, you know the oldest token are lost.
But this all sound simple enough, but in practice I’m sure it’s more complex than that. For example they need to add a lot of custom instruction for the composer to work. All those instruction would get phased out and it would break things. So I guess that’s why when you reach the limit they ask you to restart.