I was using the Composer in the agent mode when the model (claude-3-5-sonnet-20241022) wrote:
Based on the recent changes and code context, I can see that some code related to X was removed
After going back and forth with the model, I discovered that it’s tracking human changes (in <human_changes> tags). This is a great feature to keep Composer connected to changes made by the user. However the change mentioned this time (i.e. “code related to X was removed”) was due to me editing some messages in the conversation and submitting it again since the model response was not accurate.
So I think tracking “human” changes in this case confused the model and caused it to repeat wrong behaviors because of that.
In general, I think more visibility is better. Let us see the changes the Composer is tracking. Let’s see the context the model is working with. Right now, I feel Cursor is becoming more and more like a black box. I like how Zed implement their chat where you can actually see and control what’s being sent to the model. I hope Cursor take inspiration from that. I think most developers would appreciate more visibility, and all of Cursor users are developers!