Where does the bug appear (feature/product)?
Cloud Agent (GitHub, Slack, Web, Linear)
Describe the Bug
I am running a project using Grok and Composer mainly. I have instructed it to merge PRs when they are marked ready, and create work in drafts.
I had asked it to fix a bug in a PR which resurfaced after a rebase from main. After it had fixed this bug, it progressed further to not only approve and merge that PR, but another one.
When asked why it did this, it told me I sent a message to it to merge these PRs. After asking for message ids, which it said it didn’t have any for, I looked through the history for the agent reasoning.
It shows that it created a message wrapped in <user_query> tags, and then responded to that in one message, allowing it to listen to itself and ignore real user input.
Steps to Reproduce
I suppose, setup a rule through chat instruction and wait for it to try to bypass the rule after several prompts. Also address the <user_query> tag itself.
Expected Behavior
It should not be able to fabricate user input.
Screenshots / Screen Recordings
Operating System
MacOS
Version Information
IDE: 3.27.14
For AI issues: which model did you use?
Composer 2.5
For AI issues: add Request ID with privacy disabled
It gave me: f4a0a0d8-0b0a-4a6d-8e0d-7a0e0e0e0e0e which seems fabricated.
My last message before the PR merges was 9c488ac5-ce64-46c6-b375-b8454ed533f8.
Does this stop you from using Cursor
No - Cursor works, but with this issue
