Screenshot-based UI annotations that feed into chat context (Antigravity-style)

Feature request for product/service

Cursor IDE

Describe the request

Hi Cursor team :waving_hand:

I’d love to see a feature similar to Google Antigravity’s screenshot “artifacts” / comments system, but inside Cursor.

What I’m asking for

A way to:
1. Capture a screenshot of the running app (or paste/upload one).
2. Draw a rectangle / highlight a specific region on the screenshot.
3. Attach a short comment to that region.
4. Have both the screenshot and the selected region + comment automatically sent into the current chat context.

So instead of writing “the button in the top-right looks off” and hoping the model understands, I could literally point to the exact place in the UI and say:

“Increase spacing between these two elements by 8px and align them vertically.”

The model would see the image, the selected region, and the text, and then propose concrete code changes.

Why this would be super useful

•	Frontend + UI work becomes much more precise. Small visual issues (1–2 px misalignment, wrong font weight, inconsistent spacing, hover states, etc.) are much easier to show than describe.

•	Better collaboration between devs, designers and PMs. Designers/PMs could highlight issues visually and let Cursor suggest the corresponding code changes, instead of writing long text descriptions.

•	Faster feedback loops When working on a feature, I could quickly screenshot the current state, mark 3–4 areas with comments (like in Figma/Antigravity), and ask Cursor: “Apply all of these tweaks in the code.”

Nice-to-have details

•	Multiple annotations per screenshot, each treated as a separate “comment” in the chat thread.
•	Being able to say in chat: “Fix all issues from this screenshot” and have the model iterate through all annotations.

In short: screenshots + region-based comments that become first-class context for the AI, focused on improving front-end and UI workflows. I think this would massively improve the experience for anyone doing visual/frontend work in Cursor.

1 Like