Cursor 3: Agents Window

When using OTP-based SSH, do I need to re-authenticate in the Agent window each time I switch between workspaces?
In Cursor 2 or VS Code I can open multiple windows for different workspaces, but with the Agent window it feels like I’m expected to use a single window. Is that correct?