So, I manage to fix it by connecting to VM (not via cursor) and removing dir called .cursor_server
(or something like that) on that VM. After that I was able to connect to VM
In other words I removed existing cursor server from VM and let it install new one from the scratch