I’ve just installed Cursor and I’m having this exact issue.
I solved it by closing the “Welcome” section at the top (even though I didn’t want to…) so I don’t think this is fixed yet.
So the team should fix file explorer scrolling when the welcome section is present 