This functionality is already available via Supabase CLI:
https://supabase.com/docs/reference/cli/start
It requires creating a local copy of the database and then Cursor can see the data, schema, etc. locally within the IDE. You can pull and push to Supabase as needed.
Hope it helps.