Same as with vscode. Install WSL extension (ms-vscode-remote.remote-wsl), and it should all work out of the box.