Hey, thanks for the report. This is a known issue with the inline Markdown preview (the Preview/Markdown button in the tab header). Local links don’t work correctly there. The team is aware.
As a workaround, use Open Preview to the Side. Links work fine there, like you noticed.
Similar report: Links of md files are not working on preview mode