Maybe an extension is using resources. Open the command palette and search for Developer: Open Process Explorer to see if you can identify it. Also, try starting in disable-extensions mode to check if the issue persists.
Developer: Open Process Explorer
disable-extensions