There doesn't seem to be a way to fix this part that I have found. I've tried the old methods of creating a shortcut to explorer.exe /e and the extra text that stands for this location, but when I pin that to the Taskbar, it will launch to 'This PC', but creates another button on the Taskbar rather than using the same one as the shortcut. I much prefer the old default to 'This PC' which has most every folder/drive I need to access quickly.
I don't really care for the new 'Home' location in File Explorer.