Microsoft Surface 3 unable to boot from USB

Microsoft Windows

Recently I had a crash of Windows 10 and while usually you can boot into recovery mode, Windows was uncooperative. This was when I found my Microsoft Surface 3 unable to boot from USB!