Can't think up any more suggestions, to be honest.
What was this computer running prior to the ESXi install? Could it be a boot order issue if it was earlier running ESX from local storage?
Try this:
Boot into the BIOS and check the boot order.
Ensure that the USB is at the top of the boot devices list and save the changes. Then try logging back in the ESX installation and see if that works?