Are these ESXi servers runnning a different version perhaps ?
There have been some changes in the way the SNMP daemon works between ESXi 4.* and 5.*
Update: just saw that you said these are 5/5.1 ESXi servers.
Are the ones where it doesn't work all the same ESXi version ?