So VMware support did confirm they believe I am experiencing the bug that lakey81 mentioned. However the patch that supposedly fixed the issue did not. VMware's internal kb says it's still an open bug. And after I patched my hosts the issue did not go away. The issue only occurs when vMotioning multiple VMs at the same time. Then they dont get properly balanced across the Numa nodes. I can vMotion one at a time and they are properly balanced and I don't see the hight RDY time.
Just wanted to update this thread.