Thanks! That showed all RDMs of still-accessible VMs. However, I got it working by just removing the inaccessible VM from the inventory. After that I was able to choose the RDM, even with the LUN filtering being still active.
So solution is: Just remove VM from inventory.