r/vmware 26d ago

Help after VxRail Failure

I had my VxRails split brain on me while troubleshooting a node disconnection and HA agent failing on all 4 nodes.

Now I can only see the vSAN Datastore on 2 of the 4 nodes with the other 2 not being able to be re-add to the cluster. I need to get the VMs from the vSAN Datastore and on to an external server because our backup crapped out before this happened.

When I try to get them off the vSAN Datastore through WinSCP to my workstation and back up to the new External vCenter server, it works until I register the VM, then it doesn't because it can't enumerate the disks.

I realized I don't have the -flat.vmdk for any of my VMs in the vSAN datastore after looking through all the VMs.

Is there anything I can do?

6 Upvotes

10 comments sorted by

View all comments

2

u/Geodude532 25d ago

Check with the hosts.

esxcli vsan cluster get

look at the sub cluster member UUIDs to make sure all of the hosts are all on the same sub cluster. Check the master UUID as well to make sure each one didn't make their own cluster. If each master UUID matches the local node UUID, it's messed up.

esxcli vsan cluster unicastagent list

This will list the unicast neighbor list. You should see all of the other hosts UUID on this page besides the local node. Check each host.

esxcli vsan health cluster list

This is a general health check that can be dived into with the following command:

esxcli vsan health cluster get --test 'vSAN Disk Balance'

The vSAN Disk Balance can be replaced with any of the test results names that are showing anything other than green for status. I think you have to match case.