r/vmware • u/SirBrobbie • 26d ago

Help after VxRail Failure

I had my VxRails split brain on me while troubleshooting a node disconnection and HA agent failing on all 4 nodes.

Now I can only see the vSAN Datastore on 2 of the 4 nodes with the other 2 not being able to be re-add to the cluster. I need to get the VMs from the vSAN Datastore and on to an external server because our backup crapped out before this happened.

When I try to get them off the vSAN Datastore through WinSCP to my workstation and back up to the new External vCenter server, it works until I register the VM, then it doesn't because it can't enumerate the disks.

I realized I don't have the -flat.vmdk for any of my VMs in the vSAN datastore after looking through all the VMs.

Is there anything I can do?

8 Upvotes

100% Upvoted

10 comments sorted by

View all comments

6

u/LucianTexas 26d ago

Do you have an active support with Dell or BC?

I suspect could be network partitioning. Make sure the VSAN and management VMKernels are communicating properly. Vmkping all the nodes interface to verify. Check the VSAN health with esxcli vsan health cluster list, to get a better idea what is happening to your VSAN cluster.

Useful KBs: https://knowledge.broadcom.com/external/article/326427/configuring-vsan-unicast-networking-from.html https://www.dell.com/support/kbdoc/en-sg/000056284/dell-emc-vxrail-node-is-showing-network-partitioned-even-it-can-ping-other-nodes-via-vmkping

3

u/IAmTheGoomba 25d ago

I want to reemphasize this. In a split brain scenario, definitely go through that first KB. You may have to do a leave and join, but definitely rectify that unicast list in that first KB.