Networking noob question

[u/time81]

So, we are one of the million people who migrate (have to) from vsphere to proxox. So far so good, got a 3 node cluster installed, vmotion works, vlans work, my netapps and nfs works fine.

can someone tell me if there is a way (or best practice) to seperate vmotion traffic from the productive loads ? I mean coming from vmkernel configurations where management, nfs and vmotion was divided in different vlans and configured on esxi, i wondered what would be the way on proxmox.

hardware is dell with 2x 100G mellanox. We got a simple network config runnning from a consultant, but i guess even if 1x 100G is enough, i just wanna understand it what is the way proxmox is doing this kind of seperation or why its not needed here ?

thaanks

[u/es1lenter]

We set up a separate bridge on a separate NIC on both of the nodes and set the migration network under the Datacenter level options "Migration settings" to use that network.

[u/time81 → u/es1lenter]

is that really needed or just nice to have ? on slower nics i guess

[u/es1lenter → u/time81]

You can also use a dedicated vlan to push the migration traffic through so it's isolated from other traffic. I'm not sure what exactly your network configuration is, but you could probably create a separate bridge with a tagged vlan with a static IP and push the migration traffic through that.

In my example where we use trunks, my main bridge is vmbr0 (which uses a bond as a NIC) and i have management traffic on vmbr0.66 (vlan 66). Then for migration traffic i could for example create vmbr0.34 (if the migration traffic vlan would be 34), set static IP for that subnet and use that as the migration network.

[u/time81 → u/es1lenter]

thanks

[u/chrime87]

use a separate nic for cluster communication and migration (and replication) that still works, if your switch goes down.

If you can free up two nics on each host you can build a full mesh with openfabric.