2:39 - Sunday, 20 April 2014

RHEL 6 KVM NIC Configuration With Bonding + Vlan + Bridge

#Topics: centos 6 bonding bridge bond,centos 6 vlan uuid,centos 6: vlan with bonding issues,centos bonding bridge ip

We are having trouble with our bonded NICs + vlan + bridged network configuration. We have a blade server running RHEL6, and are trying to set up the networking for KVM virtualisation.

The blade server has 2 NICs (p2p1 and p2p2) which connect to the internal blade chassis 10 Gb switches. We want to bond the 2 blade NICs and setup

  1. default vlan (vlan 1) for our production network (172.16.x.x) assigned via DHCP, and
  2. vlan 3 on our storage network (192.168.10.x) statically assigned.

There is an added complication that the KVM guests need to connect to our production network, and so we also need a bridge on the production network.

Setting up the bonding (as described here) together with vlan 3 (as described here) seems fine. We used the following configuration files

DEVICE=”p2p1”BOOTPROTO=”none”HWADDR=[Removed]NM_CONTROLLED=”no”ONBOOT=”yes”TYPE=”Ethernet”UUID=[Removed]MASTER=bond0SLAVE=yesUSERCTL=noDEVICE=”p2p2”BOOTPROTO=”none”HWADDR=[Removed]NM_CONTROLLED=”no”ONBOOT=”yes”TYPE=”Ethernet”UUID=[Removed]MASTER=bond0SLAVE=yesUSERCTL=noDEVICE=bond0ONBOOT=yesBOOTPROTO=noneUSERCTL=noDEVICE=bond0.3ONBOOT=yesBOOTPROTO=staticIPADDR=192.168.10.22NETMASK=255.255.255.0USERCTL=noVLAN=yes

The problem comes when we try to set up a bridged network connection for the default vlan (vlan 1). For example we might try modifying bond0 and adding br0 as described here.

DEVICE=bond0ONBOOT=yesBOOTPROTO=noneUSERCTL=noBRIDGE=br0DEVICE=br0TYPE=BridgeBOOTPROTO=dhcpONBOOT=yesDELAY=0

However, br0 never obtains an IP over DHCP. We know it’s not a DHCP issues since DHCP works fine if we set it up directly on bond0, but that’s not a bridge interface so the VMs can’t use it.

How should we configure the interfaces for both vlan 3 (storage) and default vlan for KVM guests and administration?

An incompatibility between Cisco Rapid Spanning Tree and our blade centre switches led to our network engineers changing the design, so the question no longer applies. However, I found the following discussions informative and they may help others in future.

  • Similar setup, which was eventually confirmed as working here.
  • A known issue with ARP with bridges on bonded interfaces here.

Share

Advertisement

Comment