Re: 82599ES SR-IOV on Ubuntu 14.04

Hi Patrick,

Thanks so much for your reply. I hope you enjoyed your vacation time and I'm really sorry you have to deal with me upon your return!

So, I wouldn't normally assign MAC addresses to the VFs, I only went that route because of the random behavior of the VFs after starting the VM that the hostdev interfaces were assigned to.

For this reply, I changed my guest from FreeBSD to CentOS to perhaps simplify things but what I was originally seeing and the reason I even set them was because I was arbitrarily getting an all zeros MAC randomly on the VMs interfaces.

First, in response to your recommended steps.

1) ixgbevf is being blacklisted from within /etc/modprobe.d/blacklist.conf

blacklist ixgbevf

2) I am loading ixgbe and VFs from within /etc/modprobe.d/ixgbe.conf

options ixgbe max_vfs=16

options loop max_loop=128

3) Now begging with my new CentOS VM, I have not assigned MAC addresses to the VFs.

root@ubuntu:~# ip link show dev eth4

5: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000

link/ether 90:e2:ba:47:2c:30 brd ff:ff:ff:ff:ff:ff

vf 0 MAC 00:00:00:00:00:00, vlan 100, spoof checking on, link-state auto

vf 1 MAC 00:00:00:00:00:00, vlan 200, spoof checking on, link-state auto

vf 2 MAC 00:00:00:00:00:00, vlan 300, spoof checking on, link-state auto

vf 3 MAC 00:00:00:00:00:00, vlan 100, spoof checking on, link-state auto

vf 4 MAC 00:00:00:00:00:00, vlan 200, spoof checking on, link-state auto

vf 5 MAC 00:00:00:00:00:00, vlan 300, spoof checking on, link-state auto

vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 10 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 11 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 12 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 13 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 14 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

vf 15 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

4) VLANs are assigned (see output from 3)

5) Here is the applicable snippet from my guest's XML configuration

	<interface type='hostdev' managed='yes'>
	<mac address='52:54:00:58:5f:0c'/>
	<source>
	<address type='pci' domain='0x0000' bus='0x81' slot='0x10' function='0x0'/>
	</source>
	<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
	</interface>
	<interface type='hostdev' managed='yes'>
	<mac address='52:54:00:d4:63:a7'/>
	<source>
	<address type='pci' domain='0x0000' bus='0x81' slot='0x10' function='0x1'/>
	</source>
	<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
	</interface>
	<interface type='hostdev' managed='yes'>
	<mac address='52:54:00:51:5c:0a'/>
	<source>
	<address type='pci' domain='0x0000' bus='0x81' slot='0x10' function='0x2'/>
	</source>
	<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
	</interface>

6) And the result from starting the guest which still reflects bizarre behavior. Notice from the log output below that a MAC was set to VF0 two times, a MAC was set for VF1 but VF2 was never set.

root@ubuntu:~# ip link show dev eth4

5: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000

link/ether 90:e2:ba:47:2c:30 brd ff:ff:ff:ff:ff:ff

vf 0 MAC 52:54:00:58:5f:0c, spoof checking on, link-state auto

vf 1 MAC 52:54:00:51:5c:0a, spoof checking on, link-state auto