Hello
I have been doing different benchmarks using iperf-2.0.5.2-Win32 and NTttcp.exe verion 5.28. I noticed that only one CPU core is handling the network activity as indicated the Perfmon \Per Processor Network Activity cycles\0, Intel(R) I350 Gigabit Network Connection to 23. In my case its always core 6 that is in use. the 22 other cpu always show 0 activity. This is also visiable by watching the TaskManager Performance tab CPU per core activity during the test. only Core 6 has close to 100% activity.
The network card is an intel I350-T2 OEM card using ProSet drivers version 19.1.51.0 on a Windows 2012 R2 server. The hardware is Dell T7500 Workstation with 2 Xeon X5660 CPU and 96 GB of ram.
I have RSS enabled in the Intel. driver settings.
Powershell shows the RSS settings for my primary nNIC.
Name : Ethernet 4
InterfaceDescription : Intel(R) I350 Gigabit Network Connection
Enabled : True
NumberOfReceiveQueues : 8
Profile : NUMA
BaseProcessor: [Group:Number] 0
MaxProcessor: [Group:Number] :63
MaxProcessors : 8
RssProcessorArray: [Group:Number/NUMA Distance] :
IndirectionTable: [Group:Number] :
the Intel power shell setting return the following:
PS C:\Users\> Get-IntelNetAdapterSetting
Name DisplayName DisplayValue RegistryKeyword RegistryValue
---- ----------- ------------ --------------- -------------
Intel(R) I350 Gigabit Network Connection Locally Administere... NetworkAddress
Intel(R) I350 Gigabit Network Connection Low Latency Interru... {} LLIPorts {}
Intel(R) I350 Gigabit Network Connection SR-IOV Queues 6 *NumVFs 6
Intel(R) I350 Gigabit Network Connection VM Queues 1 VMQueues 1
Intel(R) I350 Gigabit Network Connection Receive Buffers 256 *ReceiveBuffers 256
Intel(R) I350 Gigabit Network Connection RSS Base Processor ... 0 *RssBaseProcNumber 0
Intel(R) I350 Gigabit Network Connection Transmit Buffers 512 *TransmitBuffers 512
Intel(R) I350 Gigabit Network Connection Low Latency Interrupts Disabled EnableLLI 0
Intel(R) I350 Gigabit Network Connection Flow Control Rx & Tx Enabled *FlowControl 3
Intel(R) I350 Gigabit Network Connection Interrupt Moderation Enabled *InterruptModeration 1
Intel(R) I350 Gigabit Network Connection IPv4 Checksum Offload Rx & Tx Enabled *IPChecksumOffloadIPv4 3
Intel(R) I350 Gigabit Network Connection Jumbo Packet Disabled *JumboPacket 1514
Intel(R) I350 Gigabit Network Connection Large Send Offload ... Enabled *LsoV2IPv4 1
Intel(R) I350 Gigabit Network Connection Large Send Offload ... Enabled *LsoV2IPv6 1
Intel(R) I350 Gigabit Network Connection Maximum number of R... 8 *MaxRssProcessors 8
Intel(R) I350 Gigabit Network Connection Preferred NUMA node System Default *NumaNodeId 65535
Intel(R) I350 Gigabit Network Connection Maximum Number of R... 8 Queues *NumRssQueues 8
Intel(R) I350 Gigabit Network Connection ARP Offload Enabled *PMARPOffload 1
Intel(R) I350 Gigabit Network Connection NS Offload Enabled *PMNSOffload 1
Intel(R) I350 Gigabit Network Connection Packet Priority & VLAN Packet Prior... *PriorityVLANTag 3
Intel(R) I350 Gigabit Network Connection Receive Side Scaling Enabled *RSS 1
Intel(R) I350 Gigabit Network Connection RSS load balancing ... NUMAScaling *RSSProfile 3
Intel(R) I350 Gigabit Network Connection Speed & Duplex 1.0 Gbps Ful... *SpeedDuplex 6
Intel(R) I350 Gigabit Network Connection SR-IOV Enabled *SRIOV 1
Intel(R) I350 Gigabit Network Connection TCP Checksum Offloa... Rx & Tx Enabled *TCPChecksumOffloadIPv4 3
Intel(R) I350 Gigabit Network Connection TCP Checksum Offloa... Rx & Tx Enabled *TCPChecksumOffloadIPv6 3
Intel(R) I350 Gigabit Network Connection UDP Checksum Offloa... Rx & Tx Enabled *UDPChecksumOffloadIPv4 3
Intel(R) I350 Gigabit Network Connection UDP Checksum Offloa... Rx & Tx Enabled *UDPChecksumOffloadIPv6 3
Intel(R) I350 Gigabit Network Connection Virtual Machine Queues Enabled *VMQ 1
Intel(R) I350 Gigabit Network Connection Wake on Magic Packet Enabled *WakeOnMagicPacket 1
Intel(R) I350 Gigabit Network Connection Wake on Pattern Match Enabled *WakeOnPattern 1
Intel(R) I350 Gigabit Network Connection DMA Coalescing Disabled DMACoalescing 0
Intel(R) I350 Gigabit Network Connection Energy Efficient Et... On if system... EEELinkAdvertisement 1
Intel(R) I350 Gigabit Network Connection Wake on Magic Packe... Disabled EnablePME 0
Intel(R) I350 Gigabit Network Connection Interrupt Moderatio... Adaptive ITR 65535
Intel(R) I350 Gigabit Network Connection Log Link State Event Enabled LogLinkStateEvent 51
Intel(R) I350 Gigabit Network Connection Gigabit Master Slav... Auto Detect MasterSlave 0
Intel(R) I350 Gigabit Network Connection Reduce link speed d... Enabled ReduceSpeedOnPowerDown 1
Intel(R) I350 Gigabit Network Connection Wait for Link Auto Detect WaitAutoNegComplete 2
Intel(R) I350 Gigabit Network Connection Wake on Link Settings Disabled WakeOnLink 0
Another interesting issue is that SMB3 does not detect the I350-T2 NIC as having RSS enabled.
The active Intel I350 intel nic is Interface index 27.
PS C:\Users\> Get-SmbClientNetworkInterface and output with Get-SmbServerNetworkInterface
Interface Index RSS Capable RDMA Capable Speed IpAddresses Friendly Name
--------------- ----------- ------------ ----- ----------- -------------
20 False False 0 bps {fe80::5efe:192.... isatap.{DE460070...
16 False False 0 bps {fe80::5efe:192.... isatap.{F21F7E71...
15 False False 0 bps {fe80::5efe:192.... isatap.{F3FB0818...
14 False False 0 bps {fe80::5efe:192.... isatap.{5993ADFC...
29 False False 1 Gbps {fe80::6987:ecfb... Ethernet 5
27 False False 1 Gbps {fe80::4953:f511... Ethernet 4
23 False False 0 bps {fe80::5efe:10.6... isatap.{651D92EC...
19 False False 100 Mbps {fe80::f8d1:df34... VirtualBox Host-...
25 False False 100 Mbps {fe80::c5b4:ca4e... VMware Network A...
26 False False 100 Mbps {fe80::f976:cf0e... VMware Network A...
9 False False 100 Mbps {fe80::308a:9214... Ethernet 2
Any suggestion on how to fix this issue ?
Naim.