Ethernet Switches & Routers

Reply
New Contributor
Posts: 3
Registered: ‎06-16-2011

flow control on the TurboIron-X24

I have a 16 node cluster and I'm doing experiments with iWARP/RDMA over 10GbE using the TurboIron switch.  I have flow control enabled on all ports and on the Adapters (Chelsio T420 cards).  I run certain tests that generate a moderate load, and I see the switch dropping ingress packets.  Further, I see NO flow control pause frames being sent by the switch.  Do I have something misconfigured?  I would expect pause frames to be sent by the switch before dopping any ingress frames due to lack of buffer space.

Similar runs on a Arista switch work fine with no packet drops.


Port 1 counters.  Note Indiscards is high and OutFlowCtrlPkts is 0:

telnet@turboiron24x>show statistics ethernet 1
Port  Link    State     Dupl Speed Trunk Tag Priori MAC            Name       
1     Up      Forward   Full 10G   None  No  level0 0026.9e17.2f6d            

Port 1 Counters:
         InOctets          17631463334           OutOctets          17646457205
           InPkts             19638714             OutPkts             19897004
  InBroadcastPkts                   30    OutBroadcastPkts                  150
  InMulticastPkts                   11    OutMulticastPkts                 2228
    InUnicastPkts             19638673      OutUnicastPkts             19894626
        InBadPkts                    0
      InFragments                    0
       InDiscards                 1295           OutErrors                    0
              CRC                    0          Collisions                    0
         InErrors                    0      LateCollisions                    0
      InGiantPkts                    0
      InShortPkts                    0
         InJabber                    0
   InFlowCtrlPkts                    0     OutFlowCtrlPkts                    0
     InBitsPerSec                    0       OutBitsPerSec                  256
     InPktsPerSec                    0       OutPktsPerSec                    0
    InUtilization                0.00%      OutUtilization                0.00%

Port 1 config (all 24 ports are the same):

telnet@turboiron24x>show interfaces ethernet  1
10GigabitEthernet1 is up, line protocol is up
  Hardware is 10GigabitEthernet, address is 0026.9e17.2f6d (bia 0026.9e17.2f6d)
  Configured speed 10Gbit, actual 10Gbit, configured duplex fdx, actual fdx
  Member of L2 VLAN ID 1, port is untagged, port state is FORWARDING
  BPDU guard is Disabled, ROOT protect is Disabled
  Link Error Dampening is Disabled
  STP configured to ON, priority is level0
  Flow Control is enabled
  mirror disabled, monitor disabled
  Not member of any active trunks
  Not member of any configured trunks
  No port name
  IPG XGMII 96 bits-time
  IP MTU 1500 bytes
  300 second input rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
  300 second output rate: 256 bits/sec, 0 packets/sec, 0.00% utilization
  19638714 packets input, 17631463334 bytes, 0 no buffer
  Received 30 broadcasts, 11 multicasts, 19638673 unicasts
  0 input errors, 0 CRC, 0 frame, 1295 ignored
  0 runts, 0 giants
  19896999 packets output, 17646456885 bytes, 0 underruns
  Transmitted 150 broadcasts, 2223 multicasts, 19894626 unicasts
  0 output errors, 0 collisions

Switch version info:

telnet@turboiron24x>show version
  SW: Version 04.1.00c Copyright (c) 1996-2009 Brocade Communications Systems, Inc.
      Compiled on Oct 07 2009 at 18:22:47 labeled as TIS04100c
      (4851167 bytes) from Primary TIS04100c.bin
      Compressed Boot-Monitor Image size = 373767, Version:04.1.00T205 (grz04100)
  HW: Stackable TurboIron-X24
==========================================================================
      Serial  #: BFF2340E032
      BROCADE-ASIC 0: type B820, rev 01  subrev 00
==========================================================================
  833 MHz Power PC processor 8541 (version 32/0020) 66 MHz bus
  512 KB boot flash memory
31744 KB code flash memory
  512 MB DRAM
The system uptime is 1 hours 15 minutes 45 seconds
The system : started=warm start   reloaded=by "reload"

Super Contributor
Posts: 1,087
Registered: ‎12-13-2009

Re: flow control on the TurboIron-X24

Hi Swise,

     Please checkl to what level of flow controll you are using on the TI.

SSH@TX24 Switch(config-if-e10000-17)#flow-control
  both                Flow Control in PAUSE generation and honoring mode.
  generate-only Flow Control in PAUSE generation only mode.
  honor-only      Flow Control in  PAUSE honoring (Default) mode.
  neg-on            Enable Flow Control with negotiation enabled
  <cr>

Note honor is the default.  Change to 'both' for the ports you need it on.

Thanks

Michael.

New Contributor
Posts: 3
Registered: ‎06-16-2011

Re: flow control on the TurboIron-X24

Hey Michael,


Thanks for the tip.  But my SW doesn't have those options.  Do I need to upgrade?

telnet@turboiron24x(config-mif-1-24)#flow-control
  neg-on   Enable Flow Control with negotiation enabled
  <cr>

Super Contributor
Posts: 1,087
Registered: ‎12-13-2009

Re: flow control on the TurboIron-X24

I guess so - 4.2.00c as the flow control options exists on my switch and that is the version I am running.  See bloe output of 'show Version'

SSH@TX24 Switch(config-if-e10000-17)#sh ver
  SW: Version 04.2.00c Copyright (c) 1996-2010 Brocade Communications Systems, Inc.
      Compiled on Jan 12 2011 at 19:40:30 labeled as TIS04200c
      (4490260 bytes) from Primary TIS04200c.bin
      Compressed Boot-Monitor Image size = 373767, Version:04.1.00T205 (grz04100)
  HW: Stackable TurboIron-X24
==========================================================================
      Serial  #: BFF2336F04B
      BROCADE-ASIC 0: type B820, rev 11  subrev 00
==========================================================================
  833 MHz Power PC processor 8541 (version 32/0020) 66 MHz bus
  512 KB boot flash memory
31744 KB code flash memory
  512 MB DRAM
The system uptime is 10 days 15 hours 26 minutes 12 seconds
The system : started=cold start

Thanks

Michael.

New Contributor
Posts: 3
Registered: ‎06-16-2011

Re: flow control on the TurboIron-X24

Upgrading did the trick!  Thanks.

Super Contributor
Posts: 1,087
Registered: ‎12-13-2009

Re: flow control on the TurboIron-X24

Hi Swise,

     You are welcome.  Thanks for marking as answered.

Thanks

Michael.

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.

Download FREE NVMe eBook