Fibre Channel (SAN)

Reply
Contributor
Posts: 26
Registered: ‎08-07-2014

Port Throttled and Invalid_Word Errors

I have two switches that I can't get connected.  Here are the details:

 

Switch #1
===================
Brocade 4900 (HP StorageWorks 4/64)
FOS 6.4.3
4GB transceiver

 

Switch #2
===================
Brocade 6510 (HP StorageWorks SN6000B)
FOS 7.2.1d
16GB transceiver

 

I'm getting a "Disabled (Port Throttled)" error on the 6510 when I connect the switches with the default configuration. I've tried changing the port from 16GB to 4GB  but get a ton of "Invalid_word" errors. I've replaced the fiber jumper and different ports/transceivers but can't get them talking. I tried setting the fill word but that apparently only applies to 8GB transceivers. Here are the port configs for both switches. What am I missing?

 

Brocade 4900 -- portcfgshow 26
Area Number: 26
Speed Level: AUTO(HW)
Fill Word: 0(Idle-Idle)
AL_PA Offset 13: OFF
Trunk Port ON
Long Distance OFF
VC Link Init OFF
Locked L_Port OFF
Locked G_Port OFF
Disabled E_Port OFF
Locked E_Port OFF
ISL R_RDY Mode OFF
RSCN Suppressed OFF
Persistent Disable OFF
LOS TOV enable OFF
NPIV capability ON
QOS E_Port OFF
Port Auto Disable: OFF
Mirror Port OFF
F_Port Buffers OFF
Fault Delay: 0(R_A_TOV)
NPIV PP Limit: 126

 

Brocade 6510 -- portcfgshow 23
Area Number: 23
Octet Speed Combo: 1(16G|8G|4G|2G)
Speed Level: 4G
AL_PA Offset 13: OFF
Trunk Port ON
Long Distance OFF
VC Link Init OFF
Locked L_Port OFF
Locked G_Port OFF
Disabled E_Port OFF
Locked E_Port OFF
ISL R_RDY Mode OFF
RSCN Suppressed OFF
Persistent Disable OFF
LOS TOV enable OFF
NPIV capability ON
QOS Port AE
Port Auto Disable: OFF
Rate Limit OFF
EX Port OFF
Mirror Port OFF
SIM Port OFF
Credit Recovery ON
F_Port Buffers OFF
E_Port Credits OFF
Fault Delay: 0(R_A_TOV)
NPIV PP Limit: 126
CSCTL mode: OFF
D-Port mode: OFF
D-Port over DWDM: OFF
Compression: OFF
Encryption: OFF
FEC: ON
Non-DFE: OFF

 

Highlighted
External Moderator
Posts: 4,985
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

David,

 

what type of SFP+ are you use in 6510 ? 8G or 16G ?

 

additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g

TechHelp24
External Moderator
Posts: 4,985
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

[ Edited ]

sorry,.... I see you use 16G SFP.

 

if the SFP on 4900 is a old Finisar, is most probabble this caused the problem.

 

do you have 4G Brocade branded SFP for Brocade 4900 and can replace the 16G on 6510 with 8G SFP+ ?

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

 

what type of SFP+ are you use in 6510 ? 8G or 16G ?

 

  16GB.  Should I try an 8GB transceiver?

 

Additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g

 
  I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  
 
FWIW, my plan is to connect the 6510 to this fabric and get the zoning info and then cutover connections one at a time.  I'll decom the 4900 after I move the last connection.
 
External Moderator
Posts: 4,985
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

David,

 

about the SFP, please see my second post, and yes you shold use 8G.

 

about fillword, have you tried to set on 4900 Mode 3 ?

 

unplug the FC Cable

portcfgpersistentdisable port_number

portcfgfillword port_number

portcfgpersistentenable port_number

plug the cable back

 

-> I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  

 

firmwaredownload is no-disruptive.

TechHelp24
External Moderator
Posts: 4,985
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

can you post please output from "sfpshow" from the port in question on 4900 ?

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

Well, before I saw your response I installed an 8GB transceiver in the 6510 and performed a portcfgdefault on the port.  It connected and successfully downloaded fabric information (yay!).  What's curious, though not really a problem, is that both sides connected at 2GB instead of 4GB (the lowest-common demonimator).  

 

Is there anything else I need to do?

 

Here's a portshow from the 6510

portIndex: 23
portName: port23
portHealth: HEALTHY

Authentication: None
portDisableReason: None
portCFlags: 0x1
portFlags: 0x10000907 PRESENT ACTIVE E_PORT G_PORT U_PORT LOGICAL_ONLINE LOGI
N
LocalSwcFlags: 0x0
portType: 24.0
POD Port: Port is licensed
portState: 1 Online
Protocol: FC
portPhys: 6 In_Sync portScn: 16 E_Port
port generation number: 418
state transition count: 416

portId: 161700
portIfId: 43020013
portWwn: 20:17:50:eb:1a:ea:3e:42
portWwn of device(s) connected:

Distance: normal
portSpeed: N2Gbps

FEC: Inactive
Credit Recovery: Inactive
LE domain: 0
FC Fastwrite: OFF
Interrupts: 0 Link_failure: 0 Frjt: 0
Unknown: 0 Loss_of_sync: 0 Fbsy: 0
Lli: 0 Loss_of_sig: 0
Proc_rqrd: 3 Protocol_err: 0
Timed_out: 0 Invalid_word: 0
Rx_flushed: 0 Invalid_crc: 0
Tx_unavail: 0 Delim_err: 0
Free_buffer: 0 Address_err: 0
Overrun: 0 Lr_in: 0
Suspended: 0 Lr_out: 0
Parity_err: 0 Ols_in: 0
2_parity_err: 0 Ols_out: 0
CMI_bus_err: 0

External Moderator
Posts: 4,985
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

is port 23 on 6510 the ISL port to 4900 ?

 

->portSpeed: N2Gbps

 

the port negotiated at 2Gb with.

 

are you sure on the 4900 th eSFP inserted is 4G ?

 

please post "sfpshow" from the port in question on 4900

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
Encoding: 1 8B10B
Baud Rate: 42 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u: 15 (units 10 meters)
Length 62.5u:7 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: FINISAR CORP.
Vendor OUI: 00:90:65
Vendor PN: FTLF8524P2BNV-HP
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 0032 Loss_of_Sig,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: PEK1HSU
Date Code: 081106
DD Type: 0x68
Enh Options: 0xd8
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x40
Warn Flags[0,1] = 0x5, 0x40
Alarm Warn
low high low high
Temperature: 39 Centigrade -25 95 -20 90
Current: 5.490 mAmps 1.000 17.000 2.000 14.000
Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

 

And here's the one on the 6150:

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
Encoding: 1 8B10B
Baud Rate: 85 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u (OM2): 5 (units 10 meters)
Length 50u (OM3): 0 (units 10 meters)
Length 62.5u:2 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: HP-F BROCADE
Vendor OUI: 00:05:1e
Vendor PN: AJ716B
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: UAF413410000PRU
Date Code: 131011
DD Type: 0x68
Enh Options: 0xfa
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x0
Warn Flags[0,1] = 0x5, 0x0
Alarm Warn
low high low high
Temperature: 49 Centigrade -10 90 -5 85
Current: 8.082 mAmps 1.000 17.000 2.000 14.000
Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW

Frequent Contributor
Posts: 130
Registered: ‎02-05-2014

Re: Port Throttled and Invalid_Word Errors

I would start worrying about the very low RX db values here. These would most likley clock up a fair amount of port errors. The SFP is unrelated to the fillword as it is tied to the ASIC. Thats where the serdes chip resides. I think when using the 8G SFP you got lucky on speed negotiation timers. Use a new OM3 or OM4 cable and connect them again. The DB RX values should normally be around -5db on a short-distance link with these SFP's. -17dB is way off the chart.
See for more info over here: http://www.erwinvanlonden.net/2012/03/the-importance-of-clean-fibre-optics/

DavidHickok wrote:

Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
Encoding: 1 8B10B
Baud Rate: 42 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u: 15 (units 10 meters)
Length 62.5u:7 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: FINISAR CORP.
Vendor OUI: 00:90:65
Vendor PN: FTLF8524P2BNV-HP
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 0032 Loss_of_Sig,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: PEK1HSU
Date Code: 081106
DD Type: 0x68
Enh Options: 0xd8
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x40
Warn Flags[0,1] = 0x5, 0x40
Alarm Warn
low high low high
Temperature: 39 Centigrade -25 95 -20 90
Current: 5.490 mAmps 1.000 17.000 2.000 14.000
Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

 

And here's the one on the 6150:

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
Encoding: 1 8B10B
Baud Rate: 85 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u (OM2): 5 (units 10 meters)
Length 50u (OM3): 0 (units 10 meters)
Length 62.5u:2 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: HP-F BROCADE
Vendor OUI: 00:05:1e
Vendor PN: AJ716B
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: UAF413410000PRU
Date Code: 131011
DD Type: 0x68
Enh Options: 0xfa
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x0
Warn Flags[0,1] = 0x5, 0x0
Alarm Warn
low high low high
Temperature: 49 Centigrade -10 90 -5 85
Current: 8.082 mAmps 1.000 17.000 2.000 14.000
Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW


Kind regards,
Erwin van Londen
Brocade Distinguished Architect
http://www.erwinvanlonden.net The Fibre Channel blog


Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.

Click to Register
Download FREE NVMe eBook