Fibre Channel (SAN)

Reply
Contributor
Posts: 26
Registered: ‎08-07-2014

Port Throttled and Invalid_Word Errors

I have two switches that I can't get connected.  Here are the details:

 

Switch #1
===================
Brocade 4900 (HP StorageWorks 4/64)
FOS 6.4.3
4GB transceiver

 

Switch #2
===================
Brocade 6510 (HP StorageWorks SN6000B)
FOS 7.2.1d
16GB transceiver

 

I'm getting a "Disabled (Port Throttled)" error on the 6510 when I connect the switches with the default configuration. I've tried changing the port from 16GB to 4GB  but get a ton of "Invalid_word" errors. I've replaced the fiber jumper and different ports/transceivers but can't get them talking. I tried setting the fill word but that apparently only applies to 8GB transceivers. Here are the port configs for both switches. What am I missing?

 

Brocade 4900 -- portcfgshow 26
Area Number: 26
Speed Level: AUTO(HW)
Fill Word: 0(Idle-Idle)
AL_PA Offset 13: OFF
Trunk Port ON
Long Distance OFF
VC Link Init OFF
Locked L_Port OFF
Locked G_Port OFF
Disabled E_Port OFF
Locked E_Port OFF
ISL R_RDY Mode OFF
RSCN Suppressed OFF
Persistent Disable OFF
LOS TOV enable OFF
NPIV capability ON
QOS E_Port OFF
Port Auto Disable: OFF
Mirror Port OFF
F_Port Buffers OFF
Fault Delay: 0(R_A_TOV)
NPIV PP Limit: 126

 

Brocade 6510 -- portcfgshow 23
Area Number: 23
Octet Speed Combo: 1(16G|8G|4G|2G)
Speed Level: 4G
AL_PA Offset 13: OFF
Trunk Port ON
Long Distance OFF
VC Link Init OFF
Locked L_Port OFF
Locked G_Port OFF
Disabled E_Port OFF
Locked E_Port OFF
ISL R_RDY Mode OFF
RSCN Suppressed OFF
Persistent Disable OFF
LOS TOV enable OFF
NPIV capability ON
QOS Port AE
Port Auto Disable: OFF
Rate Limit OFF
EX Port OFF
Mirror Port OFF
SIM Port OFF
Credit Recovery ON
F_Port Buffers OFF
E_Port Credits OFF
Fault Delay: 0(R_A_TOV)
NPIV PP Limit: 126
CSCTL mode: OFF
D-Port mode: OFF
D-Port over DWDM: OFF
Compression: OFF
Encryption: OFF
FEC: ON
Non-DFE: OFF

 

External Moderator
Posts: 4,907
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

David,

 

what type of SFP+ are you use in 6510 ? 8G or 16G ?

 

additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g

TechHelp24
External Moderator
Posts: 4,907
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

[ Edited ]

sorry,.... I see you use 16G SFP.

 

if the SFP on 4900 is a old Finisar, is most probabble this caused the problem.

 

do you have 4G Brocade branded SFP for Brocade 4900 and can replace the 16G on 6510 with 8G SFP+ ?

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

 

what type of SFP+ are you use in 6510 ? 8G or 16G ?

 

  16GB.  Should I try an 8GB transceiver?

 

Additional, i would suggest to upgrade the 4900 to latest release 6.4.3h and the 6510 to 7.2.1g

 
  I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  
 
FWIW, my plan is to connect the 6510 to this fabric and get the zoning info and then cutover connections one at a time.  I'll decom the 4900 after I move the last connection.
 
External Moderator
Posts: 4,907
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

David,

 

about the SFP, please see my second post, and yes you shold use 8G.

 

about fillword, have you tried to set on 4900 Mode 3 ?

 

unplug the FC Cable

portcfgpersistentdisable port_number

portcfgfillword port_number

portcfgpersistentenable port_number

plug the cable back

 

-> I would but the 4900 will be decom'd shortly and coordinating downtime for connected hosts is a bit of a challenge.  

 

firmwaredownload is no-disruptive.

TechHelp24
External Moderator
Posts: 4,907
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

can you post please output from "sfpshow" from the port in question on 4900 ?

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

Well, before I saw your response I installed an 8GB transceiver in the 6510 and performed a portcfgdefault on the port.  It connected and successfully downloaded fabric information (yay!).  What's curious, though not really a problem, is that both sides connected at 2GB instead of 4GB (the lowest-common demonimator).  

 

Is there anything else I need to do?

 

Here's a portshow from the 6510

portIndex: 23
portName: port23
portHealth: HEALTHY

Authentication: None
portDisableReason: None
portCFlags: 0x1
portFlags: 0x10000907 PRESENT ACTIVE E_PORT G_PORT U_PORT LOGICAL_ONLINE LOGI
N
LocalSwcFlags: 0x0
portType: 24.0
POD Port: Port is licensed
portState: 1 Online
Protocol: FC
portPhys: 6 In_Sync portScn: 16 E_Port
port generation number: 418
state transition count: 416

portId: 161700
portIfId: 43020013
portWwn: 20:17:50:eb:1a:ea:3e:42
portWwn of device(s) connected:

Distance: normal
portSpeed: N2Gbps

FEC: Inactive
Credit Recovery: Inactive
LE domain: 0
FC Fastwrite: OFF
Interrupts: 0 Link_failure: 0 Frjt: 0
Unknown: 0 Loss_of_sync: 0 Fbsy: 0
Lli: 0 Loss_of_sig: 0
Proc_rqrd: 3 Protocol_err: 0
Timed_out: 0 Invalid_word: 0
Rx_flushed: 0 Invalid_crc: 0
Tx_unavail: 0 Delim_err: 0
Free_buffer: 0 Address_err: 0
Overrun: 0 Lr_in: 0
Suspended: 0 Lr_out: 0
Parity_err: 0 Ols_in: 0
2_parity_err: 0 Ols_out: 0
CMI_bus_err: 0

External Moderator
Posts: 4,907
Registered: ‎02-23-2004

Re: Port Throttled and Invalid_Word Errors

is port 23 on 6510 the ISL port to 4900 ?

 

->portSpeed: N2Gbps

 

the port negotiated at 2Gb with.

 

are you sure on the 4900 th eSFP inserted is 4G ?

 

please post "sfpshow" from the port in question on 4900

TechHelp24
Contributor
Posts: 26
Registered: ‎08-07-2014

Re: Port Throttled and Invalid_Word Errors

Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
Encoding: 1 8B10B
Baud Rate: 42 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u: 15 (units 10 meters)
Length 62.5u:7 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: FINISAR CORP.
Vendor OUI: 00:90:65
Vendor PN: FTLF8524P2BNV-HP
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 0032 Loss_of_Sig,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: PEK1HSU
Date Code: 081106
DD Type: 0x68
Enh Options: 0xd8
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x40
Warn Flags[0,1] = 0x5, 0x40
Alarm Warn
low high low high
Temperature: 39 Centigrade -25 95 -20 90
Current: 5.490 mAmps 1.000 17.000 2.000 14.000
Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

 

And here's the one on the 6150:

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
Encoding: 1 8B10B
Baud Rate: 85 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u (OM2): 5 (units 10 meters)
Length 50u (OM3): 0 (units 10 meters)
Length 62.5u:2 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: HP-F BROCADE
Vendor OUI: 00:05:1e
Vendor PN: AJ716B
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: UAF413410000PRU
Date Code: 131011
DD Type: 0x68
Enh Options: 0xfa
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x0
Warn Flags[0,1] = 0x5, 0x0
Alarm Warn
low high low high
Temperature: 49 Centigrade -10 90 -5 85
Current: 8.082 mAmps 1.000 17.000 2.000 14.000
Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW

Frequent Contributor
Posts: 130
Registered: ‎02-05-2014

Re: Port Throttled and Invalid_Word Errors

I would start worrying about the very low RX db values here. These would most likley clock up a fair amount of port errors. The SFP is unrelated to the fillword as it is tied to the ASIC. Thats where the serdes chip resides. I think when using the 8G SFP you got lucky on speed negotiation timers. Use a new OM3 or OM4 cable and connect them again. The DB RX values should normally be around -5db on a short-distance link with these SFP's. -17dB is way off the chart.
See for more info over here: http://www.erwinvanlonden.net/2012/03/the-importance-of-clean-fibre-optics/

DavidHickok wrote:

Here's the port connected to the 6150, negotiated at 2GB.  I Googled the vendor PN and it definitely seems to be a 4GB transceiver

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 150c402001000000 100,200,400_MB/s M5,M6 sw Inter_dist
Encoding: 1 8B10B
Baud Rate: 42 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u: 15 (units 10 meters)
Length 62.5u:7 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: FINISAR CORP.
Vendor OUI: 00:90:65
Vendor PN: FTLF8524P2BNV-HP
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 0032 Loss_of_Sig,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: PEK1HSU
Date Code: 081106
DD Type: 0x68
Enh Options: 0xd8
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x40
Warn Flags[0,1] = 0x5, 0x40
Alarm Warn
low high low high
Temperature: 39 Centigrade -25 95 -20 90
Current: 5.490 mAmps 1.000 17.000 2.000 14.000
Voltage: 3313.4 mVolts 2700.0 3900.0 2900.0 3700.0
RX Power: -9.3 dBm (116.8 uW) 10.0 uW 1259.0 uW 15.8 uW 794.0 uW
TX Power: -4.6 dBm (346.9 uW) 67.0 uW 631.0 uW 79.0 uW 631.0 uW

 

And here's the one on the 6150:

 

Identifier: 3 SFP
Connector: 7 LC
Transceiver: 540c404000000000 2,4,8_Gbps M5,M6 sw Short_dist
Encoding: 1 8B10B
Baud Rate: 85 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u (OM2): 5 (units 10 meters)
Length 50u (OM3): 0 (units 10 meters)
Length 62.5u:2 (units 10 meters)
Length Cu: 0 (units 1 meter)
Vendor Name: HP-F BROCADE
Vendor OUI: 00:05:1e
Vendor PN: AJ716B
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 003a Loss_of_Sig,Tx_Fault,Tx_Disable
BR Max: 0
BR Min: 0
Serial No: UAF413410000PRU
Date Code: 131011
DD Type: 0x68
Enh Options: 0xfa
Status/Ctrl: 0x82
Alarm flags[0,1] = 0x5, 0x0
Warn Flags[0,1] = 0x5, 0x0
Alarm Warn
low high low high
Temperature: 49 Centigrade -10 90 -5 85
Current: 8.082 mAmps 1.000 17.000 2.000 14.000
Voltage: 3259.1 mVolts 2900.0 3700.0 3000.0 3600.0
RX Power: -17.9 dBm (16.2 uW) 10.0 uW 1258.9 uW 15.8 uW 1000.0 uW
TX Power: -3.4 dBm (460.0 uW) 125.9 uW 631.0 uW 158.5 uW 562.3 uW


Kind regards,
Erwin van Londen
Brocade Distinguished Architect
http://www.erwinvanlonden.net The Fibre Channel blog


Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.