Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

ISL between 5100/4100 Latency issues

[ Edited ]

2014/10/23-23:46:46, [AN-1010], 30, FID 128, WARNING, i-mqn-fcsw-cor-03, Severe latency bottleneck detected at slot 0 port 38.

I have no enc out errors on either switch. Latency is on the 5100 ISL port.

 

I see the timeouts - how do I add buffer credits to 4100 trunk E-port without disruption? Do I make same change on 5100 ISL port?

I appreciate any help possible - thanks.

 

 

Here is portstats on edge switch (a 4100) ISL port master

 

i-mqn-fcsw-edg-15:admin> portstatsshow 4
stat_wtx 3820108748 4-byte words transmitted
stat_wrx 210202436 4-byte words received
stat_ftx 89301479 Frames transmitted
stat_frx 44860311 Frames received
stat_cdr_frx 0 Class 2 frames received
stat_c3_frx 44838257 Class 3 frames received
stat_lc_rx 9782 Link control frames received
stat_mc_rx 0 Multicast frames received
stat_mc_to 0 Multicast timeouts
stat_mc_tx 0 Multicast frames transmitted
tim_rdy_pri 450 Time R_RDY high priority
tim_txcrd_z 1042541 Time BB credit zero (2.5Us ticks)
er_enc_in 0 Encoding errors inside of frames
er_crc 0 Frames with CRC errors
er_trunc 0 Frames shorter than minimum
er_toolong 0 Frames longer than maximum
er_bad_eof 0 Frames with bad end-of-frame
er_enc_out 0 Encoding error outside of frames
er_bad_os 0 Invalid ordered set
er_rx_c3_timeout 112 Class 3 receive frames discarded due to timeout
er_tx_c3_timeout 0 Class 3 transmit frames discarded due to timeout
er_c3_dest_unreach 8 Class 3 frames discarded due to destination unreachable
er_other_discard 2 Other discards
er_zone_discard 0 Class 3 frames discarded due to zone mismatch
er_crc_good_eof 0 Crc error with good eof
er_inv_arb 0 Invalid ARB
open 0 loop_open
transfer 0 loop_transfer
opened 0 FL_Port opened
starve_stop 0 tenancies stopped due to starvation
fl_tenancy 0 number of times FL has the tenancy
nl_tenancy 0 number of times NL has the tenancy
zero_tenancy 0 zero tenancy

 

 

 

Here is ISL port on 5100

 

i-mqn-fcsw-cor-03:admin> portstatsshow 38
stat_wtx 4246547488 4-byte words transmitted
stat_wrx 3273242009 4-byte words received
stat_ftx 44134421 Frames transmitted
stat_frx 88099810 Frames received
stat_c2_frx 0 Class 2 frames received
stat_c3_frx 88078225 Class 3 frames received
stat_lc_rx 12015 Link control frames received
stat_mc_rx 0 Multicast frames received
stat_mc_to 0 Multicast timeouts
stat_mc_tx 0 Multicast frames transmitted
tim_rdy_pri 0 Time R_RDY high priority
tim_txcrd_z 1588767 Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc 0- 3: 0 0 0 0
tim_txcrd_z_vc 4- 7: 2934508 0 0 0
tim_txcrd_z_vc 8-11: 0 0 0 0
tim_txcrd_z_vc 12-15: 0 0 0 0
er_enc_in 0 Encoding errors inside of frames
er_crc 0 Frames with CRC errors
er_trunc 0 Frames shorter than minimum
er_toolong 0 Frames longer than maximum
er_bad_eof 0 Frames with bad end-of-frame
er_enc_out 0 Encoding error outside of frames
er_bad_os 0 Invalid ordered set
er_rx_c3_timeout 0 Class 3 receive frames discarded due to timeout
er_tx_c3_timeout 38 Class 3 transmit frames discarded due to timeout
er_c3_dest_unreach 0 Class 3 frames discarded due to destination unreachable
er_other_discard 0 Other discards
er_type1_miss 0 frames with FTB type 1 miss
er_type2_miss 0 frames with FTB type 2 miss
er_type6_miss 0 frames with FTB type 6 miss
er_zone_miss 0 frames with hard zoning miss
er_lun_zone_miss 0 frames with LUN zoning miss
er_crc_good_eof 0 Crc error with good eof
er_inv_arb 0 Invalid ARB
open 0 loop_open
transfer 0 loop_transfer
opened 0 FL_Port opened
starve_stop 0 tenancies stopped due to starvation
fl_tenancy 0 number of times FL has the tenancy
nl_tenancy 0 number of times NL has the tenancy
zero_tenancy 0 zero tenancy

External Moderator
Posts: 4,780
Registered: ‎02-23-2004

Re: ISL between 5100/4100 Latency issues

pbarwick,

 

before you made some change, check with command "portbuffershow" the buffer usage on affected ports.

 

another option is, you can try to disable QoS, and set the Port's as LE.

 

such operation are disruptive.

 

 

TechHelp24
Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

Re: ISL between 5100/4100 Latency issues

I have qos disabled already on the ISL ports.

 

So do I set ISL ports on both side to LE or just on the 4100?

Will traffic fail over to my secondary trunk port, or should I have storage access shutdown?

 

Thanks so much for your help.

 

-Patrick

 

 

External Moderator
Posts: 4,780
Registered: ‎02-23-2004

Re: ISL between 5100/4100 Latency issues

Patrick,

 

what is the output of "portbuffershow" ?

 

-->>So do I set ISL ports on both side to LE or just on the 4100?

 

both side

 

--->>Will traffic fail over to my secondary trunk port,...

 

how many Trunk group have you created ?

 

if you have Only ONE Trunk Group, the operation is disruptive.

 

"trunkshow" command, display trunking information

 

 

TechHelp24
Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

Re: ISL between 5100/4100 Latency issues

portbuffershow. relevant ports are 

 

33 - 8 - ( - ) - ( - ) 0 - -
34 E - 8 - ( - ) - ( - ) 26 26 2km
35 E - 8 - ( - ) - ( - ) 26 26 <2km
36 - 8 - ( - ) - ( - ) 0 - -
37 - 8 - ( - ) - ( - ) 0 - -
38 E - 8 - ( 64) - ( 256) 26 26 2km
39 E - 8 - ( - ) - ( - ) 26 26 <2km 1620

 

Trunkshow for this edge switch.

 

2: 38-> 4 10:00:00:05:1e:02:17:24 15 deskew 16 MASTER
34-> 0 10:00:00:05:1e:02:17:24 15 deskew 15

 

Thanks for quick responses.

 

 

Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

Re: ISL between 5100/4100 Latency issues

I do have another edge switch on 2 more trunk ports - that hosts are connected to, so disruption so be on only half the paths.

I am thinking this would be ok to change off hours.

 

Also, will the portcfgfillword need to be adjusted since 4gb and 8gb talk differently?

 

 

External Moderator
Posts: 4,780
Registered: ‎02-23-2004

Re: ISL between 5100/4100 Latency issues

patrick,

 

sorry to say, you should post all relevant information at same time.

 

if you are not sure how you san is configiured, run SAN-health and send me it by email

 

abongiorno@techhelp24.net

 

from trunkshow output you post here, show to me you have only ONE trunk group

 

now you talk

 

--->>>I do have another edge switch on 2 more trunk ports 

 

trunk group and trunk port is not the same

 

--->>>Also, will the portcfgfillword need to be adjusted since 4gb and 8gb talk differently?

 

best practices is, since you have TWO different speed switch to set the port speed as fixed in this case at 4Gb and not as Auto Negotiation.

 

and yes, portcfgfillword should have same value.

 

additional I would check the FOS release and if necessary to upgrade to.

TechHelp24
Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

Re: ISL between 5100/4100 Latency issues

OK - I'll set port speed. I have read that this helps.

 

Proper trunkshow output.

 

i-mqn-fcsw-cor-03:admin> trunkshow
1: 35-> 35 10:00:00:27:f8:87:30:70 2 deskew 15 MASTER
39-> 39 10:00:00:27:f8:87:30:70 2 deskew 29

2: 38-> 4 10:00:00:05:1e:02:17:24 15 deskew 16 MASTER
34-> 0 10:00:00:05:1e:02:17:24 15 deskew 15

 

4100 - Fabric OS:  v6.4.2a

5100  - Fabric OS:  v7.2.1a

 

I will run San Health and email you. - thanks again for your assistance.

 

Occasional Contributor
Posts: 12
Registered: ‎11-17-2011

Re: ISL between 5100/4100 Latency issues

Are you with Brocade? Techhelp24.net email address is not a brocade address is it?

 

 

 

External Moderator
Posts: 4,780
Registered: ‎02-23-2004

Re: ISL between 5100/4100 Latency issues

no, I'm not

TechHelp24

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.