Fibre Channel (SAN)

Reply
Frequent Contributor
Posts: 107
Registered: ‎04-05-2011

How to investigate a High frjt and fbusy counters

My fabric is one director only and I'm experiencing a high count of fbusy and frjt metrics in a few minutes. I would like to know hot to start the troubleshooting, since I dont see any physical issues

 

SAN_48K> porterrshow |grep -v "0      0      0      0      0      0      0      0      0      0      0      0      0"
          frames      enc    crc    crc    too    too    bad    enc   disc   link   loss   loss   frjt   fbsy
       tx     rx      in    err    g_eof  shrt   long   eof     out   c3    fail    sync   sig
     =========================================================================================================
 11:    8.9m  66.0m   0      0      0      0      0      0      0      0      0      0      0    113      0
 24:    3.1m   1.1m   0      0      0      0      0      0      0      0      0      0      0    683      0
 55:  416.8m 255.8m   0      0      0      0      0      0      0      0      0      0      0      9      0
 78:    4.6m  32.9m   0      0      0      0      0      0      0      0      0      0      0    460      0
 95:    2.3m  32.7m   0      0      0      0      0      0      0      0      0      0      0     62      0
128:   33.1k  30.6k   0      0      0      0      0      0      0      0      0      0      0      9      0
130:    8.4k   8.1k   0      0      0      0      0      0      0      0      0      0      0    729      0
131:   18.5k  18.0k   0      0      0      0      0      0      0      0      0      0      0    722      0
144:   14.3k  14.0k   0      0      0      0      0      0      0      0      0      0      0     94      0
149:    3.1m   1.2m   0      0      0      0      0      0      0      0      0      0      0    615      0
163:   14.8k  14.9k   0      0      0      0      0      0      0      0      0      0      0     26      0
170:    3.0m 496.2k   0      0      0      0      0      0      0      0      0      0      0     39      0
176:   70.9m 374.1m   0      0      0      0      0      0      0      0      0      0      0     86      0
186:  585.4m 247.4m   0      0      0      0      0      0      0      0      0      0      0      9      0
188:  159.6m 266.5m   0      0      0      0      0      0      0      0      0      0      0     20      0
195:   22.0k  23.8k   0      0      0      0      0      0      0      0      0      0      0     48      0
210:  103.8m   1.3g   0      0      0      0      0      0      0      0      0      0      0    167      0
240:  344.6m 314.2m   0      0      0      0      0      0      0      0      0      0      0    800      0
243:    1.0g  79.2m   0      0      0      0      0      0      0      0      0      0      0     11    257
244:  411.1m 811.7m   0      0      0      0      0      0      0      0      0      0      0    804      0
251:  736.8m 106.8m   0      0      0      0      0      0      0      0      0      0      0     11    173
252:    6.4k   5.3k   0      0      0      0      0      0      0      0      0      0      0    230      0

Frequent Contributor
Posts: 80
Registered: ‎01-28-2010

Re: How to investigate a High frjt and fbusy counters

still need help with this?

 

 

Frequent Contributor
Posts: 107
Registered: ‎04-05-2011

Re: How to investigate a High frjt and fbusy counters

Hi!

 

Yes!

 

I'm trying to find more detailed documentation about this.

Frequent Contributor
Posts: 80
Registered: ‎01-28-2010

Re: How to investigate a High frjt and fbusy counters

so the ports in the porterrshow output are the only ports on this switch/director that show this behaviour?

 

first guess, one of the systems on your san is so much occupied with itself that it stopped answering and thus rejects incoming frames.

 

about the porterr output in the OP, can you tell us what ports are HOST and Storage ports.

 

i would check if there is a storage processor that is already on its performance edge.

 

this is just a first guess.

maybe you find a bit of time to have a look into this

Frequent Contributor
Posts: 107
Registered: ‎04-05-2011

Re: How to investigate a High frjt and fbusy counters

Hi doges, Returning to this case this week. I'll separate both host and target ports and enumerate them to you

Frequent Contributor
Posts: 141
Registered: ‎05-26-2009

Re: How to investigate a High frjt and fbusy counters

Are you sure they increased in minutes? These both counters usually don't get cleared with statsclear & Co. So it might be that it just had their old value...

Frequent Contributor
Posts: 107
Registered: ‎04-05-2011

Re: How to investigate a High frjt and fbusy counters

Hello Seb!

 

Unfortunately i had issuead a portstatsclear and after some minutes new erros incremented.

 

By issuing this command, the counter are cleared successfully:

251:    3.3g   4.2g   0      0      0      0      0      0      0      0      0      0      0     47      0
252:    0      0      0      0      0      0      0      0      0      0      0      0      0      0      0
253:    2.5k  20.7k   0      0      0      0      0      0      0      0      0      0      0      0      0
254:    0      0      0      0      0      0      0      0      0      0      0      0      0      0      0
255:    0      0      0      0      0      0      0      0      0      0      0      0      0      0      0
48K_C1:sanadm> switchshow |grep 251
251   10   27   c1fb00   id    N4   Online      FC  F-Port  50:05:07:64:05:00:38:9c
48K_C1:sanadm> portstatsclear 10/27
48K_C1:sanadm> porterrshow |grep "^251"
251:  190.3k  30.7k   0      0      0      0      0      0      0      0      0      0      0      0      0

Frequent Contributor
Posts: 141
Registered: ‎05-26-2009

Re: How to investigate a High frjt and fbusy counters

Just for the others: Portlogdump -> check S_IDs and D_IDs of the requests being rejected  (in this case it was FICON doing Class 2) -> Check if destination is online and zoned -> wasn't online -> intended or not? -> was intended -> check path definitions on mainframe -> drop obsolete path definitions.

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.

Download FREE NVMe eBook