Fibre Channel (SAN)

Reply
Highlighted
Contributor
Posts: 26
Registered: ‎05-16-2017
Accepted Solution

B2B Credit and Port Config

Dear Brocade Guy´s

 

We have Dual Fabric and I see a lott of B2B Zero so we have 2 ISL one over 16 km and one over 32 km DWDM 8Gb, we use two Core Switch one is 5300 80 Port and the second is 6510 48 Port

 

Question: we configured ISL together with Storage Port in Group 5 the Remaining Buffer is 84 and also in Group 2 the Remaining Buffer is 38 is it better we connect the ISL to Group 1 Remaining Buffer 292 and Group 4 Remaining Buffer 274.

 

S000PS03:admin>  portbuffershow
User     Port     Lx     Max/Resv  Avg Buffer Usage & FrameSize    Buffer Needed     Link     Remaining
Port     Type    Mode    Buffers        Tx         Rx              Usage  Buffers   Distance  Buffers
----     ----    ----    -------   ----------------------------    ------ -------   --------- ----------
   0       F      Storage    8        1(2044)      - ( 104)           8       -          -
   1       F      Storage    8        1(1900)      - ( 888)           8       -          -
   2       F      Storage    8        1(1540)       1(1312)           8       -          -
   3       F      Storage    8        1(1844)       1(1956)           8       -          -
   4       F      Storage    8       - ( 236)       1(1904)           8       -          -
   5       F      Storage    8        1(1760)      - ( 964)           8       -          -
   6       F      Storage    8        1(1772)      - ( 464)           8       -          -
   7       F      Storage    8        1(1052)      - ( 988)           8       -          -
   8       F      Storage    8       - ( 276)       1(1896)           8       -          -
   9       F      Storage    8        1(1312)      - ( 368)           8       -          -
  10       F      Storage    8        1(1856)       1(1956)           8       -          -
  11       F      Storage    8       - ( 996)       1(1044)           8       -          -
  12       F      Storage    8       - ( 416)      - ( 276)           8       -          -
  13               -         8       - (  - )      - (  - )           0       -          -
  14               -         8       - (  - )      - (  - )           0       -          -
  15               -         8       - (  - )      - (  - )           0       -          -       292
---------------------------------------------------------------------------------------------------------
  16       F       -         8       - (  84)      - ( 900)           8       -          -
  17       F       -         8        1(1292)      - ( 360)           8       -          -
  18               -         8       - (  - )      - (  - )           0       -          -
  19               -         8       - (  - )      - (  - )           0       -          -
  20               -         8       - (  - )      - (  - )           0       -          -
  21       F       -         8       - (  68)       1(1144)           8       -          -
  22       F       -         8       - ( 988)       1(1104)           8       -          -
  23               -         8       - (  - )      - (  - )           0       -          -
  24       F       -         8        1(1860)      - ( 108)           8       -          -
  25       F       -         8        1(2008)      - ( 972)           8       -          -
  26               -         8       - (  - )      - (  - )           0       -          -
  27               -         8       - (  - )      - (  - )           0       -          -
  28       F       -         8       - (  - )      - (  - )           8       -          -
  29               -         8       - (  - )      - (  - )           0       -          -
  30               -         8       - (  - )      - (  - )           0       -          -
  31       E      LS       262       32(1004)      33(1060)         262     262        64km       38
---------------------------------------------------------------------------------------------------------
  32       F       -         8        1(2004)      - (1016)           8       -          -
  33               -         8       - (  - )      - (  - )           0       -          -
  34               -         8       - (  - )      - (  - )           0       -          -
  35       F       -         8        1(1868)      - (  96)           8       -          -
  36               -         8       - (  - )      - (  - )           0       -          -
  37               -         8       - (  - )      - (  - )           0       -          -
  38               -         8       - (  - )      - (  - )           0       -          -
  39               -         8       - (  - )      - (  - )           0       -          -
  40       E       -         8       - (  76)       1(2044)          26      26        <2km
  41       E       -         8       - ( 148)       1(2032)          26      26        <2km
  42               -         8       - (  - )      - (  - )           0       -          -
  43       E       -         8       - (  52)       2(2048)          26      26        <2km
  44               -         8       - (  - )      - (  - )           0       -          -
  45               -         8       - (  - )      - (  - )           0       -          -
  46               -         8       - (  - )      - (  - )           0       -          -
  47               -         8       - (  - )      - (  - )           0       -          -       238
---------------------------------------------------------------------------------------------------------
  48       F       -         8       - ( 152)       1(1744)           8       -          -
  49               -         8       - (  - )      - (  - )           0       -          -
  50       F       -         8       - (  - )      - (  - )           8       -          -
  51       F       -         8       - (  - )      - (  - )           8       -          -
  52       F       -         8       - (  - )      - (  - )           8       -          -
  53               -         8       - (  - )      - (  - )           0       -          -
  54       F       -         8       - (  - )      - (  - )           8       -          -
  55       F       -         8       - (  - )      - (  - )           8       -          -
  56       F       -         8       - (  - )      - (  - )           8       -          -
  57       F       -         8       - (  - )      - (  - )           8       -          -
  58       F       -         8       - (  - )      - (  - )           8       -          -
  59               -         8       - (  - )      - (  - )           0       -          -
  60       F       -         8       - (  - )      - (  - )           8       -          -
  61       F       -         8       - (  - )      - (  - )           8       -          -
  62       F       -         8       - (  84)       1(2032)           8       -          -
  63       E       -         8       - ( 552)       1(1832)          26      26        <2km      274
---------------------------------------------------------------------------------------------------------
  64               -         8       - (  - )      - (  - )           0       -          -
  65               -         8       - (  - )      - (  - )           0       -          -
  66               -         8       - (  - )      - (  - )           0       -          -
  67       E       -         8        1(1656)       1(1588)          26      26        <2km
  68               -         8       - (  - )      - (  - )           0       -          -
  69               -         8       - (  - )      - (  - )           0       -          -
  70               -         8       - (  - )      - (  - )           0       -          -
  71       F       Storage   8       - (  - )      - (  - )           8       -          -
  72       F       Storage   8       - (  - )      - (  - )           8       -          -
  73       F       Storage   8        1(1960)       1(1860)           8       -          -
  74       F       Storage   8       - (  - )      - (  - )           8       -          -
  75       E       LS      198       24(1020)      26(1076)         198     198        48km
  76       F       Storage   8       - (  - )      - (  - )           8       -          -
  77       F       Storage   8       - (  - )      - (  - )           8       -          -
  78       F       Storage   8        1(1956)       1(1848)           8       -          -
  79       F       Storage   8       - (  - )      - (  - )           8       -          -        84

Broadcom Moderator
Posts: 455
Registered: ‎03-29-2011

Re: B2B Credit and Port Config

Hi,

 

it is pretty normal to see B2B zero on ISLs. Do see latency messages (AN-) for the E-port or not? You do have bottlenckmon configure or FPI enabled (for FOS 7.3 and 7.4). BD and FPI measure B2B every seconds and react much faster than any SNMP based tool (should pull data at most every 5 min for long time duration).

 

 You have to put in relation ship to the traffic on the link, e.g. compare the value for B2B against the numbers of transmitted frames - use the counters from "portstats64show -long E-port", e.g.

 

tim64_txcrd_z / stat64_ftx

 

and if this goes above 100% then I get worries. First things to take a look at average frame size - I see that you have doubled your distance below, so you handle from1024 bytes frame nicely. The portstats64show stat64_aveTxFrameSize give you the average frame in FC words, to multiply with 4 to get bytes.

 

For the 5300 and 6410, if you put your long distance ISL in the port groups with no storage, the backend ASIC in the 5300 and 6510 will do some buffering from you. Of course, if you put your ISL in the same group (ASIC) as the storage / host, then you can use the local switch (E-port to F-port).  I would probably go for the Group1 and or Group 4 since you more buffers if needed. And local switch is double edge swords, since a slow drain port taking traffic from the ISL can cause back pressure on to the ISL, but that is an extreme case.

 




If this provided you with a solution to this issue, please mark it with the button at the bottom "Accept as solution".


Any and all information provided by me is not reviewed, approved or endorsed by Brocade and is provided solely as a convenience for Brocade customers. All systems and all networks are different and unique. If you have a service affecting network problem, please open a TAC service request for service through Brocade, or through your OEM equipment provider. If this provided you with a solution to this issue, please mark it with the button at the bottom "Accept as solution"
Contributor
Posts: 26
Registered: ‎05-16-2017

Re: B2B Credit and Port Config

Dear Martin,

 

Thank you for your replay, now this is the portstatsshow from the 2 ISL

 

RZ 1

S001PS03:admin> portstatsshow 0
stat_wtx                109955280   4-byte words transmitted
stat_wrx                4004093722  4-byte words received
stat_ftx                624134681   Frames transmitted
stat_frx                1012694952  Frames received
stat_c2_frx             0           Class 2 frames received
stat_c3_frx             1012692259  Class 3 frames received
stat_lc_rx              1346        Link control frames received
stat_mc_rx              0           Multicast frames received
stat_mc_to              0           Multicast timeouts
stat_mc_tx              0           Multicast frames transmitted
tim_rdy_pri             28317       Time R_RDY high priority
tim_txcrd_z             1763798     Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc  0- 3:  1723959     0           39839       0         
tim_txcrd_z_vc  4- 7:  0           0           0           0         
tim_txcrd_z_vc  8-11:  0           0           0           0         
tim_txcrd_z_vc 12-15:  0           0           0           0         
tim_latency_vc  0- 3:  1           1           2           1         
tim_latency_vc  4- 7:  1           1           1           1         
tim_latency_vc  8-11:  1           1           1           1         
tim_latency_vc 12-15:  1           1           1           1         
fec_cor_detected        0           Count of blocks that were corrected by FEC
fec_uncor_detected      0           Count of blocks that were left uncorrected by FEC
er_enc_in               0           Encoding errors inside of frames
er_crc                  0           Frames with CRC errors
er_trunc                0           Frames shorter than minimum
er_toolong              0           Frames longer than maximum
er_bad_eof              0           Frames with bad end-of-frame
er_enc_out              0           Encoding error outside of frames
er_bad_os               0           Invalid ordered set
er_pcs_blk              0           PCS block errors
er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout
er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout
er_unroutable           0           Frames that are unroutable
er_unreachable          0           Frames with unreachable destination
er_other_discard        0           Other discards
er_type1_miss           0           frames with FTB type 1 miss
er_type2_miss           0           frames with FTB type 2 miss
er_type6_miss           0           frames with FTB type 6 miss
er_zone_miss            0           frames with hard zoning miss
er_lun_zone_miss        0           frames with LUN zoning miss
er_crc_good_eof         0           Crc error with good eof
er_inv_arb              0           Invalid ARB
er_single_credit_loss    0           Single vcrdy/frame loss on link
er_multi_credit_loss    0           Multiple vcrdy/frame loss on link
phy_stats_clear_ts      10-02-2017 CEST Mon 07:20:07    Timestamp of phy_port stats clear
lgc_stats_clear_ts      10-02-2017 CEST Mon 07:20:07    Timestamp of lgc_port stats clear
S001PS03:admin> portstatsshow 4
stat_wtx                4056566464  4-byte words transmitted
stat_wrx                3293827303  4-byte words received
stat_ftx                620892908   Frames transmitted
stat_frx                1010672309  Frames received
stat_c2_frx             0           Class 2 frames received
stat_c3_frx             1010634423  Class 3 frames received
stat_lc_rx              16909       Link control frames received
stat_mc_rx              0           Multicast frames received
stat_mc_to              0           Multicast timeouts
stat_mc_tx              0           Multicast frames transmitted
tim_rdy_pri             36399       Time R_RDY high priority
tim_txcrd_z             10945035    Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc  0- 3:  10918857    0           26178       0         
tim_txcrd_z_vc  4- 7:  0           0           0           0         
tim_txcrd_z_vc  8-11:  0           0           0           0         
tim_txcrd_z_vc 12-15:  0           0           0           0         
tim_latency_vc  0- 3:  1           1           19          1         
tim_latency_vc  4- 7:  1           1           1           1         
tim_latency_vc  8-11:  1           1           1           1         
tim_latency_vc 12-15:  1           1           1           1         
fec_cor_detected        0           Count of blocks that were corrected by FEC
fec_uncor_detected      0           Count of blocks that were left uncorrected by FEC
er_enc_in               0           Encoding errors inside of frames
er_crc                  0           Frames with CRC errors
er_trunc                0           Frames shorter than minimum
er_toolong              0           Frames longer than maximum
er_bad_eof              0           Frames with bad end-of-frame
er_enc_out              0           Encoding error outside of frames
er_bad_os               0           Invalid ordered set
er_pcs_blk              0           PCS block errors
er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout
er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout
er_unroutable           0           Frames that are unroutable
er_unreachable          0           Frames with unreachable destination
er_other_discard        0           Other discards
er_type1_miss           0           frames with FTB type 1 miss
er_type2_miss           0           frames with FTB type 2 miss
er_type6_miss           0           frames with FTB type 6 miss
er_zone_miss            0           frames with hard zoning miss
er_lun_zone_miss        0           frames with LUN zoning miss
er_crc_good_eof         0           Crc error with good eof
er_inv_arb              0           Invalid ARB
er_single_credit_loss    0           Single vcrdy/frame loss on link
er_multi_credit_loss    0           Multiple vcrdy/frame loss on link
phy_stats_clear_ts      10-02-2017 CEST Mon 07:20:07    Timestamp of phy_port stats clear
lgc_stats_clear_ts      10-02-2017 CEST Mon 07:20:07    Timestamp of lgc_port stats clear
S001PS03:admin>

 

RZ 2

 

S000PS03:admin> portstatsshow 31
stat_wtx                1892379147  4-byte words transmitted
stat_wrx                3326180451  4-byte words received
stat_ftx                1006771011  Frames transmitted
stat_frx                618638490   Frames received
stat_c2_frx             0           Class 2 frames received
stat_c3_frx             618614333   Class 3 frames received
stat_lc_rx              13521       Link control frames received
stat_mc_rx              0           Multicast frames received
stat_mc_to              0           Multicast timeouts
stat_mc_tx              0           Multicast frames transmitted
tim_rdy_pri             4117        Time R_RDY high priority
tim_txcrd_z             804982      Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc  0- 3:  804982      0           0           0         
tim_txcrd_z_vc  4- 7:  0           0           0           0         
tim_txcrd_z_vc  8-11:  0           0           0           0         
tim_txcrd_z_vc 12-15:  0           0           0           0         
er_enc_in               0           Encoding errors inside of frames
er_crc                  0           Frames with CRC errors
er_trunc                0           Frames shorter than minimum
er_toolong              0           Frames longer than maximum
er_bad_eof              0           Frames with bad end-of-frame
er_enc_out              0           Encoding error outside of frames
er_bad_os               0           Invalid ordered set
er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout
er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout
er_c3_dest_unreach      0           Class 3 frames discarded due to destination unreachable
er_other_discard        0           Other discards
er_type1_miss           0           frames with FTB type 1 miss
er_type2_miss           0           frames with FTB type 2 miss
er_type6_miss           0           frames with FTB type 6 miss
er_zone_miss            0           frames with hard zoning miss
er_lun_zone_miss        0           frames with LUN zoning miss
er_crc_good_eof         0           Crc error with good eof
er_inv_arb              0           Invalid ARB
open                    0           loop_open
transfer                0           loop_transfer
opened                  0           FL_Port opened
starve_stop             0           tenancies stopped due to starvation
fl_tenancy              0           number of times FL has the tenancy
nl_tenancy              0           number of times NL has the tenancy
zero_tenancy            0           zero tenancy
phy_stats_clear_ts      10-02-2017 CEST Mon 07:20:29    Timestamp of phy_port stats clear
lgc_stats_clear_ts      10-02-2017 CEST Mon 07:20:29    Timestamp of lgc_port stats clear
S000PS03:admin> portstatsshow 75
stat_wtx                3025753249  4-byte words transmitted
stat_wrx                3887162369  4-byte words received
stat_ftx                1009992329  Frames transmitted
stat_frx                622545986   Frames received
stat_c2_frx             0           Class 2 frames received
stat_c3_frx             622529592   Class 3 frames received
stat_lc_rx              8783        Link control frames received
stat_mc_rx              0           Multicast frames received
stat_mc_to              0           Multicast timeouts
stat_mc_tx              0           Multicast frames transmitted
tim_rdy_pri             2904        Time R_RDY high priority
tim_txcrd_z             0           Time TX Credit Zero (2.5Us ticks)
tim_txcrd_z_vc  0- 3:  0           0           0           0         
tim_txcrd_z_vc  4- 7:  0           0           0           0         
tim_txcrd_z_vc  8-11:  0           0           0           0         
tim_txcrd_z_vc 12-15:  0           0           0           0         
er_enc_in               0           Encoding errors inside of frames
er_crc                  0           Frames with CRC errors
er_trunc                0           Frames shorter than minimum
er_toolong              0           Frames longer than maximum
er_bad_eof              0           Frames with bad end-of-frame
er_enc_out              0           Encoding error outside of frames
er_bad_os               0           Invalid ordered set
er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout
er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout
er_c3_dest_unreach      0           Class 3 frames discarded due to destination unreachable
er_other_discard        0           Other discards
er_type1_miss           0           frames with FTB type 1 miss
er_type2_miss           0           frames with FTB type 2 miss
er_type6_miss           0           frames with FTB type 6 miss
er_zone_miss            0           frames with hard zoning miss
er_lun_zone_miss        0           frames with LUN zoning miss
er_crc_good_eof         0           Crc error with good eof
er_inv_arb              0           Invalid ARB
open                    0           loop_open
transfer                0           loop_transfer
opened                  0           FL_Port opened
starve_stop             0           tenancies stopped due to starvation
fl_tenancy              0           number of times FL has the tenancy
nl_tenancy              0           number of times NL has the tenancy
zero_tenancy            0           zero tenancy
phy_stats_clear_ts      10-02-2017 CEST Mon 07:20:29    Timestamp of phy_port stats clear
lgc_stats_clear_ts      10-02-2017 CEST Mon 07:20:29    Timestamp of lgc_port stats clear
S000PS03:admin>

S000PS03:admin> islshow
  1: 31->  4 10:00:00:27:f8:22:f9:95   7 S001PS03        sp:  8.000G bw:  8.000G
  2: 40-> 17 10:00:50:eb:1a:1d:28:53   3 S000PS16        sp:  8.000G bw:  8.000G
  3: 41-> 17 10:00:50:eb:1a:fd:21:e4  10 S000PS18        sp:  8.000G bw:  8.000G
  4: 43-> 17 10:00:00:27:f8:05:2b:8c   6 S000PS11        sp:  8.000G bw:  8.000G
  5: 63-> 17 10:00:c4:f5:7c:37:6e:12  12 S000PS20        sp:  8.000G bw:  8.000G
  6: 67-> 19 10:00:00:27:f8:60:bf:a3   5 S000PS13        sp:  8.000G bw:  8.000G
  7: 75->  0 10:00:00:27:f8:22:f9:95   7 S001PS03        sp:  8.000G bw:  8.000G

Best regards

Ernst

Contributor
Posts: 26
Registered: ‎05-16-2017

Re: B2B Credit and Port Config

Dear Martin,

 

Sorry wrong command,

 

S000PS03:admin> portstats64show 31  
stat64_wtx      84          top_int : 4-byte words transmitted
                41761074    bottom_int : 4-byte words transmitted
stat64_wrx      45          top_int : 4-byte words received
                4040572538  bottom_int : 4-byte words received
stat64_ftx      0           top_int : Frames transmitted
                1037729395  bottom_int : Frames transmitted
stat64_frx      0           top_int : Frames received
                634870600   bottom_int : Frames received
stat64_c2_frx    0           top_int : Class 2 frames received
                 0           bottom_int : Class 2 frames received
stat64_c3_frx    0           top_int : Class 3 frames received
                 634974548   bottom_int : Class 3 frames received
stat64_lc_rx    0           top_int : Link control frames received
                13664       bottom_int : Link control frames received
stat64_mc_rx    0           top_int : Multicast frames received
                0           bottom_int : Multicast frames received
stat64_mc_to    0           top_int : Multicast timeouts
                0           bottom_int : Multicast timeouts
stat64_mc_tx    0           top_int : Multicast frames transmitted
                0           bottom_int : Multicast frames transmitted
tim64_rdy_pri    0           top_int : Time R_RDY high priority
                4207        bottom_int : Time R_RDY high priority
tim64_txcrd_z    0           top_int : Time BB_credit zero
                839798      bottom_int : Time BB_credit zero
er64_enc_in     0           top_int : Encoding errors inside of frames
                0           bottom_int : Encoding errors inside of frames
er64_crc        0           top_int : Frames with CRC errors
                0           bottom_int : Frames with CRC errors
er64_trunc      0           top_int : Frames shorter than minimum
                0           bottom_int : Frames shorter than minimum
er64_toolong    0           top_int : Frames longer than maximum
                0           bottom_int : Frames longer than maximum
er64_bad_eof    0           top_int : Frames with bad end-of-frame
                0           bottom_int : Frames with bad end-of-frame
er64_enc_out    0           top_int : Encoding error outside of frames
                0           bottom_int : Encoding error outside of frames
er64_disc_c3    0           top_int : Class 3 frames discarded
                0           bottom_int : Class 3 frames discarded
er64_pcs_blk    0           top_int : PCS block errors
                0           bottom_int : PCS block errors
stat64_rateTxFrame    37321       Tx frame rate (fr/sec)
stat64_rateRxFrame    28564       Rx frame rate (fr/sec)
stat64_rateTxPeakFrame    99139       Tx peak frame rate (fr/sec)
stat64_rateRxPeakFrame    53630       Rx peak frame rate (fr/sec)
stat64_rateTxWord    12509493    Tx Word rate (words/sec)
stat64_rateRxWord    9206675     Rx Word rate (words/sec)
stat64_rateTxPeakWord    39251069    Tx peak Word rate (words/sec)
stat64_rateRxPeakWord    18735120    Rx peak Word rate (words/sec)
stat64_PRJTFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_PBSYFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_inputBuffersFull    0           top_int : 4-byte words transmitted
                           0           bottom_int : 4-byte words transmitted
stat64_rxClass1Frames    0           top_int : 4-byte words transmitted
                         0           bottom_int : 4-byte words transmitted
stat64_aveTxFrameSize    335         Average Tx Frame size
stat64_aveRxFrameSize    322         Average Rx Frame size
S000PS03:admin> portstats64show 75
stat64_wtx      84          top_int : 4-byte words transmitted
                1464237920  bottom_int : 4-byte words transmitted
stat64_wrx      46          top_int : 4-byte words received
                404850249   bottom_int : 4-byte words received
stat64_ftx      0           top_int : Frames transmitted
                1041738801  bottom_int : Frames transmitted
stat64_frx      0           top_int : Frames received
                639157459   bottom_int : Frames received
stat64_c2_frx    0           top_int : Class 2 frames received
                 0           bottom_int : Class 2 frames received
stat64_c3_frx    0           top_int : Class 3 frames received
                 639132633   bottom_int : Class 3 frames received
stat64_lc_rx    0           top_int : Link control frames received
                8905        bottom_int : Link control frames received
stat64_mc_rx    0           top_int : Multicast frames received
                0           bottom_int : Multicast frames received
stat64_mc_to    0           top_int : Multicast timeouts
                0           bottom_int : Multicast timeouts
stat64_mc_tx    0           top_int : Multicast frames transmitted
                0           bottom_int : Multicast frames transmitted
tim64_rdy_pri    0           top_int : Time R_RDY high priority
                2998        bottom_int : Time R_RDY high priority
tim64_txcrd_z    0           top_int : Time BB_credit zero
                0           bottom_int : Time BB_credit zero
er64_enc_in     0           top_int : Encoding errors inside of frames
                0           bottom_int : Encoding errors inside of frames
er64_crc        0           top_int : Frames with CRC errors
                0           bottom_int : Frames with CRC errors
er64_trunc      0           top_int : Frames shorter than minimum
                0           bottom_int : Frames shorter than minimum
er64_toolong    0           top_int : Frames longer than maximum
                0           bottom_int : Frames longer than maximum
er64_bad_eof    0           top_int : Frames with bad end-of-frame
                0           bottom_int : Frames with bad end-of-frame
er64_enc_out    0           top_int : Encoding error outside of frames
                0           bottom_int : Encoding error outside of frames
er64_disc_c3    0           top_int : Class 3 frames discarded
                0           bottom_int : Class 3 frames discarded
er64_pcs_blk    0           top_int : PCS block errors
                0           bottom_int : PCS block errors
stat64_rateTxFrame    46963       Tx frame rate (fr/sec)
stat64_rateRxFrame    34437       Rx frame rate (fr/sec)
stat64_rateTxPeakFrame    103594      Tx peak frame rate (fr/sec)
stat64_rateRxPeakFrame    53801       Rx peak frame rate (fr/sec)
stat64_rateTxWord    15274712    Tx Word rate (words/sec)
stat64_rateRxWord    10286582    Rx Word rate (words/sec)
stat64_rateTxPeakWord    41106456    Tx peak Word rate (words/sec)
stat64_rateRxPeakWord    18749712    Rx peak Word rate (words/sec)
stat64_PRJTFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_PBSYFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_inputBuffersFull    0           top_int : 4-byte words transmitted
                           0           bottom_int : 4-byte words transmitted
stat64_rxClass1Frames    0           top_int : 4-byte words transmitted
                         0           bottom_int : 4-byte words transmitted
stat64_aveTxFrameSize    325         Average Tx Frame size
stat64_aveRxFrameSize    298         Average Rx Frame size
S000PS03:admin>

 

islshow
S001PS03:admin> islshow
  1:  0-> 75 10:00:00:05:1e:a4:8a:2b   1 S000PS03        sp:  8.000G bw:  8.000G
  2:  4-> 31 10:00:00:05:1e:a4:8a:2b   1 S000PS03        sp:  8.000G bw:  8.000G
  3: 10-> 17 10:00:00:27:f8:38:1d:c7   8 S001PS06        sp:  8.000G bw:  8.000G
  4: 14-> 18 10:00:00:27:f8:97:8b:09   9 S001PS07        sp:  8.000G bw:  8.000G
  5: 16-> 18 10:00:50:eb:1a:1d:28:51   4 S001PS09        sp:  8.000G bw:  8.000G
  6: 20-> 17 10:00:50:eb:1a:fd:21:e0   2 S001PS13        sp:  8.000G bw:  8.000G
  7: 32-> 17 10:00:c4:f5:7c:25:26:5f  11 S001PS15        sp:  8.000G bw:  8.000G
S001PS03:admin> portstats64show 0
stat64_wtx      46          top_int : 4-byte words transmitted
                1310444202  bottom_int : 4-byte words transmitted
stat64_wrx      84          top_int : 4-byte words received
                3178197550  bottom_int : 4-byte words received
stat64_ftx      0           top_int : Frames transmitted
                642086154   bottom_int : Frames transmitted
stat64_frx      0           top_int : Frames received
                1046635811  bottom_int : Frames received
stat64_c2_frx    0           top_int : Class 2 frames received
                 0           bottom_int : Class 2 frames received
stat64_c3_frx    0           top_int : Class 3 frames received
                 1046733226  bottom_int : Class 3 frames received
stat64_lc_rx    0           top_int : Link control frames received
                1386        bottom_int : Link control frames received
stat64_mc_rx    0           top_int : Multicast frames received
                0           bottom_int : Multicast frames received
stat64_mc_to    0           top_int : Multicast timeouts
                0           bottom_int : Multicast timeouts
stat64_mc_tx    0           top_int : Multicast frames transmitted
                0           bottom_int : Multicast frames transmitted
tim64_rdy_pri    0           top_int : Time R_RDY high priority
                29073       bottom_int : Time R_RDY high priority
tim64_txcrd_z    0           top_int : Time BB_credit zero
                1764350     bottom_int : Time BB_credit zero
er64_enc_in     0           top_int : Encoding errors inside of frames
                0           bottom_int : Encoding errors inside of frames
er64_crc        0           top_int : Frames with CRC errors
                0           bottom_int : Frames with CRC errors
er64_trunc      0           top_int : Frames shorter than minimum
                0           bottom_int : Frames shorter than minimum
er64_toolong    0           top_int : Frames longer than maximum
                0           bottom_int : Frames longer than maximum
er64_bad_eof    0           top_int : Frames with bad end-of-frame
                0           bottom_int : Frames with bad end-of-frame
er64_enc_out    0           top_int : Encoding error outside of frames
                0           bottom_int : Encoding error outside of frames
er64_disc_c3    0           top_int : Class 3 frames discarded
                0           bottom_int : Class 3 frames discarded
er64_pcs_blk    0           top_int : PCS block errors
                0           bottom_int : PCS block errors
stat64_rateTxFrame    43508       Tx frame rate (fr/sec)
stat64_rateRxFrame    70787       Rx frame rate (fr/sec)
stat64_rateTxPeakFrame    54181       Tx peak frame rate (fr/sec)
stat64_rateRxPeakFrame    110737      Rx peak frame rate (fr/sec)
stat64_rateTxWord    14298731    Tx Word rate (words/sec)
stat64_rateRxWord    25439550    Rx Word rate (words/sec)
stat64_rateTxPeakWord    18925491    Tx peak Word rate (words/sec)
stat64_rateRxPeakWord    44667686    Rx peak Word rate (words/sec)
stat64_PRJTFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_PBSYFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_inputBuffersFull    0           top_int : 4-byte words transmitted
                           0           bottom_int : 4-byte words transmitted
stat64_rxClass1Frames    0           top_int : 4-byte words transmitted
                         0           bottom_int : 4-byte words transmitted
stat64_aveTxFrameSize    328         Average Tx Frame size
stat64_aveRxFrameSize    359         Average Rx Frame size
S001PS03:admin> portstats64show 4
stat64_wtx      46          top_int : 4-byte words transmitted
                897065310   bottom_int : 4-byte words transmitted
stat64_wrx      84          top_int : 4-byte words received
                2302784950  bottom_int : 4-byte words received
stat64_ftx      0           top_int : Frames transmitted
                638607812   bottom_int : Frames transmitted
stat64_frx      0           top_int : Frames received
                1044183398  bottom_int : Frames received
stat64_c2_frx    0           top_int : Class 2 frames received
                 0           bottom_int : Class 2 frames received
stat64_c3_frx    0           top_int : Class 3 frames received
                 1044217990  bottom_int : Class 3 frames received
stat64_lc_rx    0           top_int : Link control frames received
                17203       bottom_int : Link control frames received
stat64_mc_rx    0           top_int : Multicast frames received
                0           bottom_int : Multicast frames received
stat64_mc_to    0           top_int : Multicast timeouts
                0           bottom_int : Multicast timeouts
stat64_mc_tx    0           top_int : Multicast frames transmitted
                0           bottom_int : Multicast frames transmitted
tim64_rdy_pri    0           top_int : Time R_RDY high priority
                37306       bottom_int : Time R_RDY high priority
tim64_txcrd_z    0           top_int : Time BB_credit zero
                10956085    bottom_int : Time BB_credit zero
er64_enc_in     0           top_int : Encoding errors inside of frames
                0           bottom_int : Encoding errors inside of frames
er64_crc        0           top_int : Frames with CRC errors
                0           bottom_int : Frames with CRC errors
er64_trunc      0           top_int : Frames shorter than minimum
                0           bottom_int : Frames shorter than minimum
er64_toolong    0           top_int : Frames longer than maximum
                0           bottom_int : Frames longer than maximum
er64_bad_eof    0           top_int : Frames with bad end-of-frame
                0           bottom_int : Frames with bad end-of-frame
er64_enc_out    0           top_int : Encoding error outside of frames
                0           bottom_int : Encoding error outside of frames
er64_disc_c3    0           top_int : Class 3 frames discarded
                0           bottom_int : Class 3 frames discarded
er64_pcs_blk    0           top_int : PCS block errors
                0           bottom_int : PCS block errors
stat64_rateTxFrame    32940       Tx frame rate (fr/sec)
stat64_rateRxFrame    48395       Rx frame rate (fr/sec)
stat64_rateTxPeakFrame    53964       Tx peak frame rate (fr/sec)
stat64_rateRxPeakFrame    112235      Rx peak frame rate (fr/sec)
stat64_rateTxWord    10160477    Tx Word rate (words/sec)
stat64_rateRxWord    16254144    Rx Word rate (words/sec)
stat64_rateTxPeakWord    18910434    Tx peak Word rate (words/sec)
stat64_rateRxPeakWord    45481602    Rx peak Word rate (words/sec)
stat64_PRJTFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_PBSYFrames    0           top_int : 4-byte words transmitted
                     0           bottom_int : 4-byte words transmitted
stat64_inputBuffersFull    0           top_int : 4-byte words transmitted
                           0           bottom_int : 4-byte words transmitted
stat64_rxClass1Frames    0           top_int : 4-byte words transmitted
                         0           bottom_int : 4-byte words transmitted
stat64_aveTxFrameSize    308         Average Tx Frame size
stat64_aveRxFrameSize    335         Average Rx Frame size
S001PS03:admin>

 

regards

Ernst

Contributor
Posts: 26
Registered: ‎05-16-2017

Re: B2B Credit and Port Config

Dear Martin,

 

Is it Good or Bad ??

 

Broadcom Moderator
Posts: 455
Registered: ‎03-29-2011

Re: B2B Credit and Port Config

Hi,

 

you have a ratio 6% which is good.  Notice that on E-Ports (ISLs) we always will see latency. Now, I went over the values you provided earlier, and the ratio is good <= 1%.  If we look the ave[RX]xFrameSize below (report for last few seconds) in the portstats64show, they are in the 1200-1300 bytes / frames (325 frame = 1300 bytes), and I also use the portstats64show to compute the same value to see if over long time the average is also OK.  If the below are long distance links, you are good with a distance (LS mode) of 2 x physical distance (or use "portcfglongdistance ... -distance <km> -framesize 1024") - if I remeber correctly you had already setup your long distance ISL with a factor 2x, good.

 

S000PS03:admin> portstats64show 31 
stat64_wtx      84          top_int : 4-byte words transmitted
                41761074    bottom_int : 4-byte words transmitted
stat64_ftx      0           top_int : Frames transmitted
                1037729395  bottom_int : Frames transmitted
tim64_txcrd_z   0           top_int : Time BB_credit zero
                839798      bottom_int : Time BB_credit zero
tim64_txcrd_z   0           top_int : Time BB_credit zero
                839798      bottom_int : Time BB_credit zero
stat64_aveTxFrameSize    335         Average Tx Frame size
stat64_aveRxFrameSize    322         Average Rx Frame size

b2b/ftx = 839798      / 1037729395  = < 1%

tx framesize = (84 * 2^32 + 41761074) / 41761074 = 346 word / frame = 1300 bytes / frame

S000PS03:admin> portstats64show 75
stat64_ftx      0           top_int : Frames transmitted
                1041738801  bottom_int : Frames transmitted
tim64_txcrd_z   0           top_int : Time BB_credit zero *****
                0           bottom_int : Time BB_credit zero
stat64_aveTxFrameSize    325         Average Tx Frame size
stat64_aveRxFrameSize    298         Average Rx Frame size

b2b/ftx = 0
tx framesize =


S001PS03:admin> portstats64show 0
stat64_ftx      0           top_int : Frames transmitted
                642086154   bottom_int : Frames transmitted
tim64_txcrd_z   0           top_int : Time BB_credit zero
                1764350     bottom_int : Time BB_credit zero
stat64_aveTxFrameSize    328         Average Tx Frame size
stat64_aveRxFrameSize    359         Average Rx Frame size

b2b/ftx = 1764350 / 642086154   =0.2%
tx framesize = 347

S001PS03:admin> portstats64show 4
stat64_ftx      0           top_int : Frames transmitted
                638607812   bottom_int : Frames transmitted
tim64_txcrd_z    0           top_int : Time BB_credit zero
                10956085    bottom_int : Time BB_credit zero
stat64_aveTxFrameSize    308         Average Tx Frame size
stat64_aveRxFrameSize    335         Average Rx Frame size

b2b/ftx = 10956085    / 638607812   = 1%
tx framesize = 309




If this provided you with a solution to this issue, please mark it with the button at the bottom "Accept as solution".


Any and all information provided by me is not reviewed, approved or endorsed by Brocade and is provided solely as a convenience for Brocade customers. All systems and all networks are different and unique. If you have a service affecting network problem, please open a TAC service request for service through Brocade, or through your OEM equipment provider. If this provided you with a solution to this issue, please mark it with the button at the bottom "Accept as solution"
Contributor
Posts: 26
Registered: ‎05-16-2017

Re: B2B Credit and Port Config

Dear Martin,

 

Thank You for your help, realy greate :manhappy:

 

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.

vADC is now Pulse Secure
Download FREE NVMe eBook