Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 6
Registered: ‎12-13-2017

ISL performance slow

Hello Experts,
I have configured ISL between two sites , distance 140km.
 DCX8510-4 has 2  ISL connections  to 6510 ,  on both sites installed DWDM Packetlight.

The ISL has performance issue  :  each session  is restricted on 20MB thoughput .

Data flow destinations are  tape device and storage NETAPP for DR purpose.

How can be solved performance issue ? Why  it's only  20MB?

Thanks.

External Moderator
Posts: 5,255
Registered: ‎02-23-2004

Re: ISL performance slow

@dmitryya

 

you wrote:

 

--->>> DCX8510-4 has 2  ISL connections  to 6510 ,  on both sites installed DWDM Packetlight.

 

how is the ISL configured ?

 

Site_A_6510 <----> WDM <----> Site_B_6510

 

or are both 6510 on Site_B ?

 

Site_A_DCX <----> WDM <----> Site_B_6510_1 / 6510_2 ?

 

you should post more details, such as Port config, license, FOS release, type of WDM, type of SFP, and so on....

TechHelp24
Occasional Contributor
Posts: 6
Registered: ‎12-13-2017

Re: ISL performance slow

 Hello,

 

Our configuration is: 

 

   Site A                            Site B

 

DCX  -- DWDM ------->  DWDM---6510

 

FOS is 7.3.0c

 

 

DCX:

Portcfgshow:

 

 

Area Number:              185

Octet Speed Combo:        1(16G|8G|4G|2G)

Speed Level:              8G

AL_PA Offset 13:          OFF

Trunk Port                OFF

Long Distance             LS

VC Link Init              OFF

Desired Distance          450 Km

Reserved Buffers          1806

Locked L_Port             OFF

Locked G_Port             ON

Disabled E_Port           OFF

Locked E_Port             OFF

ISL R_RDY Mode            OFF

RSCN Suppressed           OFF

Persistent Disable        OFF

LOS TOV enable            OFF

NPIV capability           ON

QOS Port                  OFF

Port Auto Disable:        OFF

Rate Limit                OFF

EX Port                   OFF

Mirror Port               OFF

SIM Port                  OFF

Credit Recovery           ON

F_Port Buffers            OFF

E_Port Credits            OFF

Fault Delay:              0(R_A_TOV)

NPIV PP Limit:            126

NPIV FLOGI Logout:        OFF

CSCTL mode:               OFF

D-Port mode:              OFF

D-Port over DWDM:         OFF

Compression:              ON

Encryption:               OFF

FEC:                      OFF

FEC via TTS:              OFF

 

 

SFP status :

 

Identifier:  3    SFP

Connector:   7    LC

Transceiver: 700c406000000000 4,8,16_Gbps M5,M6 sw Inter,Short_dist

Encoding:    6    64B66B

Baud Rate:   140  (units 100 megabaud)

Length 9u:   0    (units km)

Length 9u:   0    (units 100 meters)

Length 50u (OM2):  4    (units 10 meters)

Length 50u (OM3):  0    (units 10 meters)

Length 62.5u:2    (units 10 meters)

Length Cu:   0    (units 1 meter)

Vendor Name: BROCADE        

Vendor OUI:  00:05:1e

Vendor PN:   57-0000088-01  

Vendor Rev:  A  

Wavelength:  850  (units nm)

Options:     003a Loss_of_Sig,Tx_Fault,Tx_Disable

BR Max:      0  

BR Min:      0  

Serial No:   HAA1124010A0112

Date Code:   121003 

DD Type:     0x68

Enh Options: 0xfa

Status/Ctrl: 0xa2

Pwr On Time: 1.62 years (14228 hours)

E-Wrap Control: 0

O-Wrap Control: 0

Alarm flags[0,1] = 0x0, 0x0

Warn Flags[0,1] = 0x0, 0x0

                                           Alarm                  Warn

                                    low         high       low         high

Temperature: 44      Centigrade      -5         85         0           75

Current:     7.456   mAmps           2.500      12.000     2.000       11.500

Voltage:     3319.6  mVolts          3000.0     3600.0     3130.0      3460.0

RX Power:    -3.4    dBm (458.9uW)   31.6   uW  1258.9 uW  31.6   uW   794.0  uW

TX Power:    -2.3    dBm (582.5 uW)  126.0  uW  1258.9 uW  251.0  uW   794.0  uW

 

State transitions: 3

 

 

Licenseshow :

 

DataFort Compatibility license

Extended Fabric license

    Fabric Watch license

    Performance Monitor license

    Trunking license

    Adaptive Networking - obsolete license

    Server Application Optimization - obsolete license

    Fabric Vision license

 

 

portbuffershow

User     Port     Lx     Max/Resv  Avg Buffer Usage & FrameSize    Buffer Needed     Link     Remaining

Port     Type    Mode    Buffers        Tx         Rx              Usage  Buffers   Distance  Buffers

----     ----    ----    -------   ----------------------------    ------ -------   --------- ----------

200       E      LS       246       23( 780)      31(1040)         246     246        30km

201               -         8       - (  - )      - (  - )           0       -          -

 202       F       -         8        2(2060)      - (  68)           8       -          -

 203               -         8       - (  - )      - (  - )           0       -          -

 204       F       -         8        1(1520)      - ( 984)           8       -          -

 205               -         8       - (  - )      - (  - )           0       -          -

 206               -         8       - (  - )      - (  - )           0       -          -

 207       F       -         8       - (   8)      - ( 172)           8       -          -

 208       F       -         8        1(1368)       1(1684)           8       -          -

 209       F       -         8        1(1680)       1(1396)           8       -          -

 210               -         8       - (  - )      - (  - )           0       -          -

 211               -         8       - (  - )      - (  - )           0       -          -

 212       F       -         8       - ( 112)      - (  76)           8       -          -

 213       F       -         8       - ( 384)       2(2996)           8       -          -

 214               -         8       - (  - )      - (  - )           0       -          -

 215       F       -         8        1(1844)       1(1056)           8       -          -

 232       F       -         8       - ( 452)       1(1796)           8       -          -

 233       E      LS      1806      229(1040)      11(  52)        1806    1806       450km

234               -         8       - (  - )      - (  - )           0       -          -

 235               -         8       - (  - )      - (  - )           0       -          -

 236       F       -         8        1(1760)       1(1768)           8       -          -

 237               -         8       - (  - )      - (  - )           0       -          -

 238               -         8       - (  - )      - (  - )           0       -          -

 239       F       -         8       - (  - )      - (  - )           8       -          -       2924

 

portstatsshow

stat_wtx                3869671951  4-byte words transmitted

stat_wrx                1325616566  4-byte words received

stat_ftx                227065204   Frames transmitted

stat_frx                304417886   Frames received

stat_c2_frx             0           Class 2 frames received

stat_c3_frx             304332131   Class 3 frames received

stat_lc_rx              85752       Link control frames received

stat_mc_rx              0           Multicast frames received

stat_mc_to              0           Multicast timeouts

stat_mc_tx              0           Multicast frames transmitted

tim_rdy_pri             0           Time R_RDY high priority

tim_txcrd_z             2909260     Time TX Credit Zero (2.5Us ticks)

tim_txcrd_z_vc  0- 3:  2909260     0           0           0        

tim_txcrd_z_vc  4- 7:  0           0           0           0        

tim_txcrd_z_vc  8-11:  0           0           0           0        

tim_txcrd_z_vc 12-15:  0           0           0           0        

er_enc_in               0           Encoding errors inside of frames

er_crc                  0           Frames with CRC errors

er_trunc                0           Frames shorter than minimum

er_toolong              0           Frames longer than maximum

er_bad_eof              0           Frames with bad end-of-frame

er_enc_out              0           Encoding error outside of frames

er_bad_os               0           Invalid ordered set

er_pcs_blk              0           PCS block errors

er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout

er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout

er_unroutable           0           Frames that are unroutable

er_unreachable          0           Frames with unreachable destination

er_other_discard        0           Other discards

er_type1_miss           0           frames with FTB type 1 miss

er_type2_miss           0           frames with FTB type 2 miss

er_type6_miss           0           frames with FTB type 6 miss

er_zone_miss            0           frames with hard zoning miss

er_lun_zone_miss        0           frames with LUN zoning miss

er_crc_good_eof         0           Crc error with good eof

er_inv_arb              0           Invalid ARB

er_single_credit_loss   0           Single vcrdy/frame loss on link

er_multi_credit_loss    0           Multiple vcrdy/frame loss on link

compression_ratio       51          Average compression ratio

phy_stats_clear_ts      12-25-2017 IST Mon 15:23:32     Timestamp of phy_port stats clear

lgc_stats_clear_ts      12-25-2017 IST Mon 15:23:32     Timestamp of lgc_port stats clear

 

6510:

 

Portcfgshow

 

Area Number:              23

Octet Speed Combo:        1(16G|8G|4G|2G)

Speed Level:              8G

AL_PA Offset 13:          OFF

Trunk Port                OFF

Long Distance             LS

VC Link Init              OFF

Desired Distance          450 Km

Reserved Buffers          1806

Locked L_Port             OFF

Locked G_Port             ON

Disabled E_Port           OFF

Locked E_Port             OFF

ISL R_RDY Mode            OFF

RSCN Suppressed           OFF

Persistent Disable        OFF

LOS TOV enable            OFF

NPIV capability           ON

QOS Port                  OFF

Port Auto Disable:        OFF

Rate Limit                OFF

EX Port                   OFF

Mirror Port               OFF

SIM Port                  OFF

Credit Recovery           ON

F_Port Buffers            OFF

E_Port Credits            OFF

Fault Delay:              0(R_A_TOV)

NPIV PP Limit:            126

NPIV FLOGI Logout:        OFF

CSCTL mode:               OFF

D-Port mode:              OFF

D-Port over DWDM:         OFF

Compression:              ON

Encryption:               OFF

FEC:                      OFF

FEC via TTS:              OFF

Non-DFE:                  OFF

 

SFPshow:

 

Identifier:  3    SFP

Connector:   7    LC

Transceiver: 7004404000000000 4,8,16_Gbps M5 sw Short_dist

Encoding:    6    64B66B

Baud Rate:   140  (units 100 megabaud)

Length 9u:   0    (units km)

Length 9u:   0    (units 100 meters)

Length 50u (OM2):  3    (units 10 meters)

Length 50u (OM3):  0    (units 10 meters)

Length 62.5u:0    (units 10 meters)

Length Cu:   0    (units 1 meter)

Vendor Name: BROCADE        

Vendor OUI:  00:05:1e

Vendor PN:   57-0000088-01  

Vendor Rev:  A  

Wavelength:  850  (units nm)

Options:     003a Loss_of_Sig,Tx_Fault,Tx_Disable

BR Max:      0  

BR Min:      0  

Serial No:   HAF316110000CZY

Date Code:   160307 

DD Type:     0x68

Enh Options: 0xfa

Status/Ctrl: 0x82

Pwr On Time: 1.09 years (9596 hours)

E-Wrap Control: 0

O-Wrap Control: 0

Alarm flags[0,1] = 0x5, 0x0

Warn Flags[0,1] = 0x5, 0x0

                                           Alarm                  Warn

                                    low         high       low         high

Temperature: 43      Centigrade      -5         85         0           75

Current:     8.238   mAmps           2.500      12.000     2.000       11.500

Voltage:     3326.0  mVolts          3000.0     3600.0     3100.0      3500.0

RX Power:    -3.3    dBm (470.0uW)   31.6   uW  1258.9 uW  31.6   uW   794.3  uW

TX Power:    -2.9    dBm (517.8 uW)  125.9  uW  1258.9 uW  251.2  uW   794.3  uW

 

State transitions: 1

 

Licenseshow:

 

Fabric Watch license

  Extended Fabric license

 

portbuffershow

User     Port     Lx     Max/Resv  Avg Buffer Usage & FrameSize    Buffer Needed     Link     Remaining

Port     Type    Mode    Buffers        Tx         Rx              Usage  Buffers   Distance  Buffers

----     ----    ----    -------   ----------------------------    ------ -------   --------- ----------

   0       F       -         8       - (  - )      - (  - )           8       -          -

   1       F       -         8        1(2024)      - (  52)           8       -          -

   2       F       -         8        1(1668)      - (  44)           8       -          -

   3               -         8       - (  - )      - (  - )           0       -          -

   4               -         8       - (  - )      - (  - )           0       -          -

   5               -         8       - (  - )      - (  - )           0       -          -

   6               -         8       - (  - )      - (  - )           0       -          -

   7               -         8       - (  - )      - (  - )           0       -          -

   8       F       -         8       - (  - )      - (  88)           8       -          -

   9       F       -         8       - (  - )      - (  - )           8       -          -

  10       F       -         8        1(2016)      - (  52)           8       -          -

  11               -         8       - (  - )      - (  - )           0       -          -

  12       F       -         8       - (  88)      - (   4)           8       -          -

  13       F       -         8       - (  48)       1(1820)           8       -          -

  14               -         8       - (  - )      - (  - )           0       -          -

  15               -         8       - (  - )      - (  - )           0       -          -

  16               -         8       - (  - )      - (  - )           0       -          -

  17               -         8       - (  - )      - (  - )           0       -          -

  18               -         8       - (  - )      - (  - )           0       -          -

  19               -         8       - (  - )      - (  - )           0       -          -

  20               -         8       - (  - )      - (  - )           0       -          -

  21               -         8       - (  - )      - (  - )           0       -          -

  22       E      LS      1806       11(  52)     242(1100)        1806    1806       450km

  23       E      LS      1806       11(  52)     242(1100)        1806    1806       450km

  24               -         8       - (  - )      - (  - )           0       -          -

  25               -         8       - (  - )      - (  - )           0       -          -

  26               -         8       - (  - )      - (  - )           0       -          -

  27               -         8       - (  - )      - (  - )           0       -          -

  28               -         8       - (  - )      - (  - )           0       -          -

  29               -         8       - (  - )      - (  - )           0       -          -

  30               -         8       - (  - )      - (  - )           0       -          -

  31               -         8       - (  - )      - (  - )           0       -          -

  32               -         8       - (  - )      - (  - )           0       -          -

  33               -         8       - (  - )      - (  - )           0       -          -

  34               -         8       - (  - )      - (  - )           0       -          -

  35               -         8       - (  - )      - (  - )           0       -          -

  36               -         8       - (  - )      - (  - )           0       -          -

  37               -         8       - (  - )      - (  - )           0       -          -

  38               -         8       - (  - )      - (  - )           0       -          -

  39               -         8       - (  - )      - (  - )           0       -          -

  40               -         8       - (  - )      - (  - )           0       -          -

  41               -         8       - (  - )      - (  - )           0       -          -

  42               -         8       - (  - )      - (  - )           0       -          -

  43               -         8       - (  - )      - (  - )           0       -          -

  44               -         8       - (  - )      - (  - )           0       -          -

  45               -         8       - (  - )      - (  - )           0       -          -

  46               -         8       - (  - )      - (  - )           0       -          -

  47               -         8       - (  - )      - (  - )           0       -          -       4116

 

 

portstatsshow

stat_wtx                1328399062  4-byte words transmitted

stat_wrx                423292893   4-byte words received

stat_ftx                304624165   Frames transmitted

stat_frx                230258309   Frames received

stat_c2_frx             0           Class 2 frames received

stat_c3_frx             230091575   Class 3 frames received

stat_lc_rx              148732      Link control frames received

stat_mc_rx              0           Multicast frames received

stat_mc_to              0           Multicast timeouts

stat_mc_tx              0           Multicast frames transmitted

tim_rdy_pri             0           Time R_RDY high priority

tim_txcrd_z             73665022    Time TX Credit Zero (2.5Us ticks)

tim_txcrd_z_vc  0- 3:  73665022    0           0           0        

tim_txcrd_z_vc  4- 7:  0           0           0           0        

tim_txcrd_z_vc  8-11:  0           0           0           0        

tim_txcrd_z_vc 12-15:  0           0           0           0        

er_enc_in               0           Encoding errors inside of frames

er_crc                  0           Frames with CRC errors

er_trunc                0           Frames shorter than minimum

er_toolong              0           Frames longer than maximum

er_bad_eof              0           Frames with bad end-of-frame

er_enc_out              0           Encoding error outside of frames

er_bad_os               0           Invalid ordered set

er_pcs_blk              0           PCS block errors

er_rx_c3_timeout        0           Class 3 receive frames discarded due to timeout

er_tx_c3_timeout        0           Class 3 transmit frames discarded due to timeout

er_unroutable           0           Frames that are unroutable

er_unreachable          0           Frames with unreachable destination

er_other_discard        0           Other discards

er_type1_miss           0           frames with FTB type 1 miss

er_type2_miss           0           frames with FTB type 2 miss

er_type6_miss           0           frames with FTB type 6 miss

er_zone_miss            0           frames with hard zoning miss

er_lun_zone_miss        0           frames with LUN zoning miss

er_crc_good_eof         0           Crc error with good eof

er_inv_arb              0           Invalid ARB

er_single_credit_loss   0           Single vcrdy/frame loss on link

er_multi_credit_loss    0           Multiple vcrdy/frame loss on link

compression_ratio       1           Average compression ratio

phy_stats_clear_ts      12-25-2017 IST Mon 15:23:51     Timestamp of phy_port stats clear

lgc_stats_clear_ts      12-25-2017 IST Mon 15:23:51     Timestamp of lgc_port stats clear

 

 

 

 

 

 

 

Occasional Contributor
Posts: 6
Registered: ‎12-13-2017

Re: ISL performance slow

Additional info :

 


DWDM on both sites:

Product Name:
PL-2000AD Metro
Part Number:
PL2000ADM001
Hardware Version:
02-01
Firmware Version:
1.1.18-BBAB-A02D

External Moderator
Posts: 5,255
Registered: ‎02-23-2004

Re: ISL performance slow

@dmitryya

 

quick review the portcfgshow output, and see

 

--->>>ISL R_RDY Mode            OFF

 

in LS Mode, ISL R_RDY Mode must be set to ON

 

 

 

 

TechHelp24
Occasional Contributor
Posts: 6
Registered: ‎12-13-2017

Re: ISL performance slow

Good morning, unfortunately this change did not solved the issue.

Thanks Dmitry.
Occasional Contributor
Posts: 6
Registered: ‎12-13-2017

Re: ISL performance slow

Need be change some on DWDM?

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.