Fibre Channel (SAN)

Reply
Contributor
Posts: 27
Registered: ‎12-05-2008

Two BR-7800 remote connection problem

Hi,

Two BR-7800 (version : v6.4.1) in the two data centers ,fiber optic linkdistance : 29KM; Optical fiber directly connected(not connected DWDM )

Two BR-7800 specifies two configuration port 0 as E-port, configure ELWL 4G SFP 50KM;

other port for the EX-port ,connecting BR-5100 Switches;witch the command :spinfab; test port 0(E-port) data traffic, portperfshow display 54.4m

Configuration is as follows(BR-7800 port 0 configure the same):

swd77:admin> portcfglongdistance 0 LD 1
Please enter the desired distance (in Km) -- 50KM
Warning: Port 0 portcfglongdistance vc_translation_link_init conflict with portcfgfillword configuration. Valid configurations are: vc_translation_link_init = 0, fillword = IDLE_IDLE or vc_translation_link_init =1 fillword=ARB_ARB, IDLE_ARB, AA_THEN_IA
Reserved Buffers =        206
Warning: port may be buffer limited if cable is longer than estimated.

swd77:admin>sfpshow 0 -f

Temperature: 50      Centigrade     -5          85         0           80
Current:     32.832  mAmps          2.000       90.000     4.000       80.000
Voltage:     3275.2  mVolts         3000.0      3600.0     3100.0      3500.0
RX Power:    -9.7    dBm (108.2 uW) 10.0   uW   1258.9 uW  15.8   uW   1000.0 uW
TX Power:    2.3     dBm (1699.2 uW) 794.3  uW   3162.3 uW  1000.0 uW   2511.9 uW

swd77:admin> spinfab -nmegs 11099

Running spinfab ..............

BJSDCFRT01:admin> portperfshow
    0      1      2      3      4      5      6      7      8      9     10     11     12     13     14     15 
================================================================================================================
  54.4m   0      0      0      0      0      0      0      0      0      0      0      0      0      0      0 

   16     17     18     19     20     21     22     23   Total
================================================================
   0      0      0      0      0      0      0      0     54.4m

    0      1      2      3      4      5      6      7      8      9     10     11     12     13     14     15 
================================================================================================================
  54.4m   0      0      0      0      0      0      0      0      0      0      0      0      0      0      0 

   16     17     18     19     20     21     22     23   Total
================================================================
   0      0      0      0      0      0      0      0     54.4m

This performance is too low, please help to see if the configuration problem . please help.

Thanks.

Super Contributor
Posts: 644
Registered: ‎03-01-2007

Re: Two BR-7800 remote connection problem

--->>> Warning: port may be buffer limited if cable is longer than estimated.

Buffer-to-Buffer must be set. See table below.

Cable.bmp

If you are satisfied with the responses please mark as 'Answered'.
If not, just let me know I can see to get more info.
I would appreciated if you rate the threads.


Thank you.

Contributor
Posts: 27
Registered: ‎12-05-2008

Re: Two BR-7800 remote connection problem

Hi,

Thank you for your help.

My two BR-7800 with the Extened fabric License.

I did the following configuration:

swd77:admin> portcfgdefault 0

BJSDCFRT01:admin> portcfglongdistance 0 LS 1
Please enter the desired distance (in Km) -- 30KM
Warning: Port 0 portcfglongdistance vc_translation_link_init conflict with portcfgfillword configuration. Valid configurations are: vc_translation_link_init = 0, fillword = IDLE_IDLE or vc_translation_link_init =1 fillword=ARB_ARB, IDLE_ARB, AA_THEN_IA
Reserved Buffers =   126
Warning: port may be reserving more credits depending on port speed.

BJSDCFRT01:admin> portbuffershow
User     Port     Lx           Max/Resv    Buffer Needed          Link   Remaining
Port     Type    Mode          Buffers     Usage  Buffers     Distance  Buffers
----     ----    ----          -------     ------ -------     --------- ----------
  0    E     LS  126     66     66    30km
  1    EX   -    8     17     17    <2km
  2    EX   -    8     17     17    <2km
  3         -    8      0      -     -
  4         -    8      0      -     -
  5         -    8      0      -     -
  6         -    8      0      -     -
  7         -    8      0      -     -
  8         -    8      0      -     -
  9         -    8      0      -     -
10         -    8      0      -     -
11         -    8      0      -     -
12         -    8      0      -     -
13         -    8      0      -     -
14         -    8      0      -     -
15         -    8      0      -     -      272

swd77:admin> portcfglongdistance 0 LS 1
Please enter the desired distance (in Km) -- 80
Warning: Port 0 portcfglongdistance vc_translation_link_init conflict with portcfgfillword configuration. Valid configurations are: vc_translation_link_init = 0, fillword = IDLE_IDLE or vc_translation_link_init =1 fillword=ARB_ARB, IDLE_ARB, AA_THEN_IA
Reserved Buffers =   326
Warning: one or more E_Ports may come up in buffer limited mode.

BJSDCFRT01:admin> portbuffershow
User     Port     Lx           Max/Resv    Buffer Needed          Link   Remaining
Port     Type    Mode          Buffers     Usage  Buffers     Distance  Buffers
----     ----    ----          -------     ------ -------     --------- ----------
  0    E     LS  326    166    166    80km
  1    EX   -    8     17     17    <2km
  2    EX   -    8     17     17    <2km
  3         -    8      0      -     -
  4         -    8      0      -     -
  5         -    8      0      -     -
  6         -    8      0      -     -
  7         -    8      0      -     -
  8         -    8      0      -     -
  9         -    8      0      -     -
10         -    8      0      -     -
11         -    8      0      -     -
12         -    8      0      -     -
13         -    8      0      -     -
14         -    8      0      -     -
15         -    8      0      -     -       72

swd77:admin> portcfglongdistance 0 LS 1
Please enter the desired distance (in Km) -- 100Km
Warning: Port 0 portcfglongdistance vc_translation_link_init conflict with portcfgfillword configuration. Valid configurations are: vc_translation_link_init = 0, fillword = IDLE_IDLE or vc_translation_link_init =1 fillword=ARB_ARB, IDLE_ARB, AA_THEN_IA
Failed: already exceeds Buffer credits allowed.

I wonder Why configuration portcfglongdisatance 30KM、50KM and 100KM , Will report this err :"Warning: Port 0 portcfglongdistance vc_translation_link_init conflict with portcfgfillword configuration. Valid configurations are: vc_translation_link_init = 0, fillword = IDLE_IDLE or vc_translation_link_init =1 fillword=ARB_ARB, IDLE_ARB, AA_THEN_IA "

This is how to solve the problem.

what does it mean these:

1. IDLE_IDLE

2. ARB_ARB,

3. IDLE_ARB,

4. AA_THEN_IA

Thanks.

Super Contributor
Posts: 644
Registered: ‎03-01-2007

Re: Two BR-7800 remote connection problem

--->>> what does it mean these:

1. IDLE_IDLE

2. ARB_ARB,

3. IDLE_ARB,

4. AA_THEN_IA

This are all the available Mode which can be set in portcfgfillword

I find here a Internal note, see follow example

to set fillword mode 3 on blade 1 port 0):

portCfgFillWord 1/0 3

for details see in Command Reference Manuals.

I'm unable to test here such env. and we don't have here 7800 Switches.

I note you have changed from LD to LS but set the KM to 80 ?

Why ?

Contributor
Posts: 27
Registered: ‎12-05-2008

Re: Two BR-7800 remote connection problem

Hi,

Thank you for your help.

I want to test 4Gbit/s in the 30km、80km and 100km of the performance, use the spinfab ,portperfshow display is 54.4m, I want to know why the performance is so low.

I want to test the maximum bandwidth of this link. Do you have a better way to test the link bandwidth.

Want to make sure my configuration is problem. If you have questions, please help correct it.

portcfgfillword have to configure it?

Thanks.

Super Contributor
Posts: 644
Registered: ‎03-01-2007

Re: Two BR-7800 remote connection problem

--->>> portcfgfillword have to configure it?

Yes, but this command cannot be set on VE and  VEX Port.

--->>> want to test 4Gbit/s in the 30km、80km and 100km of the performance

such test dont make a sense, because - AFAIK - ! the Switch/Port latency check the Distance and in this case you dont have 80 or 100 KM effective.

BTW a FOS Documentation Update is available now since 6.4.1 is attached here.

As mentione yesterday in my post, you have to configured the Port correct with the Distance and correct setting Value.

I would in this case reset the Port by Default and then benig with a new config to avoid malfunction.

Super Contributor
Posts: 635
Registered: ‎04-12-2010

Re: Two BR-7800 remote connection problem

Hi,

to test the performance you should use a server and on the other side of the link a storage system.

Run the freeware tool iometer on the server. You can generate large sequential reads.

It is important to know that one buffer credit means one frame on the wire. But this does not mean the frame is full. To measure the throught put you need to know how many bytes of payload is in the frame.

With iometer you can deside how big your read IOs are. This gives you a better feeling of the throughput.

Sometime it is good to double the amount of buffers to increase the throughput.

Remember to set the buffer values on both sides on the same level.

As far as I remember you should set vc_translation_link_init 1 and fillword as Idel_arb  on a 4 Gbit interface speed.

I can check this tomorrow.

FOS admin Guide chapter 20

Andreas

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.