07-14-2013 06:04 PM
I have a POC I am trying to setup and am not seeing the issue in what I have. The connection is a bit "odd" I have a pair of Brocade 8Gb 24 port switches at each "site" (physically linked with 1Gb CAT 5 cables between two racks) with a blade chassis of servers which the customer purchased QLogic FC switches so I put them into NPV mode. Zones within site work fine. I have implemented best practices of seperate "A" and "B" fabrics (and for sake of example I call them by colors "red", "blue", "green", "yellow")
Now I have a storage controller attached directly to the 24port Brocade SAN switches (two controllers with two connections to each switch). I want to link primary site "PSCFC01" storage ports to remote site "RSCFC01" storage so I can do SAN replication. (and then repeat to join the "PSCFC02" storage to "RSCFC02").
I have the tunnels up and linked and can ping from both directions..
I created LSAN zones which contain the cross connected site WWPNs from each storage controller. I don't think I have ever done single FCR at each site with expectation to set tunnel to join "GE0" -> Red / blue SANs and "GE1" -> yellow and green SANs. I think their is some step I am missing to set link between the EX to VEX association?
I am likely missing something simple. It has been a while sense I did FCIP...
Any help and comments would be appreciated.
|Draft Lab Guide|
Fibre Channel Router
* Make sure the ports are in the copper (default) ports, if optical is desired mode must be changed.
Step 1: Activate License Keys for FCIP and Routing
Step 2: Login to fibre router and set up port
Select fc port and rename port description
Set mode on port to EX (SAN Routed Port) Set port to "EX-Port" with matching fabric ID to Native mode.
Now enable the "Gi" ports for VEX mode for ports 16, 17 which will bridge FCIP to remote switch.
Choose switch and "FCR"
Set the FCR ID by choosing "Set Fabric ID" (switch will have to be set to "disabled" to change this ID) then select "Enable FCR" and set Backbone ID to 20
(For lcrscfc03 site, ID will be 20,21,22,23,24 while lcpscfc03 site IDs will be 10,11,12,13,14)
Choose "VE/Vex Ports" and choose the first Ethernet port and set to VEX and set Domain ID
Port Summary of descriptions (upstream connections) as well as Fabric Domain IDs
Step 2: Setup Zones Aliase and routed Zone
Under Zone Admin
Create aliases for each WWPN. Example is for "lcrscv70001" system Canister 1, port 1
Now create zone for storage
** Repeat above step exactly but this time name zone "LSAN_******". This creates a Zone that can be routed.
Now add both zones created to the zone database, save to switches
Then activate by clicking "Enable Config" and then select desired version and click ok
Step 3: Setup FCR IP and routes on Gigibit interfaces
Example: lcrscfc01 with below WAN IP mapping
Display mapping of ports: portcfgpersistentenable
This sets IP to port "16" which is the first SFP based Ethernet Port.
Step 4: Now we create a zone for v7000s across sites
The router setup is to route between the WWP connections of the connected sites per table below.
The above table will be created on each switch as a LSAN (routed) zone. Below are the commands for each of the four switch sides.
Step 5: Now with the use of the Brocade Network Assistant GUI, we can quickly add switches and setup routed zones between the fabrics
Install 70day evaluation version of Brocade Network Advisor
Launch GUI login
Click to add new device
Input each of the six FC switches
Note that the three switches of each site are diagramed as being in a single connection
Now we can create a routed zone between the two sites for the v7000 controllers
Create LSAN zone
2)Typeinzone 4: 141 Ibi ÇIIP_New Zone New Member... OK Cancel Help Potential Members All Levels El lcrsctcO3 S 4 lcrsctcOl El lcrsctcO2 4 Type VMsN Name Product Type Class lcrsctcO3 lcrsctcOl lcrsctco2 site vl000s ¿3 Activate... :h la" height="374" border="0" width="576">
CLI LSAN zoning
07-15-2013 12:01 AM
have you created ONE or TWO LSAN config ?
I'm not sure, but i think such config you want/have created can not work with more than one LSAN
07-15-2013 04:58 AM
Yes there is / will be two VSAN segments.
The LSAN zone for the storage will be the interfaces in an LSAN that have "pscfc01" and "rscfc01" controller ports. And a seperate LSAN containing controller ports of interfaces in "pscfc02" and "rscfc02".
Example attached of Aliase / WWPN from switch where I manually added the cross WWPN IDs to the LSAN_ zone
lcpscv70001_1_3; lcpscv70001_1_4; lcpscv70001_2_1;
lcrscv70001_1_3; lcrscv70001_1_4; lcrscv70001_2_1;
What I don't follow is if their is any other step, besides creating the LSAN, to join the two zones over FCR.
07-15-2013 01:31 PM
I don't think you can create a Routing with/between two LSAN, or better to say any such config is unknown to me.
07-17-2013 12:28 AM
I have taken a look at the diagram and it is conceptually wrong:
You cannot connect two VEX port together, a VEX port only can be connected to a VE port (as well as a EX port can only be connected to a E port). The only way to perform the config you want to implement is to configure a BB fabric made up of the two fcip tunnels.
07-17-2013 05:32 AM
I figured that out via some RTFM and poking around and got the environment working.
What I miss configured is that the brocade R06 is "routing" what it is actually doing is "Bridging"
That works. Because what I needed to do is merge the FC03 switches (R06 router switch fabrics) together such that they were "one switch" from which I could then "Bridge" the "red to blue" and "green to yellow".
Here is updated diagram
That works as expected.