Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Problems getting FCIP tunnel up on 7500 switches.

I've tried multiple configure but can never get my remote devices to get Imported instead of configured.

I can ping and traceroute out of the ge0 port in both directions.

I'll post the configs from the remote site:

nlalm-sanrtr1:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
53: fffc35 10:00:00:05:1e:c1:da:ff 10.17.9.202     10.17.8.53     >"nlalm-sanrtr1"

nlalm-sanrtr1:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:da:ff, Dom ID:  53,
Info: 10.17.9.202, "nlalm-sanrtr1"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0          3     10.17.9.200      10:00:00:05:33:51:4d:b3   "nlalm-sansw1"
       1          3     10.17.9.201      10:00:00:05:33:51:42:4d   "nlalm-sansw2"

nlalm-sanrtr1:admin> portshow fciptunnel ge0 all

Port: ge0
-------------------------------------------
        Tunnel ID 0
        Tunnel Description Not Configured
        Remote IP Addr 161.63.10.205
        Local IP Addr 10.17.8.53
        Remote WWN Not Configured
        Local WWN 10:00:00:05:1e:c1:da:ff
        Compression off
        Fastwrite off
        Tape Pipelining off
        Committed Rate 100000 Kbps (0.100000 Gbps)
        SACK on
        Min Retransmit Time 100
        Keepalive Timeout 10
        Max Retransmissions 8
        VC QoS Mapping off
        DSCP Marking (Control): 0, DSCP Marking (Data): 0
        VLAN Tagging Not Configured
        TCP Byte Streaming off
        Status : Active
        Connected Count: 103
        Uptime 59 seconds

nlalm-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 3 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  EXIST
        50:06:01:66:44:60:23:de  Configured

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Local site info:

nlams-sanrtr1:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
99: fffc63 10:00:00:05:1e:c1:e4:73 161.63.10.215   161.63.10.205  >"nlams-sanrtr1"

nlams-sanrtr1:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:e4:73, Dom ID:  99,
Info: 161.63.10.215, "nlams-sanrtr1"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0          2     161.63.10.209    10:00:00:05:1e:c2:22:53   "amssan05"
       1          2     161.63.10.210    10:00:00:05:1e:c0:db:57   "amssan06"

nlams-sanrtr1:admin> portshow fciptunnel ge0 all

Port: ge0
-------------------------------------------
        Tunnel ID 0
        Tunnel Description Not Configured
        Remote IP Addr 10.17.8.53
        Local IP Addr 161.63.10.205
        Remote WWN Not Configured
        Local WWN 10:00:00:05:1e:c1:e4:73
        Compression off
        Fastwrite off
        Tape Pipelining off
        Committed Rate 100000 Kbps (0.100000 Gbps)
        SACK on
        Min Retransmit Time 100
        Keepalive Timeout 10
        Max Retransmissions 8
        VC QoS Mapping off
        DSCP Marking (Control): 0, DSCP Marking (Data): 0
        VLAN Tagging Not Configured
        TCP Byte Streaming off
        Status : Active
        Connected Count: 116
        Uptime 2 minutes, 10 seconds

nlams-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 2 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  Configured
        50:06:01:66:44:60:23:de  EXIST

and switchshow for bakbone switches:

nlalm-sanrtr1:admin> switchshow
switchName:     nlalm-sanrtr1
switchType:     46.2
switchState:    Online
switchMode:     Native
switchRole:     Principal
switchDomain:   53
switchId:       fffc35
switchWwn:      10:00:00:05:1e:c1:da:ff
zoning:         ON (AlmereReplication)
switchBeacon:   OFF
FC Router:      ON
FC Router BB Fabric ID: 1
Address Mode:   0

Index Port Address Media Speed State     Proto
==============================================
  0   0   350000   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:4d:b3 "nlalm-sansw1" (fabric id = 3 )
  1   1   350100   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:42:4d "nlalm-sansw2" (fabric id = 3 )
  2   2   350200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   350300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   350400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   350500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   350600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   350700   id    N4   No_Light    FC
  8   8   350800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   350900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   350a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   350b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   350c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   350d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   350e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   350f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   351000   --    --   Online      VE  VEX-Port 00:00:00:00:00:00:00:00 "" (fabric id = 3 )
17  17   351100   --    --   Offline     VE  Disabled (Persistent)
18  18   351200   --    --   Offline     VE  Disabled (Persistent)
19  19   351300   --    --   Offline     VE  Disabled (Persistent)
20  20   351400   --    --   Offline     VE  Disabled (Persistent)
21  21   351500   --    --   Offline     VE  Disabled (Persistent)
22  22   351600   --    --   Offline     VE  Disabled (Persistent)
23  23   351700   --    --   Offline     VE  Disabled (Persistent)
24  24   351800   --    --   Offline     VE  Disabled (Persistent)
25  25   351900   --    --   Offline     VE  Disabled (Persistent)
26  26   351a00   --    --   Offline     VE  Disabled (Persistent)
27  27   351b00   --    --   Offline     VE  Disabled (Persistent)
28  28   351c00   --    --   Offline     VE  Disabled (Persistent)
29  29   351d00   --    --   Offline     VE  Disabled (Persistent)
30  30   351e00   --    --   Offline     VE  Disabled (Persistent)
31  31   351f00   --    --   Offline     VE  Disabled (Persistent)
     ge0  id    1G   Online    FCIP
     ge1  id    1G   Online    FCIP

nlams-sanrtr1:admin> switchshow
switchName:     nlams-sanrtr1
switchType:     46.2
switchState:    Online
switchMode:     Native
switchRole:     Principal
switchDomain:   99
switchId:       fffc63
switchWwn:      10:00:00:05:1e:c1:e4:73
zoning:         ON (AmsterdamReplication)
switchBeacon:   OFF
FC Router:      ON
FC Router BB Fabric ID: 1
Address Mode:   0

Index Port Address Media Speed State     Proto
==============================================
  0   0   630000   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c2:22:53 "amssan05" (fabric id = 2 )
  1   1   630100   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c0:db:57 "amssan06" (fabric id = 2 )
  2   2   630200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   630300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   630400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   630500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   630600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   630700   id    N4   No_Light    FC  Disabled (Persistent)
  8   8   630800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   630900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   630a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   630b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   630c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   630d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   630e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   630f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   631000   --    --   Online      VE  VEX-Port 00:00:00:00:00:00:00:00 "" (fabric id = 2 )
17  17   631100   --    --   Offline     VE  Disabled (Persistent)
18  18   631200   --    --   Offline     VE  Disabled (Persistent)
19  19   631300   --    --   Offline     VE  Disabled (Persistent)
20  20   631400   --    --   Offline     VE  Disabled (Persistent)
21  21   631500   --    --   Offline     VE  Disabled (Persistent)
22  22   631600   --    --   Offline     VE  Disabled (Persistent)
23  23   631700   --    --   Offline     VE  Disabled (Persistent)
24  24   631800   --    --   Offline     VE  Disabled (Persistent)
25  25   631900   --    --   Offline     VE  Disabled (Persistent)
26  26   631a00   --    --   Offline     VE  Disabled (Persistent)
27  27   631b00   --    --   Offline     VE  Disabled (Persistent)
28  28   631c00   --    --   Offline     VE  Disabled (Persistent)
29  29   631d00   --    --   Offline     VE  Disabled (Persistent)
30  30   631e00   --    --   Offline     VE  Disabled (Persistent)
31  31   631f00   --    --   Offline     VE  Disabled (Persistent)
     ge0  id    1G   Online    FCIP
     ge1  id    1G   Online    FCIP

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

did you define LSAN zoning on both edge fabrics ? If yes you would have 2 fabric ID entries for your LSAN zone.

cfgshow on both edge fabrics may help

BTW please provide a drawing with router / switch names, it will help in better understanding your architecture

Kind regards,

--

david

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

On routers, configure VE-port instead of VEX-port to have edge fabric <-> backbone fabric <-> edge fabric (see http://community.brocade.com/message/16831#16831) and all will be fine.

Kind regards,

--

david

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

The LSAN_ zones are only on the edge fabrics:

nlams-sanrtr1:admin> cfgshow
Defined configuration:
cfg:   AmsterdamReplication
                SANRTR1_P16
cfg:   ArM8G   LSAN_DR_ALMERE; SoIP_sancopy1; SoIP_sancopy3; SoIP_sancopy4
zone:  LSAN_DR_ALMERE
                50:06:01:64:46:e0:3e:5d; 50:06:01:66:44:60:23:de
zone:  SANRTR1_P16
                NLAMS_SANRTR1_P16
zone:  SoIP_sancopy1
                50:06:01:61:30:21:87:08; 50:06:01:65:44:60:27:b9
zone:  SoIP_sancopy3
                50:06:01:60:30:21:87:08; 50:06:01:67:44:60:23:de
zone:  SoIP_sancopy4
                50:06:01:68:30:21:87:08; 50:06:01:6f:44:60:23:de
alias: AMSECC_HBA0_P0
                101,1
alias: AMSECC_HBA1_P0
                102,1
alias: AMSHMFG301_HBA1_P0
                102,16
alias: AMSLVSPROD_HBA0_P1
                101,4
alias: AMSLVSPROD_HBA1_P1
                102,4
alias: AMSWVCB102_HBA0_P0
                101,23
alias: AMSWVCB102_HBA0_P1
                102,23
alias: CX240_101_SPA6
                101,11
alias: CX240_101_SPA7
                102,11
alias: CX240_101_SPB6
                101,19
alias: CX240_101_SPB7
                102,19
alias: CX240_102_SPA6
                101,3
alias: CX240_102_SPA7
                102,3
alias: CX240_102_SPB6
                101,10
alias: CX240_102_SPB7
                102,10
alias: NLAMS_FCIP_P16
                99,16
alias: NLAMS_SANRTR1_P16
                99,16

Effective configuration:
cfg:   AmsterdamReplication
zone:  SANRTR1_P16
                99,16

nlalm-sanrtr1:admin> cfgshow
Defined configuration:
cfg:   AlmereReplication
                SANRTR1_P16
zone:  LSAN_DR_ALMERE
                50:06:01:64:46:e0:3e:5d; 50:06:01:66:44:60:23:de
zone:  SANRTR1_P16
                NLALM_SANRTR1_P16
alias: NLALM_SANRTR1_P16
                53,16

Effective configuration:
cfg:   AlmereReplication
zone:  SANRTR1_P16
                53,16

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

drawing attached

IP addresses have changed.

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Yeah, I read that link many times and it still didn't fix it.

Here's what I end up with 2 VE ports:

AMS:

Index Port Address Media Speed State     Proto
==============================================
  0   0   630000   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c2:22:53 "amssan05" (fabric id = 2 )
  1   1   630100   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c0:db:57 "amssan06" (fabric id = 2 )
  2   2   630200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   630300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   630400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   630500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   630600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   630700   id    N4   No_Light    FC  Disabled (Persistent)
  8   8   630800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   630900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   630a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   630b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   630c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   630d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   630e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   630f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   631000   --    --   Online      VE  VE-Port  segmented,(zone conflict)

nlams-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 2 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  Configured
        50:06:01:66:44:60:23:de  EXIST

ALM:

Index Port Address Media Speed State     Proto
==============================================
  0   0   350000   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:4d:b3 "nlalm-sansw1" (fabric id = 3 )
  1   1   350100   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:42:4d "nlalm-sansw2" (fabric id = 3 )
  2   2   350200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   350300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   350400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   350500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   350600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   350700   id    N4   No_Light    FC
  8   8   350800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   350900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   350a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   350b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   350c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   350d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   350e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   350f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   351000   --    --   Online      VE  VE-Port  10:00:00:05:1e:c1:e4:73 ""

nlalm-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 3 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  EXIST
        50:06:01:66:44:60:23:de  Configured

Contributor
Posts: 39
Registered: ‎10-26-2010

Re: Problems getting FCIP tunnel up on 7500 switches.

From what I can see in your output, it looks like you may have attempted VEX-to-VEX (which will not work) then tried VE-to-VE and ran into a zoning conflict.

If you want to have a backbone and route to your edge fabrics, then you should do VEX-to-VE.  Have you tried that?

If you're ok with the two sides merging, then the VE-to-VE can be a solution, but the zoning is going to have to match across both sides before the merge will succeed (just like in any regular Brocade fabric).

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

zoning conflict between your routers ... Both routers should form a fabric and have same zoning defined. Unless you have devices directly connected on routers, you may clear zoning configuration on them with cfgclear / cfgsave.

Then VE-ports will go up, and LSAN zones defined in edge fabrics will exist / be imported  in backbone fabric.

kind regards,

--

david

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Yup, well spotted. I tried all the different combinations but hadn't noticed that at some stage my Production switch had merged with that fabric. Once I cleared out all configs on the backbone routers and set them to VE <-> VE all came up as advertised.

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.