Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Problems getting FCIP tunnel up on 7500 switches.

I've tried multiple configure but can never get my remote devices to get Imported instead of configured.

I can ping and traceroute out of the ge0 port in both directions.

I'll post the configs from the remote site:

nlalm-sanrtr1:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
53: fffc35 10:00:00:05:1e:c1:da:ff 10.17.9.202     10.17.8.53     >"nlalm-sanrtr1"

nlalm-sanrtr1:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:da:ff, Dom ID:  53,
Info: 10.17.9.202, "nlalm-sanrtr1"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0          3     10.17.9.200      10:00:00:05:33:51:4d:b3   "nlalm-sansw1"
       1          3     10.17.9.201      10:00:00:05:33:51:42:4d   "nlalm-sansw2"

nlalm-sanrtr1:admin> portshow fciptunnel ge0 all

Port: ge0
-------------------------------------------
        Tunnel ID 0
        Tunnel Description Not Configured
        Remote IP Addr 161.63.10.205
        Local IP Addr 10.17.8.53
        Remote WWN Not Configured
        Local WWN 10:00:00:05:1e:c1:da:ff
        Compression off
        Fastwrite off
        Tape Pipelining off
        Committed Rate 100000 Kbps (0.100000 Gbps)
        SACK on
        Min Retransmit Time 100
        Keepalive Timeout 10
        Max Retransmissions 8
        VC QoS Mapping off
        DSCP Marking (Control): 0, DSCP Marking (Data): 0
        VLAN Tagging Not Configured
        TCP Byte Streaming off
        Status : Active
        Connected Count: 103
        Uptime 59 seconds

nlalm-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 3 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  EXIST
        50:06:01:66:44:60:23:de  Configured

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Local site info:

nlams-sanrtr1:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
99: fffc63 10:00:00:05:1e:c1:e4:73 161.63.10.215   161.63.10.205  >"nlams-sanrtr1"

nlams-sanrtr1:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:e4:73, Dom ID:  99,
Info: 161.63.10.215, "nlams-sanrtr1"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0          2     161.63.10.209    10:00:00:05:1e:c2:22:53   "amssan05"
       1          2     161.63.10.210    10:00:00:05:1e:c0:db:57   "amssan06"

nlams-sanrtr1:admin> portshow fciptunnel ge0 all

Port: ge0
-------------------------------------------
        Tunnel ID 0
        Tunnel Description Not Configured
        Remote IP Addr 10.17.8.53
        Local IP Addr 161.63.10.205
        Remote WWN Not Configured
        Local WWN 10:00:00:05:1e:c1:e4:73
        Compression off
        Fastwrite off
        Tape Pipelining off
        Committed Rate 100000 Kbps (0.100000 Gbps)
        SACK on
        Min Retransmit Time 100
        Keepalive Timeout 10
        Max Retransmissions 8
        VC QoS Mapping off
        DSCP Marking (Control): 0, DSCP Marking (Data): 0
        VLAN Tagging Not Configured
        TCP Byte Streaming off
        Status : Active
        Connected Count: 116
        Uptime 2 minutes, 10 seconds

nlams-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 2 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  Configured
        50:06:01:66:44:60:23:de  EXIST

and switchshow for bakbone switches:

nlalm-sanrtr1:admin> switchshow
switchName:     nlalm-sanrtr1
switchType:     46.2
switchState:    Online
switchMode:     Native
switchRole:     Principal
switchDomain:   53
switchId:       fffc35
switchWwn:      10:00:00:05:1e:c1:da:ff
zoning:         ON (AlmereReplication)
switchBeacon:   OFF
FC Router:      ON
FC Router BB Fabric ID: 1
Address Mode:   0

Index Port Address Media Speed State     Proto
==============================================
  0   0   350000   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:4d:b3 "nlalm-sansw1" (fabric id = 3 )
  1   1   350100   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:42:4d "nlalm-sansw2" (fabric id = 3 )
  2   2   350200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   350300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   350400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   350500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   350600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   350700   id    N4   No_Light    FC
  8   8   350800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   350900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   350a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   350b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   350c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   350d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   350e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   350f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   351000   --    --   Online      VE  VEX-Port 00:00:00:00:00:00:00:00 "" (fabric id = 3 )
17  17   351100   --    --   Offline     VE  Disabled (Persistent)
18  18   351200   --    --   Offline     VE  Disabled (Persistent)
19  19   351300   --    --   Offline     VE  Disabled (Persistent)
20  20   351400   --    --   Offline     VE  Disabled (Persistent)
21  21   351500   --    --   Offline     VE  Disabled (Persistent)
22  22   351600   --    --   Offline     VE  Disabled (Persistent)
23  23   351700   --    --   Offline     VE  Disabled (Persistent)
24  24   351800   --    --   Offline     VE  Disabled (Persistent)
25  25   351900   --    --   Offline     VE  Disabled (Persistent)
26  26   351a00   --    --   Offline     VE  Disabled (Persistent)
27  27   351b00   --    --   Offline     VE  Disabled (Persistent)
28  28   351c00   --    --   Offline     VE  Disabled (Persistent)
29  29   351d00   --    --   Offline     VE  Disabled (Persistent)
30  30   351e00   --    --   Offline     VE  Disabled (Persistent)
31  31   351f00   --    --   Offline     VE  Disabled (Persistent)
     ge0  id    1G   Online    FCIP
     ge1  id    1G   Online    FCIP

nlams-sanrtr1:admin> switchshow
switchName:     nlams-sanrtr1
switchType:     46.2
switchState:    Online
switchMode:     Native
switchRole:     Principal
switchDomain:   99
switchId:       fffc63
switchWwn:      10:00:00:05:1e:c1:e4:73
zoning:         ON (AmsterdamReplication)
switchBeacon:   OFF
FC Router:      ON
FC Router BB Fabric ID: 1
Address Mode:   0

Index Port Address Media Speed State     Proto
==============================================
  0   0   630000   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c2:22:53 "amssan05" (fabric id = 2 )
  1   1   630100   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c0:db:57 "amssan06" (fabric id = 2 )
  2   2   630200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   630300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   630400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   630500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   630600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   630700   id    N4   No_Light    FC  Disabled (Persistent)
  8   8   630800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   630900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   630a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   630b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   630c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   630d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   630e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   630f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   631000   --    --   Online      VE  VEX-Port 00:00:00:00:00:00:00:00 "" (fabric id = 2 )
17  17   631100   --    --   Offline     VE  Disabled (Persistent)
18  18   631200   --    --   Offline     VE  Disabled (Persistent)
19  19   631300   --    --   Offline     VE  Disabled (Persistent)
20  20   631400   --    --   Offline     VE  Disabled (Persistent)
21  21   631500   --    --   Offline     VE  Disabled (Persistent)
22  22   631600   --    --   Offline     VE  Disabled (Persistent)
23  23   631700   --    --   Offline     VE  Disabled (Persistent)
24  24   631800   --    --   Offline     VE  Disabled (Persistent)
25  25   631900   --    --   Offline     VE  Disabled (Persistent)
26  26   631a00   --    --   Offline     VE  Disabled (Persistent)
27  27   631b00   --    --   Offline     VE  Disabled (Persistent)
28  28   631c00   --    --   Offline     VE  Disabled (Persistent)
29  29   631d00   --    --   Offline     VE  Disabled (Persistent)
30  30   631e00   --    --   Offline     VE  Disabled (Persistent)
31  31   631f00   --    --   Offline     VE  Disabled (Persistent)
     ge0  id    1G   Online    FCIP
     ge1  id    1G   Online    FCIP

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

did you define LSAN zoning on both edge fabrics ? If yes you would have 2 fabric ID entries for your LSAN zone.

cfgshow on both edge fabrics may help

BTW please provide a drawing with router / switch names, it will help in better understanding your architecture

Kind regards,

--

david

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

On routers, configure VE-port instead of VEX-port to have edge fabric <-> backbone fabric <-> edge fabric (see http://community.brocade.com/message/16831#16831) and all will be fine.

Kind regards,

--

david

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

The LSAN_ zones are only on the edge fabrics:

nlams-sanrtr1:admin> cfgshow
Defined configuration:
cfg:   AmsterdamReplication
                SANRTR1_P16
cfg:   ArM8G   LSAN_DR_ALMERE; SoIP_sancopy1; SoIP_sancopy3; SoIP_sancopy4
zone:  LSAN_DR_ALMERE
                50:06:01:64:46:e0:3e:5d; 50:06:01:66:44:60:23:de
zone:  SANRTR1_P16
                NLAMS_SANRTR1_P16
zone:  SoIP_sancopy1
                50:06:01:61:30:21:87:08; 50:06:01:65:44:60:27:b9
zone:  SoIP_sancopy3
                50:06:01:60:30:21:87:08; 50:06:01:67:44:60:23:de
zone:  SoIP_sancopy4
                50:06:01:68:30:21:87:08; 50:06:01:6f:44:60:23:de
alias: AMSECC_HBA0_P0
                101,1
alias: AMSECC_HBA1_P0
                102,1
alias: AMSHMFG301_HBA1_P0
                102,16
alias: AMSLVSPROD_HBA0_P1
                101,4
alias: AMSLVSPROD_HBA1_P1
                102,4
alias: AMSWVCB102_HBA0_P0
                101,23
alias: AMSWVCB102_HBA0_P1
                102,23
alias: CX240_101_SPA6
                101,11
alias: CX240_101_SPA7
                102,11
alias: CX240_101_SPB6
                101,19
alias: CX240_101_SPB7
                102,19
alias: CX240_102_SPA6
                101,3
alias: CX240_102_SPA7
                102,3
alias: CX240_102_SPB6
                101,10
alias: CX240_102_SPB7
                102,10
alias: NLAMS_FCIP_P16
                99,16
alias: NLAMS_SANRTR1_P16
                99,16

Effective configuration:
cfg:   AmsterdamReplication
zone:  SANRTR1_P16
                99,16

nlalm-sanrtr1:admin> cfgshow
Defined configuration:
cfg:   AlmereReplication
                SANRTR1_P16
zone:  LSAN_DR_ALMERE
                50:06:01:64:46:e0:3e:5d; 50:06:01:66:44:60:23:de
zone:  SANRTR1_P16
                NLALM_SANRTR1_P16
alias: NLALM_SANRTR1_P16
                53,16

Effective configuration:
cfg:   AlmereReplication
zone:  SANRTR1_P16
                53,16

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

drawing attached

IP addresses have changed.

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Yeah, I read that link many times and it still didn't fix it.

Here's what I end up with 2 VE ports:

AMS:

Index Port Address Media Speed State     Proto
==============================================
  0   0   630000   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c2:22:53 "amssan05" (fabric id = 2 )
  1   1   630100   id    N4   Online      FC  EX-Port  10:00:00:05:1e:c0:db:57 "amssan06" (fabric id = 2 )
  2   2   630200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   630300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   630400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   630500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   630600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   630700   id    N4   No_Light    FC  Disabled (Persistent)
  8   8   630800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   630900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   630a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   630b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   630c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   630d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   630e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   630f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   631000   --    --   Online      VE  VE-Port  segmented,(zone conflict)

nlams-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 2 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  Configured
        50:06:01:66:44:60:23:de  EXIST

ALM:

Index Port Address Media Speed State     Proto
==============================================
  0   0   350000   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:4d:b3 "nlalm-sansw1" (fabric id = 3 )
  1   1   350100   id    N4   Online      FC  EX-Port  10:00:00:05:33:51:42:4d "nlalm-sansw2" (fabric id = 3 )
  2   2   350200   id    N4   No_Light    FC  Disabled (Persistent)
  3   3   350300   id    N4   No_Light    FC  Disabled (Persistent)
  4   4   350400   id    N4   No_Light    FC  Disabled (Persistent)
  5   5   350500   id    N4   No_Light    FC  Disabled (Persistent)
  6   6   350600   id    N4   No_Light    FC  Disabled (Persistent)
  7   7   350700   id    N4   No_Light    FC
  8   8   350800   id    N4   No_Light    FC  Disabled (Persistent)
  9   9   350900   id    N4   No_Light    FC  Disabled (Persistent)
10  10   350a00   id    N4   No_Light    FC  Disabled (Persistent)
11  11   350b00   id    N4   No_Light    FC  Disabled (Persistent)
12  12   350c00   id    N4   No_Light    FC  Disabled (Persistent)
13  13   350d00   id    N4   No_Light    FC  Disabled (Persistent)
14  14   350e00   id    N4   No_Light    FC  Disabled (Persistent)
15  15   350f00   id    N4   No_Light    FC  Disabled (Persistent)
16  16   351000   --    --   Online      VE  VE-Port  10:00:00:05:1e:c1:e4:73 ""

nlalm-sanrtr1:admin> lsanzoneshow -s
Fabric ID: 3 Zone Name: LSAN_DR_ALMERE
        50:06:01:64:46:e0:3e:5d  EXIST
        50:06:01:66:44:60:23:de  Configured

Contributor
Posts: 39
Registered: ‎10-26-2010

Re: Problems getting FCIP tunnel up on 7500 switches.

From what I can see in your output, it looks like you may have attempted VEX-to-VEX (which will not work) then tried VE-to-VE and ran into a zoning conflict.

If you want to have a backbone and route to your edge fabrics, then you should do VEX-to-VE.  Have you tried that?

If you're ok with the two sides merging, then the VE-to-VE can be a solution, but the zoning is going to have to match across both sides before the merge will succeed (just like in any regular Brocade fabric).

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: Problems getting FCIP tunnel up on 7500 switches.

zoning conflict between your routers ... Both routers should form a fabric and have same zoning defined. Unless you have devices directly connected on routers, you may clear zoning configuration on them with cfgclear / cfgsave.

Then VE-ports will go up, and LSAN zones defined in edge fabrics will exist / be imported  in backbone fabric.

kind regards,

--

david

Occasional Contributor
Posts: 7
Registered: ‎07-14-2011

Re: Problems getting FCIP tunnel up on 7500 switches.

Yup, well spotted. I tried all the different combinations but hadn't noticed that at some stage my Production switch had merged with that fabric. Once I cleared out all configs on the backbone routers and set them to VE <-> VE all came up as advertised.

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.

vADC is now Pulse Secure
Download FREE NVMe eBook