Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 5
Registered: ‎04-09-2011

FCIP tunneling and proxydevices problem

Dear All,

I am new in this community so please forgive me for any mistake. I have problem in setting up remote mirroring which will include 2 datacenters (1 pri and 1 DR) having storage on each side. I did a fcip tunneling but i cannot see the proxydevices  in my each side san router and lsanzoneshow -s showing all proxydevices as configured.

primary site have 1 7500e san router as backbone, 2 san switches as edge and 1 ibm ds5100 storage with few hosts.

dr site have 1 7500e san router as backbone, 2 san switches as edge and 1 ibm ds4700 storage with few hosts.

below are some outputs for my routers, I am also attaching my san diagram to understand more out fcip network. Any help will be very much appreciated.

IBM_2005_R04_Pri_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:78:c3, Dom ID:   5,
Info: 172.18.18.14, "IBM_2005_R04_Pri_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
      16         30     172.17.1.14      10:00:00:05:1e:c1:79:77   "IBM_2005_R04_DR_site"
       0        100     172.18.18.12     10:00:00:05:1e:a2:3d:a5   "SAN1_Primarysite"
       1        101     172.18.18.13     10:00:00:05:1e:a3:06:a1   "SAN2_PrimarySite"

IBM_2005_R04_Pri_site:admin> fcrphydevshow
Device           WWN            Physical
Exists                            PID
in Fabric
-----------------------------------------
  100    10:00:00:00:c9:83:09:ea  011100
  100    10:00:00:00:c9:83:09:eb  011500
  101    10:00:00:00:c9:82:38:59  031600
Total devices displayed: 3

IBM_2005_R04_Pri_site:admin> fcrproxydevshow
No proxy device found

IBM_2005_R04_Pri_site:admin> lsanzoneshow -s
Fabric ID: 100 Zone Name: LSAN_AIX_DS
        10:00:00:00:c9:83:09:ea  EXIST
        20:17:00:a0:b8:48:d6:c0  Configured
        20:27:00:a0:b8:48:d6:c0  Configured
Fabric ID: 100 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  Configured
        20:02:00:0e:11:12:6f:07  Configured
        10:00:00:00:c9:83:09:eb  EXIST
Fabric ID: 101 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  Configured
        20:16:00:a0:b8:48:d6:c0  Configured
        10:00:00:00:c9:82:38:59  EXIST

IBM_2005_R04_DR_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:79:77, Dom ID:   6,
Info: 172.17.1.14, "IBM_2005_R04_DR_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        103     172.17.1.38      10:00:00:05:1e:7b:b3:2c   "SAN1_NajranUniv"
       1        104     172.17.1.39      10:00:00:05:1e:80:5f:e6   "SAN2_NajranUniv"

IBM_2005_R04_DR_site:admin> fcrphydevshow
Device           WWN            Physical
Exists                            PID
in Fabric
-----------------------------------------
  103    20:02:00:0e:11:12:6f:07  0216e1
  103    20:08:00:0e:11:12:6f:07  0217e0
  103    20:16:00:a0:b8:48:d6:c0  020000
  103    20:26:00:a0:b8:48:d6:c0  020100
  104    20:17:00:a0:b8:48:d6:c0  040000
  104    20:27:00:a0:b8:48:d6:c0  0401

IBM_2005_R04_DR_site:admin> fcrproxydevshow
No proxy device found

IBM_2005_R04_DR_site:admin> lsanzoneshow -s
Fabric ID: 103 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  EXIST
        20:16:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:82:38:59  Configured
Fabric ID: 103 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  EXIST
        20:02:00:0e:11:12:6f:07  EXIST
        10:00:00:00:c9:83:09:eb  Configured
Fabric ID: 104 Zone Name: LSAN_AIX_DS
        20:17:00:a0:b8:48:d6:c0  EXIST
        20:27:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:83:09:ea  Configured

Regards,

Mohammed

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: FCIP tunneling and proxydevices problem

Hi

did you create exactly the same LSAN zone on edges fabrics ?

Could you provide fabricshow on routers ? On fcrfabricshow you should see both local and remote routers but it's not the case, as if you have an issue with FCIP tunnel setup.

Kind regards,

--

david

Occasional Contributor
Posts: 5
Registered: ‎04-09-2011

Re: FCIP tunneling and proxydevices problem

Thanks David for the reply,

Yes, I have create same lsan zone, you can see in my lsanzoneshow cmd. I have created primary router ge0 as VEX and DR router ge0 as VE. Also, from primary router i can see remote router in  fcrfabricshow but from DR router I can't.

below are outputs which u asked

fabricIBM_2005_R04_Pri_site:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
  5: fffc05 10:00:00:05:1e:c1:78:c3 172.18.18.14    172.18.18.15   >"IBM_2005_R04_Pri_site"

IBM_2005_R04_Pri_site:admin> lsanzoneshow
Fabric ID: 100 Zone Name: LSAN_AIX_DS
        10:00:00:00:c9:83:09:ea
        20:17:00:a0:b8:48:d6:c0
        20:27:00:a0:b8:48:d6:c0
Fabric ID: 100 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07
        20:02:00:0e:11:12:6f:07
        10:00:00:00:c9:83:09:eb
Fabric ID: 101 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0
        20:16:00:a0:b8:48:d6:c0
        10:00:00:00:c9:82:38:59
IBM_2005_R04_Pri_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:78:c3, Dom ID:   5,
Info: 172.18.18.14, "IBM_2005_R04_Pri_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
      16         30     172.17.1.14      10:00:00:05:1e:c1:79:77   "IBM_2005_R04_DR_site"     (san router on remote DR site)
       0        100     172.18.18.12     10:00:00:05:1e:a2:3d:a5   "SAN1_Primarysite"          (edge switch on local PR site)
       1        101     172.18.18.13     10:00:00:05:1e:a3:06:a1   "SAN2_PrimarySite"          (edge switch on local PR site)

IBM_2005_R04_DR_site:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
  6: fffc06 10:00:00:05:1e:c1:79:77 172.17.1.14     172.17.1.15    >"IBM_2005_R04_DR_site"
160: fffca0 50:00:51:ec:17:8c:3e:1e 0.0.0.0         0.0.0.0         "fcr_fd_160"

The Fabric has 2 switches

IBM_2005_R04_DR_site:admin> lsanzoneshow
Fabric ID: 103 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0
        20:16:00:a0:b8:48:d6:c0
        10:00:00:00:c9:82:38:59
Fabric ID: 103 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07
        20:02:00:0e:11:12:6f:07
        10:00:00:00:c9:83:09:eb
Fabric ID: 104 Zone Name: LSAN_AIX_DS
        20:17:00:a0:b8:48:d6:c0
        20:27:00:a0:b8:48:d6:c0
        10:00:00:00:c9:83:09:ea
IBM_2005_R04_DR_site:admin>

IBM_2005_R04_DR_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:79:77, Dom ID:   6,
Info: 172.17.1.14, "IBM_2005_R04_DR_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        103     172.17.1.38      10:00:00:05:1e:7b:b3:2c   "SAN1_NajranUniv"         (edge switch on local DR site)
       1        104     172.17.1.39      10:00:00:05:1e:80:5f:e6   "SAN2_NajranUniv"          (edge switch on local DR site)

Regards,

Mohammed

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: FCIP tunneling and proxydevices problem

Instead of having VE port on one side and VEX on the other, I would try to use VE port on both router, thus having a backbone fabric with EX-port on each side to edge fabrics with same LSAN zone created on them.

I'm using such configuration without any issue at all, and I've never used VEX port.

Hope this helps

Kind regards,

--

david

Occasional Contributor
Posts: 5
Registered: ‎04-09-2011

Re: FCIP tunneling and proxydevices problem

Thanks  David for the reply,

If we use both side VE does it merge the fabric of both DR and PR. If yes, then will it effect anyhow to my existing zones and servers which are using SAN?

We have wireless connection between both the sites so wondering if any problem in future if both fabrics are merged.

Let me know your suggestions.

Regards,

Mohammed

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: FCIP tunneling and proxydevices problem

A fabric will be formed with both PR and DR routers (= backbone fabric), not with PR and DR edge fabrics, thanks to EXport to routers :

PR Edge fabric 1 (Eport) <-> (EXport) PR router (VE PORT) <-- wireless --> (VE PORT) DR router (EXport) <-> (Eport) DR Edge Fabric 1

Absolutly no zoning configuration on backbone fabric, only FCIP and EXport configuration.

Local zoning + LSAN zones on PR fabrics, Local zoning + same LSAN zones on DR fabrics and it's done.

I've been using such configuration for years

Hope this helps

Kind regards,

--

david

Occasional Contributor
Posts: 5
Registered: ‎04-09-2011

Re: FCIP tunneling and proxydevices problem

Thanks a million David for your valuable time and great solution! It worked for me now

IBM_2005_R04_Pri_site:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
  5: fffc05 10:00:00:05:1e:c1:78:c3 172.18.18.14    172.18.18.15   >"IBM_2005_R04_Pri_site"
  6: fffc06 10:00:00:05:1e:c1:79:77 172.17.1.14     172.17.1.15     "IBM_2005_R04_DR_site"

The Fabric has 2 switches

IBM_2005_R04_Pri_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:78:c3, Dom ID:   5,
Info: 172.18.18.14, "IBM_2005_R04_Pri_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        100     172.18.18.12     10:00:00:05:1e:a2:3d:a5   "SAN1_Primarysite"
       1        101     172.18.18.13     10:00:00:05:1e:a3:06:a1   "SAN2_PrimarySite"

FC Router WWN: 10:00:00:05:1e:c1:79:77, Dom ID:   6,
Info: 172.17.1.14, "IBM_2005_R04_DR_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        103     172.17.1.38      10:00:00:05:1e:7b:b3:2c   "SAN1_NajranUniv"
       1        104     172.17.1.39      10:00:00:05:1e:80:5f:e6   "SAN2_NajranUniv"

IBM_2005_R04_Pri_site:admin> lsanzoneshow -s
Fabric ID: 100 Zone Name: LSAN_AIX_DS
        10:00:00:00:c9:83:09:ea  EXIST
        20:17:00:a0:b8:48:d6:c0  Imported
        20:27:00:a0:b8:48:d6:c0  Imported
Fabric ID: 100 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  Imported
        20:02:00:0e:11:12:6f:07  Imported
        10:00:00:00:c9:83:09:eb  EXIST
Fabric ID: 101 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  Imported
        20:16:00:a0:b8:48:d6:c0  Imported
        10:00:00:00:c9:82:38:59  EXIST
Fabric ID: 103 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  EXIST
        20:16:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:82:38:59  Imported
Fabric ID: 103 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  EXIST
        20:02:00:0e:11:12:6f:07  EXIST
        10:00:00:00:c9:83:09:eb  Imported
Fabric ID: 104 Zone Name: LSAN_AIX_DS
        20:17:00:a0:b8:48:d6:c0  EXIST
        20:27:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:83:09:ea  Imported
IBM_2005_R04_Pri_site:admin>

IBM_2005_R04_DR_site:admin> fabricshow
Switch ID   Worldwide Name           Enet IP Addr    FC IP Addr      Name
-------------------------------------------------------------------------
  5: fffc05 10:00:00:05:1e:c1:78:c3 172.18.18.14    172.18.18.15   >"IBM_2005_R04_Pri_site"
  6: fffc06 10:00:00:05:1e:c1:79:77 172.17.1.14     172.17.1.15     "IBM_2005_R04_DR_site"

The Fabric has 2 switches

IBM_2005_R04_DR_site:admin> fcrfabricshow
FC Router WWN: 10:00:00:05:1e:c1:78:c3, Dom ID:   5,
Info: 172.18.18.14, "IBM_2005_R04_Pri_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        100     172.18.18.12     10:00:00:05:1e:a2:3d:a5   "SAN1_Primarysite"
       1        101     172.18.18.13     10:00:00:05:1e:a3:06:a1   "SAN2_PrimarySite"

FC Router WWN: 10:00:00:05:1e:c1:79:77, Dom ID:   6,
Info: 172.17.1.14, "IBM_2005_R04_DR_site"
   EX_Port       FID    Neighbor Switch Info (enet IP, WWN, name)
   ------------------------------------------------------------------------
       0        103     172.17.1.38      10:00:00:05:1e:7b:b3:2c   "SAN1_NajranUniv"
       1        104     172.17.1.39      10:00:00:05:1e:80:5f:e6   "SAN2_NajranUniv"

IBM_2005_R04_DR_site:admin> lsanzoneshow -s
Fabric ID: 100 Zone Name: LSAN_AIX_DS
        10:00:00:00:c9:83:09:ea  EXIST
        20:17:00:a0:b8:48:d6:c0  Imported
        20:27:00:a0:b8:48:d6:c0  Imported
Fabric ID: 100 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  Imported
        20:02:00:0e:11:12:6f:07  Imported
        10:00:00:00:c9:83:09:eb  EXIST
Fabric ID: 101 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  Imported
        20:16:00:a0:b8:48:d6:c0  Imported
        10:00:00:00:c9:82:38:59  EXIST
Fabric ID: 103 Zone Name: LSAN_AIX_DS_CNTA
        20:26:00:a0:b8:48:d6:c0  EXIST
        20:16:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:82:38:59  Imported
Fabric ID: 103 Zone Name: LSAN_TAPE
        20:08:00:0e:11:12:6f:07  EXIST
        20:02:00:0e:11:12:6f:07  EXIST
        10:00:00:00:c9:83:09:eb  Imported
Fabric ID: 104 Zone Name: LSAN_AIX_DS
        20:17:00:a0:b8:48:d6:c0  EXIST
        20:27:00:a0:b8:48:d6:c0  EXIST
        10:00:00:00:c9:83:09:ea  Imported

Regards,

Mohammed

Occasional Contributor
Posts: 5
Registered: ‎04-09-2011

Re: FCIP tunneling and proxydevices problem

Hi David,

Can you also help me in setting ERM using IBM storage on each DR and PR site? I dont want to use any host to the remote storage. I need to replicate LUNs from PR storage to DR storage using ERM technology.

Any help will be kind enough.

Regular Contributor
Posts: 178
Registered: ‎04-21-2008

Re: FCIP tunneling and proxydevices problem

Good decision to use storage replication mecanism instead of host to remote storage. I'm not familiar with ERM, have a look at IBM redbook (if not already done) http://www.redbooks.ibm.com/abstracts/sg247822.html?Open

In general those documentation are quite good and easy to follow ... In your case you will have to use asynchronous Global mirror

Hope this helps

Kind regards,

--

david

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.