Fibre Channel (SAN)

Reply
New Contributor
Posts: 3
Registered: ‎07-04-2011

Unable to create IFL between two virtual fabrics on DCX

Hello,

I'm trying to create an IFL between two virtual fabrics on a DCX.

The Base Virtual Switch / Virtual Fabric has FID:1 (Base-FabricA-alm)

The other Virtual Switch / Virtual Fabric has FID:31 (SoD-CoreSw01-A-alm)

When i create the EX-port on the base switch the port automaticaly disables en the errDump says:

2011/10/19-17:13:34, , 582, SLOT 5 | FID 1, WARNING, Base-FabricA-alm, Port 7/1 isolated due to mismatched configuration parameter; ELP rejected by the other switch.

In the other virtual switch the errDump displays:

2011/10/19-17:13:34, , 581, SLOT 5 | FID 31, WARNING, SoD-CoreSw01-A-alm, port 136, incompatible flow control parameters (2).

configshow: Base-FabricA-alm

Base-FabricA-alm:FID1:admin> configshow | grep -i fabric
SwitchName = Base-FabricA-alm
Fabric ID = 1
boot.name:Base-FabricA-alm
fcRoute.backboneFabricId:1
fcRoute.port.64.fabricId:23
fcRoute.port.65.fabricId:31
fcRoute.port.66.fabricId:24
fcRoute.port.67.fabricId:24
fcRoute.port.80.fabricId:28
fcRoute.port.81.fabricId:29
fcRoute.port.82.fabricId:29
fcRoute.port.83.fabricId:29
fcRoute.port.128.fabricId:44
fcRoute.port.129.fabricId:31
fcRoute.port.130.fabricId:45
fcRoute.port.131.fabricId:45
fcRoute.port.144.fabricId:50
fcRoute.port.145.fabricId:50
fcRoute.port.146.fabricId:50
fcRoute.port.147.fabricId:51
fabric.domain:120
fabric.ididmode:0
fabric.ops.BBCredit:16
fabric.ops.E_D_TOV:2000
fabric.ops.R_A_TOV:10000
fabric.ops.dataFieldSize:2112
fabric.ops.max_hops:7
fabric.ops.mode.fcpProbeDisable:0
fabric.ops.mode.isolate:0
fabric.ops.mode.longDistance:1
fabric.ops.mode.noClassF:0
fabric.ops.mode.pidFormat:1
fabric.ops.mode.tachyonCompat:0
fabric.ops.mode.unicastOnly:0
fabric.ops.mode.useCsCtl:0
fabric.ops.vc.class.2:2
fabric.ops.vc.class.3:3
fabric.ops.vc.config:0xc0
fabric.ops.vc.linkCtrl:0
fabric.ops.vc.multicast:7
fabric.ops.wan_tov:0
fabric.principalSwSelMode:0
fabric.wwnPidMode:0
switch.mcdtFabricMode:0

portcfgexport 2/1

Port   2/1   info
Admin:                  enabled
State:                  NOT OK
Pid format:             Not Applicable
Operate mode:           Brocade Native
Edge Fabric ID:         31
Preferred Domain ID:    160
Front WWN:              50:00:53:32:07:20:1e:1f
Fabric Parameters:      Auto Negotiate
R_A_TOV:                Not Applicable
E_D_TOV:                Not Applicable
Authentication Type: None
DH Group: N/A
Hash Algorithm: N/A
Edge fabric's primary wwn: N/A
Edge fabric's version stamp: N/A

portcfgshow 2/1
Area Number:              1
Speed Level:              8G
Fill Word:                0(Idle-Idle)
AL_PA Offset 13:          OFF
Trunk Port                ON
Long Distance             OFF
VC Link Init              OFF
Locked L_Port             OFF
Locked G_Port             OFF
Disabled E_Port           OFF
ISL R_RDY Mode            OFF
RSCN Suppressed           OFF
Persistent Disable        OFF
NPIV capability           ON
QOS E_Port                ON
Port Auto Disable:        OFF
Rate Limit                OFF
EX Port                   ON
Mirror Port               OFF
Credit Recovery           ON
F_Port Buffers            OFF

configshow: SoD-CoreSw01-A-alm

SoD-CoreSw01-A-alm:FID31:admin> configshow | grep -i fabric
Fabric ID = 31
fabric.domain:120
fabric.ididmode:0
fabric.ops.BBCredit:16
fabric.ops.E_D_TOV:2000
fabric.ops.R_A_TOV:10000
fabric.ops.dataFieldSize:2112
fabric.ops.max_hops:7
fabric.ops.mode.fcpProbeDisable:0
fabric.ops.mode.isolate:0
fabric.ops.mode.longDistance:0
fabric.ops.mode.noClassF:0
fabric.ops.mode.pidFormat:1
fabric.ops.mode.tachyonCompat:0
fabric.ops.mode.unicastOnly:0
fabric.ops.mode.useCsCtl:0
fabric.ops.vc.class.2:2
fabric.ops.vc.class.3:3
fabric.ops.vc.config:0xc0
fabric.ops.vc.linkCtrl:0
fabric.ops.vc.multicast:7
fabric.ops.wan_tov:0
fabric.principalSwSelMode:0
fabric.wwnPidMode:0
switch.mcdtFabricMode:0

portcfgshow 2/8
Area Number:              237
Speed Level:              8G
Fill Word:                0(Idle-Idle)
AL_PA Offset 13:          OFF
Trunk Port                ON
Long Distance             OFF
VC Link Init              OFF
Locked L_Port             OFF
Locked G_Port             ON
Disabled E_Port           OFF
ISL R_RDY Mode            OFF
RSCN Suppressed           OFF
Persistent Disable        OFF
NPIV capability           ON
QOS E_Port                ON
Port Auto Disable:        OFF
Rate Limit                OFF
EX Port                   OFF
Mirror Port               OFF
Credit Recovery           ON
F_Port Buffers            OFF

Could someone give me some advice or point me iin the right direction?

Valued Contributor
Posts: 761
Registered: ‎06-11-2010

Re: Unable to create IFL between two virtual fabrics on DCX

It seems that there is config mismatch between the VF with FID:31 and the EX_port in the base switch.

Please, take a look at "fabriclog --show" output to see if you can get more info regarding this mismatching parameter. On the other hand, try to set the EX_port as G_port also (command portcfggport) and try again to create the IFL. Also take a look at PID format in the EX_port since there could be a mismatch in it as well.

If these steps don't help to create the IFL, attach a supportshow/supportsave to the post, and let's see if we can help you in more depth.

Kind regards

New Contributor
Posts: 3
Registered: ‎07-04-2011

Re: Unable to create IFL between two virtual fabrics on DCX

The fabriclog show's the following by trying to enable the port.

Base Fabric:

17:13:34.343008 SCN AC_PORT - bad                           D2,P0  D2,P0  129   NA
17:13:34.540338 SCN LE Port Offline;g=0x0                   D2,P0  D2,P0  129   NA
17:13:34.540342 *Removing all nodes from port               D2,P0  D2,P0  129   NA

edge fabric:

17:13:34.343028 SCN LR_PORT (0);g=0x48                      D2,P0  D2,P0  136   NA
17:13:34.476074 SCN Port Online;g=0x48                      D2,P0  D2,P1  136   NA
17:13:34.508909 Send ELP requesting VC RDY + ARB mode       D2,P1  D2,P1  136   NA
17:13:34.509141 *ELP Send:rev=2,flow=1,flen=80,size=164     D2,P1  D2,P1  136   0x2e8
17:13:34.510077 ELP RJT Rcv, lgcl bsy, in prgs              D2,P1  D2,P1  136   0x2e8
17:13:34.510087 *Start ELP node timer                       D2,P1  D2,P1  136   NA
17:13:34.510856 ELP Rcv:rev=2,flow=1,flen=80,size=164       D2,P1  D2,P1  136   0x3cf8
17:13:34.511210 Segment: incompatible flow contro           D2,P1  D2,P1  136   NA
17:13:34.511211 -l parameters (2)
17:13:34.512051 *Removing all nodes from port               D2,P1  D2,P1  136   NA
17:13:34.512054 Cancel Resp Failed,g=0x0,iu=0x0             D2,P1  D2,P1  136   NA
17:13:34.512105 *Canceling ELP node timer                   D2,P1  D2,P1  136   NA
17:13:34.512106 Cancel Resp Failed,g=0x0,iu=0x0             D2,P1  D2,P1  136   NA
17:13:34.512144 *ELP Snd RJT, lgcl err, ctl prm             D2,P1  D2,P1  136   0x3cf8
17:13:34.514730 SCN Port Offline;g=0x4a                     D2,P1  D2,P0  136   NA
17:13:34.514736 *Removing all nodes from port               D2,P0  D2,P0  136   NA
17:13:34.514738 Cancel Resp Failed,g=0x0,iu=0x0             D2,P0  D2,P0  136   NA
17:13:37.515951 *ELP has been removed                       D2,P0  D2,P0  136   NA

The Edge Fabric ID on the EX-Port should match the Fabric ID of the fabric you are trying to route to?

Those are now the same (31).

Valued Contributor
Posts: 761
Registered: ‎06-11-2010

Re: Unable to create IFL between two virtual fabrics on DCX

I don't think that this two values need to match (imagine if instead of a VF, the edge switch were a physical switch, in that case the physical switch does not have a Fabric ID assigned). I would consider it a best practice making them match, since it is easier to configure and t'shoot if necessary.

There is not much info the fabriclog output. Where you able to config the ex_port as g_port?

New Contributor
Posts: 3
Registered: ‎07-04-2011

Re: Unable to create IFL between two virtual fabrics on DCX

I think you mean that the physical switch has no fabric domain. FID is something you need to configure to be able to route. If i'm not mistaken.

I was able to change the EX_Port as a G_Port but it didn't change the problem.

So far no solution, but thanx anyway for your effort.

Something else i could try?

Valued Contributor
Posts: 761
Registered: ‎06-11-2010

Re: Unable to create IFL between two virtual fabrics on DCX

you're right, but I meant that the FID in the switch is not the same concept that the one used by the base switch to route, and don't need to match.

Instead of leaving the Fabric parameters in auto-negotiate, try to set all the Fabric Parameters manually.

The following parameters must be exactly the same in the ex_port and in the VF:31 for the IFL to be created with success:

R_A_TOV

E_D_TOV

Data field size

Sequence level switching

Disable device probing

Suppress class F traffic

Per-frame route priority

BB credit

PID format

The parameters in Bold are the one that can me set in the ex_port.

Occasional Contributor
Posts: 15
Registered: ‎07-05-2010

Re: Unable to create IFL between two virtual fabrics on DCX

Hi,

I troubleshoot this problem for Marcel in November.

Fabric.ops.mode.longdistance setting was the problem. They were not the same in both fabrics.

(Eventhough the fabric.ops.mode.long distance setting is reported to be obsolete, it will prevent the merge if they are different.)

Regards,

Ed

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.