Fibre Channel (SAN)

Reply
Occasional Contributor
Posts: 19
Registered: ‎12-16-2009
Accepted Solution

ICL interconnect

Hi all.

We have a customer with 2 DCX8510-8 interconnected with ICL cables.

I was looking at output from SanHealth and later output from trunkshow  and switchshow trying to figure out how many ICL cables are used but its not clear.

 

Here is the output from switchshow

 

384    5    0   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (upstream)(Trunk master)

 385    5    1   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 386    5    2   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 387    5    3   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 388    5    4   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  0 )

 389    5    5   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  1 )

 390    5    6   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  2 )

 391    5    7   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  3 )

 392    5    8   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  0 )

 393    5    9   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  1 )

 394    5   10   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  2 )

 395    5   11   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  3 )

 396    5   12   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  0 )

 397    5   13   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  1 )

 398    5   14   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  2 )

 399    5   15   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  5 Port  3 )

 400    5   16   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 401    5   17   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 402    5   18   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 403    5   19   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 

 

416    8    0   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  4 )

 417    8    1   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  5 )

 418    8    2   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  6 )

 419    8    3   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  7 )

 420    8    4   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 421    8    5   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 422    8    6   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 423    8    7   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 424    8    8   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  4 )

 425    8    9   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  5 )

 426    8   10   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  6 )

 427    8   11   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  7 )

 428    8   12   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  4 )

 429    8   13   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  5 )

 430    8   14   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  6 )

 431    8   15   ------   id    16G        Online      FC  E-Port  (Trunk port, master is Slot  8 Port  7 )

 432    8   16   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 433    8   17   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 434    8   18   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

 435    8   19   ------   id    16G        Online      FC  E-Port  10:00:00:05:33:9a:08:00 "dcx-3" (Trunk master)

I dont know how many ICL cables used.

Its all clear about trunks with 4 members (ports 0-15), because every ICL have 4 connections inside.

But where does connections on ports 16-19 come from and why they do not form 1 Trunk but 4 instead?

ports 16-19 seem to belong to different ASICS, but not sure as have not found document where I can figure out which ports belong to what ASIC on Core Blades.

 

Any ideas?

Occasional Contributor
Posts: 19
Registered: ‎12-16-2009

Re: ICL interconnect

well, what I found about ICL from Brocade Fabric OS Administrator's Guide.

 

Each Quad Small Form-Factor Pluggable (QSFP) cable has four ports, each terminating on a different application-specific integrated circuit (ASIC). These ports cannot form a trunk with each other, but can form trunks only with corresponding ports on another QSFP.

 

So it simply means there are 5 ICL cables installed on each core blade but 1 cable is probably in different trunk group therefore it does not join existing 4 trunks, but creates 4 separate trunks.

 

Update^

found trunk groups info for core Blade:

  • Trunk group 0: QSFP ports 0-3 and 8-11.
  • Trunk group 1: QSFP ports 4-7 and 12-15.

and mapping of QSFP ports to ASIC ports

 

TABLE 27 External port to slotShow port mapping for core blades

 

Ext port | slotShow port num
0               0-3

1               4-7

2               8-11
3              12-15

4              16-19

5              20-23

6              24-27

7              28-31

8               32-35

9               36-39

10            40-43

11            44-47

12            48-51

13            52-55

14            56-59

15            60-63

 

So it explains my theory that the ports are in different trunk groups. that is why we see so many trunks in switchshow/trunkshow output.

 

And this implementation seems to be not according to Brocade Best Practice, as they recommend to add ICL in pairs and no more that 4 pairs when connecting just 2 DCX8510

External Moderator
Posts: 4,929
Registered: ‎02-23-2004

Re: ICL interconnect

--->>>trying to figure out how many ICL cables are used but its not clear.

 

--->>>I dont know how many ICL cables used.

 

--->>>So it simply means there are 5 ICL cables installed on each core blade

 

you have "TWO" DCX and want to connect via ICL, with 5 ICL cable ?????

 

In few words, what is you question in this Threads ?

 

 

TechHelp24
Occasional Contributor
Posts: 19
Registered: ‎12-16-2009

Re: ICL interconnect

well, I initially asked how many cables were used in first message, but i figured it out myself and answered in second post.

you may delete this thread Smiley Happy

Join the Community

Get quick and easy access to valuable resource designed to help you manage your Brocade Network.