Design & Build

Data Center Solution, Storage-Validation Test: Brocade VCS Fabric and EMC VMAX iSCSI Storage

by ‎11-04-2014 09:46 AM - edited ‎11-04-2014 09:47 AM (3,595 Views)

 

 

 

Preface

 

Overview

Many data centers use iSCSI block storage for a variety of applications and workloads. As more data is stored on iSCSI, efficient network designs are under evaluation to minimize latency, maximize use of interswitch links between switches and to automate IP network configuration changes. For these reasons, Brocade’s VCS Fabric with Brocade VDX Switches is increasingly being deployed when new iSCSI storage arrays are added to the storage pool.

 

Purpose of This Document

The goal of this document is to validate Brocade VCS Fabric with the EMC VMAX. The testing includes test cases that demonstrate VCS Fabric feature support, high availability and resiliency and automatic network reconfiguration when links are added or removed. This document provides validation test results for typical use cases of iSCSI with Brocade’s VCS Fabric and EMC VMAX iSCSI storage arrays.

 

Audience

The content in this document is written for a technical audience, including solution architects, system engineers, and technical development representatives.

 

Objectives

  1. Validate interoperability with redundant and non-redundant network topologies with Brocade VCS and EMC VMAX.
  2. Identify any unique configuration details necessary to establish end-to-end connectivity.
  3. Simulate real-world customer environment perturbations and validate end-to-end behavior and recovery.

 

Test Conclusions

  1. Brocade VCS Fabric and EMC VMAX smoothly interoperate with both redundant and non-redundant configurations. No exceptions were noted.
  2. The configuration procedures followed Brocade VCS Fabric and EMC VMAX standard documentation guides and found no issues with these procedures.
  3. All simulated changes in network and storage (add, remove, failover) resulted in expected behaviors and IO recovery.

 

Related Documents

 

References

Brocade Network OS Administrator’s Guide, R5.0.1

EMC Unisphere: Unified Storage Management Solution

Unisphere for VMAX 1.6 Product Guide

EMC Host Connectivity Guide for Windows

EMC Host Connectivity Guide for Linux

 

Document History

Date                  Version        Description

11-04-2014       1.0                  Initial version

 

Key Contributors

The content in this guide was provided by the following key contributors.

  • Test Architects: Dustin Maiers, Patrick Stander
  • Test Engineer: Robert Batesole

 

About Brocade

Brocade networking solutions help the world’s leading organizations transition smoothly to a world where applications and information reside anywhere. This vision is realized through the Brocade One™ strategy, which is designed to deliver key business benefits such as unmatched simplicity, non-stop networking, application optimization, and investment protection.

 

Innovative Ethernet and storage networking solutions for data center, campus, and service provider networks help reduce complexity and cost while enabling virtualization and cloud computing to increase business agility.

 

To help ensure a complete solution, Brocade partners with world-class IT companies and provides comprehensive education, support, and professional services offerings.

 

To learn more, visit (www.brocade.com)

 

About EMC

EMC is a global leader in enabling businesses and service providers to transform their operations and deliver information technology as a service (ITaaS). Fundamental to this transformation is cloud computing. Through innovative products and services, EMC accelerates the journey to cloud computing, helping IT departments to store, manage, protect and analyze their most valuable asset — information — in a more agile, trusted and cost-efficient way.

 

Test Plan

The storage array is connected to one VDX Ethernet fabric with multiple Windows and Red Hat server hosts to drive IO.

 

Scope

Testing will be performed with GA versions of Brocade’s Network Operating System (NOS) in a heterogeneous environment. Test beds will include Brocade switches configured in routed and non-routed fabric configurations.

 

Testing is centered on interoperability and optimal configuration. Performance is observed within the context of best practice fabric configuration; however absolute maximum benchmark reporting of storage performance is beyond the scope of this test.

 

Test Configuration

 

Test Topology.jpg 

   Test Topology

 

The following diagram shows VCS Fabric switch port connections for each server and the storage array. For example, “1/0/1” means the device port connects to Rbridge# = 1, Card# = 0, and Port# = 1. For fixed top of rack switches such as the VDX 6720, 6730 and 6740, there are no port cards, which are indicated by “0” for the Card#.

 

Device to VCS Fabric Switch Port Connections.jpg

   Device to VCS Fabric Switch Port Connections

 

DUT Descriptions

The following tables provide details about the devices under test (DUT).

 

Storage Array

Model

Vendor

Description

VMAX40K

EMC

The EMC® VMAX® 40K storage system delivers unmatched scalability and high availability for the enterprise while providing market-leading functionality to accelerate your transformation to the hybrid cloud. The EMC Quad Virtual Matric Architecture™ is a unique way to build storage systems that transcends the physical constraints of all existing architectures by scaling system resources through common building blocks called EMC VMAX engines.

 

Switches

Model

Vendor

Description

BR-VDX6740

Brocade

The Brocade VDX 6740 and 6740T are Ethernet fabric Top of Rack (ToR) switches featuring 10 GbE ports with 40 GbE uplinks. The new Brocade VDX 6740T-1G Switch offers dual-speed functionality. It can be deployed with 1000BASET for existing 1 GbE server connectivity and upgraded via software to 10GBASE-T for future bandwidth growth. Together with Brocade VCS Fabric technology, these switches deliver the high performance and low latency needed to support demanding virtualized data center environments.

BR-VDX8770-4

Brocade

The Brocade VDX 8770 Switch is a highly scalable, low-latency, 1/10/40/100 Gigabit Ethernet (GbE) modular switch. Designed to easily scale out Brocade VCS fabrics, the Brocade VDX 8770 Switch brings new levels of performance to VCS fabric deployments.

 

DUT Specifications

 

iSCSI Array

Version

EMC VMAX40K

Enginuity 5876.268.174, Unisphere V1.6.1.8

 

Brocade Switch

Device ID

Version

VDX 6740

CASTOR-VCS20-1

NOS 5.0.1

VDX 6740

CASTOR-VCS20-2

NOS 5.0.1

VDX 6740

CASTOR-VCS20-12

NOS 5.0.1

VDX 8770-4

M4-VCS20-11

NOS 5.0.1

 

Operating System

Adapter

Driver Version

Red Hat 6.5

Brocade 1860

3.2.4.0

Red Hat 6.5

Emulex OCe10102

10.0.803.31

Windows Server 2008 R2

Brocade 1860

3.2.4.0

Windows Server 2012 R2

Emulex OCe14102

10.2.370.19

 

Server

Memory

Processor

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

 

Test Equipment

Version

Medusa Labs Test Tools

6.0.1.148039

 

Multi-Path Software

Operating System

Version

EMC PowerPath

Windows Server 2008 R2, 2012 R2

5.7 SP 4 (build 607)

EMC PowerPath

Red Hat 6.5

5.7 SP 5 (build 2)

 

Device

Interface

IP Address

EMC VMAX40K

11h0

9.78.60.1

EMC VMAX40K

12h0

9.79.60.2

Windows 2012 Server R2

Ethernet 12

9.78.100.1

Windows 2012 Server R2

Ethernet 11

9.79.100.2

Windows 2008 Server R2

Local Area Connection 9

9.78.100.11

Windows 2008 Server R2

Local Area Connection 8

9.79.100.12

Red Hat 6.5 Server

eth0

9.78.100.21

Red Hat 6.5 Server

eth1

9.79.100.22

Red Hat 6.5 Server

eth0

9.78.100.31

Red Hat 6.5 Server

eth1

9.79.100.32

 

 

Configure DUT and Test Equipment

This section describes the initial configuration of DUT and test equipment. In some test cases, additional configuration changes are made.

 

Step 1. Brocade VDX Switch Configuration - Logical Chassis Mode

On the VCS cluster, configure VLAN 978 and 979 interfaces on all cluster members. Configure the interfaces connecting to Windows and Red Hat hosts as well as the iSCSI storage array.

 

< ========== >

protocol lldp

 advertise dcbx-iscsi-app-tlv

!

interface Vlan 978

interface Vlan 979

!

rbridge-id 1

 interface Ve 978

  ip address 9.78.1.1/16

  no shutdown

 !

 interface Ve 979

  ip address 9.79.1.1/16

  no shutdown

 !

!

rbridge-id 2

 interface Ve 978

  ip address 9.78.1.2/16

  no shutdown

 !

 interface Ve 979

  ip address 9.79.1.2/16

  no shutdown

 !

!

rbridge-id 11

 interface Ve 978

  ip address 9.78.1.11/16

  no shutdown

 !

 interface Ve 979

  ip address 9.79.1.11/16

  no shutdown

 !

!

rbridge-id 12

 interface Ve 978

  ip address 9.78.1.12/16

  no shutdown

 !

 interface Ve 979

  ip address 9.79.1.12/16

  no shutdown

 !

!

interface TenGigabitEthernet 1/0/1

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 978

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 1/0/2

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 978

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 1/0/3

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 978

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 1/0/4

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 978

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 2/0/1

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 2/0/2

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 2/0/3

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 2/0/4

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 11/1/13

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 978

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 12/0/13

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

< ========== >

 

Step 2. EMC VMAX Configuration

 

a. Network Interface Configuration

 

----------

IMPORTANT! In order to configure the IP interfaces on the EMC VMAX storage array, you must contact EMC customer support for assistance. These procedures will only show the end result of EMC’s configuration support.

----------

 

EMC VMAX40K Network Configuration Verification – Screen 1.jpg

   EMC VMAX40K Network Configuration Verification – Screen 1

 

EMC VMAX40K Network Configuration Verification – Screen 2.jpg

   EMC VMAX40K Network Configuration Verification – Screen 2

 

b. LUN Configuration

 

----------

IMPORTANT! In order to configure storage LUNs on the EMC VMAX storage array, please refer to Unisphere for VMAX 1.6 Product Guide. The complexity of these procedures is beyond the scope of this document and EMC documentation should be referenced. These procedures will only show the end result of EMC VMAX40K LUN configuration.

----------

 

EMC VMAX40K LUN Configuration Verification.jpg

   EMC VMAX40K LUN Configuration Verification

 

c. Initiator Configuration

 

Step 1. Gather IQNs from each of the iSCSI initiators.

 

Windows 2012: Open the iSCSI Initiator administration tool. Click on the Configuration tab. Note the IQN identified under the Initiator Name field.

 

Windows 2012 Server iSCSI Initiator IQN Collection.jpg

   Windows 2012 Server iSCSI Initiator IQN Collection

 

Windows 2008: Open the iSCSI Initiator administration tool. Click on the Configuration tab. Note the IQN identified under the Initiator Name field.

 

Windows 2008 Server iSCSI Initiator IQN Collection.jpg

   Windows 2008 Server iSCSI Initiator IQN Collection

 

Red Hat 6.5:

< ========== >

[root@rhel65079141 ~]# cat /etc/iscsi/initiatorname.iscsi

InitiatorName=iqn.1994-05.com.redhat:cb69d23d6086

< ========== >

 

< ========== >

[root@rhel65066109 ~]# cat /etc/iscsi/initiatorname.iscsi

InitiatorName=iqn.1994-05.com.redhat:89f0253f16

< ========== >

 

Step 2. From the EMC Unisphere Dashboard, click on Hosts.

 

EMC VMAX40K Initiator Configuration – Screen 1.jpg

   EMC VMAX40K Initiator Configuration – Screen 1

 

Step 3. Click on Initiators.

 

EMC VMAX40K Initiator Configuration – Screen 2.jpg

   EMC VMAX40K Initiator Configuration – Screen 2

 

Step 4. In the Common Tasks sidebar, click on Create a new host.

 

EMC VMAX40K Initiator Configuration – Screen 3.jpg

   EMC VMAX40K Initiator Configuration – Screen 3

 

Step 5. Configure Inititator.

  • In the Symmetrix field, select the appropriate EMC VMAX40K array.
  • In the Host field, enter a desired Initiator Group name.
  • In the Initiator/Initiator Group field, enter the IQN from the iSCSI initiator recorded from previous steps and click Add.
  • Then, click Finish.

EMC VMAX40K Initiator Configuration – Screen 4.jpg

   EMC VMAX40K Initiator Configuration – Screen 4

 

Step 6. Repeat step 5 for all desired hosts, using Host and Initiator/Initiator Group values specific to each host.

 

d. Port Group Configuration

 

Step 1. From the EMC Unisphere Dashboard, click on Hosts.

 

EMC VMAX40K Port Group Configuration – Screen 1.jpg

   EMC VMAX40K Port Group Configuration – Screen 1

 

Step 2. Click on Port Groups.

 

EMC VMAX40K Port Group Configuration – Screen 2.jpg

   EMC VMAX40K Port Group Configuration – Screen 2

 

Step 3. Click on Create.

 

EMC VMAX40K Port Group Configuration – Screen 3.jpg

   EMC VMAX40K Port Group Configuration – Screen 3

 

Step 4. Configure Port Group.

  • In the Port group name field, enter a desired Port Group name.
  • In the Ports field, select the first EMC VMAX40K physical interface and click Add.
  • Then in the Ports field, select the second EMC VMAX40K physical interface and click Add.
  • Then, click OK.

EMC VMAX40K Port Group Configuration – Screen 4.jpg

   EMC VMAX40K Port Group Configuration – Screen 4

 

EMC VMAX40K Port Group Configuration Verification.jpg

   EMC VMAX40K Port Group Configuration Verification

 

e. Storage Group Configuration

 

----------

IMPORTANT! Normal EMC procedure would be to use the Provision Storage wizard to automatically create and map LUNs. In this demonstration, existing LUNs are being mapped to new storage groups, so manual mapping is required. See EMC documentation for further explanation.

----------

 

Step 1. From the EMC Unisphere Dashboard, click on Storage.

 

EMC VMAX40K Storage Group Configuration – Screen 1.jpg

   EMC VMAX40K Storage Group Configuration – Screen 1

 

Step 2. Click on Storage Groups.

 

EMC VMAX40K Storage Group Configuration – Screen 2.jpg

   EMC VMAX40K Storage Group Configuration – Screen 2

 

Step 3. Click on Create.

 

EMC VMAX40K Storage Group Configuration – Screen 3.jpg

   EMC VMAX40K Storage Group Configuration – Screen 3

 

Step 4. Configure Storage Group.

  • In the Storage Group Name field, enter a desired storage group name.
  • In the Storage Group Type field, select Empty Storage Group.
  • Click Finish.

EMC VMAX40K Storage Group Configuration – Screen 4.jpg

   EMC VMAX40K Storage Group Configuration – Screen 4

 

Step 5. Repeat steps 3-4 for all desired hosts, using Storage Group Name values specific to each host.

 

EMC VMAX40K Storage Group Creation Verification.jpg

   EMC VMAX40K Storage Group Creation Verification

 

Step 6. Highlight the first storage group in the listing and click View Details.

 

EMC VMAX40K Storage Group Configuration – Screen 5.jpg

   EMC VMAX40K Storage Group Configuration – Screen 5

 

Step 7. In the Related Objects box, click Volumes - empty.

 

EMC VMAX40K Storage Group Configuration – Screen 6.jpg

   EMC VMAX40K Storage Group Configuration – Screen 6

 

Step 8. In the Volume window, click Add.

 

EMC VMAX40K Storage Group Configuration – Screen 7.jpg

   EMC VMAX40K Storage Group Configuration – Screen 7

 

Step 9. Highlight the desired volume from the list to be added to the Storage Group. Click OK.

 

EMC VMAX40K Storage Group Configuration – Screen 8.jpg

   EMC VMAX40K Storage Group Configuration – Screen 8

 

Step 10. Repeat steps 6-9 for all desired hosts, using desired volumes for each Storage Group.

 

 EMC VMAX40K Storage Group Configuration Verification.jpg

   EMC VMAX40K Storage Group Configuration Verification

 

f. Masking View Configuration

 

Step 1. From the EMC Unisphere Dashboard, click on Hosts.

 

EMC VMAX40K Masking View Configuration – Screen 1.jpg

   EMC VMAX40K Masking View Configuration – Screen 1

 

Step 2. Click on Masking Views.

 

EMC VMAX40K Masking View Configuration – Screen 2.jpg

   EMC VMAX40K Masking View Configuration – Screen 2

 

Step 3. Click on Create.

 

EMC VMAX40K Masking View Configuration – Screen 3.jpg

   EMC VMAX40K Masking View Configuration – Screen 3

 

Step 4. Configure Masking.

  • In the Masking View Name field, enter a desired masking view name.
  • In the Initiator Group field, select the initiator group that corresponds to the desired host.
  • In the Port Group field, select the port group that corresponds to the desired host.
  • In the Storage Group field, select the storage group that corresponds to the desired host.
  • Click OK.

 EMC VMAX40K Masking View Configuration – Screen 4.jpg

   EMC VMAX40K Masking View Configuration – Screen 4

 

Step 5. Repeat steps 3-4 for all desired hosts, using corresponding values for initiator, port, and storage group selections.

 

EMC VMAX40K Masking View Configuration Verification.jpg

   EMC VMAX40K Masking View Configuration Verification

 

Step 3. Windows Server Host Configuration

 

a. iSCSI Initiator Configuration

 

----------

Note: The following screenshots are applicable to both Windows 2012 R2 and Windows 2008 R2. Only Windows 2012 R2 screenshots are shown.

----------

 

Step 1. In Windows, open the iSCSI Initiator administration tool. Navigate to the Discovery tab and click on Discover Portal.

 

Windows Server iSCSI Initiator Target Discovery – Screen 1.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 1

 

Step 2. In the IP Address or DNS name field, enter the IP address of the storage target. Click Advanced.

 

Windows Server iSCSI Initiator Target Discovery – Screen 2.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 2

 

Step 3. Configure Initiator.

  • In the Local adapter field, select Microsoft iSCSI Initiator.
  • In the Initiator IP field, select the IP address of the first desired NIC IP address.
  • Click OK and click OK

Windows Server iSCSI Initiator Target Discovery – Screen 3.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 3

 

Step 4. Configure Target.

  • In the iSCSI Initiator Properties window, navigate to the Targets
  • Highlight the target IQN and click Connect.

Windows Server iSCSI Initiator Target Discovery – Screen 4.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 4

 

Step 5. Check the Enable multi-path box. Click Advanced.

 

Windows Server iSCSI Initiator Target Discovery – Screen 5.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 5

 

Step 6. Configure Multi-path.

  • In the Local adapter field, select Microsoft iSCSI Initiator.
  • In the Initiator IP field, select the IP address of the first desired NIC IP address.
  • In the Target portal IP, select the appropriate target IP address.
  • Click OK and click OK

Windows Server iSCSI Initiator Target Discovery – Screen 6.jpg

   Windows Server iSCSI Initiator Target Discovery – Screen 6

 

Step 7. Repeat steps 1-6 for the second target IQN with the second desired NIC IP address.

 

Windows Server iSCSI Initiator Target Discovery Verification.jpg

   Windows Server iSCSI Initiator Target Discovery Verification

 

b. EMC PowerPath Multi-Path Verification

 

Step 1. Install EMC PowerPath. Refer to EMC’s website for details on installation and management.

 

Step 2.

  • Open PowerPath Administrator. Expand EMC PowerPath Admin - > Path Management - > Disks
  • Click on the desired disk.
  • Verify each of the paths to the disk listed as:

- Status: Optimal

- State: Alive

- Mode: active

 

EMC PowerPath Verification.jpg

   EMC PowerPath Verification

 

c. Disk and File System Initialization

 

Step 1. Within Windows Server, open the Computer Management administration tool and navigate to Disk Management.

 

Windows Disk Initialization – Screen 1.jpg

   Windows Disk Initialization – Screen 1

 

Step 2. Bring the disk online by right-clicking on the disk label and click Online.

 

----------

IMPORTANT! EMC VMAX40K may present additional small LUNs to the host. These LUNs are presented for in-band communication and should not be configured.

----------

 

Windows Disk Initialization – Screen 2.jpg

   Windows Disk Initialization – Screen 2

 

Step 3. Initialize the disk by right-clicking on the disk label and click Initialize Disk.

 

Windows Disk Initialization – Screen 3.jpg

   Windows Disk Initialization – Screen 3

 

Step 4. Select the desired disk(s) to bring online. Click OK.

 

Windows Disk Initialization – Screen 4.jpg

   Windows Disk Initialization – Screen 4

 

Windows Disk Initialization Verification.jpg

   Windows Disk Initialization Verification

 

Step 5. Right-click within the unallocated space on the desired disk and click New Simple Volume. Then, click Next.

 

Windows File System Configuration – Screen 1.jpg

   Windows File System Configuration – Screen 1

 

Step 6. With the Simple volume size in MB field, enter the desired volume size. Click Next.

 

Windows File System Configuration – Screen 2.jpg

   Windows File System Configuration – Screen 2

 

Step 7. Select the desired drive letter for the new volume. Click Next.

 

Windows File System Configuration – Screen 3.jpg

   Windows File System Configuration – Screen 3

 

Step 8. Within the Volume label field, enter the desired volume name. Click Next. Click Finish.

 

Windows File System Configuration – Screen 4.jpg 

   Windows File System Configuration – Screen 4

 

Windows File System Verification.jpg

   Windows File System Verification

 

Step 4. Red Hat Linux Host Configuration

a. iSCSI Initiator Configuration

 

Step 1. Start the iscsid and iscsi daemons and enable automatic start on boot.

 

< ========== >

[root@rhel65079141 ~]# chkconfig iscsid on

[root@rhel65079141 ~]# service iscsid start

[root@rhel65079141 ~]# chkconfig iscsi on

[root@rhel65079141 ~]# service iscsi start

< ========== >

 

Step 2. Discover the iSCSI targets.

 

< ========== >

[root@rhel65079141 ~]# iscsiadm -m discovery -t st -p 9.78.60.1

9.78.60.1:3260,1 iqn.1992-04.com.emc:50000973001135e8 < ==

[root@rhel65079141 ~]# iscsiadm -m discovery -t st -p 9.79.60.2

9.79.60.2:3260,1 iqn.1992-04.com.emc:50000973001135ec < ==

< ========== >

 

Step 3. Log in to the target using the iSCSI target IP address.

 

< ========== >

[root@rhel65079141 ~]# iscsiadm -m node -T iqn.1992-04.com.emc:50000973001135e8 -p 9.78.60.1:3260 -l

Logging in to [iface: default, target: iqn.1992-04.com.emc:50000973001135e8, portal: 9.78.60.1,3260] (multiple)

Login to [iface: default, target: iqn.1992-04.com.emc:50000973001135e8, portal: 9.78.60.1,3260] successful. < ==

[root@rhel65079141 ~]# iscsiadm -m node -T iqn.1992-04.com.emc:50000973001135ec -p 9.79.60.2:3260 -l

Logging in to [iface: default, target: iqn.1992-04.com.emc:50000973001135ec, portal: 9.79.60.2,3260] (multiple)

Login to [iface: default, target: iqn.1992-04.com.emc:50000973001135ec, portal: 9.79.60.2,3260] successful. < ==

< ========== >

 

Step 4. Configure automatic iSCSI login on boot.

 

< ========== >

[root@rhel65079141 ~]# iscsiadm -m node -T iqn.1992-04.com.emc:50000973001135e8 -p 9.78.60.1 --op update -n node.startup -v automatic

[root@rhel65079141 ~]# iscsiadm -m node -T iqn.1992-04.com.emc:50000973001135ec -p 9.79.60.2 --op update -n node.startup -v automatic

< ========== >

 

Step 5. Reboot the RHEL host.

 

Step 6. Verify iSCSI connectivity.

 

< ========== >

[root@rhel65079141 ~]# iscsiadm -m session

tcp: [1] 9.78.60.1:3260,1 iqn.1992-04.com.emc:50000973001135e8 < ==

tcp: [2] 9.79.60.2:3260,1 iqn.1992-04.com.emc:50000973001135ec < ==

< ========== >

 

b. Disk and Partition Initialization

 

Step 1. Verify iSCSI LUN exist and contain partitions. If partitions do not exist, refer to OS documentation for partition creation.

 

< ========== >

[root@rhel65079141 ~]# fdisk -l

...

Disk /dev/sdc: 2148 MB, 2148925440 bytes < ==

67 heads, 62 sectors/track, 1010 cylinders

Units = cylinders of 4154 * 512 = 2126848 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

 

 

Disk /dev/sdb: 2 MB, 2949120 bytes

1 heads, 6 sectors/track, 960 cylinders

Units = cylinders of 6 * 512 = 3072 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xb065a34c

 

   Device Boot      Start         End      Blocks   Id  System

 

Disk /dev/sdd: 2 MB, 2949120 bytes

1 heads, 6 sectors/track, 960 cylinders

Units = cylinders of 6 * 512 = 3072 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xb065a34c

 

   Device Boot      Start         End      Blocks   Id  System

 

Disk /dev/sde: 2148 MB, 2148925440 bytes < ==

67 heads, 62 sectors/track, 1010 cylinders

Units = cylinders of 4154 * 512 = 2126848 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000< ========== >

 

c. EMC PowerPath Multi-Path Verification

 

Step 1. Install EMC PowerPath. Refer to EMC’s website for details on installation and management. Reboot OS if required.

 

Step 2. From a command prompt, instruct PowerPath to detect and configure any new devices.

 

< ========== >

[root@rhel65079141 ~]# powermt config

< ========== >

 

Step 3. Verify each of the paths to the disk listed as:

Mode: active

State: alive

 

< ========== >

[root@rhel65079141 ~]# powermt display dev=all

Pseudo name=emcpowerb

Symmetrix ID=000195701101

Logical device ID=0DD7

state=alive; policy=SymmOpt; queued-IOs=0

==============================================================================

--------------- Host ---------------   - Stor -  -- I/O Path --   -- Stats ---

###  HW Path               I/O Paths    Interf.  Mode     State   Q-IOs Errors

==============================================================================

   6 iSCSI Initiator over TCP/I sde         SE 12h:00 active   alive      0      0 < ==

   5 iSCSI Initiator over TCP/I sdc         SE 11h:00 active   alive      0      0 < ==

< ========== >

 

Step 4. Save PowerPath configuration.

 

< ========== >

[root@rhel65079141 ~]# powermt save

< ========== >

 

d. File System Initialization

Step 1. Create a file system on the PowerPath pseudo-device.

 

< ========== >

[root@rhel65079141 ~]# mkfs -t ext3 /dev/emcpowerb

mke2fs 1.41.12 (17-May-2010)

warning: 352 blocks unused.

 

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

Stride=0 blocks, Stripe width=0 blocks

131328 inodes, 524288 blocks

26232 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=536870912

16 block groups

32768 blocks per group, 32768 fragments per group

8208 inodes per group

Superblock backups stored on blocks:

                32768, 98304, 163840, 229376, 294912

 

Writing inode tables: done                           

Creating journal (16384 blocks): done

Writing superblocks and filesystem accounting information: done

 

This filesystem will be automatically checked every 39 mounts or

180 days, whichever comes first.  Use tune2fs -c or -i to override.

< ========== >

 

Step 2. Create a mount point for the PowerPath pseudo-device in a desired location.

 

< ========== >

[root@rhel65079141 mnt]# pwd

/mnt

[root@rhel65079141 mnt]# mkdir vmax

< ========== >

 

Step 3. Mount the file system to the mount point previously created.

 

< ========== >

[root@rhel65079141 mnt]# mount -t ext3 /dev/emcpowerb /mnt/vmax

[root@rhel65079141 mnt]# mount

/dev/emcpowerb on /mnt/vmax type ext3 (rw)

[root@rhel65079141 mnt]#

< ========== >

 

Step 5. Medusa IO Generation Configuration

The following shows the configuration of the Medusa IO data patterns used in the test cases.

 

a. Standard IO with 64KB Blocks

For test scenarios using standard IO (64 KB testing size), configure Medusa for the following command line result:

 

< =========== >

pain 1600MB -b64KB -v180 -H1 -l35 -Y1 -M180

< =========== >

 

b. Maximum IO with 1 MB Blocks

For test scenarios using maximum bandwidth IO (1 MB testing size), configure Medusa for the following command line result:

 

< =========== >

maim 1600MB -b1MB -Q8 -n -u -q5 -w -o -Y1 -M180 --perf-mode

< =========== >

 

c. Microsoft Exchange Server IO

For test scenarios using Microsoft Exchange Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 1600MB -%r50@4KB -%w25@64KB -%w25@4KB -Q1 -n -u -q5 -o -l69 -Y1 -M180

< =========== >

 

d. File Server IO

For test scenarios using File Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 1600MB -%10:r80@512B,w20@512B -%5:r80@1KB,w20@1KB -%5:r80@2KB,w20@2KB -%60:r80@4KB,w20@4KB -%2:r50@8KB,w50@8KB -%4:r75@16KB,w25@16KB -%4:r75@32KB,w25@32KB -%10:r80@64KB,w20@64KB -Q1 -n -u -o -l69 -Y1 -M180

< =========== >

 .

 

Test Cases

 

These test cases are designed to verify both basic and advanced functionality features between the Brocade VCS cluster and both host and storage devices, as well as stress all devices and confirm successful error recovery.

 

 

1.1

Ethernet Storage – Base Functionality

1.1.1

Storage Device – Physical Connection and Speed Negotiation

1.1.2

iSCSI Connectivity

1.1.3

vLAG Configuration

1.2

Ethernet Storage – Advanced Functionality

1.2.1

Storage Device – Jumbo Frame/MTU Size Validation

1.2.2

iSCSI Bandwidth Validation

1.2.3

Storage Device – w/Congested Fabric

1.2.4

Storage Device – iSCSI Protocol Jammer CRC Corruption on ISL Port

1.2.5

Storage Device – iSCSI Protocol Jammer Packet Corruption on ISL Port

1.2.6

Storage Device – iSCSI Protocol Jammer Packet Loss on ISL Port

1.2.7

Storage Device – iSCSI Protocol Jammer CRC Corruption on Storage Port

1.2.8

Storage Device – iSCSI Protocol Jammer Packet Corruption on Storage Port

1.2.9

Storage Device – iSCSI Protocol Jammer Packet Loss on Storage Port

1.3

Stress and Error Recovery

1.3.1

Storage Device Fabric IO Integrity – Congested Fabric

1.3.2

Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

1.3.3

Storage Device Integrity – Device Recovery from ISL Port Relocation

1.3.4

Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

1.3.5

Storage Device Recovery – ISL Port Toggle – Extended Run

1.3.6

Storage Device Recovery – All-ISL Port Toggle

1.3.7

Storage Device Recovery – VDX8770 Line Card Maintenance

1.3.8

Storage Device Recovery – Switch Offline

1.3.9

Workload Simulation Test Suite – Microsoft Exchange Server

1.3.10

Workload Simulation Test Suite – File Server Simulation

1.3.11

Host-side Interface Port Toggle

1.3.12

Storage-side Interface Port Toggle

1.4

Brocade Network Advisor

1.4.1

Ethernet Fabric Discovery

1.4.2

Ethernet Fabric Addition and Removal

1.4.3

Ethernet Fabric Configuration Backup and Restoration

1.4.4

Ethernet Fabric Firmware Download

 

Test Case Descriptions

 

Lines marked with ‘ < == ’ indicate important output used to validate the test results.

 

1.1 Ethernet Storage – Base Functionality

 

1.1.1 Storage Device – Physical Connection and Speed Negotiation

 

Test Objective

Verify device connectivity to VDX switch with all supported speed settings. Configure storage port for iSCSI connectivity. Validate base connectivity.

 

Results

  1. All interfaces up and operational at expected speed settings. Brocade VDX ‘show interface’ commands reflect expected interface speed.

 

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected) < ==

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit < ==

LineSpeed Configured : Auto, Duplex: Full

...

 

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/13

TenGigabitEthernet 12/0/13 is up, line protocol is up (connected) < ==

Hardware is Ethernet, address is 0005.3365.2973

    Current address is 0005.3365.2973

Pluggable media present

Interface index (ifindex) is 51942686732

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit < ==

LineSpeed Configured : Auto, Duplex: Full

...

< =========== >

 

1.1.2 iSCSI Connectivity

 

Test Objective

Verify Initiator-to-Target/LUN connectivity with iSCSI.

 

Results

  1. All iSCSI targets on Windows and Red Hat hosts are successfully connected.

 

< =========== >

PS C:\Users\Administrator> iscsicli SessionList

Microsoft iSCSI Initiator Version 6.3 Build 9600

 

Total of 2 sessions

 

Session Id             : ffffe00123d0a020-4000013700000006

Initiator Node Name    : iqn.1991-05.com.microsoft:brcd068114.englab.brocade.com

Target Node Name       : (null)

Target Name            : iqn.1992-04.com.emc:50000973001135e8

ISID                   : 40 00 01 37 00 00

TSID                   : 01 00

Number Connections     : 1

 

    Connections:

 

        Connection Id     : ffffe00123d0a020-2af7

        Initiator Portal  : 9.78.100.1/63985

        Target Portal     : 9.78.60.1/3260

        CID               : 01 00

 

    Devices:

        Device Type            : Disk

        Device Number          : 1

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 13, Bus 0, Target Id 0, LUN 0

        Location               : Bus Number 0, Target Id 0, LUN 0

        Initiator Name         : ROOT\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135e8

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#emcp&0001&0001&d_0_0_7#{53f56307-b6bf-11d0-94f2-00a0c

91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive1

        Device Instance        : 0x2

 

        Device Type            : Disk

        Device Number          : 2

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 13, Bus 0, Target Id 0, LUN 1

        Location               : Bus Number 0, Target Id 0, LUN 1

        Initiator Name         : ROOT\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135e8

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#{4a54205a-c920-4e28-88c5-9a6296a74b0b}&emcp&power7#{5

3f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive2

        Device Instance        : 0x3

        Volume Path Names      :

                                 O:\

 

Session Id             : ffffe00123d0a020-4000013700000008

Initiator Node Name    : iqn.1991-05.com.microsoft:brcd068114.englab.brocade.com

Target Node Name       : (null)

Target Name            : iqn.1992-04.com.emc:50000973001135ec

ISID                   : 40 00 01 37 00 00

TSID                   : 01 00

Number Connections     : 1

 

    Connections:

 

        Connection Id     : ffffe00123d0a020-2af9

        Initiator Portal  : 9.79.100.2/4594

        Target Portal     : 9.79.60.2/3260

        CID               : 01 00

 

    Devices:

        Device Type            : Disk

        Device Number          : 3

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 13, Bus 0, Target Id 1, LUN 0

        Location               : Bus Number 0, Target Id 1, LUN 0

        Initiator Name         : ROOT\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135ec

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#emcp&0001&0001&d_1_0_7#{53f56307-b6bf-11d0-94f2-00a0c

91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive3

        Device Instance        : 0x4

 

        Device Type            : Disk

        Device Number          : 2

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 13, Bus 0, Target Id 1, LUN 1

        Location               : Bus Number 0, Target Id 1, LUN 1

        Initiator Name         : ROOT\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135ec

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#{4a54205a-c920-4e28-88c5-9a6296a74b0b}&emcp&power7#{5

3f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive2

        Device Instance        : 0x5

        Volume Path Names      :

                                 O:\

 

The operation completed successfully.

< =========== >

 

 

< =========== >

C:\Users\Administrator>iscsicli SessionList

Microsoft iSCSI Initiator Version 6.1 Build 7601

 

Total of 2 sessions

 

Session Id             : fffffa801312c018-4000013700000006

Initiator Node Name    : iqn.1991-05.com.microsoft:brcd068128.englab.brocade.com

 

Target Node Name       : (null)

Target Name            : iqn.1992-04.com.emc:50000973001135e8

ISID                   : 40 00 01 37 00 00

TSID                   : 02 00

Number Connections     : 1

 

    Connections:

 

        Connection Id     : fffffa801312c018-2ab2

        Initiator Portal  : 9.78.100.11/37350

        Target Portal     : 9.78.60.1/3260

        CID               : 01 00

 

    Devices:

        Device Type            : Disk

        Device Number          : 2

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 5, Bus 0, Target Id 0, LUN 0

        Location               : Bus Number 0, Target Id 0, LUN 0

        Initiator Name         : Root\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135e8

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#emcp&0001&000

1&5_0_0_7#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive2

        Device Instance        : 0x82c

 

        Device Type            : Disk

        Device Number          : 1

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 5, Bus 0, Target Id 0, LUN 1

        Location               : Bus Number 0, Target Id 0, LUN 1

        Initiator Name         : Root\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135e8

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#{4a54205a-c92

0-4e28-88c5-9a6296a74b0b}&emcp&power7#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive1

        Device Instance        : 0x89c

        Volume Path Names      :

                                 O:\

 

Session Id             : fffffa801312c018-4000013700000008

Initiator Node Name    : iqn.1991-05.com.microsoft:brcd068128.englab.brocade.com

 

Target Node Name       : (null)

Target Name            : iqn.1992-04.com.emc:50000973001135ec

ISID                   : 40 00 01 37 00 00

TSID                   : 02 00

Number Connections     : 1

 

    Connections:

 

        Connection Id     : fffffa801312c018-2ab4

        Initiator Portal  : 9.79.100.12/49638

        Target Portal     : 9.79.60.2/3260

        CID               : 01 00

 

    Devices:

        Device Type            : Disk

        Device Number          : 3

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 5, Bus 0, Target Id 1, LUN 0

        Location               : Bus Number 0, Target Id 1, LUN 0

        Initiator Name         : Root\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135ec

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#emcp&0001&000

1&5_1_0_7#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive3

        Device Instance        : 0x90c

 

        Device Type            : Disk

        Device Number          : 1

        Storage Device Type    : 7

        Partition Number       : 0

        Friendly Name          : EMC SYMMETRIX SCSI Disk Device

        Device Description     : Disk drive

        Reported Mappings      : Port 5, Bus 0, Target Id 1, LUN 1

        Location               : Bus Number 0, Target Id 1, LUN 1

        Initiator Name         : Root\ISCSIPRT\0000_0

        Target Name            : iqn.1992-04.com.emc:50000973001135ec

        Device Interface Name  : \\?\scsi#disk&ven_emc&prod_power&#{4a54205a-c92

0-4e28-88c5-9a6296a74b0b}&emcp&power7#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}

        Legacy Device Name     : \\.\PhysicalDrive1

        Device Instance        : 0x97c

        Volume Path Names      :

                                 O:\

 

The operation completed successfully.

< =========== >

 

 

< =========== >

[root@rhel65079141 ~]# iscsiadm -m session

tcp: [1] 9.78.60.1:3260,1 iqn.1992-04.com.emc:50000973001135e8

tcp: [2] 9.79.60.2:3260,1 iqn.1992-04.com.emc:50000973001135ec

< =========== >

 

 

< =========== >

[root@rhel65066109 ~]# iscsiadm -m session

tcp: [1] 9.78.60.1:3260,1 iqn.1992-04.com.emc:50000973001135e8

tcp: [2] 9.79.60.2:3260,1 iqn.1992-04.com.emc:50000973001135ec

< =========== >

 

1.1.3 Multipath Connectivity

 

Test Objective

Verify multipath connectivity from initiator ports through VCS cluster to target LUNs.

 

Results

  1. All port-channel interfaces are operational and in sync.

 

< =========== >

PS C:\Users\Administrator> powermt display dev=all

Pseudo name=harddisk2

Symmetrix ID=000195701101

Logical device ID=0DD5

state=alive; policy=SymmOpt; queued-IOs=0

==============================================================================

--------------- Host ---------------   - Stor -               -- I/O Path --   -- Stats ---

###  HW Path                          I/O Paths          Interf.   Mode     State   Q-IOs Errors

==============================================================================

  13 port13\path0\tgt1\lun1 c13t1d1     SE 12h:00 active   alive      0      0 < ==

  13 port13\path0\tgt0\lun1 c13t0d1     SE 11h:00 active   alive      0      0 < ==

< =========== >

 

 

< =========== >

C:\Users\Administrator>powermt display dev=all

Pseudo name=harddisk1

Symmetrix ID=000195701101

Logical device ID=0DD6

state=alive; policy=SymmOpt; queued-IOs=0

==============================================================================

--------------- Host ---------------   - Stor -  -- I/O Path --   -- Stats ---

###  HW Path               I/O Paths                  Interf.  Mode     State   Q-IOs Errors

==============================================================================

   5 port5\path0\tgt1\lun1  c5t1d1      SE 12h:00 active   alive      0      0 < ==

   5 port5\path0\tgt0\lun1  c5t0d1      SE 11h:00 active   alive      0      0 < ==

< =========== >

 

 

< =========== >

[root@rhel65079141 ~]# powermt display dev=all

Pseudo name=emcpowerb

Symmetrix ID=000195701101

Logical device ID=0DD7

state=alive; policy=SymmOpt; queued-IOs=0

==============================================================================

--------------- Host ---------------        - Stor -     -- I/O Path --   -- Stats ---

###  HW Path                             I/O Paths     Interf.     Mode    State   Q-IOs Errors

==============================================================================

   6 iSCSI Initiator over TCP/I sde         SE 12h:00 active   alive      0      0 < ==

   5 iSCSI Initiator over TCP/I sdc         SE 11h:00 active   alive      0      0 < ==

< =========== >

 

 

< =========== >

[root@rhel65066109 Desktop]# powermt display dev=all

Pseudo name=emcpowerb

Symmetrix ID=000195701101

Logical device ID=0DD8

state=alive; policy=SymmOpt; queued-IOs=1

==============================================================================

--------------- Host ---------------     - Stor -                  -- I/O Path --   -- Stats ---

###  HW Path                                I/O Paths         Interf.  Mode    State   Q-IOs Errors

==============================================================================

   6    iSCSI Initiator over TCP/I sde         SE 12h:00 active   alive      0      0 < ==

   5    iSCSI Initiator over TCP/I sdc         SE 11h:00 active   alive      1      0 < ==

< =========== >

 

1.2 Ethernet Storage – Advanced Functionality

 

1.2.1 Storage Device – Jumbo Frame/MTU Size Validation

 

Test Objective

Perform IO validation testing using maximum MTU possible supported by all devices in the IO path.

 

Test Configuration

1. On EMC VMAX, reconfigure iSCSI port to increase MTU to 9000.

 

----------

IMPORTANT! In order to configure the IP interface MTU on the EMC VMAX storage array, you must contact EMC customer support for assistance.

----------

 

2. For Red Hat hosts, add “MTU=9000” to /etc/sysconfig/network-scripts/ifcfg-ethX and then execute ‘service network restart’.

 

< =========== >

[root@rhel65079141 ~]# more /etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE=eth0

IPADDR=9.78.100.21

NETMASK=255.255.0.0

BOOTPROTO=none

MTU=9000

ONBOOT=yes

USERCTL=no

NM_CONTROLLED=no

< =========== >

 

3. For Windows 2012 Server host, reconfigure NIC properties for maximum MTU:

 

Windows 2012 Server Emulex NIC MTU Configuration.jpg

   Windows 2012 Server Emulex NIC MTU Configuration

 

4. For Windows 2008 Server host, reconfigure NIC properties for maximum MTU:

 

Windows 2008 Server Brocade NIC MTU Configuration.jpg

   Windows 2008 Server Brocade NIC MTU Configuration

 

5. On VDX devices, configure as follows:

 

< =========== >

rbridge-id 1

 interface ve 978

  ip mtu 9018

rbridge-id 2

 interface ve 978

  ip mtu 9018

rbridge-id 11

 interface ve 978

  ip mtu 9018

rbridge-id 12

 interface ve 978

  ip mtu 9018

interface TenGigabitEthernet 1/0/1

 mtu 9216

interface TenGigabitEthernet 1/0/2

 mtu 9216

interface TenGigabitEthernet 1/0/3

 mtu 9216

interface TenGigabitEthernet 1/0/4

 mtu 9216

interface TenGigabitEthernet 11/1/13

 mtu 9216

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. All initiator and target interfaces pass jumbo frames successfully.

< =========== >

PS C:\Users\Administrator> ping 9.78.60.1 -l 8972 -f

 

Pinging 9.78.60.1 with 8972 bytes of data&colon;

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.78.60.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

< =========== >

 

< =========== >

C:\Users\Administrator>ping 9.78.60.1 -l 8972 -f

 

Pinging 9.78.60.1 with 8972 bytes of data&colon;

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

Reply from 9.78.60.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.78.60.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

< =========== >

 

< =========== >

[root@rhel65079141 ~]# ping -c 4 -M do -s 8972 9.78.60.1

PING 9.78.60.1 (9.78.60.1) 8972(9000) bytes of data.

8980 bytes from 9.78.60.1: icmp_seq=1 ttl=255 time=0.123 ms

8980 bytes from 9.78.60.1: icmp_seq=2 ttl=255 time=0.156 ms

8980 bytes from 9.78.60.1: icmp_seq=3 ttl=255 time=0.171 ms

8980 bytes from 9.78.60.1: icmp_seq=4 ttl=255 time=0.158 ms

 

--- 9.78.60.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 2999ms < ==

rtt min/avg/max/mdev = 0.123/0.152/0.171/0.017 ms

< =========== >

 

< =========== >

[root@rhel65066109 ~]# ping -c 4 -M do -s 8972 9.78.60.1

PING 9.78.60.1 (9.78.60.1) 8972(9000) bytes of data.

8980 bytes from 9.78.60.1: icmp_seq=1 ttl=255 time=0.170 ms

8980 bytes from 9.78.60.1: icmp_seq=2 ttl=255 time=0.174 ms

8980 bytes from 9.78.60.1: icmp_seq=3 ttl=255 time=0.187 ms

8980 bytes from 9.78.60.1: icmp_seq=4 ttl=255 time=0.183 ms

 

--- 9.78.60.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 3001ms < ==

rtt min/avg/max/mdev = 0.170/0.178/0.187/0.015 ms

< =========== >

 

Jumbo Frame MTU Size Medusa Results.jpg

   Jumbo Frame MTU Size Medusa Results

 

< =========== >

CASTOR-VCS20-2# show interface TenGigabitEthernet 1/0/1

TenGigabitEthernet 1/0/1 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1945

    Current address is 50eb.1a22.1945

Pluggable media present

Interface index (ifindex) is 4697653248

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:12

Queueing strategy: fifo

Receive Statistics:

    6355480 packets, 37340595432 bytes

    Unicasts: 6352959, Multicasts: 2383, Broadcasts: 138

    64-byte pkts: 1293773, Over 64-byte pkts: 555651, Over 127-byte pkts: 104

    Over 255-byte pkts: 1, Over 511-byte pkts: 247, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 4505704 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    7104985 packets, 36870632562 bytes

    Unicasts: 7104854, Multicasts: 46, Broadcasts: 85

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 2.387392 Mbits/sec, 3830 packets/sec, 0.02% of line-rate

    Output 670.260808 Mbits/sec, 10149 packets/sec, 6.70% of line-rate

Time since last interface status change: 1d08h29m

 

CASTOR-VCS20-2# show interface TenGigabitEthernet 1/0/2

TenGigabitEthernet 1/0/2 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1946

    Current address is 50eb.1a22.1946

Pluggable media present

Interface index (ifindex) is 4697686017

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:12

Queueing strategy: fifo

Receive Statistics:

    6138490 packets, 36801233289 bytes

    Unicasts: 6138372, Multicasts: 45, Broadcasts: 73

    64-byte pkts: 1158653, Over 64-byte pkts: 537811, Over 127-byte pkts: 17

    Over 255-byte pkts: 0, Over 511-byte pkts: 322, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 4441687 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    6927337 packets, 35709686339 bytes

    Unicasts: 6927118, Multicasts: 69, Broadcasts: 150

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 619.724056 Mbits/sec, 9383 packets/sec, 6.20% of line-rate

    Output 3.228136 Mbits/sec, 5535 packets/sec, 0.03% of line-rate

Time since last interface status change: 02:16:53

 

CASTOR-VCS20-2# show interface TenGigabitEthernet 1/0/3

TenGigabitEthernet 1/0/3 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1947

    Current address is 50eb.1a22.1947

Pluggable media present

Interface index (ifindex) is 4697718786

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:12

Queueing strategy: fifo

Receive Statistics:

    7128306 packets, 34537567387 bytes

    Unicasts: 7128270, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 218, Over 64-byte pkts: 2977671, Over 127-byte pkts: 36

    Over 255-byte pkts: 946, Over 511-byte pkts: 378, Over 1023-byte pkts: 48

    Over 1518-byte pkts(Jumbo): 4149009 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    6837363 packets, 34106552818 bytes

    Unicasts: 6837060, Multicasts: 86, Broadcasts: 217

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 569.431664 Mbits/sec, 9712 packets/sec, 5.69% of line-rate

    Output 3.394572 Mbits/sec, 5312 packets/sec, 0.03% of line-rate

Time since last interface status change: 02:20:11

 

CASTOR-VCS20-2# show interface TenGigabitEthernet 1/0/4

TenGigabitEthernet 1/0/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1948

    Current address is 50eb.1a22.1948

Pluggable media present

Interface index (ifindex) is 4697751555

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:12

Queueing strategy: fifo

Receive Statistics:

    10113926 packets, 35993251736 bytes

    Unicasts: 10113890, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 69, Over 64-byte pkts: 5812227, Over 127-byte pkts: 30

    Over 255-byte pkts: 73, Over 511-byte pkts: 378, Over 1023-byte pkts: 65

    Over 1518-byte pkts(Jumbo): 4301084 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    29965555 packets, 36212197232 bytes

    Unicasts: 29965253, Multicasts: 85, Broadcasts: 217

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 7.878584 Mbits/sec, 13166 packets/sec, 0.08% of line-rate

    Output 714.539368 Mbits/sec, 61953 packets/sec, 7.15% of line-rate

Time since last interface status change: 1d08h29m

 

CASTOR-VCS20-2# show interface TenGigabitEthernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:13

Queueing strategy: fifo

Receive Statistics:

    50801012 packets, 142832985012 bytes

    Unicasts: 50801030, Multicasts: 30, Broadcasts: 0

    64-byte pkts: 4165733, Over 64-byte pkts: 8741176, Over 127-byte pkts: 106

    Over 255-byte pkts: 21699, Over 511-byte pkts: 2473807, Over 1023-byte pkts: 22302973

    Over 1518-byte pkts(Jumbo): 13095518 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    29717326 packets, 144623991820 bytes

    Unicasts: 29717027, Multicasts: 85, Broadcasts: 223

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1434.815648 Mbits/sec, 83580 packets/sec, 14.35% of line-rate

    Output 1207.123328 Mbits/sec, 36908 packets/sec, 12.07% of line-rate

Time since last interface status change: 1d08h10m

< =========== >

 

1.2.2 iSCSI Bandwidth Validation

 

Test Objective

1. Validate maximum sustained bandwidth to storage port via iSCSI.

2. After 15 minutes, verify IO completes error-free.

 

Results

  1. PASS. All IO completes error-free.
  2. PASS. All storage LUNs show utilization at maximum capacity.

< =========== >

M4-VCS20-11# show interface TenGigabitEthernet 1/0/1

TenGigabitEthernet 1/0/1 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1945

    Current address is 50eb.1a22.1945

Pluggable media present

Interface index (ifindex) is 4697653248

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:18

Queueing strategy: fifo

Receive Statistics:

    34918987 packets, 52921955748 bytes

    Unicasts: 34916455, Multicasts: 2396, Broadcasts: 136

    64-byte pkts: 2517, Over 64-byte pkts: 190, Over 127-byte pkts: 115

    Over 255-byte pkts: 3612, Over 511-byte pkts: 8849, Over 1023-byte pkts: 34903704

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    18251271 packets, 1201104064 bytes

    Unicasts: 18251136, Multicasts: 45, Broadcasts: 90

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 464.535944 Mbits/sec, 38312 packets/sec, 4.65% of line-rate < ==

    Output 10.539352 Mbits/sec, 20028 packets/sec, 0.11% of line-rate

Time since last interface status change: 2d23h34m

 

M4-VCS20-11# show interface TenGigabitEthernet 2/0/1

TenGigabitEthernet 2/0/1 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a20.d610

    Current address is 50eb.1a20.d610

Pluggable media present

Interface index (ifindex) is 8992620544

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:18

Queueing strategy: fifo

Receive Statistics:

    34957015 packets, 52963667670 bytes

    Unicasts: 34954548, Multicasts: 2392, Broadcasts: 75

    64-byte pkts: 12954, Over 64-byte pkts: 227, Over 127-byte pkts: 358

    Over 255-byte pkts: 1973, Over 511-byte pkts: 9379, Over 1023-byte pkts: 34932124

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    10781269 packets, 722862332 bytes

    Unicasts: 10781137, Multicasts: 45, Broadcasts: 87

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 466.452756 Mbits/sec, 38486 packets/sec, 4.66% of line-rate < ==

    Output 6.283328 Mbits/sec, 11713 packets/sec, 0.06% of line-rate

Time since last interface status change: 2d23h17m

 

M4-VCS20-11# show interface TenGigabitEthernet 1/0/2

TenGigabitEthernet 1/0/2 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1946

    Current address is 50eb.1a22.1946

Pluggable media present

Interface index (ifindex) is 4697686017

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:18

Queueing strategy: fifo

Receive Statistics:

    33112012 packets, 50193601251 bytes

    Unicasts: 33111890, Multicasts: 44, Broadcasts: 78

    64-byte pkts: 197, Over 64-byte pkts: 128, Over 127-byte pkts: 45

    Over 255-byte pkts: 688, Over 511-byte pkts: 1083, Over 1023-byte pkts: 33109871

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    17338204 packets, 1140849053 bytes

    Unicasts: 17337988, Multicasts: 68, Broadcasts: 148

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 440.552464 Mbits/sec, 36328 packets/sec, 4.41% of line-rate < ==

    Output 10.016240 Mbits/sec, 19032 packets/sec, 0.10% of line-rate

Time since last interface status change: 2d23h34m

 

M4-VCS20-11# show interface TenGigabitEthernet 2/0/2

TenGigabitEthernet 2/0/2 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a20.d611

    Current address is 50eb.1a20.d611

Pluggable media present

Interface index (ifindex) is 8992653313

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:18

Queueing strategy: fifo

Receive Statistics:

    33139149 packets, 50234529429 bytes

    Unicasts: 33139030, Multicasts: 44, Broadcasts: 75

    64-byte pkts: 209, Over 64-byte pkts: 800, Over 127-byte pkts: 54

    Over 255-byte pkts: 237, Over 511-byte pkts: 10020, Over 1023-byte pkts: 33127829

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    11200302 packets, 748037985 bytes

    Unicasts: 11200154, Multicasts: 61, Broadcasts: 87

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 440.527952 Mbits/sec, 36326 packets/sec, 4.41% of line-rate < ==

    Output 6.509000 Mbits/sec, 12181 packets/sec, 0.07% of line-rate

Time since last interface status change: 2d23h17m

 

M4-VCS20-11# show interface TenGigabitEthernet 1/0/3

TenGigabitEthernet 1/0/3 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1947

    Current address is 50eb.1a22.1947

Pluggable media present

Interface index (ifindex) is 4697718786

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:18

Queueing strategy: fifo

Receive Statistics:

    32208733 packets, 47287209954 bytes

    Unicasts: 32208697, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 67, Over 64-byte pkts: 687345, Over 127-byte pkts: 315

    Over 255-byte pkts: 583763, Over 511-byte pkts: 12294, Over 1023-byte pkts: 30924949

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    16069853 packets, 1158543392 bytes

    Unicasts: 16069551, Multicasts: 82, Broadcasts: 220

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 402.539000 Mbits/sec, 34278 packets/sec, 4.03% of line-rate < ==

    Output 9.852632 Mbits/sec, 17081 packets/sec, 0.10% of line-rate

Time since last interface status change: 21:22:49

 

M4-VCS20-11# show interface TenGigabitEthernet 2/0/3

TenGigabitEthernet 2/0/3 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a20.d612

    Current address is 50eb.1a20.d612

Pluggable media present

Interface index (ifindex) is 8992686082

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:19

Queueing strategy: fifo

Receive Statistics:

    413 packets, 155750 bytes

    Unicasts: 377, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 73, Over 64-byte pkts: 82, Over 127-byte pkts: 0

    Over 255-byte pkts: 0, Over 511-byte pkts: 258, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    383 packets, 126842 bytes

    Unicasts: 152, Multicasts: 75, Broadcasts: 156

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 0.000000 Mbits/sec, 0 packets/sec, 0.00% of line-rate

    Output 0.000000 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Time since last interface status change: 21:22:47

 

M4-VCS20-11# show interface TenGigabitEthernet 1/0/4

TenGigabitEthernet 1/0/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a22.1948

    Current address is 50eb.1a22.1948

Pluggable media present

Interface index (ifindex) is 4697751555

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:19

Queueing strategy: fifo

Receive Statistics:

    31008495 packets, 45524963296 bytes

    Unicasts: 31008459, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 82, Over 64-byte pkts: 661747, Over 127-byte pkts: 372

    Over 255-byte pkts: 562500, Over 511-byte pkts: 11294, Over 1023-byte pkts: 29772500

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    15462484 packets, 1114781432 bytes

    Unicasts: 15462182, Multicasts: 82, Broadcasts: 220

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 395.029648 Mbits/sec, 33635 packets/sec, 3.95% of line-rate < ==

    Output 9.670824 Mbits/sec, 16768 packets/sec, 0.10% of line-rate

Time since last interface status change: 21:25:12

 

M4-VCS20-11# show interface TenGigabitEthernet 2/0/4

TenGigabitEthernet 2/0/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 50eb.1a20.d613

    Current address is 50eb.1a20.d613

Pluggable media present

Interface index (ifindex) is 8992718851

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:19

Queueing strategy: fifo

Receive Statistics:

    416 packets, 156866 bytes

    Unicasts: 380, Multicasts: 30, Broadcasts: 6

    64-byte pkts: 76, Over 64-byte pkts: 52, Over 127-byte pkts: 30

    Over 255-byte pkts: 0, Over 511-byte pkts: 258, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    379 packets, 126064 bytes

    Unicasts: 148, Multicasts: 75, Broadcasts: 156

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 0.000000 Mbits/sec, 0 packets/sec, 0.00% of line-rate

    Output 0.000000 Mbits/sec, 0 packets/sec, 0.00% of line-rate

Time since last interface status change: 21:25:12

 

M4-VCS20-11# show interface TenGigabitEthernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:19

Queueing strategy: fifo

Receive Statistics:

    67140949 packets, 4615618812 bytes

    Unicasts: 67140960, Multicasts: 30, Broadcasts: 0

    64-byte pkts: 34086641, Over 64-byte pkts: 33054249, Over 127-byte pkts: 60

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    131286758 packets, 195990535629 bytes

    Unicasts: 131286449, Multicasts: 82, Broadcasts: 226

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 40.892752 Mbits/sec, 74369 packets/sec, 0.41% of line-rate

    Output 1736.427128 Mbits/sec, 145389 packets/sec, 17.36% of line-rate < ==

Time since last interface status change: 20:26:15

 

M4-VCS20-11# show interface TenGigabitEthernet 12/0/13

TenGigabitEthernet 12/0/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2973

    Current address is 0005.3365.2973

Pluggable media present

Interface index (ifindex) is 51942686732

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:19

Queueing strategy: fifo

Receive Statistics:

    21970944 packets, 1469712102 bytes

    Unicasts: 21970914, Multicasts: 30, Broadcasts: 0

    64-byte pkts: 20457384, Over 64-byte pkts: 1513499, Over 127-byte pkts: 61

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    68063315 packets, 103152557813 bytes

    Unicasts: 68063078, Multicasts: 75, Broadcasts: 162

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 12.755944 Mbits/sec, 23829 packets/sec, 0.13% of line-rate

    Output 901.811032 Mbits/sec, 74380 packets/sec, 9.02% of line-rate < ==

Time since last interface status change: 01:52:20

< =========== >

 

EMC VMAX utilization is at maximum capacity.

 

EMC VMAX Utilization Graph.jpg

   EMC VMAX Utilization Graph

 

All Medusa IO traffic completed without errors.

 

iSCSI Bandwidth Medusa Results.jpg

   iSCSI Bandwidth Medusa Results

 

1.2.3 Storage Device – w/Congested Fabric

 

Test Objective

1. Create network bottleneck through a single Ethernet Fabric ISL.

  1. Configure VDX switch for AUTONAS.
  2. Configure multiple ‘iSCSI to host’ data streams sufficient to saturate ISLs’ available bandwidth for 30 minutes.

4. Verify file IO completes error-free. Add L3 FCoE and L2 Ethernet traffic to fill available bandwidth.

5. File IO compares are disabled.

 

Test Configuration

1. Configure AUTONAS on VDX as follows:

 

< =========== >

nas auto-qos

nas server-ip 9.78.60.1/32 vlan 978

< =========== >

 

2. Add IXIA connections:

 

VCS Fabric Ports for IXIA Traffic Generator.jpg 

   VCS Fabric Ports for IXIA Traffic Generator

 

4. Reconfigure VDX as follows:

 

< =========== >

interface TenGigabitEthernet 11/1/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 11/1/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 12/0/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 11/1/43

 shutdown

!

interface TenGigabitEthernet 11/1/44

 shutdown

!

interface TenGigabitEthernet 11/1/45

 shutdown

!

interface TenGigabitEthernet 11/1/46

 shutdown

!

interface TenGigabitEthernet 11/1/47

 shutdown

!

interface TenGigabitEthernet 12/0/13

 shutdown

!

< =========== >

 

Results

  1. PASS. iSCSI IO completes error-free through bandwidth congestion.

Storage Device Congested Fabric Medusa Results.jpg

   Storage Device Congested Fabric Medusa Results

 

< =========== >

M4-VCS20-11# show fabric isl

 

Rbridge-id: 11   #ISLs: 1

 

 Src       Src                   Nbr       Nbr  

Index   Interface          Index   Interface        Nbr-WWN                                BW   Trunk  Nbr-Name

----------------------------------------------------------------------------------------------------------------------------------------------

59        Te 11/1/48       111    Te 12/0/48      10:00:00:05:33:65:29:60   10G   Yes   "CASTOR-VCS20-12" < ==

 

M4-VCS20-11# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:17

Queueing strategy: fifo

Receive Statistics:

    1461532665 packets, 2229306250938 bytes

    Unicasts: 1461526074, Multicasts: 6789, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 263866, Over 127-byte pkts: 1889914

    Over 255-byte pkts: 1820839, Over 511-byte pkts: 72516, Over 1023-byte pkts: 1913742

    Over 1518-byte pkts(Jumbo): 1455571812

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 13223

Transmit Statistics:

    1452872965 packets, 2062014120730 bytes

    Unicasts: 1452872419, Multicasts: 633, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 13562

Rate info:

    Input 9820.568280 Mbits/sec, 804810 packets/sec, 98.21% of line-rate < ==

    Output 9082.922120 Mbits/sec, 801195 packets/sec, 90.83% of line-rate

Time since last interface status change: 04:32:08

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/13

Interface TenGigabitEthernet 11/1/13

                  RX                RX                                            TX                TX

  CoS        Packets       Bytes                        CoS        Packets       Bytes

  ------------------------------------    --------------------------------------------------------------------

    0              0                 0                                 0              0                         0

    1              0                 0                                 1              0                         0

    2              0                 0                                 2              0                         0

    3              0                 0                                 3              0                         0

    4              0                 0                                 4              0                         0

    5              0                 0                                 5              0                         0

    6              0                 0                                 6              0                         0

    7              0                 0                                 7              0                         0

  untag    108564914  7459565968          untag    212991365      318070394736 < ==

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/31

Interface TenGigabitEthernet 11/1/31

                  RX                RX                                                     TX                TX

  CoS        Packets       Bytes                             CoS        Packets         Bytes

  ------------------------------------    -------------------------------------------------------------------------

    0              0                    0                                     0              0                     0

    1              0                    0                                     1              0                     0

    2              0                    0                                     2              0                     0

    3              0                    0                                     3              0                     0

    4              0                    0                                     4              0                     0

    5              0                    0                                     5              0                     0

    6              0                     0                                     6              0                    0

    7              0                     0                                     7              0                    0

  untag    672627267     1008940913608    untag    625602787     1104067889440 < ==

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/32

Interface TenGigabitEthernet 11/1/32

                  RX               RX                                             TX                TX

  CoS        Packets     Bytes                           CoS        Packets     Bytes

  ------------------------------------    -----------------------------------------------------------------

    0              0                 0                                 0              0                 0

    1              0                 0                                 1              0                 0

    2              0                 0                                 2              0                 0

    3      672660404     1008990442432      3       623915026      935872392672 < ==

    4              0                 0                                 4              0                 0

    5              0                 0                                 5              0                 0

    6              0                 0                                 6              0                 0

    7              0                 0                                 7              0                 0

  untag       61           6032                        untag         5731          539048

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/48

Interface TenGigabitEthernet 11/1/48

                  RX                RX                                         TX                  TX

  CoS        Packets       Bytes                     CoS        Packets           Bytes

  ------------------------------------    ------------------------------------------------------------------

    0      625665463      956007971664      0         672694343     1027876539784 < ==

    1              0                 0                               1              0                     0

    2      213023304      324083384464      2        108581432     10500980112 < ==

    3      623945673      950893406816      3        672693903     1025185703000 < ==

    4              0                 0                               4              0                    0

    5              0                 0                               5              0                    0

    6              0                 0                               6              0                    0

    7          13250          22333336                7          13589          24851728

  untag            0                 0                        untag            0                 0

< =========== >

 

1.2.4 Storage Device – iSCSI Protocol Jammer CRC Corruption on ISL Port

 

Test Objective

1. Perform iSCSI jammer testing using CRC corruption with a burst of 10 CRC errors on ISL link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

3. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer CRC corruption on ISL port.

 

NTFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1124312 packets, 862848651 bytes

    Unicasts: 1124282, Multicasts: 20, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 545728, Over 127-byte pkts: 24961

    Over 255-byte pkts: 12616, Over 511-byte pkts: 48380, Over 1023-byte pkts: 11445

    Over 1518-byte pkts(Jumbo): 481182

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 459

Transmit Statistics:

    1163962 packets, 1726605534 bytes

    Unicasts: 1163835, Multicasts: 127, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 459

Rate info:

    Input 914.040384 Mbits/sec, 78242 packets/sec, 9.14% of line-rate

    Output 5.625716 Mbits/sec, 6882 packets/sec, 0.06% of line-rate

Time since last interface status change: 00:18:01

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 1.jpg

   iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 1

 

EXT3, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1109186 packets, 807970572 bytes

    Unicasts: 1109173, Multicasts: 3, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 575234, Over 127-byte pkts: 25746

    Over 255-byte pkts: 433, Over 511-byte pkts: 11788, Over 1023-byte pkts: 60404

    Over 1518-byte pkts(Jumbo): 435581

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 23

Transmit Statistics:

    1283757 packets, 1766330695 bytes

    Unicasts: 1283719, Multicasts: 38, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 23

Rate info:

    Input 932.628840 Mbits/sec, 79314 packets/sec, 9.33% of line-rate

    Output 13.667424 Mbits/sec, 16596 packets/sec, 0.14% of line-rate

Time since last interface status change: 00:29:54

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 2.jpg

   iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 2

 

NTFS, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:33

Queueing strategy: fifo

Receive Statistics:

    1173383 packets, 1734269509 bytes

    Unicasts: 1173334, Multicasts: 39, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 40646, Over 127-byte pkts: 12607

    Over 255-byte pkts: 0, Over 511-byte pkts: 10, Over 1023-byte pkts: 24892

    Over 1518-byte pkts(Jumbo): 1095228

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 33

Transmit Statistics:

    1173129 packets, 930595719 bytes

    Unicasts: 1173115, Multicasts: 14, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 33

Rate info:

    Input 5.511328 Mbits/sec, 6729 packets/sec, 0.06% of line-rate

    Output 910.398508 Mbits/sec, 77928 packets/sec, 9.10% of line-rate

Time since last interface status change: 00:31:18

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 3.jpg

   iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 3

 

EXT3, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1306787 packets, 1769473917 bytes

    Unicasts: 1306725, Multicasts: 57, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 117359, Over 127-byte pkts: 38593

    Over 255-byte pkts: 24601, Over 511-byte pkts: 454, Over 1023-byte pkts: 454

    Over 1518-byte pkts(Jumbo): 1125326

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Transmit Statistics:

    1218866 packets, 969924159 bytes

    Unicasts: 1218878, Multicasts: 18, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info:

    Input 13.385544 Mbits/sec, 16256 packets/sec, 0.13% of line-rate

    Output 907.600320 Mbits/sec, 77193 packets/sec, 9.08% of line-rate

Time since last interface status change: 00:32:36

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 4.jpg

   iSCSI Protocol Jammer CRC Corruption on ISL Port Medusa Result 4

 

1.2.5 Storage Device – iSCSI Protocol Jammer Packet Corruption on ISL Port

 

Test Objective

1. Perform iSCSI jammer testing using packet corruption with a burst of 10 packet errors on ISL link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

3. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer packet corruption on ISL port.

 

NTFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:34

Queueing strategy: fifo

Receive Statistics:

    1158707 packets, 912597644 bytes

    Unicasts: 1158691, Multicasts: 6, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 545786, Over 127-byte pkts: 24956

    Over 255-byte pkts: 13392, Over 511-byte pkts: 51446, Over 1023-byte pkts: 12146

    Over 1518-byte pkts(Jumbo): 510981

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 27

Transmit Statistics:

    1167830 packets, 1726998667 bytes

    Unicasts: 1167772, Multicasts: 58, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info:

    Input 917.938924 Mbits/sec, 78570 packets/sec, 9.18% of line-rate

    Output 5.589408 Mbits/sec, 6829 packets/sec, 0.06% of line-rate

Time since last interface status change: 00:34:20

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 1.jpg

   iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 1

 

EXT3, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1094747 packets, 819189540 bytes

    Unicasts: 1094732, Multicasts: 5, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 552783, Over 127-byte pkts: 24497

    Over 255-byte pkts: 452, Over 511-byte pkts: 11990, Over 1023-byte pkts: 61353

    Over 1518-byte pkts(Jumbo): 443672

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Transmit Statistics:

    1240933 packets, 1701247823 bytes

    Unicasts: 1240886, Multicasts: 47, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info:

    Input 909.361168 Mbits/sec, 77342 packets/sec, 9.09% of line-rate

    Output 13.336472 Mbits/sec, 16206 packets/sec, 0.13% of line-rate

Time since last interface status change: 00:35:46

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 2.jpg

   iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 2

 

NTFS, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:31

Queueing strategy: fifo

Receive Statistics:

    1167265 packets, 1728980804 bytes

    Unicasts: 1167186, Multicasts: 70, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 39455, Over 127-byte pkts: 11704

    Over 255-byte pkts: 0, Over 511-byte pkts: 11, Over 1023-byte pkts: 24791

    Over 1518-byte pkts(Jumbo): 1091304

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 1345

Transmit Statistics:

    1128609 packets, 869492720 bytes

    Unicasts: 1128647, Multicasts: 9, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 1390

Rate info:

    Input 5.723160 Mbits/sec, 7026 packets/sec, 0.06% of line-rate

    Output 910.665624 Mbits/sec, 77899 packets/sec, 9.11% of line-rate

Time since last interface status change: 00:38:41

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 3.jpg

   iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 3

 

EXT3, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1291948 packets, 1750363842 bytes

    Unicasts: 1291885, Multicasts: 54, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 115332, Over 127-byte pkts: 38165

    Over 255-byte pkts: 24323, Over 511-byte pkts: 456, Over 1023-byte pkts: 453

    Over 1518-byte pkts(Jumbo): 1113219

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Transmit Statistics:

    1204759 packets, 958703075 bytes

    Unicasts: 1204736, Multicasts: 21, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info:

    Input 13.479196 Mbits/sec, 16381 packets/sec, 0.13% of line-rate

    Output 921.471428 Mbits/sec, 78384 packets/sec, 9.21% of line-rate

Time since last interface status change: 00:40:03

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 4.jpg

   iSCSI Protocol Jammer Packet Corruption on ISL Port Medusa Result 4

 

1.2.6 Storage Device – iSCSI Protocol Jammer Packet Loss on ISL Port

 

Test Objective

1. Perform iSCSI jammer testing using packet loss with a burst of 10 packet drops on ISL link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

3. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer packet loss on ISL port.

 

NTFS, PACKET DROP BURST ON READ TRAFFIC

iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 1.jpg

   iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 1

 

 

EXT3, PACKET DROP BURST ON READ TRAFFIC

iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 2.jpg

   iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 2

 

NTFS, PACKET DROP BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 3.jpg

   iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 3

 

EXT3, PACKET DROP BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 4.jpg

   iSCSI Protocol Jammer Packet Loss on ISL Port Medusa Result 4

 

1.2.7 Storage Device – iSCSI Protocol Jammer CRC Corruption on Storage Port

 

Test Objective

1. Perform iSCSI jammer testing using CRC corruption with a burst of 10 CRC errors on storage port link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer packet corruption on storage port.

 

NTFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:34

Queueing strategy: fifo

Receive Statistics:

    283611 packets, 18673053 bytes

    Unicasts: 283601, Multicasts: 1, Broadcasts: 0

    64-byte pkts: 271227, Over 64-byte pkts: 12368, Over 127-byte pkts: 10

    Over 255-byte pkts: 7, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    554400 packets, 839897456 bytes

    Unicasts: 554386, Multicasts: 1, Broadcasts: 13

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 12.938776 Mbits/sec, 24567 packets/sec, 0.13% of line-rate

    Output 582.379776 Mbits/sec, 48042 packets/sec, 5.82% of line-rate

Time since last interface status change: 00:02:43

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 1.jpg

   iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 1

 

EXT3, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    565005 packets, 40710275 bytes

    Unicasts: 565017, Multicasts: 1, Broadcasts: 0

    64-byte pkts: 94, Over 64-byte pkts: 564905, Over 127-byte pkts: 2

    Over 255-byte pkts: 4, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1115032 packets, 1632742262 bytes

    Unicasts: 1115040, Multicasts: 5, Broadcasts: 7

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 14.101000 Mbits/sec, 24457 packets/sec, 0.14% of line-rate

    Output 563.415672 Mbits/sec, 48083 packets/sec, 5.63% of line-rate

Time since last interface status change: 00:04:51

< =========== >

 

iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 2.jpg

   iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 2

 

NTFS, CRC ERROR BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 3.jpg

   iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 3

 

EXT3, CRC ERROR BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 4jpg.jpg

   iSCSI Protocol Jammer CRC Corruption on Storage Port Medusa Result 4

 

1.2.8 Storage Device – iSCSI Protocol Jammer Packet Corruption on Storage Port

 

Test Objective

1. Perform SMB/NFS jammer testing using packet corruption with a burst of 10 packet errors on storage port link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer packet corruption on storage port.

 

NTFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1185494 packets, 943258133 bytes

    Unicasts: 1185530, Multicasts: 1, Broadcasts: 0

    64-byte pkts: 528504, Over 64-byte pkts: 24055, Over 127-byte pkts: 125

    Over 255-byte pkts: 14419, Over 511-byte pkts: 65399, Over 1023-byte pkts: 553037

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1137117 packets, 1641136836 bytes

    Unicasts: 1137110, Multicasts: 2, Broadcasts: 7

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 880.913488 Mbits/sec, 76868 packets/sec, 8.81% of line-rate

    Output 4.029560 Mbits/sec, 6812 packets/sec, 0.04% of line-rate

Time since last interface status change: 00:11:14

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 1.jpg

   iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 1

 

EXT3, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/13

TenGigabitEthernet 11/1/13 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71da

    Current address is 0027.f81c.71da

Pluggable media present

Interface index (ifindex) is 47651913861

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:31

Queueing strategy: fifo

Receive Statistics:

    690955 packets, 212526805 bytes

    Unicasts: 690962, Multicasts: 1, Broadcasts: 0

    64-byte pkts: 96, Over 64-byte pkts: 572222, Over 127-byte pkts: 2

    Over 255-byte pkts: 111, Over 511-byte pkts: 11775, Over 1023-byte pkts: 106749

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1192280 packets, 1659922908 bytes

    Unicasts: 1192274, Multicasts: 3, Broadcasts: 12

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 688.076048 Mbits/sec, 64386 packets/sec, 6.88% of line-rate

    Output 132.981320 Mbits/sec, 40714 packets/sec, 1.33% of line-rate

Time since last interface status change: 00:12:37

< =========== >

 

iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 2.jpg

   iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 2

 

NTFS, PACKET ERROR BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 3.jpg

   iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 3

 

EXT3, PACKET ERROR BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 4.jpg

   iSCSI Protocol Jammer Packet Corruption on Storage Port Medusa Result 4

 

1.2.9 Storage Device – iSCSI Protocol Jammer Packet Loss on Storage Port

 

Test Objective

1. Perform iSCSI jammer testing using packet loss with a burst of 10 lost packets on ISL link, in each direction sequentially, while IO is running from a single host.

2. Verify IO recovers successfully.

 

Test Configuration

1. Shutdown multi-path connection between iSCSI target and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 12/0/13

 shutdown

< =========== >

 

Results

  1. PASS. All IO completes error-free through Ethernet jammer packet loss on storage port.

 

NTFS, PACKET DROP BURST ON READ TRAFFIC

iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 1.jpg

   iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 1

 

EXT3, PACKET DROP BURST ON READ TRAFFIC

iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 2.jpg

   iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 2

 

NTFS, PACKET DROP BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 3.jpg

   iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 3

 

EXT3, PACKET DROP BURST ON WRITE TRAFFIC

iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 4.jpg

   iSCSI Protocol Jammer Packet Loss on Storage Port Medusa Result 4

 

1.3 Stress and Error Recovery

 

1.3.1 Storage Device Fabric IO Integrity – Congested Fabric

 

Test Objective

1. Configure fabric and devices for maximum link and device saturation.

  1. Configure VDX switch for AUTONAS.
  2. Add L3 FCoE traffic (COS 3), SMB/NFS traffic (COS 2) and L2 Ethernet traffic (COS 0) to fill all available bandwidth.

4. From all iSCSI initiators, start a mixture of READ/WRITE/VERIFY traffic with random data patterns continuously to all targets for 12 hours.

5. Verify no unexpected change in IO throughput occurs.

 

Test Configuration

1. See test configuration for test 1.2.3.

 

Results

  1. PASS. All IO completes error-free through VCS fabric congestion.

 Storage Device Fabric IO Integrity – Congested Fabric Medusa Result.jpg

   Storage Device Fabric IO Integrity – Congested Fabric Medusa Result

 

< =========== >

M4-VCS20-11# show fabric isl

 

Rbridge-id: 11   #ISLs: 1

 

 Src       Src                 Nbr       Nbr  

Index   Interface         Index   Interface         Nbr-WWN                                 BW   Trunk  Nbr-Name

---------------------------------------------------------------------------------------------------------------------------------------------

59        Te 11/1/48       111    Te 12/0/48      10:00:00:05:33:65:29:60   10G   Yes   "CASTOR-VCS20-12" < ==

 

M4-VCS20-11# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 15:01:38

Queueing strategy: fifo

Receive Statistics:

    44414301365 packets, 65847829112085 bytes

    Unicasts: 44414205344, Multicasts: 96221, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 1241404710, Over 127-byte pkts: 131702744

    Over 255-byte pkts: 42576636, Over 511-byte pkts: 735001, Over 1023-byte pkts: 44480937

    Over 1518-byte pkts(Jumbo): 42953401359

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 76060

Transmit Statistics:

    44736487074 packets, 65117652062227 bytes

    Unicasts: 44736468083, Multicasts: 19099, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 77030

Rate info:

    Input 9796.725904 Mbits/sec, 850597 packets/sec, 97.97% of line-rate < ==

    Output 9813.319888 Mbits/sec, 840367 packets/sec, 98.13% of line-rate < ==

Time since last interface status change: 17:39:16

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/13

Interface TenGigabitEthernet 11/1/13

                  RX                     RX                                          TX                TX

  CoS        Packets             Bytes                      CoS        Packets             Bytes

  ------------------------------------    --------------------------------------------------------------------------

    0              0                          0                            0              0                        0

    1              0                          0                            1              0                        0

    2              0                          0                            2              0                        0

    3              0                          0                            3              0                        0

    4              0                          0                            4              0                        0

    5              0                          0                            5              0                        0

    6              0                          0                            6              0                        0

    7              0                          0                            7              0                        0

  untag   6185728744     6116018179656    untag   5332854203     6060137940944 < ==

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/31

Interface TenGigabitEthernet 11/1/31

                  RX                       RX                                              TX                TX

  CoS        Packets             Bytes                          CoS        Packets             Bytes

  ------------------------------------    ----------------------------------------------------------------------------------

    0              0                         0                                 0              0                          0

    1              0                         0                                 1              0                          0

    2              0                         0                                 2              0                          0

    3              0                         0                                 3              0                          0

    4              0                         0                                 4              0                          0

    5              0                         0                                 5              0                          0

    6              0                         0                                 6              0                          0

    7              0                         0                                 7              0                          0

  untag  20019816757    30029725142216    untag  19573457889    29360100880456 < ==

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/32

Interface TenGigabitEthernet 11/1/32

                  RX                RX                                                TX                TX

  CoS        Packets       Bytes                            CoS        Packets      Bytes

  ------------------------------------    -----------------------------------------------------------------------

    0              0                   0                                   0              0                 0

    1              0                   0                                   1              0                 0

    2              0                   0                                   2              0                 0

    3    20019857821    30029776350368      3    19508786353    29263169961192 < ==

    4              0                   0                                   4              0                 0

    5              0                   0                                   5              0                 0

    6              0                   0                                   6              0                 0

    7              0                   0                                   7              0                 0

  untag      1802            178392                     untag        63421        9202824

 

M4-VCS20-11# show qos queue interface tengigabitethernet 11/1/48

Interface TenGigabitEthernet 11/1/48

                  RX                RX                                                TX                       TX

  CoS        Packets        Bytes                           CoS        Packets             Bytes

  ------------------------------------    ---------------------------------------------------------------------------

    0    19573552157    29908270702528      0         19263938906    29435280371752 < ==

    1              0                 0                                     1              0                         0

    2     5332865810     6209477358976         2         6185760805     6289255586016 < ==

    3    19508812710    29731430759296      3         19287705072    29394462770320 < ==

    4              0                 0                                     4              0                        0

    5              0                 0                                     5              0                        0

    6              3               216                                  6             16                    1184

    7          76085         100192272                     7          77055               108410800

  untag        0                 0                                     untag     0                         0

< =========== >

 

1.3.2 Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

 

Test Objective

1. Perform sequentially for each Storage Device and Adapter port.

2. With IO running, perform a quick port toggle every Storage Device and Adapter port. 

3. Verify host IO will recover.

 

Results

  1. PASS. All IO recovers through port disconnections and reconnections.

 

1.3.3 Storage Device Integrity – Device Recovery from ISL Port Relocation

 

Test Objective

1. With IO running, manually disconnect and reconnect ISL port to different port in same switch.

2. Verify fabric integrity and file IO recovery.

3. Repeat test for all switch types.

 

Results

  1. PASS. All IO completes error-free through ISL port disconnections and reconnections.

 

1.3.4 Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

 

Test Objective

  1. Sequentially toggle each Initiator and Target port in fabric.
  2. Verify host IO will recover to alternate path and toggled path will recover.
  3. Run for 12 hours.

 

Results

  1. PASS. All IO completes error-free through initiator and target port disable and enable commands.

Device Port Toggle Extended Run Medusa Result.jpg

   Device Port Toggle Extended Run Medusa Result

 

1.3.5 Storage Device Recovery – ISL Port Toggle – Extended Run

 

Test Objective

1. Verify fabric ISL path redundancy between hosts and storage devices.

2. Sequentially toggle each ISL path on all switches. 

3. Host IO may pause but should recover.

4. Verify host IO throughout test.

5. Run for 12 hours.

 

Results

  1. PASS. All IO completes error-free through ISL port disable and enable commands.

ISL Port Toggle Extended Run Medusa Result.jpg

   ISL Port Toggle Extended Run Medusa Result

 

1.3.6 Storage Device Recovery – All-ISL Port Toggle

 

Test Objective

1. Verify fabric switch path redundancy between hosts and storage devices. Sequentially, and for all switches, disable all ISLs on the switch under test. 

  1. Verify IO pauses and resume after switch fabric convergence.

 

Results

  1. PASS. All IO completes error-free through ISL port disable and enable commands.

VDX8770 All-ISL Port Toggle Medusa Result.jpg

   VDX8770 All-ISL Port Toggle Medusa Result

 

1.3.7 Storage Device Recovery – VDX8770 Line Card Maintenance

 

Test Objective

1. For extended time, verify device connectivity to VDX 8770 blades.

2. Sequentially power off and on each Mercury line card.

3. Verify host IO will failover to alternate path and toggled path will recover.

 

Results

  1. PASS. All IO completes error-free through line card power off and on commands.

VDX8770 Line Card Maintenance Medusa Result.jpg

   VDX8770 Line Card Maintenance Medusa Result

 

1.3.8 Storage Device Recovery – Switch Offline

 

Test Objective

1. Toggle each switch in sequential order with a mix of

- chassis disable,

- reboot, and

- power cycles.

2. For switches containing device under test, IO will pause and then resume after switch comes online.

 

Results

1. Chassis Disable/Enable: PASS. IO successfully resumes after chassis enable.

2. Reboot: PASS. IO successfully resumes after chassis reboot.

3. Power Cycle: PASS. IO successfully resumes after chassis power cycle.

 

1.3.9 Workload Simulation Test Suite – Microsoft Exchange Server

 

Test Objective

1. Validate Storage/Fabric behavior while running a Medusa Microsoft Exchange Server workload simulation test suite for 30 minutes.

  1. Verify file IO completes error-free. File IO compares are disabled.

 

Results

  1. PASS. All IO completes error-free.

Microsoft Exchange Server Medusa Result.jpg

   Microsoft Exchange Server Medusa Result

 

1.3.10 Workload Simulation Test Suite – File Server Simulation

 

Test Objective

1. Validate Storage/Fabric behavior while running a Medusa File Server Simulation workload simulation test suite for 30 minutes.

  1. Verify file IO completes error-free. File IO compares are disabled.

 

Results

  1. PASS. All IO completes error-free.

File Server Simulation Medusa Result.jpg

   File Server Simulation Medusa Result

 

1.3.11 Host-side Interface Port Toggle

 

Test Objective

  1. From the hosts, sequentially disable and enable interfaces connected to the VCS fabric. Verify host IO will recover to alternate path and toggled path will recover.

 

Results

  1. PASS. All IO completes error-free through host-side interface disable and enable actions.

Host-side Interface Port Toggle Medusa Result.jpg

   Host-side Interface Port Toggle Medusa Result

 

1.3.12 Storage-side Interface Port Toggle

 

Test Objective

1. From the storage, sequentially disable and enable interfaces connected to the VCS fabric. Verify host IO will recover to alternate path and toggled path will recover.

 

Results

  1. PASS. All IO completes error-free through storage-side interface disable and enable actions.

Storage-side Interface Port Toggle Medusa Result.jpg

   Storage-side Interface Port Toggle Medusa Result

 

1.4 Brocade Network Advisor

 

1.4.1 Ethernet Fabric Discovery

 

Test Objective

Verify BNA discovers the VCS fabric.

 

Results

  1. PASS. The VCS cluster is discovered.

Ethernet Fabric Discovery Result.jpg

   Ethernet Fabric Discovery Result

 

1.4.2 Ethernet Fabric Addition and Removal

 

Test Objective

Verify BNA recognizes VCS fabric node addition and removal. Isolate a VCS cluster member by shutting down all of its ISL ports. Verify BNA accurately reflects VCS cluster change. Reintroduce VCS cluster member previously isolated by enabling all of its ISL ports. Verify BNA accurately reflects VCS cluster change.

 

Results

  1. PASS. BNA accurately reports the VCS cluster changes during both removal and addition.

Ethernet Fabric Removal Result.jpg

   Ethernet Fabric Removal Result

 

Ethernet Fabric Addition Result.jpg

   Ethernet Fabric Addition Result

 

1.4.3 Ethernet Fabric Configuration Backup and Restoration

 

Test Objective

Verify BNA performs configuration backup and configuration restore for storage configuration. Perform BNA configuration backup, followed by configuration default on entire VCS cluster. Then, perform BNA configuration restoration using previous configuration backup. Verify configuration is successfully restored.

 

Results

  1. PASS. BNA successfully performs both configuration backup and restoration.

Ethernet Fabric Configuration Backup Result.jpg

   Ethernet Fabric Configuration Backup Result

 

Ethernet Fabric Configuration Restoration Result.jpg

   Ethernet Fabric Configuration Restoration Result

 

Ethernet Fabric Restoration Verification.jpg

   Ethernet Fabric Restoration Verification

 

1.4.4 Ethernet Fabric Firmware Download

 

Test Objective

Verify BNA performs firmware download from previous GA release to current GA release.

 

Results

  1. PASS. BNA successfully performs firmware download from NOS5.0.0 to NOS5.0.1.

Ethernet Fabric Firmware Download Verification.jpg 

   Ethernet Fabric Firmware Download Verification

Contributors