Design & Build

Data Center Solution, Storage-Validation Test: Brocade VCS Fabric and NetApp 3170 NAS Storage Array

by on ‎08-18-2014 08:01 AM - edited on ‎09-22-2014 12:26 PM by Community Manager (2,248 Views)
 

 

Preface

 

Overview

Many data centers use network attached storage (NAS) for a variety of applications and workloads. As more data is stored on NAS, efficient network designs are under evaluation to minimize latency, maximum use of interswitch links between switches and to automate network configuration changes. For these reasons, Brocade’s VCS Fabric with Brocade VDX Switches is increasingly being deployed when new NAS arrays are added to the storage pool.

 

Purpose of This Document

The goal of this document is to validate Brocade VCS Fabric with the NetApp 3170 NAS storage array. The testing includes test cases that demonstrate VCS Fabric feature support, high availability and resiliency and automatic network reconfiguration when links are added or removed. This document provides validation test results for typical use cases of NAS with Brocade’s VCS Fabric and NetApp 3170 NAS storage arrays.

 

Audience

The content in this document is written for a technical audience, including solution architects, system engineers, and technical development representatives.

 

Objectives

  1. Validate interoperability with redundant and non-redundant network topologies with Brocade VCS and NetApp 3170.
  2. Identify any unique configuration details necessary to establish end-to-end connectivity.
  3. Simulate real-world customer environment perturbations and validate end-to-end behavior and recovery.

 

Test Conclusions

  1. Brocade VCS Fabric and NetApp 3170 NAS array smoothly interoperate with both redundant and non-redundant configurations. No exceptions were noted.
  2. The configuration procedures followed Brocade VCS Fabric and NetApp 3170 standard documentation guides and found no issues with these procedures.
  3. All simulated changes in network and storage (add, remove, failover) resulted in expected behaviors and I/O recovery.

 

Related Documents

 

References

 

Document History

Date                  Version        Description

8-18-2014           1.0                Initial version

 

Key Contributors

The content in this guide was provided by the following key contributors.

  • Test Architects: Dustin Maiers, Patrick Stander
  • Test Engineer: Robert Batesole

 

About Brocade

Brocade networking solutions help the world’s leading organizations transition smoothly to a world where applications and information reside anywhere. This vision is realized through the Brocade One™ strategy, which is designed to deliver key business benefits such as unmatched simplicity, non-stop networking, application optimization, and investment protection.

 

Innovative Ethernet and storage networking solutions for data center, campus, and service provider networks help reduce complexity and cost while enabling virtualization and cloud computing to increase business agility.

 

To help ensure a complete solution, Brocade partners with world-class IT companies and provides comprehensive education, support, and professional services offerings.

 

To learn more, visit (www.brocade.com)

 

About NetApp

NetApp creates innovative products—storage systems and software that help customers around the world store, manage, protect, and retain one of their most precious corporate assets: their data. We are recognized throughout the industry for continually pushing the limits of today’s technology so that our customers never have to choose between saving money and acquiring the capabilities they need to be successful.

 

Test Plan

The storage array is connected to one VDX Ethernet fabric with multiple Windows and Red Hat server hosts to drive I/O.

 

Scope

Testing will be performed with GA versions of Brocade’s Network Operating System (NOS) in a heterogeneous environment. Test beds will include Brocade switches configured in routed and non-routed fabric configurations.

 

Testing is centered on interoperability and optimal configuration. Performance is observed within the context of best practice fabric configuration; however absolute maximum benchmark reporting of storage performance is beyond the scope of this test.

 

Test Configuration

 

TestTopology.jpg

   Test Topology

 

The following shows VCS Fabric switch port connections and vLAG (port-channel) ports for each sever and the NetApp 3170 array. For example, “1/0/1” means the device port connects to Rbridge# = 1, Card# = 0 and Port# = 1. For fixed top of rack switches such as the VDX 6720, 6730 and 6740, there are no port cards which is indicated by “0” for the Card #

 

Device to VCS Fabric Switch Port Connections.jpg 

   Device to VCS Fabric Switch Port Connections

 

DUT Descriptions

The following tables provide details about the devices under test (DUT).

 

Storage Array

Model

Vendor

Description

FAS3170

NetApp

This Network Attached Storage (NAS) array unifies data storage with Fibre Channel SAN, IP SAN (iSCSI, FCoE) and NAS (NFS, CIFS). Up to 40 4 / 8 Gbps FC ports and 36 Ethernet ports as well as 10 GE support makes this a versatile storage option.

 

VCS Fabric Switches

Model

Vendor

Description

BR-VDX6720-24

Brocade

The Brocade VDX 6720 is a high-performance, ultra-low latency wire-speed 10 Gigabit Ethernet (GbE) fixed configuration switch. The VDX 6720 has been superseded by the VDX 6740 which is the latest generation of ToR switch in the VDX Switch family offering more bandwidth (40 GE) and options for 10BASE-T connectivity.

BR-VDX6730-32

Brocade

The Brocade VDX 6730 Switch is a 10 Gigabit Ethernet (GbE) fixed configuration switch with LAN and native Fibre Channel ports. It supports multiple connectivity options, Ethernet storage connectivity for Fibre Channel over Ethernet (FCoE), iSCSI, NAS, and bridges to Fibre Channel Storage Area Networks (SANs).

BR-VDX6740

Brocade

The Brocade VDX 6740 and 6740T are Ethernet fabric Top of Rack (ToR) switches featuring 10 GbE ports with 40 GbE uplinks. The new Brocade VDX 6740T-1G Switch offers dual-speed functionality. It can be deployed with1000BASET for existing 1 GbE server connectivity and upgraded via software to 10GBASE-T for future bandwidth growth. Together with Brocade VCS Fabric technology, these switches deliver the high performance and low latency needed to support demanding virtualized data center environments.

BR-VDX8770-4

Brocade

The Brocade VDX 8770 Switch is a highly scalable, low-latency, 1/10/40/100 Gigabit Ethernet (GbE) modular switch. Designed to easily scale out Brocade VCS fabrics, the Brocade VDX 8770 Switch brings new levels of performance to VCS fabric deployments.

 

DUT Specifications

 

NAS Array

Version

NetApp 3170

NetApp Release 8.2.1 7-Mode

NetApp OnCommand System Manager

Version 3.1 (3.1.1RC1)

QLogic CNA 8152

Firmware Revision 5.8.0

 

Brocade Switches

Version

VDX 6720

NOS 4.1.2

VDX 6730

NOS 4.1.2

VDX 6740

NOS 4.1.2

VDX 8770

NOS 4.1.2

 

Adapters

Version

Brocade 1020 (Now QLogic)

3.0.0.0 (Red Hat 6.5)

Brocade 1860 (Now QLogic)

3.2.4.0 (Windows Server 2008)

Emulex OCe10102

8.3.5.68.5p (Red Hat 6.3)

Emulex OCe14102

10.0.803.23 (Windows Server 2012)

 

Servers

Memory

Processor

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

 

Operating Systems

Version

Red Hat Enterprise Linux Server

6.5, 6.3

Windows Server

2008 R2, 2012 R2

 

Test Equipment

Version

Medusa Labs Test Tools

6.0.1.148039

 

Device

Interface

IP Address

NetApp 3170

node4, e4a

9.79.20.1

NetApp 3170

node3, VIF NOS_VCS20

9.79.20.2

Windows 2012 Server

NIC Team

9.79.100.1

Windows 2008 Server

NIC Team

9.79.100.11

Red Hat 6.5 Server

bond0

9.79.100.21

Red Hat 6.3 Server

bond0

9.79.100.31

 

Configure DUT and Test Equipment

This section describes the initial configuration of DUT and test equipment. In some test cases, additional configuration changes are made.

 

Step 1. Brocade VDX Switch Configuration - Logical Chassis Mode

On the VCS cluster, configure VLAN 979 interfaces on all cluster members. Configure the vLAG interfaces connecting to Windows and Red Hat hosts as well as the NetApp 3170 storage array.

 

< =========== >

interface Vlan 979

!

rbridge-id 1

 interface Ve 979

  ip address 9.79.1.1/16

  no shutdown

!

rbridge-id 2

 interface Ve 979

  ip address 9.79.1.2/16

  no shutdown

!

rbridge-id 11

 interface Ve 979

  ip address 9.79.1.11/16

  no shutdown

!

rbridge-id 12

 interface Ve 979

  ip address 9.79.1.12/16

  no shutdown

!

interface TenGigabitEthernet 1/0/1

 no fabric isl enable

 no fabric trunk enable

 channel-group 101 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/2

 no fabric isl enable

 no fabric trunk enable

 channel-group 102 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 103 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/4

 no fabric isl enable

 no fabric trunk enable

 channel-group 104 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/1

 no fabric isl enable

 no fabric trunk enable

 channel-group 101 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/2

 no fabric isl enable

 no fabric trunk enable

 channel-group 102 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 103 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/4

 no fabric isl enable

 no fabric trunk enable

 channel-group 104 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 11/1/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 21 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 11/1/4

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 12/0/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 21 mode active type standard

 lacp timeout long

 no shutdown

!

interface Port-channel 21

 cee default

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 101

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 102

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 103

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 104

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

< =========== >

 

Step 2. NetApp 3170 Configuration

 

a. Physical Interface Configuration

For single interface configuration, open the NetApp OnCommand System Manager and navigate to Configuration -> Network -> Network Interfaces. Select the desired physical interface and click Edit.

 

NetApp 3170 Network Interface Configuration – Screen 1.jpg

   NetApp 3170 Network Interface Configuration – Screen 1

 

Enter the desired interface IP address in the IPv4 Address / Netmask field. Finally, click Save and Close.

 

NetApp 3170 Network Interface Configuration – Screen 2.jpg 

   NetApp 3170 Network Interface Configuration – Screen 2

 

b. LACP Interface Configuration

For LACP interface configuration, open the NetApp OnCommand System Manager and navigate to Configuration -> Network -> Network Interfaces.

 

NetApp 3170 System Manager, Network Interfaces.jpg 

   NetApp 3170 System Manager, Network Interfaces

 

Then, click on Create VIF to start the VIF Wizard. Supply a name for the Virtual Interface (VIF) Name, select the desired physical interfaces to aggregate, and select LACP as the Trunk Mode.

 

NetApp 3170 VIF Wizard – Screen 1.jpg 

   NetApp 3170 VIF Wizard – Screen 1

 

Choose IP based for the Load balancing type.

 

NetApp 3170 VIF Wizard – Screen 2.jpg

   NetApp 3170 VIF Wizard – Screen 2

 

Choose This interface will not be part of another virtual interface.

 

NetApp 3170 VIF Wizard – Screen 3.jpg

   NetApp 3170 VIF Wizard – Screen 3

 

Enter the desired interface IP address in the IPv4 Address / Netmask field.

 

NetApp 3170 VIF Wizard – Screen 4.jpg

   NetApp 3170 VIF Wizard – Screen 4

 

c. Storage Volume Configuration

Storage -> Volumes. Then, click on Create to start the Create Volume Wizard.

 

NetApp 3170 System Manager, Storage Volumes.jpg 

   NetApp 3170 System Manager, Storage Volumes

 

Supply a volume name for the Name, select the volume size for Total Size, and set Snapshot Reserve to 0.

 

NetApp 3170 Storage Volume Configuration – Screen 1.jpg
   NetApp 3170 Storage Volume Configuration – Screen 1

 

(Optional) After the volume is created, return to Storage -> Volumes, highlight the newly-created volume, and click Snapshot Copies -> Configure. Then, uncheck Make Snapshot directory (.snapshot) visible and uncheck Enable scheduled Snapshot Copies. This option reduces disk usage at the expense of data backup.

 

NetApp 3170 Storage Volume Configuration – Screen 2.jpg
   NetApp 3170 Storage Volume Configuration – Screen 2

 

d. CIFS Share Configuration

Open the NetApp OnCommand System Manager and navigate to Storage -> Shares. Then, click on Create to create a new share.

 

NetApp 3170 System Manager, Storage Shares.jpg 

   NetApp 3170 System Manager, Storage Shares

 

Next, click on Browse and select the full path to the desired volume previously created. The Selected Path will autofill with the appropriate path.

 

NetApp 3170 CIFS Share Configuration – Screen 1.jpg
   NetApp 3170 CIFS Share Configuration – Screen 1

 

Click Create to complete the share creation.

 

NetApp 3170 CIFS Share Configuration – Screen 2.jpg

   NetApp 3170 CIFS Share Configuration – Screen 2

 

e. NFS Export Configuration

NetApp 3170 automatically creates NFS exports for any volumes created, so the exports designated for the Windows servers can be deleted if desired. Open the NetApp OnCommand System Manager and navigate to Storage -> Exports. Then, click on the NFS export you wish to delete and click Delete.

 

Then, click on the NFS export you wish to delete and click on the Unix folder entry and click Edit. Within the Edit Export Rule window, select Grant root access to all hosts under the Anonymous Access header.

 

NetApp 3170 NFS Export Configuration.jpg 

   NetApp 3170 NFS Export Configuration

 

Step 3. Windows Host Configuration

 

a. Configure Windows 2012 Server Hosts for Ethernet Teaming

Configure Windows 2012 Server NIC teaming interface for connectivity to VCS cluster.

 

Windows 2012 NIC Teaming.jpg 

   Windows 2012 NIC Teaming

 

b. Configure Windows 2008 Server Hosts for Ethernet Teaming

Configure Windows 2008 Server NIC teaming interface for connectivity to VCS cluster using the

Brocade Host Connectivity Manager.

 

Windows 2008 NIC Team using Brocade Host Connectivity Manager.jpg    Windows 2008 NIC Team using Brocade Host Connectivity Manager

 

c. Map NetApp 3170 Network Shares on Windows 2012 Server

Map network drives on Windows 2012 Server hosts.

 

Windows 2012 Network Shares Configuration – Screen 1.jpg 

   Windows 2012 Network Shares Configuration – Screen 1

 

 

Windows 2012 Network Shares Configuration – Screen 2.jpg

   Windows 2012 Network Shares Configuration – Screen 2

 

d. Map Network Drives on Windows 2008 Server

Map network drives on Windows 2008 Server hosts.

 

Windows 2008 Network Drive Mapping – Screen 1.jpg
   Windows 2008 Network Drive Mapping – Screen 1

 

Windows 2008 Network Drive Mapping – Screen 2.jpg
   Windows 2008 Network Drive Mapping – Screen 2

 

Step 4. Red Hat Linux Host Configuration

 

a. Configure NIC Bonding

The following are the entries within /etc/sysconfig/network-scripts/ on Red Hat hosts to enable Ethernet bonding, or NIC bonding.

 

< =========== >

ifcfg-eth4

DEVICE=eth4

BOOTPROTO=none

ONBOOT=yes

MASTER=bond0

SLAVE=yes

USERCTL=no

NM_CONTROLLED=no

 

ifcfg-eth5

DEVICE=eth4

BOOTPROTO=none

ONBOOT=yes

MASTER=bond0

SLAVE=yes

USERCTL=no

NM_CONTROLLED=no

 

ifcfg-bond0

DEVICE=bond0

IPADDR=9.79.100.21

NETMASK=255.255.0.0

ONBOOT=yes

BOOTPROTO=none

USERCTL=no

NM_CONTROLLED=no

BONDING_OPTS="mode=802.3ad miimon=100 downdelay=5000 updelay=5000"

< =========== >

 

b. Mount NFS Disk Shares

The following commands mount the NetApp 3170 NFS shares on hosts running Red Hat 6.5/6.3.

 

<< =========== >

mount -t nfs 9.79.20.1:/REDHAT_66.109 /mnt/netapp3170

mount -t nfs 9.79.20.1:/REDHAT_79.141 /mnt/netapp3170

< =========== >

 

Step 5. Medusa I/O Generation Configuration

The following shows the configuration of the Medusa IO data patterns used in the test cases.

 

a. Standard I/O with 64KB Blocks

For test scenarios using standard I/O (64 KB testing size), configure Medusa for the following command line result:

 

< =========== >

pain 2GB -b64KB -t8 -v2 -H45 -l35 -Y1 –M45

< =========== >

 

b. Maximum I/O with 1 MB Blocks

For test scenarios using maximum bandwidth I/O (1 MB testing size), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -b1MB -Q8 -n -u -q5 -w -o -Y1 –M45 --perf-mode

< =========== >

 

c. Microsoft Exchange Server I/O

For test scenarios using Microsoft Exchange Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -%r50@4KB -%w25@64KB -%w25@4KB -Q1 -n -u -q5 -o -l69 -Y1 -M45

< =========== >

 

d. File Server I/O

For test scenarios using File Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -%10:r80@512B,w20@512B -%5:r80@1KB,w20@1KB -%5:r80@2KB,w20@2KB -%60:r80@4KB,w20@4KB -%2:r50@8KB,w50@8KB -%4:r75@16KB,w25@16KB -%4:r75@32KB,w25@32KB -%10:r80@64KB,w20@64KB -Q1 -n -u -o -l69 -Y1 -M45

< =========== >

 

Test Cases

These test cases are designed to verify both basic and advanced functionality features between the Brocade VCS cluster and both host and storage devices, as well as stress all devices and confirm successful error recovery.

 

1.1

Ethernet Storage – Base Functionality

1.1.1

Storage Device – Physical Connection and Speed Negotiation

1.1.2

NAS Connectivity

1.1.3

vLAG Configuration

1.2

Ethernet Storage – Advanced Functionality

1.2.1

Storage Device – Jumbo Frame/MTU Size Validation

1.2.2

NAS Bandwidth Validation

1.2.3

Storage Device – w/Congested Fabric

1.2.4

Storage Device – NAS Protocol Jammer CRC Corruption on ISL Port

1.2.5

Storage Device – NAS Protocol Jammer Packet Corruption on ISL Port

1.2.6

Storage Device – NAS Protocol Jammer Packet Loss on ISL Port

1.2.7

Storage Device – NAS Protocol Jammer CRC Corruption on Storage Port

1.2.8

Storage Device – NAS Protocol Jammer Packet Corruption on Storage Port

1.2.9

Storage Device – NAS Protocol Jammer Packet Loss on Storage Port

1.3

Stress and Error Recovery

1.3.1

Storage Device Fabric I/O Integrity – Congested Fabric

1.3.2

Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

1.3.3

Storage Device Integrity – Device Recovery from ISL Port Relocation

1.3.4

Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

1.3.5

Storage Device Recovery – ISL Port Toggle – Extended Run

1.3.6

Storage Device Recovery – All-ISL Port Toggle

1.3.7

Storage Device Recovery – VDX8770 Line Card Maintenance

1.3.8

Storage Device Recovery – Switch Offline

1.3.9

Storage Device Recovery – Switch Firmware Download ISSU on VDX8770

1.3.10

Workload Simulation Test Suite – Microsoft Exchange Server

1.3.11

Workload Simulation Test Suite – File Server Simulation

 

Test Case Descriptions

==============

NOTE:

Lines in bold with “< == “at the end indicate important output used to validate the test results.

==============

 

1.1 Ethernet Storage – Base Functionality

 

1.1.1 Storage Device – Physical Connection and Speed Negotiation

 

Test Objective

  1. Verify device connectivity to VDX switch with all supported speed settings.
  2. Configure storage port for NAS connectivity.
  3. Validate base connectivity.

Results

  1. PASS. All interfaces up and operational at expected speed settings.
  2. PASS. Brocade VDX ‘show interface’ commands reflect expected interface speed.

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/3

TenGigabitEthernet 11/1/3 is up, line protocol is up (connected) < ==

Hardware is Ethernet, address is 0027.f81c.71d0

    Current address is 0027.f81c.71d0

Pluggable media not present

Interface index (ifindex) is 47651586051

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit < ==

LineSpeed Configured : Auto, Duplex: Full

...

 

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected) < ==

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit < ==

LineSpeed Configured : Auto, Duplex: Full

...

 

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/3

TenGigabitEthernet 12/0/3 is up, line protocol is up (connected) < ==

Hardware is Ethernet, address is 0005.3365.2967

    Current address is 0005.3365.2967

Pluggable media not present

Interface index (ifindex) is 51942359042

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit < ==

LineSpeed Configured : Auto, Duplex: Full

...

< =========== >

 

1.1.2 NAS Connectivity

 

Test Objective

  1. Verify host to File Share connectivity with CIFS and NFS with multiple simultaneous connections.

Results

  1. PASS. All network drives on all Windows and Red Hat hosts are successfully mapped.

< =========== >

PS C:\Users\Administrator> net use

New connections will be remembered.

 

Status    Local  Remote                    Network

 

----------------------------------------------------------------------------

OK           J   \\9.79.20.1\WINDOWS_68114 Microsoft Windows Network< ==

OK           K:  \\9.79.20.2\WINDOWS_68114 Microsoft Windows Network< ==

                 \\TSCLIENT\C              Microsoft Terminal Services

The command completed successfully.

 

C:\Users\Administrator>net use

New connections will be remembered.

 

Status    Local  Remote                    Network

 

-------------------------------------------------------------------------------

OK        J:     \\9.79.20.1\WINDOWS_68128 Microsoft Windows Network< ==

OK        K:     \\9.79.20.2\WINDOWS_68128 Microsoft Windows Network< ==

                 \\TSCLIENT\C              Microsoft Terminal Services

The command completed successfully.

 

 [root@ilo65205 ~]# df

Filesystem                                  1K-blocks Used         Available Use%  Mounted on

...

9.79.20.1:/vol/REDHAT_79141      20971520 16816768   4154752  81%  /mnt/netapp3170< ==

 

[root@v-e-vmw066109 ~]# df

Filesystem                                1K-blocks   Used         Available Use%  Mounted on

...

9.79.20.1:/vol/REDHAT_66109   20971520   16816704   4154816  81%   /mnt/netapp3170< ==

< =========== >

 

1.1.3 vLAG Configuration

 

Test Objective

  1. Configure vLAG connectivity from Storage Ports to 2 separate VDX switches.
  2. Verify data integrity through vLAG.

Results

1. PASS. All port-channel interfaces are operational and in sync.

 

< =========== >

CASTOR-VCS20-12# show port-channel 21

 LACP Aggregator: Po 21 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 11 (1)

    rbridge-id: 12 (1)

  Admin Key: 0021 - Oper Key 0021

  Partner System ID - 0x0001,02-a0-98-12-39-00

  Partner Oper Key 0001

 Member ports on rbridge-id 11:

   Link: Te 11/1/3 (0xB18418003) sync: 1   *< ==

 

 Member ports on rbridge-id 12:

   Link: Te 12/0/3 (0xC18018002) sync: 1     < ==

 

CASTOR-VCS20-12# show port-channel 101

 LACP Aggregator: Po 101 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0101 - Oper Key 0101

  Partner System ID - 0x0000,00-90-fa-6c-01-ae

  Partner Oper Key 0000

 Member ports on rbridge-id 1:

   Link: Te 1/0/1 (0x118008000) sync: 1   *< ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/1 (0x218008000) sync: 1     < ==

 

CASTOR-VCS20-12# show port-channel 102

 LACP Aggregator: Po 102 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0102 - Oper Key 0102

  Partner System ID - 0xffff,8c-7c-ff-10-84-02

  Partner Oper Key 0017

 Member ports on rbridge-id 1:

   Link: Te 1/0/2 (0x118010001) sync: 1   *< ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/2 (0x218010001) sync: 1     < ==

 

CASTOR-VCS20-12# show port-channel 103

 LACP Aggregator: Po 103 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0103 - Oper Key 0103

  Partner System ID - 0xffff,00-05-33-48-4c-12

  Partner Oper Key 0033

 Member ports on rbridge-id 1:

   Link: Te 1/0/3 (0x118018002) sync: 1     < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/3 (0x218018002) sync: 1   *< ==

 

CASTOR-VCS20-12# show port-channel 104

 LACP Aggregator: Po 104 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0104 - Oper Key 0104

  Partner System ID - 0xffff,00-00-c9-b1-e5-c2

  Partner Oper Key 0033

 Member ports on rbridge-id 1:

   Link: Te 1/0/4 (0x118020003) sync: 1     < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/4 (0x218020003) sync: 1   *< ==

< =========== >

 

1.2 Ethernet Storage – Advanced Functionality

 

1.2.1 Storage Device – Jumbo Frame/MTU Size Validation

 

Test Objective

  1. Perform I/O validation testing while incrementing MTU size from minimum to maximum with reasonable increments.
  2. Include Jumbo frame sizes as well as maximum negotiated/supported between device and switch.

 

Test Configuration

Step 1. Open the NetApp OnCommand System Manager and navigate to Configuration -> Network -> Network Interfaces. Then, highlight the desired network interface and click Edit. Click on the Advanced tab and change the entry for MTU Size (in bytes) to the desired value. Finally, click Save and Close.

 

NetApp 3170 MTU Configuration.jpg
   NetApp 3170 MTU Configuration

 

Step 2. For Red Hat hosts, add “MTU=9000” to /etc/sysconfig/network-scripts/ifcfg-bond0 and then execute service network restart.

 

< =========== >

[root@ilo65205 ~]# more /etc/sysconfig/network-scripts/ifcfg-bond0

DEVICE=bond0

IPADDR=9.79.100.21

NETMASK=255.255.0.0

ONBOOT=yes

BOOTPROTO=none

MTU=9000

USERCTL=no

NM_CONTROLLED=no

BONDING_OPTS="mode=802.3ad miimon=100 downdelay=5000 updelay=5000"

[root@ilo65205 ~]#

< =========== >

 

Step 3. For Windows 2012 Server host, reconfigure individual NIC team members for increased MTU size. Perform Disable and Enable on NIC Team interface within Windows to apply packet size change.

 

Windows 2012 Server Emulex NIC MTU Configuration.jpg
   Windows 2012 Server Emulex NIC MTU Configuration

 

Step 4. For Windows 2008 Server host, reconfigure NIC team interface.

 

Windows 2008 Server Brocade NIC MTU Configuration.jpg
   Windows 2008 Server Brocade NIC MTU Configuration

 

Step 5. On VDX devices, configure as follows:

 

< =========== >

<rbridge-id 1

 interface ve 979

ip mtu 9018

rbridge-id 2

 interface ve 979

  ip mtu 9018

rbridge-id 11

 interface ve 979

  ip mtu 9018

rbridge-id 12

 interface ve 979

  ip mtu 9018

interface TenGigabitEthernet 11/1/4

 mtu 9216

interface Port-Channel 21

 mtu 9216

interface Port-Channel 101

 mtu 9216

interface Port-Channel 102

 mtu 9216

interface Port-Channel 103

 mtu 9216

interface Port-Channel 104

 mtu

< =========== >

 

Results

  1. PASS. Non-fragmented ping packets were successfully responded to and all jumbo frame storage traffic was error-free.

< =========== >

PS C:\Users\Administrator> ping 9.79.20.1 -l 8972 -f

 

Pinging 9.79.20.1 with 8972 bytes of data&colon;

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.79.20.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

 

C:\Users\Administrator>ping 9.79.20.1 -l 8972 -f

 

Pinging 9.79.20.1 with 8972 bytes of data&colon;

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.20.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.79.20.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

 

[root@ilo65205 ~]# ping -c 4 -M do -s 8972 9.79.20.1

PING 9.79.20.1 (9.79.20.1) 8972(9000) bytes of data.

8980 bytes from 9.79.20.1: icmp_seq=1 ttl=255 time=0.161 ms

8980 bytes from 9.79.20.1: icmp_seq=2 ttl=255 time=0.160 ms

8980 bytes from 9.79.20.1: icmp_seq=3 ttl=255 time=0.166 ms

8980 bytes from 9.79.20.1: icmp_seq=4 ttl=255 time=0.160 ms

 

--- 9.79.20.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 2999ms < ==

rtt min/avg/max/mdev = 0.160/0.161/0.166/0.015 ms

 

[root@v-e-vmw066109 ~]# ping -c 4 -M do -s 8972 9.79.20.1

PING 9.79.20.1 (9.79.20.1) 8972(9000) bytes of data.

8980 bytes from 9.79.20.1: icmp_seq=1 ttl=255 time=0.730 ms

8980 bytes from 9.79.20.1: icmp_seq=2 ttl=255 time=0.224 ms

8980 bytes from 9.79.20.1: icmp_seq=3 ttl=255 time=0.225 ms

8980 bytes from 9.79.20.1: icmp_seq=4 ttl=255 time=0.232 ms

 

--- 9.79.20.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 3000ms < ==

rtt min/avg/max/mdev = 0.224/0.352/0.730/0.219 ms

< =========== >

 

NetApp 3170 Array-Medusa Jumbo Frame MTU Size Errors.jpg    NetApp 3170 Array-Medusa Jumbo Frame MTU Size Errors

 

< =========== >

CASTOR-VCS20-12# show interface port-channel 101

Port-channel 101 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6ca

    Current address is 0005.336b.a6ca

Interface index (ifindex) is 671088741

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:14

Queueing strategy: fifo

Receive Statistics:

    5523041 packets, 34803532143 bytes

    Unicasts: 5518149, Multicasts: 4810, Broadcasts: 82

    64-byte pkts: 714591, Over 64-byte pkts: 690914, Over 127-byte pkts: 42459

    Over 255-byte pkts: 1468, Over 511-byte pkts: 5830, Over 1023-byte pkts: 2474

    Over 1518-byte pkts(Jumbo): 4065305 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    6238372 packets, 25262286680 bytes

    Unicasts: 6235769, Multicasts: 1946, Broadcasts: 657

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 2.872640 Mbits/sec, 3491 packets/sec, 0.01% of line-rate

    Output 618.673012 Mbits/sec, 9358 packets/sec, 3.09% of line-rate

Time since last interface status change: 00:22:28

 

CASTOR-VCS20-12# show interface port-channel 102

Port-channel 102 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c8

    Current address is 0005.336b.a6c8

Interface index (ifindex) is 671088742

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:14

Queueing strategy: fifo

Receive Statistics:

    5474289 packets, 34801617484 bytes

    Unicasts: 5473859, Multicasts: 161, Broadcasts: 269

    64-byte pkts: 655992, Over 64-byte pkts: 734128, Over 127-byte pkts: 28470

    Over 255-byte pkts: 3536, Over 511-byte pkts: 8108, Over 1023-byte pkts: 1272

    Over 1518-byte pkts(Jumbo): 4042783 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    6328123 packets, 25934260554 bytes

    Unicasts: 6327476, Multicasts: 177, Broadcasts: 470

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 2.801824 Mbits/sec, 3379 packets/sec, 0.01% of line-rate

    Output 613.639264 Mbits/sec, 9283 packets/sec, 3.07% of line-rate

Time since last interface status change: 00:23:42

 

CASTOR-VCS20-12# show interface port-channel 103

Port-channel 103 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c7

    Current address is 0005.336b.a6c7

Interface index (ifindex) is 671088743

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:14

Queueing strategy: fifo

Receive Statistics:

    11401661 packets, 73071221978 bytes

    Unicasts: 11401532, Multicasts: 123, Broadcasts: 6

    64-byte pkts: 75, Over 64-byte pkts: 2251562, Over 127-byte pkts: 1033843

    Over 255-byte pkts: 5959, Over 511-byte pkts: 5145, Over 1023-byte pkts: 2576

    Over 1518-byte pkts(Jumbo): 8102501 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    14038276 packets, 69848610349 bytes

    Unicasts: 14037312, Multicasts: 213, Broadcasts: 751

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 945.266600 Mbits/sec, 13603 packets/sec, 4.73% of line-rate

    Output 6.082684 Mbits/sec, 9046 packets/sec, 0.03% of line-rate

Time since last interface status change: 00:29:33

 

CASTOR-VCS20-12# show interface port-channel 104

Port-channel 104 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c9

    Current address is 0005.336b.a6c9

Interface index (ifindex) is 671088744

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:15

Queueing strategy: fifo

Receive Statistics:

    11161421 packets, 63728202020 bytes

    Unicasts: 11157524, Multicasts: 3890, Broadcasts: 7

    64-byte pkts: 3844, Over 64-byte pkts: 3300848, Over 127-byte pkts: 781541

    Over 255-byte pkts: 9238, Over 511-byte pkts: 5880, Over 1023-byte pkts: 2104

    Over 1518-byte pkts(Jumbo): 7057966 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    11233391 packets, 52506438558 bytes

    Unicasts: 11232429, Multicasts: 218, Broadcasts: 744

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 826.500456 Mbits/sec, 12040 packets/sec, 4.13% of line-rate

    Output 6.240720 Mbits/sec, 8108 packets/sec, 0.03% of line-rate

Time since last interface status change: 00:30:15

 

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:15

Queueing strategy: fifo

Receive Statistics:

    37860349 packets, 173659550086 bytes

    Unicasts: 37851159, Multicasts: 9018, Broadcasts: 182

    64-byte pkts: 4341558, Over 64-byte pkts: 10638197, Over 127-byte pkts: 2055092

    Over 255-byte pkts: 22, Over 511-byte pkts: 1, Over 1023-byte pkts: 1

    Over 1518-byte pkts(Jumbo): 20825478 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    33570288 packets, 206550446466 bytes

    Unicasts: 33569582, Multicasts: 155, Broadcasts: 557

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 1258.197448 Mbits/sec, 35288 packets/sec, 12.58% of line-rate

    Output 1694.879580 Mbits/sec, 31493 packets/sec, 16.95% of line-rate

Time since last interface status change: 1d18h17m

< =========== >

 

1.2.2 NAS Bandwidth Validation

 

Test Objective

  1. Validate maximum sustained bandwidth to storage port via CIFS/NFS.
  2. After 15 minutes, verify I/O completes error-free.

Results

  1. PASS. All I/O completes error-free.
  2. PASS. All host and storage ports show bandwidth under maximum capacity.

< =========== >

CASTOR-VCS20-12# show interface port-channel 101

Port-channel 101 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c9

    Current address is 0005.336b.a6c9

Interface index (ifindex) is 671088741

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:21:12

Queueing strategy: fifo

Receive Statistics:

    36026612 packets, 53691133663 bytes

    Unicasts: 36019843, Multicasts: 6667, Broadcasts: 102

    64-byte pkts: 462245, Over 64-byte pkts: 235, Over 127-byte pkts: 21219

    Over 255-byte pkts: 42092, Over 511-byte pkts: 397688, Over 1023-byte pkts: 35103133

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    19775385 packets, 1336954677 bytes

    Unicasts: 19771758, Multicasts: 2700, Broadcasts: 927

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 352.092120 Mbits/sec, 29514 packets/sec, 1.76% of line-rate < ==

    Output 8.860276 Mbits/sec, 16379 packets/sec, 0.04% of line-rate

Time since last interface status change: 4d04h17m

 

CASTOR-VCS20-12# show interface port-channel 102

Port-channel 102 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c7

    Current address is 0005.336b.a6c7

Interface index (ifindex) is 671088742

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:21:12

Queueing strategy: fifo

Receive Statistics:

    40826443 packets, 60899431647 bytes

    Unicasts: 40825823, Multicasts: 231, Broadcasts: 389

    64-byte pkts: 369364, Over 64-byte pkts: 188, Over 127-byte pkts: 31273

    Over 255-byte pkts: 55743, Over 511-byte pkts: 691691, Over 1023-byte pkts: 39678184

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    22908416 packets, 1546650265 bytes

    Unicasts: 22907576, Multicasts: 207, Broadcasts: 633

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 406.643096 Mbits/sec, 34087 packets/sec, 2.03% of line-rate < ==

    Output 10.286732 Mbits/sec, 19049 packets/sec, 0.05% of line-rate

Time since last interface status change: 4d04h16m

 

CASTOR-VCS20-12# show interface port-channel 103

Port-channel 103 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6ca

    Current address is 0005.336b.a6ca

Interface index (ifindex) is 671088743

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:21:12

Queueing strategy: fifo

Receive Statistics:

    60178256 packets, 90869658294 bytes

    Unicasts: 60178079, Multicasts: 169, Broadcasts: 8

    64-byte pkts: 112, Over 64-byte pkts: 329476, Over 127-byte pkts: 106

    Over 255-byte pkts: 372, Over 511-byte pkts: 76, Over 1023-byte pkts: 59848114

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    31739947 packets, 2316992467 bytes

    Unicasts: 31738638, Multicasts: 296, Broadcasts: 1013

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 572.715840 Mbits/sec, 47386 packets/sec, 2.86% of line-rate < ==

    Output 14.607416 Mbits/sec, 25011 packets/sec, 0.07% of line-rate

Time since last interface status change: 21:31:03

 

CASTOR-VCS20-12# show interface port-channel 104

Port-channel 104 is up, line protocol is up

Hardware is AGGREGATE, address is 0005.336b.a6c8

    Current address is 0005.336b.a6c8

Interface index (ifindex) is 671088744

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:21:12

Queueing strategy: fifo

Receive Statistics:

    64299177 packets, 96947928318 bytes

    Unicasts: 64293910, Multicasts: 5259, Broadcasts: 8

    64-byte pkts: 5173, Over 64-byte pkts: 447383, Over 127-byte pkts: 172

    Over 255-byte pkts: 358, Over 511-byte pkts: 3, Over 1023-byte pkts: 63846088

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    33806039 packets, 2557964376 bytes

    Unicasts: 33804726, Multicasts: 299, Broadcasts: 1014

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 608.204080 Mbits/sec, 50406 packets/sec, 3.04% of line-rate< ==

    Output 16.064104 Mbits/sec, 26541 packets/sec, 0.08% of line-rate

Time since last interface status change: 21:16:11

 

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:21:13

Queueing strategy: fifo

Receive Statistics:

    108277398 packets, 7760480033 bytes

    Unicasts: 108264624, Multicasts: 12544, Broadcasts: 257

    64-byte pkts: 39360196, Over 64-byte pkts: 66191072, Over 127-byte pkts: 2726130

    Over 255-byte pkts: 5, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    201395029 packets, 302524235014 bytes

    Unicasts: 201394074, Multicasts: 194, Broadcasts: 764

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 46.579248 Mbits/sec, 81351 packets/sec, 0.47% of line-rate

    Output 1815.864704 Mbits/sec, 151103 packets/sec, 18.16% of line-rate < ==

Time since last interface status change: 1d02h03m

< =========== >

 

NetApp 3170 storage array is at maximum CPU capacity.

 

NetApp 3170 Array CPU Utilization.jpg 

   NetApp 3170 Array CPU Utilization

 

All Medusa I/O traffic completed without errors.

 

NetApp 3170 Array-Medusa IO Errors.jpg

   NetApp 3170 Array-Medusa IO Errors

 

1.2.3 Storage Device – w/Congested Fabric

 

Test Objective

  1. Create network bottleneck through a single Ethernet Fabric ISL.
  2. Configure VDX switch for AUTONAS.
  3. Configure multiple ‘NAS to host’ data streams sufficient to saturate ISLs’ available bandwidth for 30 minutes. 
  4. Verify file I/O completes error-free.
  5. Add L3 FCoE and L2 Ethernet traffic to fill available bandwidth.
  6. File I/O compares are disabled.

Test Configuration

Step 1. Configure NAS auto-QoS on VDX as follows:

 

<< =========== >

nas auto-qos

nas server-ip 9.79.20.1/32 vlan 979

< =========== >

 

Step 2. Because VDX6730 does not support NAS auto-QOS, move all host connections to CASTOR-VCS20-12.

 

VCS Fabric Ports for Host Port Connections.jpg 

   VCS Fabric Ports for Host Port Connections

 

Step 3. Add IXIA connections:

 

VCS Fabric Ports for IXIA Traffic Generator.jpg 

   VCS Fabric Ports for IXIA Traffic Generator

 

Step 4. Reconfigure VCS Fabric as follows:

 

< =========== >

interface TenGigabitEthernet 11/1/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 11/1/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 12/0/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 12/0/17

 no fabric isl enable

 no fabric trunk enable

 channel-group 201 mode active type standard

 no shutdown

!

interface TenGigabitEthernet 12/0/18

 no fabric isl enable

 no fabric trunk enable

 channel-group 201 mode active type standard

 no shutdown

!

interface Port-channel 201

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/19

 no fabric isl enable

 no fabric trunk enable

 channel-group 202 mode active type standard

 no shutdown

!

interface TenGigabitEthernet 12/0/20

 no fabric isl enable

 no fabric trunk enable

 channel-group 202 mode active type standard

 no shutdown

!

interface Port-channel 202

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/21

 no fabric isl enable

 no fabric trunk enable

 channel-group 203 mode active type standard

 no shutdown

!

interface TenGigabitEthernet 12/0/22

 no fabric isl enable

 no fabric trunk enable

 channel-group 203 mode active type standard

 no shutdown

!

interface Port-channel 203

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/23

 no fabric isl enable

 no fabric trunk enable

 channel-group 204 mode active type standard

 no shutdown

!

interface TenGigabitEthernet 12/0/24

 no fabric isl enable

 no fabric trunk enable

 channel-group 204 mode active type standard

 no shutdown

!

interface Port-channel 204

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/43

 shutdown

!

interface TenGigabitEthernet 12/0/44

 shutdown

!

interface TenGigabitEthernet 12/0/45

 shutdown

!

interface TenGigabitEthernet 12/0/46

 shutdown

!

interface TenGigabitEthernet 12/0/47

 shutdown

!

< =========== >

 

Results

1. PASS. NAS I/O completes error-free through bandwidth congestion.

 

NetApp 3170 Array-Medusa Congestions Errors.jpg 

   NetApp 3170 Array- Medusa Congestions Errors

 

< =========== >

CASTOR-VCS20-12# show fabric isl

 

Rbridge-id: 12   #ISLs: 1

 

 Src       Src           Nbr       Nbr  

Index   Interface       Index   Interface               Nbr-WWN           BW   Trunk  Nbr-Name

----------------------------------------------------------------------------------------------

51      Te 12/0/48       59     Te 11/1/48      10:00:00:27:F8:1C:71:48   10G   Yes   "M4-VCS20-11"< ==

 

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:31:51

Queueing strategy: fifo

Receive Statistics:

    1561771922 packets, 2169991852987 bytes

    Unicasts: 1561771283, Multicasts: 643, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 140518038, Over 127-byte pkts: 8927210

    Over 255-byte pkts: 9, Over 511-byte pkts: 2, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 1412326675

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 2661

Transmit Statistics:

    1532781190 packets, 2340524018646 bytes

    Unicasts: 1532779637, Multicasts: 1553, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 2457

Rate info (interval 299 seconds):

    Input 9101.324340 Mbits/sec, 819204 packets/sec, 91.01% of line-rate

    Output 9817.403120 Mbits/sec, 803639 packets/sec, 98.17% of line-rate< ==

Time since last interface status change: 02:28:40

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/48

Interface TenGigabitEthernet 12/0/48

              RX           RX                                     TX          TX

CoS      Packets     Bytes                   TC       Packets    Bytes

------------------------------------    -------------------------------------------------------

  0      706896572   1080137766288      0       205            20224< ==

  1      0                 0                           1       971            373592

  2      149598096   14795497407         2       0                0< ==

  3      706896434   1077310165416      3      628173        962362188064< ==

  4      0                 0                          4       0                 0

  5      0                 0                          5       27444952     422502537847

  6      0                 0                          6       631783122   970418287800 

  7      2689           3026175                7       2485            3027657

  untag  0              0                       untag     0                0

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/31

Interface TenGigabitEthernet 12/0/31

             R X                RX                                   TX            TX

CoS        Packets       Bytes                  TC         Packets    Bytes

  ------------------------------------    ------------------------------------------------------------

 0              0                 0                       0          0                0

 1              0                 0                       1         956             350145

 2              0                 0                       2          0                0

 3              0                 0                       3          0                0

 4              0                 0                       4          0                0

 5              0                 0                       5          383            43930

 6              0                 0                       6          706966114 1060448496816

 7              0                 0                       7          63              7623

 untag      706917551   1060376326500  untag   70696789   1060449471514< ==

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/32

Interface TenGigabitEthernet 12/0/32

              RX               RX                                  TX             TX

CoS        Packets       Bytes                     TC     Packets    Bytes

  ------------------------------------    --------------------------------------------------------------------

 0              0               0                           0          238        19040

 1              0               0                           1          956        350145

 2              0               0                           2            0          0

 3            706960159   1060439865140      3     707014311  1060521466500< ==

 4              0               0                           4     0                0

 5              0               0                           5     383             43930

 6              0               0                           6     489             59316

 7              0               0                           7     63              8379

 untag        63             6237                   untag 1891           461770

 

CASTOR-VCS20-12# show qos queue interface port-channel 201

Interface TenGigabitEthernet 12/0/17

             RX                       RX                             TX                  TX

CoS        Packets             Bytes              TC       Packets       Bytes

  ------------------------------------    -----------------------------------------------------------------

 0              0                    0                      0           0                 0

 1              0                    0                      1        1104            389387

 2              0                    0                      2           0                 0

 3              4851               310464             3           0                 0

 4              0                    0                      4           0                 0

 5              0                    0                      5         384             44044

 6              0                    0                      6         531             62004

 7              0                    0                      7         1968           252224

 untag       59971189       89677268783    untag   3987           747659< ==

 

Interface TenGigabitEthernet 12/0/18

            RX                RX                            TX                 TX

 CoS    Packets        Bytes          TC          Packets         Bytes

------------------------------------    -----------------------------------------------------------------

 0              0                 0             0              0                 0

 1              0                 0             1            646              303718

 2              0                 0             2              0                 0

 3           4851            310464       3              0                 0

 4              0                 0             4              0                 0

 5              0                 0             5          32964005        2227835958

 6              0                 0             6              1                64

 7              0                 0             7           1966              251963

untag         701            231992    untag     32966649        2228393777

 

CASTOR-VCS20-12# show qos queue interface port-channel 202

Interface TenGigabitEthernet 12/0/19

               RX                 RX                       TX                  TX

CoS        Packets         Bytes     TC          Packets          Bytes

  ------------------------------------    ----------------------------------------------------------------

 0              0                 0             0              0                 0

 1              0                 0             1            935            403738

 2              0                 0             2              0                 0

 3              0                 0             3              0                 0

 4              0                 0             4              0                 0

 5              0                 0             5          42230278      2847824621

 6              0                 0             6            521             61364

 7              0                 0             7            127             16571

untag         321            111395    untag     42231886      2848308074

 

Interface TenGigabitEthernet 12/0/20

           RX                  RX                                   TX                TX

CoS      Packets         Bytes                  TC        Packets        Bytes

  ------------------------------------    -------------------------------------------------------------------

0              0                 0                        0              0               0

1              0                 0                        1            417          136104

2              0                 0                        2              0               0

3              0                 0                        3              0               0

4              0                 0                        4              0               0

5              0                 0                        5              0               0

6              0                 0                        6              1              64

7              0                 0                        7            127           16571

untag     73621060      110128221731    untag       545          152739< ==

 

CASTOR-VCS20-12# show qos queue interface port-channel 203

Interface TenGigabitEthernet 12/0/21

                 RX               RX                              TX               TX

CoS       Packets          Bytes                TC      Packets      Bytes

  ------------------------------------    ---------------------------------------------------------------------

 0              0                 0                       0            0              0

 1              0                 0                       1         1070         364457

 2              0                 0                       2            0              0

 3              0                 0                       3            0              0

 4              0                 0                       4            0              0

 5              0                 0                       5          384          44044

 6              0                 0                       6          489          59316

 7              0                 0                       7          127          16576

untag     69359890     104853578604    untag     2070        484393< ==

 

Interface TenGigabitEthernet 12/0/22

               RX                RX                            TX               TX

CoS        Packets         Bytes        TC           Packets      Bytes

  ------------------------------------    ----------------------------------------------------------------

 0              0                 0              0              0                 0

 1              0                 0              1            190             35753

 2              0                 0              2              0                 0

 3              0                 0              3              0                 0

 4              0                 0              4              0                 0

 5              0                 0              5        36669264        2676434644

 6              0                 0              6              0                 0

 7              0                 0              7            127             16576

untag        138             20544      untag    36669627        2676490193

 

CASTOR-VCS20-12# show qos queue interface port-channel 204

Interface TenGigabitEthernet 12/0/23

               RX              RX                                  TX               TX

CoS        Packets       Bytes                   TC      Packets       Bytes

------------------------------------    ----------------------------------------------------------------------------

 0           3824            244736                  0              0            0

 1              0                 0                        1           1120         370549

 2              0                 0                        2              0            0

 3              0                 0                        3              0            0

 4              0                 0                        4              0            0

 5              0                 0                        5         37803177     2859594086

 6              0                 0                        6            489           59316

 7              0                 0                        7            127           16576

 untag     71593975      108104559474    untag    37804937    2860042343< ==

 

Interface TenGigabitEthernet 12/0/24

              RX                RX                    TX                    TX

CoS        Packets       Bytes     TC       Packets           Bytes

------------------------------------    --------------------------------------------------------------------------

 0           3825            244800      0              0                 0

 1              0                 0            1            144             32844

 2              0                 0            2              0                 0

 3              0                 0            3              0                 0

 4              0                 0            4              0                 0

 5              0                 0            5              0                 0

 6              0                 0            6              0                 0

 7              0                 0            7            127             16576

 untag          141           23948    untag        271             49420

< =========== >

 

1.2.4 Storage Device – NAS Protocol Jammer CRC Corruption on ISL Port

 

Test Objective

Perform CIFS/NFS jammer testing using CRC corruption with a burst of 10 CRC errors on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Test Configuration

Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Results

1. PASS. All I/O completes error-free through Ethernet jammer CRC corruption on ISL port.

 

CIFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:45

Queueing strategy: fifo

Receive Statistics:

    2000933 packets, 191284271 bytes

    Unicasts: 2000917, Multicasts: 6, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 1841528, Over 127-byte pkts: 159394

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 11

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 34

Transmit Statistics:

    3690579 packets, 5551131578 bytes

    Unicasts: 3690551, Multicasts: 28, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 31

Rate info (interval 299 seconds):

    Input 35.718744 Mbits/sec, 46698 packets/sec, 0.36% of line-rate

    Output 1036.923980 Mbits/sec, 86166 packets/sec, 10.37% of line-rate

Time since last interface status change: 00:27:09

< =========== >

 NetApp 3170 Array-Medusa CIFS Read Burst CRC Errors.jpg

   NetApp 3170 Array-Medusa CIFS Read Burst CRC Errors

 

NFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:35

Queueing strategy: fifo

Receive Statistics:

    3157420 packets, 318882560 bytes

    Unicasts: 3157393, Multicasts: 17, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 3026341, Over 127-byte pkts: 131072

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 8

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 22

Transmit Statistics:

    5983102 packets, 9197749491 bytes

    Unicasts: 5983071, Multicasts: 31, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 21

Rate info (interval 299 seconds):

    Input 74.265652 Mbits/sec, 91924 packets/sec, 0.74% of line-rate

    Output 2141.228472 Mbits/sec, 174151 packets/sec, 21.41% of line-rate

Time since last interface status change: 00:28:50

< =========== >

 

NetApp 3170 Array-Medusa NFS Read Burst CRC Errors.jpg

   NetApp 3170 Array-Medusa NFS Read Burst CRC Errors

 

CIFS, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media not present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:51

Queueing strategy: fifo

Receive Statistics:

    4241873 packets, 6380982742 bytes

    Unicasts: 4241854, Multicasts: 33, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 33441, Over 127-byte pkts: 186

    Over 255-byte pkts: 471, Over 511-byte pkts: 170941, Over 1023-byte pkts: 1477

    Over 1518-byte pkts(Jumbo): 4035357

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 45

Transmit Statistics:

    2300245 packets, 219913358 bytes

    Unicasts: 2300232, Multicasts: 19, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 45

Rate info (interval 299 seconds):

    Input 1121.453204 Mbits/sec, 93165 packets/sec, 11.21% of line-rate

    Output 38.633856 Mbits/sec, 50525 packets/sec, 0.39% of line-rate

Time since last interface status change: 00:30:48

< =========== >

 

NetApp 3170 Array-Medusa CIFS Write Burst CRC Errors.jpg

   NetApp 3170 Array-Medusa CIFS Write Burst CRC Errors

 

NFS, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media not present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:01:06

Queueing strategy: fifo

Receive Statistics:

    11185785 packets, 17197218010 bytes

    Unicasts: 11185763, Multicasts: 44, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 48643, Over 127-byte pkts: 1636

    Over 255-byte pkts: 7449, Over 511-byte pkts: 13663, Over 1023-byte pkts: 9946

    Over 1518-byte pkts(Jumbo): 11104448

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 53

Transmit Statistics:

    5902669 packets, 596154029 bytes

    Unicasts: 5902661, Multicasts: 10, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 53

Rate info (interval 299 seconds):

    Input 2151.042056 Mbits/sec, 174908 packets/sec, 21.51% of line-rate

    Output 74.562384 Mbits/sec, 92288 packets/sec, 0.75% of line-rate

Time since last interface status change: 00:33:40

< =========== >

 

NetApp 3170 Array-Medusa NFS Write Burst CRC Errors.jpg

   NetApp 3170 Array-Medusa NFS Write Burst CRC Errors

 

1.2.5 NAS Protocol Jammer Packet Corruption on ISL Port

 

Test Objective

Perform CIFS/NFS jammer testing using packet corruption with a burst of 10 packet errors on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Test Configuration

Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Results

1. PASS. All I/O completes error-free through Ethernet jammer packet corruption on ISL port.

 

CIFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:44

Queueing strategy: fifo

Receive Statistics:

    2016058 packets, 192728236 bytes

    Unicasts: 2016026, Multicasts: 21, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 1855440, Over 127-byte pkts: 160607

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 10

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 28

Transmit Statistics:

    3718039 packets, 5592799008 bytes

    Unicasts: 3718013, Multicasts: 26, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info (interval 299 seconds):

    Input 37.156732 Mbits/sec, 48592 packets/sec, 0.37% of line-rate

    Output 1077.749992 Mbits/sec, 89557 packets/sec, 10.78% of line-rate

Time since last interface status change: 00:38:03

< =========== >

 

NetApp 3170 Array-Medusa CIFS Read ISL CRC Errors.jpg

   NetApp 3170 Array-Medusa CIFS Read ISL CRC Errors

 

NFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:43

Queueing strategy: fifo

Receive Statistics:

    3739601 packets, 377680405 bytes

    Unicasts: 3739586, Multicasts: 5, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 3584389, Over 127-byte pkts: 155201

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 11

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 33

Transmit Statistics:

    7088175 packets, 10893205306 bytes

    Unicasts: 7088143, Multicasts: 32, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 29

Rate info (interval 299 seconds):

    Input 71.143912 Mbits/sec, 88060 packets/sec, 0.71% of line-rate

    Output 2051.337336 Mbits/sec, 166866 packets/sec, 20.51% of line-rate

Time since last interface status change: 00:39:4

< =========== >

 

NetApp 3170 Array-Medusa NFS Read ISL CRC Errors.jpg

   NetApp 3170 Array-Medusa NFS Read ISL CRC Errors

 

CIFS, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media not present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:40

Queueing strategy: fifo

Receive Statistics:

    3269565 packets, 4917663158 bytes

    Unicasts: 3269539, Multicasts: 39, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 26248, Over 127-byte pkts: 149

    Over 255-byte pkts: 313, Over 511-byte pkts: 131797, Over 1023-byte pkts: 1233

    Over 1518-byte pkts(Jumbo): 3109825

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 26

Transmit Statistics:

    1772854 packets, 169477620 bytes

    Unicasts: 1772832, Multicasts: 22, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 26

Rate info (interval 299 seconds):

    Input 977.447392 Mbits/sec, 81257 packets/sec, 9.77% of line-rate

    Output 33.706044 Mbits/sec, 44081 packets/sec, 0.34% of line-rate

Time since last interface status change: 00:41:19

< =========== >

 

NetApp 3170 Array-Medusa CIFS Write ISL CRC Errors.jpg

   NetApp 3170 Array-Medusa CIFS Write ISL CRC Errors

 

NFS, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media not present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:41

Queueing strategy: fifo

Receive Statistics:

    6908040 packets, 10619131471 bytes

    Unicasts: 6908009, Multicasts: 21, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 30530, Over 127-byte pkts: 1039

    Over 255-byte pkts: 4687, Over 511-byte pkts: 8996, Over 1023-byte pkts: 6391

    Over 1518-byte pkts(Jumbo): 6856397

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 28

Transmit Statistics:

    3645113 packets, 368138939 bytes

    Unicasts: 3645091, Multicasts: 21, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 28

Rate info (interval 299 seconds):

    Input 2142.096440 Mbits/sec, 174334 packets/sec, 21.42% of line-rate

    Output 74.290552 Mbits/sec, 91963 packets/sec, 0.74% of line-rate

Time since last interface status change: 00:43:00

< =========== >

 

NetApp 3170 Array-Medusa NFS Write ISL CRC Errors.jpg

   NetApp 3170 Array-Medusa NFS Write ISL CRC Errors

 

 

1.2.6 Storage Device – NAS Protocol Jammer Packet Loss on ISL Port

 

Test Objective

1.       Perform CIFS/NFS jammer testing using packet loss with a burst of 10 packet drops on ISL link, in each direction sequentially, while I/O is running from a single host.

  1.        Verify I/O recovers successfully.

Test Configuration

Step 1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

 

< =========== >

<interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Step 2. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

Results

1. PASS. All I/O completes error-free through Ethernet jammer packet loss on ISL port.

 

CIFS, PACKET DROP BURST ON READ TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Read ISL Packet Loss Errors.jpg

   NetApp 3170 Array-Medusa CIFS Read ISL Packet Loss Errors

 

NFS, PACKET DROP BURST ON READ TRAFFIC

 

NetApp 3170 Array-Medusa NFS Read ISL Packet Loss Errors.jpg

   NetApp 3170 Array-Medusa NFS Read ISL Packet Loss Errors

 

CIFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Write ISL Packet Loss Errors.jpg

   NetApp 3170 Array-Medusa CIFS Write ISL Packet Loss Errors

 

NFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa NFS Write ISL Packet Loss Errors.jpg

   NetApp 3170 Array-Medusa NFS Write ISL Packet Loss Errors

 

1.2.7 Storage Device – NAS Protocol Jammer CRC Corruption on Storage Port

 

Test Objective

  1. Perform CIFS/NFS jammer testing using CRC corruption with a burst of 10 CRC errors on storage port link, in each direction sequentially, while I/O is running from a single host.
  2. Verify I/O recovers successfully.

Results

1. PASS. All I/O completes error-free through Ethernet jammer packet corruption on storage port.

 

CIFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:46

Queueing strategy: fifo

Receive Statistics:

    2089350 packets, 141205037 bytes

    Unicasts: 2088896, Multicasts: 441, Broadcasts: 15

    64-byte pkts: 1923005, Over 64-byte pkts: 166340, Over 127-byte pkts: 5

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    3851870 packets, 5684788862 bytes

    Unicasts: 3851833, Multicasts: 3, Broadcasts: 34

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 27.155436 Mbits/sec, 50222 packets/sec, 0.27% of line-rate

    Output 1094.574872 Mbits/sec, 92677 packets/sec, 10.95% of line-rate

Time since last interface status change: 00:15:01

< =========== >

 

 

   NetApp 3170 Array-Medusa CIFS Read Storage Port CRS Error

 

NFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:41

Queueing strategy: fifo

Receive Statistics:

    3466732 packets, 253041831 bytes

    Unicasts: 3466347, Multicasts: 386, Broadcasts: 15

    64-byte pkts: 384, Over 64-byte pkts: 3322342, Over 127-byte pkts: 144001

    Over 255-byte pkts: 5, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    6582550 packets, 9923450901 bytes

    Unicasts: 6582478, Multicasts: 28, Broadcasts: 45

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 51.975760 Mbits/sec, 89010 packets/sec, 0.52% of line-rate

    Output 2038.766432 Mbits/sec, 169030 packets/sec, 20.39% of line-rate

Time since last interface status change: 00:17:33

< =========== >

 

NetApp 3170 Array-Medusa NFS Read Storage Port CRS Error.jpg

   NetApp 3170 Array-Medusa NFS Read Storage Port CRS Error

 

CIFS, CRC ERROR BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Write Storage Port CRS Error.jpg

   NetApp 3170 Array-Medusa CIFS Write Storage Port CRS Error

 

NFS, CRC ERROR BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa NFS Write Storage Port CRS Error.jpg

   NetApp 3170 Array-Medusa NFS Write Storage Port CRS Error

 

1.2.8 Storage Device – NAS Protocol Jammer Packet Corruption on Storage Port

 

Test Objective

  1. Perform CIFS/NFS jammer testing using packet corruption with a burst of 10 packet errors on storage port link, in each direction sequentially, while I/O is running from a single host.
  2. Verify I/O recovers successfully.

Results

PASS. All I/O completes error-free through Ethernet jammer packet corruption on storage port.

 

CIFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:40

Queueing strategy: fifo

Receive Statistics:

    1798021 packets, 121518658 bytes

    Unicasts: 1797644, Multicasts: 379, Broadcasts: 0

    64-byte pkts: 1654814, Over 64-byte pkts: 143204, Over 127-byte pkts: 4

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    3315606 packets, 4894393498 bytes

    Unicasts: 3315593, Multicasts: 10, Broadcasts: 26

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 24.259500 Mbits/sec, 44869 packets/sec, 0.24% of line-rate

    Output 976.879472 Mbits/sec, 82739 packets/sec, 9.77% of line-rate

Time since last interface status change: 00:45:43

< =========== >

 

NetApp 3170 Array-Medusa CIFS Read Storage Port Packet Error.jpg

   NetApp 3170 Array-Medusa CIFS Read Storage Port Packet Error

 

NFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/4

TenGigabitEthernet 11/1/4 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d1

    Current address is 0027.f81c.71d1

Pluggable media not present

Interface index (ifindex) is 47651618818

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:38

Queueing strategy: fifo

Receive Statistics:

    3256739 packets, 237701867 bytes

    Unicasts: 3256396, Multicasts: 363, Broadcasts: 1

    64-byte pkts: 361, Over 64-byte pkts: 3121264, Over 127-byte pkts: 135109

    Over 255-byte pkts: 5, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    6172473 packets, 9310408747 bytes

    Unicasts: 6172472, Multicasts: 17, Broadcasts: 29

    Underruns: 0

    Errors: 0, Discards: 0

Rate info (interval 299 seconds):

    Input 52.992736 Mbits/sec, 90760 packets/sec, 0.53% of line-rate

    Output 2075.179600 Mbits/sec, 172063 packets/sec, 20.75% of line-rate

Time since last interface status change: 00:47:07

< =========== >

 

NetApp 3170 Array-Medusa NFS Read Storage Port Packet Error.jpg

   NetApp 3170 Array-Medusa NFS Read Storage Port Packet Error

 

CIFS, PACKET ERROR BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Write Storage Port Packet Error.jpg

   NetApp 3170 Array-Medusa CIFS Write Storage Port Packet Error

 

NFS, PACKET ERROR BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa NFS Write Storage Port Packet Error.jpg

   NetApp 3170 Array-Medusa NFS Write Storage Port Packet Error

 

1.2.9 Storage Device – NAS Protocol Jammer Packet Loss on Storage Port

 

Test Objective

  1. Perform CIFS/NFS jammer testing using packet loss with a burst of 10 lost packets on ISL link, in each direction sequentially, while I/O is running from a single host.
  2. Verify I/O recovers successfully.

Results

1. PASS. All I/O completes error-free through Ethernet jammer packet loss on storage port.

 

CIFS, PACKET DROP BURST ON READ TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Read Storage Port Packet Loss.jpg

   NetApp 3170 Array-Medusa CIFS Read Storage Port Packet Loss

 

NFS, PACKET DROP BURST ON READ TRAFFIC

 

NetApp 3170 Array-Medusa NFS Read Storage Port Packet Loss.jpg

   NetApp 3170 Array-Medusa NFS Read Storage Port Packet Loss

 

CIFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa CIFS Write Storage Port Packet Loss.jpg

   NetApp 3170 Array-Medusa CIFS Write Storage Port Packet Loss

 

NFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NetApp 3170 Array-Medusa NFS Write Storage Port Packet Loss.jpg

   NetApp 3170 Array-Medusa NFS Write Storage Port Packet Loss

 

1.3 Stress and Error Recovery

 

1.3.1 Storage Device Fabric I/O Integrity – Congested Fabric

 

Test Objective

  1. Configure fabric and devices for maximum link and device saturation.
  2. Configure VDX switch for AUTONAS.
  3. Add L3 FCoE traffic (COS 3), CIFS/NFS traffic (COS 2) and L2 Ethernet traffic (COS 0) to fill all available bandwidth.
  4. From all initiators, start a mixture of READ/WRITE/VERIFY traffic with random data patterns continuously to all targets for 12 hours. 
  5. Verify no unexpected change in I/O throughput occurs.
  6. File I/O compares are enabled.

Test Configuration

See test configuration for test 1.2.3.

 

Results

1. PASS. All I/O completes error-free through VCS fabric congestion.

 

NetApp 3170 Array-Medusa VCS Fabric Congestion Errors.jpg

   NetApp 3170 Array-Medusa VCS Fabric Congestion Errors

 

< =========== >

CASTOR-VCS20-12# show fabric isl

 

Rbridge-id: 12   #ISLs: 1

 

Src   Src       Nbr   Nbr  

Index Interface Index Interface   Nbr-WWN                 BW  Trunk Nbr-Name

-----------------------------------------------------------------------------

51    Te 12/0/48   59 Te 11/1/48  10:00:00:27:F8:1C:71:48 10G  Yes "M4-VCS20-11" < ==

 

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2994

    Current address is 0005.3365.2994

Pluggable media not present

Interface index (ifindex) is 51943833647

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 16:20:38

Queueing strategy: fifo

Receive Statistics:

    49942439875 packets, 71351391755910 bytes

    Unicasts: 49942419793, Multicasts: 20085, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 3132204193, Over 127-byte pkts: 262824763

    Over 255-byte pkts: 64152997, Over 511-byte pkts: 50742939, Over 1023-byte pkts: 72167582

    Over 1518-byte pkts(Jumbo): 46360347415

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 102068

Transmit Statistics:

    48508059504 packets, 71579967131196 bytes

    Unicasts: 48508011093, Multicasts: 48411, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 96911

Rate info (interval 299 seconds):

    Input 9815.379908 Mbits/sec, 842263 packets/sec, 98.15% of line-rate

    Output 9795.928520 Mbits/sec, 837868 packets/sec, 97.96% of line-rate < ==

Time since last interface status change: 22:51:45

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/48

Interface TenGigabitEthernet 12/0/48

        RX                 RX                                       TX                  TX

CoS  Packets         Bytes                      TC        Packets          Bytes

------------------------------------    ----------------------------------------------------------------------------------------

 0     20420652249  31202751790102      0          6370                624608 < ==

 1            0               0                          1          30117              11700975

 2      9066855745   8975356587446       2              0                 0 < ==

 3      20454840355  31173176701020     3         20447930617    31326229705244 < ==

 4            0               0                          4              0                 0

 5            0               0                          5         7418780157     8936733841573

 6            0               0                          6         20641929770   31705986386073

 7       102068       122220490                7         96937              128909871

 untag        0               0                      untag         0                 0

 

CASTOR-VCS20-12# show qos queue interface port-channel 201

Interface TenGigabitEthernet 12/0/17

           RX                 RX                                      TX            TX

CoS    Packets          Bytes                    TC         Packets    Bytes

------------------------------------    ---------------------------------------------------------------------------------------

 0              0                 0                       0           4               256

 1              0                 0                       1           34080        11987116

 2              0                 0                       2            0               0

 3         149390           9560960               3            0               0

 4              0                 0                       4            0               0

 5              0                 0                       5           11914         1369184

 6              0                 0                       6           15778         1860905

 7              0                 0                       7           60586         7764813

 untag  629500245      851452829168    untag     122362        22982274 < ==

 

Interface TenGigabitEthernet 12/0/18

             RX                RX                                   TX                TX

CoS      Packets        Bytes                   TC        Packets        Bytes

------------------------------------    --------------------------------------------------------------------------------------

 0              0               0                          0              0               0

 1              0               0                          1          20759          9390656

 2              0               0                          2              0               0

 3            149390         9560960               3              0               0

 4              0               0                          4              0               0

 5              0               0                          5         1854186306   1826576888399

 6              0               0                          6              5              320

 7              0               0                          7          60587           7764941

 untag     702982254    951370949889    untag    1854267683  1826594046160 < ==

 

CASTOR-VCS20-12# show qos queue interface port-channel 202

Interface TenGigabitEthernet 12/0/19

               RX                 RX                         TX                 TX

CoS         Packets        Bytes     TC            Packets         Bytes

------------------------------------    --------------------------------------------------------------------------------------------

 0              0                 0             0              0                   0

 1              0                 0              1           28505             12279865

 2              0                 0              2              0                  0

 3              0                 0              3              0                  0

 4              0                 0              4              0                  0

 5              0                 0              5           2021987481     1961258586002

 6              0                 0              6           15471              1841257

 7              0                 0              7           3919                511437

 untag       9582           3402864    untag      2022035376     1961273218561

 

Interface TenGigabitEthernet 12/0/20

                RX                 RX                                      TX           TX

CoS          Packets         Bytes                   TC         Packets    Bytes

------------------------------------    -----------------------------------------------------------------------------------------

 0              0                   0                          0            0              0

 1              0                   0                          1            13650       4233388

 2              0                   0                          2             0              0

 3              0                   0                          3             0              0

 4              0                   0                          4             0              0

 5              0                   0                          5             0              0

 6              0                   0                          6             2            128

 7              0                   0                          7             3919        511437

 untag      1448549452    1939226793891    untag      17571       4744953 < ==

 

CASTOR-VCS20-12# show qos queue interface port-channel 203

Interface TenGigabitEthernet 12/0/21

                RX               RX                             TX                TX

CoS          Packets       Bytes                TC     Packets       Bytes

------------------------------------    -----------------------------------------------------------------------------------

 0              0                 0                       0           4                 256

 1              0                 0                        1        39983            12495015

 2              0                 0                        2           0                 0

 3              0                 0                        3           0                 0

 4              0                 0                        4           0                 0

 5              0                 0                        5        2407352932    2397582075752

 6              0                 0                        6        14904            1804969

 7              0                 0                        7         3919              511437

 untag   1998628570   2385449289678   untag   2407411961    2397597217163 < ==

 

Interface TenGigabitEthernet 12/0/22

                RX                 RX                          TX                  TX

CoS          Packets        Bytes     TC             Packets      Bytes

------------------------------------    ----------------------------------------------------------------------------------

 0              0                 0              0              0                 0

 1              0                 0              1              0                 0

 2              0                 0              2              0                 0

 3              0                 0              3              0                 0

 4              0                 0              4              0                 0

 5              0                 0              5              0                 0

 6              0                 0              6              0                 0

 7              0                 0              7             60587           7764941

 untag       1922            199888    untag         60587           7764941

 

CASTOR-VCS20-12# show qos queue interface port-channel 204

Interface TenGigabitEthernet 12/0/23

            RX                 RX                               TX                    TX

CoS     Packets          Bytes                 TC      Packets          Bytes

------------------------------------    ------------------------------------------------------------------------------------

 0         118417           7578688               0            0              0

 1              0                 0                       1        35116          11421934

 2              0                 0                       2            0              0

 3              0                 0                       3            0              0

 4              0                 0                       4            0              0

 5              0                 0                       5        2783592776  2536362792772

 6              0                 0                       6        14892           1804201

 7              0                 0                       7        3919             511437

 untag  2639292562  2542236636888    untag   2783646720  2536376531670 < ==

 

Interface TenGigabitEthernet 12/0/24

            RX                 RX                             TX                 TX

CoS      Packets         Bytes          TC          Packets       Bytes

------------------------------------    --------------------------------------------------------------------------------------

 0         118445           7580480      0              0                 0

 1              0                 0              1            4639            1024330

 2              0                 0              2              0                 0

 3              0                 0              3              0                 0

 4              0                 0              4              0                 0

 5              0                 0              5              0                 0

 6              0                 0              6              0                 0

 7              0                 0              7             3919            511437

 untag       4335            745622    untag         8558           1535767

< =========== >

 

1.3.2 Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

 

Test Objective

  1. Perform sequentially for each Storage Device and Adapter port.
  2. With I/O running, perform a quick port toggle every Storage Device and Adapter port. 
  3. Verify host I/O will recover.

Results

1. PASS. All I/O recovers through port disconnections and reconnections.

 

1.3.3 Storage Device Integrity – Device Recovery from ISL Port Relocation

 

Test Objective

  1. With I/O running, manually disconnect and reconnect ISL port to different port in same switch.
  2. Verify fabric integrity and file I/O recovery.
  3. Repeat test for all switch types.

Results

1. PASS. The VCS fabric reforms properly and all I/O recovers through ISL port disconnections and reconnections.

 

1.3.4 Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

 

Test Objective

  1. Sequentially toggle each Initiator and Target ports in fabric.  
  2. Verify host I/O will recover to alternate path and toggled path will recover.
  3. Run for 12 hours.

Results

  1. PASS. All I/O recovers through all initiator and target port disable and enables.

 

NetApp 3170 Array-Medusa Host and Storage Port OnOff Line Errors.jpg

   NetApp 3170 Array-Medusa Host and Storage Port On-Off Line Errors

 

1.3.5 Storage Device Recovery – ISL Port Toggle – Extended Run

 

Test Objective

  1. Verify fabric ISL path redundancy between hosts and storage devices.
  2. Sequentially toggle each ISL path on all switches.  Host I/O may pause but should recover. 
  3. Verify host I/O throughout test.
  4. Run for 12 hours.

Results

1. PASS. All I/O completes error-free through ISL port disable and enable commands.

 

 

   NetApp 3170 Array-Medusa ISL Port On-Off Line Errors

 

1.3.6 Storage Device Recovery – All-ISL Port Toggle

 

Test Objective

  1. Verify fabric switch path redundancy between hosts and storage devices.
  2. Sequentially, and for all switches, disable all ISLs on the switch under test. 
  3. Verify I/O pauses and resume after switch fabric convergence.

Results

1. PASS. All I/O completes error-free after ISL port disable and enable commands.

 

1.3.7 Storage Device Recovery – VDX8770 Line Card Maintenance

 

Test Objective

  1. For an extended time, execute the following procedure:
  2. Verify device connectivity to VDX 8770 blades.
  3. Sequentially power off and on each VDX 8770 line card.
  4. Verify host I/O will failover to alternate path and toggled path will recover.

Results

1. PASS. All I/O completes error-free through line card power off and on commands.

 

NetApp 3170 Array-Medusa VDX 8770 Line Card OnOff Errors.jpg

   NetApp 3170 Array-Medusa VDX 8770 Line Card On-Off Errors

 

1.3.8 Storage Device Recovery – Switch Offline

 

Test Objective

  1. Toggle each switch in sequential order.
  2. Mix of chassis disable, reboot, and power cycles.
  3. For switches containing device under test, I/O will pause and then resume after switch comes online.

Results

  1. PASS. Chassis Disable/Enable:I/O successfully resumes after chassis enable.
  2. PASS. Reboot: I/O successfully resumes after chassis reboot.
  3. PASS. Power Cycle: I/O successfully resumes after chassis power cycle.

 

1.3.9 Storage Device Recovery – Switch Firmware Download ISSU on VDX8770

 

Test Objective

  1. Sequentially perform firmware maintenance procedure on all VDX 8770 devices connected switches under test.
  2. Verify host I/O will continue (with minimal disruption) through firmware download.

Test Configuration

Step 1. Execute ‘firmware download’ from NOS4.1.2 to NOS4.1.2aa.

 

Results

1. PASS. All I/O completes error-free through firmware download command.

 

NetApp 3170 Array-Medusa VDX Switch Firmware Download Errors.jpg

   NetApp 3170 Array-Medusa VDX Switch Firmware Download Errors

 

1.3.10 Workload Simulation Test Suite – Microsoft Exchange Server

 

Test Objective

1. Validate Storage/Fabric behavior while running a Medusa Microsoft Exchange Server workload simulation test suite for 30 minutes.

  1. Verify file I/O completes error-free. File I/O compares are disabled.

Results

1. PASS. All I/O completes error-free.

 

NetApp 3170 Array-Medusa Microsoft Exchange Server Test Suite Errors.jpg

   NetApp 3170 Array-Medusa Microsoft Exchange Server Test Suite Errors

 

1.3.11 Workload Simulation Test Suite – File Server Simulation

 

Test Objective

  1. Validate Storage/Fabric behavior while running a Medusa File Server Simulation workload simulation test suite for 30 minutes.
  2. Verify file I/O completes error-free. File I/O compares are disabled.

Results

1. PASS. All I/O completes error-free.