1 / 33

EMC Disk Library 141 Tools and Troubleshooting

EMC Disk Library 141 Tools and Troubleshooting. IST Richard Murphy. COST. FUNCTIONALITY. Disk Library Family Platforms. CLARiiON CX3-80 UltraScale arrays 4 Gb/s end-to-end architecture Twice the performance of the DL700 Twice the scale of the DL700

arnav
Télécharger la présentation

EMC Disk Library 141 Tools and Troubleshooting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GIG Tech Summit EMC Disk Library 141 Tools and Troubleshooting IST Richard Murphy

  2. COST FUNCTIONALITY GIG Tech Summit Disk Library Family Platforms • CLARiiON CX3-80 UltraScale arrays • 4 Gb/s end-to-end architecture • Twice the performance of the DL700 • Twice the scale of the DL700 • Up to 83% better performance than previous models DL4400 • Two engines x two CLARiiON CX3-80s • Two new Intel servers • 24 4 GB ports • 12 Gigabit EthernetFibre Channel ports • Up to 340 TB useable • Up to 930 drives • 2,200 MB/s DL4200 • Two engines x one CLARiiON CX3-80 • Two new Intel servers • 24 4 GB ports • 12 Gigabit EthernetFibre Channel ports • Up to 170 TB useable • Up to 465 drives • 1,200 MB/s DL4100 • One engine x one CLARiiON CX3-80 • One new Intel server • 12 4 GB Fibre Channel ports • 6 Gigabit Ethernetports • Up to 170 TB useable • Up to 465 drives • 1,100 MB/s DL210 • Eight Fibre Channel ports • 24 TB • 380 MB/s

  3. GIG Tech Summit

  4. COST FUNCTIONALITY GIG Tech Summit EMC’s Disk Library Family Platform CLARiiON DL740 • Two engines x one CLARiiON CX700 • Twelve Fibre Channel ports • Up to 116 TB usable • 1,160 MB/s CLARiiON DL720 • Two engines x one CLARiiON CX700 • Eight Fibre Channel ports • Up to 58 TB usable • 700 MB/s CLARiiON DL710 CLARiiON DL210 • One engine x one CLARiiON CX700 • Eight Fibre Channel ports • Up to 58 TB usable • 450 MB/s • Eight Fibre Channel ports • 24 TB • 380 MB/s Entry-levelDisk Library

  5. GIG Tech Summit

  6. GIG Tech Summit CDL to CDL Connections Host Ports Library Ports Host Ports Library Ports <- to SAN <- to SAN

  7. GIG Tech Summit CDL connected via Fibre to second CDL Direct Connect OR Local SAN OR Distance SAN Distance SAN DWDM

  8. GIG Tech Summit Intel Server port layout 2x1 1x1 2x2

  9. GIG Tech Summit Old CPG Picture

  10. GIG Tech Summit Before you begin the initialization process, gather the following information: NOTE: The hardware serial number is located on a label on the front of the storage system behind the bezel, as shown below.

  11. GIG Tech Summit For DL4400 arrays, gather the following information from the second CLARiiON:

  12. GIG Tech Summit Run the Storage System Initialization Utility on the management host Start > Programs > EMC > Navisphere > NavisphereStorageSystemInitialization Select the storage system to initialize by selecting the storage-system’s serial number from the Uninitialized Systems list. Click Next.

  13. GIG Tech Summit Enter the name you want for the storage system, which cannot exceed 32 characters. Possible Gotchas IMPORTANT: Verify that you enter the username and password exactly as specified below. Otherwise, the storage system will not function correctly.Username: cdlsupportPassword: wabisabi Note: This is for a DL4000 series

  14. GIG Tech Summit Set up active engine failover in DL4200/DL4400 systems Verify the prerequisites for setting up the failover configuration have been met: You must have two Disk Library servers. The two servers, server A and server B should have access to the same CLARiiON storage system(s). Both servers (server A and server B) must reside on the same network segment. This network segment must have at least one other device that responds to a network ping (such as a router, switch, or server). This allows server B to detect the network in the event of a server A failure. For each server, the customer needs to reserve two additional IP addresses for bond0(service IP):The virtual IP address, which is the primary IP for Disk Library Console management and remote copy. This IP moves to the partner DL server when a failover occurs.The service IP address, used to connect to the DL server for service purposes in case of a server failure. This IP is also the secondary heartbeat when the preferred eth0 heartbeat is down. This IP address does not switch over to the partner DL server when failover occurs. The service IP should be on the same subnet as the Virtual IP and is a public address. The health of the DL servers is monitored using eth0 (using a crossover cable). When this predefined IP, which is the preferred heartbeat IP, is down, the service IP is used as the heartbeat IP.

  15. GIG Tech Summit In the FailoverSetupWizard that opens, locate the Enterthe IP Addresses on the Servers screen, the IP addresses of the two servers to be configured for failover appear in the following fields:IP Address for the server:server AIP Address for the server:server BThese IP addresses are the primary IPs for Disk Library Console management and remote copy. The IP address of the failed server moves to the partner server when a failover occurs. In the Enter Service IP Addresses of the servers screen, enter the service IP addresses of both the servers and click Next.You can use these IP addresses to service the servers when there is a failure. The two servers use these IP addresses for server health monitoring. A service IP address will continue to be owned by a server even after its failure.

  16. GIG Tech Summit New tab and server icon for a CLARiiON fault

  17. GIG Tech Summit CLARiiON Health Check continued • Reports faults and write cache disabled • Adds new CLARiiON fault tab for server • Red “!” on CDL server • When condition is fixed, tab and red “!” go away

  18. GIG Tech Summit Interoperability • Remote copy between CDL 1.2 and 2.0 • Not supported due to change in tape format (needed for tape expansion bug) • CDL 2.0 console able to manage 1.2 systems • New features in 2.0 hidden/greyed out • No SPCollect in X-Ray for 1.2 systems • NEI servers do not have a factory image for 2.0. This means that the server must be running 1.2 and then can be upgraded to 2.0 then to 2.1, etc. • The CDL console is backward compatible for one revision only. • 3.0 Console is NOT backward compatible with CDL2.2

  19. GIG Tech Summit Upgrades • NEI (software only) – unsupported 2.0 features: • Write coalescing • Active/active • No performance gain for backend libraries (No additional FC ports) • NEI to Dell and v2.0 (new LUN scheme only) • DL300 to DL310 • DL700 to DL710 • DL700 to DL720 • DL700 to DL740 • Virtual Library and Tape Rebalancing

  20. GIG Tech Summit CDL Gotchas • Three IP addresses are needed for 1.x systems. Up to 8 IP addresses are needed for 2.x systems • Make sure multiple cabinets are interconnected as shipped from Manufacturing • Use the CDL console UI to make the CDL server IP address change persistent • The CDL should be managed by only one console session at a time. • The CDL console is normally backwards compatible for one revision level only. Version 2.0 will support both 1.1 and 1.2 server versions. • Don’t make changes to the CLARiiON layout • Two methods to shut down the CDL server are to use “halt” from the CDL console or use the “shutdown” command from the Linux CLI. • Com port settings are 19.2k,8,n,1.

  21. GIG Tech Summit Gotchas continued • HBA LEDS turn from amber to green only after the driver is loaded and a Fibre connection is available. • Get spcollects from each SP and an X-ray from the CDL console UI to keep as a baseline reference • Make sure no standby server is powered up at the same time the primary server is running. • Read and understand all upgrade instructions before starting any upgrades • Don’t upgrade Flare with a general Flare release unless the CDL is specifically mentioned in the upgrade. • Shut Down Disk Library Server Before Performing NDU

  22. GIG Tech Summit Gotchas continued • Location of messages file on CDL server: /var/log/messages • Fibre HBA port 5 is reserved for a physical tape library on NEI by default. This is a flex port that can be changed to a target port as well from the GUI in version 1.2 or greater. • The CDL server will not boot or function if SPA has failed on any 1x1 or 2x2 system. SPA or SPB failures on a 2x1 (DL720) will result in one of the two servers not booting. • Com port settings are 19.2k,8,n,1. • The Add-A-Shelf script must be run from the /opt/tools directory. • Add-A-Shelf script is included with 1.1 and above

  23. GIG Tech Summit Gotchas continued • DL720 systems share a CLARiiON, therefore the CLARiiON is split between the two DL hosts. By default one host does not have the total capacity of the CLARiiON. However, via RPQ customers have done this in order to basically make the DL720 a DL710 with a hot standby server. The disadvantage to this is that the full throughput of the server is not available, as both servers are not in use simultaneously

  24. GIG Tech Summit How do you troubleshoot a CDL? CDL Server Backup server • The first step in troubleshooting is to understand how the product is configured. CLARiiON Physical Tape Library CDL Console CDL

  25. GIG Tech Summit Troubleshooting continued • When troubleshooting from a backup host perspective, the first and foremost thing to remember is that the CDL is a tape array as far as the backup host is concerned. • Any problems that are seen will be reported as if a physical tape library is being used. • The backup host will NEVER see the CLARiiON. If problems are suspected with the CDL CLARiiON, standard CLARiiON array troubleshooting methods are used in troubleshooting it.

  26. GIG Tech Summit Troubleshooting continued • There are many standard troubleshooting tools available. i.e. ping, telnet, etc. • The CDL server will support a directly connected keyboard and display if needed. • Use the built in ismon fcmon and tlecli tools from the CDL server. See emc97427. • Several tools can be used from the /opt/tools directory • Fclar – gives the SP IP addresses, CLARiiON S/n and CLARiiON type (to execute: ./fclar) • Pathoptimizer – Can be used to optimize paths. Note: requires that the disk library be stopped and started in order for the new settings to take effect. (to execute: pathoptimizer /usr/local/disklibrary/etc/CDLHOSTNAME/ipstor.conf)

  27. GIG Tech Summit Troubleshooting continued • Navisphere CLI commands can be issued from the /opt/Navisphere/bin directory. (version 1.1 and above) • Keep in mind that the CDL CLARiiON is directly connected to the CDL server, so no storage groups are used. Except where FCO is installed • Tape per LUN assignment can be determined from the “ipstor.conf” X-ray file. • The CDL CLARiiON S/N is available in the “ipstorpartinfo” X-Ray file. • CDL server information i.e. processes, summary, etc can be found in the “info” X-Ray file.

  28. GIG Tech Summit How to take an XRAY • Console • Right click on array and select xray • Will be stored on the CDL Console host system the X-Ray was executed from. Located in the “My Documents” folder of the Username that was used to execute the X-Ray. • From Linux Server • ipstorxray <xrayname> • You will find the xray in: /usr/local/disklibrary/var/xray/<xrayname>.tar.gz

  29. GIG Tech Summit XRAY Options (Version 2.0 display)

  30. GIG Tech Summit CDL Analysis Tool CAT (v1.0) CLARiiON Disk Library is an EMC backup-to-disk device and used by veritas netbackup/legato networker. EMC CDL family comprises of DL 300, 310, 700, 710 and DL 720,740. DL 720 and 740 has two DL Server and support fail-over but rest of CDLs do not provide fail over. CDL constantly logs its performance details. The log is called X-ray which is a zip file. When Customer encounters some problem, we get the CDL X-ray from the customer, analyze the logs to figure out the cause of the problem and provide a solution. The CDL analysis Tool extracts the relevant info from the X-ray and display in user-friendly way in the XML file. So with a single click, the service engineers can get the health report of the device in a web layout, which enables them to figure out the problem quickly and provide a solution.

  31. GIG Tech Summit

  32. GIG Tech Summit Helpful URL’s • CDL Engineering Support Page • http://clariipub.corp.emc.com/casi/cdl/ • Clariis • http://clariis2000/ or 168.159.15.64 • http://www.context.cx/

More Related