1 / 41

EMC ControlCenter 6.1 Control Center Architecture Citigroup North America

EMC ControlCenter 6.1 Control Center Architecture Citigroup North America. Date: 1/22/10 Version: 5.0 Author: John Maloney Reviewer: Jim Stringer. Architectural Factors. Architectural Factors. Current 2009. Growth/Change (12-mos., 12%). Hosts Physical Hosts = + 1,188 = 8,526

aerona
Télécharger la présentation

EMC ControlCenter 6.1 Control Center Architecture Citigroup North America

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EMC ControlCenter 6.1 Control Center Architecture Citigroup North America Date: 1/22/10 Version: 5.0 Author: John Maloney Reviewer: Jim Stringer

  2. Architectural Factors

  3. Architectural Factors Current 2009 Growth/Change (12-mos., 12%) Hosts Physical Hosts = +1,188 = 8,526 VMware ESX = +500 Virtual Machines = +??? Databases Oracle = +4 = 91 SYBASE = +6 = 395 SQL Server = +6 = 96 SAN Ports = 30,927 Switches = 262 • Hosts • Physical hosts = 7,338 • VMware • ESX = 0 • Virtual Machines = 0 • Databases • Oracle = 91 • SYBASE = 389 • SQL Server = 90 • SAN • Not Discovered

  4. Architectural Factors Current 2009 Growth/Change (12-mos., 12%) Symmetrix = +16 = 139 Devices added = 35,523 Symmetrix removed = -0 Devices removed = -0 CLARiiON = +38 = 173 Disks added = 2,277 HDS = +5 = 36 Centera = +16 = 18 Celerra = +46 = 46 Total Arrays = 412 2010 Array Total = 130 • Arrays Symmetrix = 114 • Devices = 254,651 CLARiiON = 135 • Disks = 9,963 HDS = 31 Centera = 2 Celerra = 0 • DataMovers = 2 to 4 /per • Total Arrays = 282

  5. Design Expectations

  6. Design Expectations – based on a per Datacenter • Hosts • Maximum Host Agents = 2,500 • Host Containers do not count as Managed Hosts • Virtual Machines discovered through ESX server discovery do not count as Managed Hosts unless a Master and Host Agent is installed • ControlCenter will be running from SAN storage • Recommended to be Mirrored RAID1 for best performance • RAID5 SAN Storage is supported

  7. Design Expectations • SAN Discovery Only • Monitoring only • Monitored through McData (Brocade) SMI provider Agent for EOS products 2.7 or later • New requirement for ControlCenter 6.1 • Core-Edge with 100% Locality • Locality provides isolation and independence • Fabrics can not exceed McData (Brocade) scalability limits • Maximum Switches per fabric = 18 • Maximum Zones per fabric = 1456 • FC Ports in Switches = 1952 • WWN Zone Members = 1002

  8. Design Expectations • Symmetrix Management • Each Symmetrix will need 6 Gatekeepers provisioned to each managing agent server • 6 Gatekeepers for ControlCenter Agent – dedicated and not multipathed • Minimum version of Solutions Enabler – 7.1.0.0 • Recommend 7.1.0.0 or higher • Symmetrix Management will use latest Control Center Solutions Enabler Media Repository Load Kit version.

  9. Design Expectations CLARiiON Management • CLARiiON Arrays managed by specific CLARiiON Agents NAS (Celerra) • Celerra Arrays managed by specific NAS Agents Centera • Centera Arrays will be managed by specific Centera Agents VMware • ESX servers will be managed by specific VMWARE agents Databases • SYBASE, Oracle and SQL Server databases will be discovered. • WLA for databases will not be implemented. Fibre Channel Connectivity • All switches, fabrics, zones and members managed by all FCC agents. • Managed objects managed with auto load balancing.

  10. Design Expectations - Performance Data Collection • Performance information (WLA) can be captured for • Limited set of SAN components. • All Arrays • Specific Hosts for diagnostics • WLA Daily Daily @ 15-minute intervals • All Symmetrix • Up to 1,024 SAN Ports for limited period of time using 15-minute intervals WLA Daily DCP. • For problem investigation/resolution only • Performance Statistics monitor up to 10 switches at a time

  11. Design Expectations • Performance Data Collection • No Revolving (no longer needed) • Analyst for problem resolution @ 2-minute interval for specific managed objects. • Run for 2 to 4 hour periods • Performance degradation ControlCenter will be experienced during this period • System level backups must to be outside of Discovery, Hot Backup and StorageScope nightly ETL processing time periods. • StorageScope nightly ETL process could run for a max of 4.0 hours. • This should not be run during business hours

  12. Design Expectations Changes to be made to ControlCenter Configuration • JAVA Console memory increased to 1024 • IT Operational Expectations needed: • JAVA Updates need to be disabled and frozen at the version installed by EMC on the ControlCenter servers • WINS not configured on any ControlCenter Server • Data Execution Prevention set to essential Windows file only • Page File set to 1.5 times physical memory installed in server • Larger disk capacity for some Virtual Servers

  13. Server Requirements

  14. Server Requirements • ControlCenter Server & Repository • Minimum of SPEC CINT2000 Rate (baseline) = 123 or SPEC CINT2006 Rate (baseline) = 61 - (Required) or higher SPEC # • Physical Servers only • Store(s) • Virtual Machines • 2 vCPU • 2 gbvMemory • StorageScope Server & DSS Repository • Virtual Machines • 2 vCPU • 2 gbvMemory • WLA Archiver • Virtual Machines • 2 vCPU • 2 gb vMemory

  15. Server Requirements • Multi-Agent Shared Servers for TCP/IP based Agents • Virtual Machines • 2 vCPU • 2 gbvMemory • Symmetrix Agent Dedicated Servers without SMC • Physical Server - Windows • 2x 2.66 GHz Dual-Core • 4 gb Memory (min) • Physical Server - Solaris • 2x 1.5 GHz processors (SunFire v240) • 4 gb Memory (min) • Solaris 10

  16. Server Requirements • Console Servers • Terminal Services (Application Server Mode) • Needs to be locked to 2 sessions maximum • Physical Server • 2.66 GHz Dual-Core or higher • 4 gb Memory (min) • Each server will have these components installed • Console with JAVA Heap set to 1024 • Performance Manager GUI Client • Will only support 2 Java consoles or 1 Java console and 1 Performance Manger console

  17. Server Setup Requirements • Operating System • Windows 2003 Enterprise, 64-bit recommended • 64-bit x86 multi-core processor for Physical machines recommended • 2vCPU for Virtual machines recommended • 4 GB physical Memory on Physical Server • 2 GB vMemory on Virtual Machines • Page File set to 1.5 times Physical memory, not split • Data Execution Prevention set to essential Windows file only • No WINS • For Multi-NIC, on the primary NIC registers with DNS • Primary NIC is set to first in Binding Order • Do not use /3GB switch in boot.ini • ECCADMIN local user account can be disabled after installation, but not deleted

  18. Break Down by Site

  19. Summary of changes to existing 6.0 architecture • Server footprint is increasing due to CLARiiON WLA, Database Proxy to support Sybase on AIX and Sybase 15 • x additional agents to support Sybase 15 via proxy • Implementation of Dedicated Database Proxy Agents for current ControlCenter 6.1 and n-1 versions (Phase II) • This architecture is based on currently available information with the following growth over 12-months of MO count. • 390/111 0% • Rutherford 0% • Silver Springs 0% • Georgetown 100% • Roanoke 30% • Columbus 50% • Tampa 0% • Information waiting from Citigroup: • SAN Fabric Logical Configuration • VMAX Support • Addition of NAS (Celera) Monitoring and Reporting • Implementation of Performance Manager for Symmetrix only • 1 Dedicated VM per Infrastructure • Implementation of SAN Discovery and Reporting • Implementation of EMC Engineering Recommended Distributed Store Split • 1 Dedicated VM per Infrastructure • Implementation of Agent Architecture based on Control Center 6.1 Performance and Scalability Guidelines • 1 additional Stores • 4 additional Symmetrix/SDM agents • 6 additional CLARiiON Agents • Implementation of decoupling Storage Agents from Solutions enabler • 6 additional VM for DB Proxy discover for CC 6.0 agents

  20. Design Comparison – Current to Proposed – Phase 1 Current Environment Proposed Environment Total Servers = 94 36 Physical Servers 58 Virtual Servers 7 Physical CC Server / Repository 17 Stores on VM 6 WLA on VM and 1 on Physical Server 6 StorageScope Server on VM and 1 on Physical Server 19 FC-connected Dedicated Physical Agent Servers 26 IP-based Shared VM Agent Servers 3 IP-based Physical Shared Agent Servers Console and Performance Manager GUI Servers 7 Physical Servers • Total Servers = 64 • 32 Physical Servers • 32 Virtual Servers • 7 Physical CC Server/Repository • 10 Stores on VM • 0 WLA on VM and 0 on Physical Server • 6 StorageScope Server on VM and 1on Physical Server • 15 FC-connected Dedicated Physical Agent Servers • 16 IP-based Shared VM Agent Servers • 4 IP-based Physical Shared Agent Servers • Console • 8 Physical Servers

  21. ControlCenter 6.1 UB7 Agent Scalability Guidelines

  22. Managed Objects – 2009 Actual

  23. Managed Objects – 2010 Growth

  24. Managed Objects - Added with Control Center 6.1

  25. Managed Objects – 2010 Forecast

  26. 17 ECC hosts Increase of +5 Hosts 13 ECC hosts Increase of +4 Hosts ECC 6.1 UB7 Production Deployment at Citigroup 390 Silver Spring GTDC 14 ECC hosts Increase of +6 Hosts 6ECC hosts Increase of +2 Hosts Tampa 15 ECC hosts Increase of +4 Hosts Rutherford 14 ECC hosts Increase of +5 Hosts 15 ECC hosts Increase of +4 Hosts SWDC MWDC 94 Hosts 36 Physical 58 Virtual

  27. Phase I ECC Deployment Large Configuration Virtual 390 : Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository Store #1 ECC Server Repository SPECint_rate_base2006 82.6 • 2010 Managed Objects • Host Device Logical • Paths 61,493 • Arrays 53 • Symmetrix 32 • VMAX 2 • CLARiiON 15 • HDS 4 • Switches 52/6360 • ESX (SAN) 75 Max • Databases 246 • Sybase 213 • Oracle 20 • SQL Server 13 DSS: StorageScope/DSS ST03: Store #1 ST04: Store #2 ST05: Store #3 • CurrentManaged Objects • Host Device Logical • Paths 61,493 • Arrays 48 • Switches 0 • Symmetrix 32 • VMAX 0 • CLARiiON 12 • HDS 4 • ESX 0 • Databases 246 • Sybase 213 • Oracle 20 • SQL Server 13 2 vCPU 2 GB vMemory DSS: StorageScope/DSS ST04: Store #2 ST05: Store #3 AG01: HDS, Oracle AG02: CLARiiON, CMA AG03:No Agents Installed AG01: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG02: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG03: CMA (DB), Oracle, FCC, SMI Agent Provider AG04: CMA (DB) (6.0), Oracle (6.0) AG05: WLA 2 vCPU 2 GB vMemory Symmetrix Agent #1 Symmetrix Agent #2 Symmetrix Agent #1 Symmetrix Agent #2 Symmetrix Agent #5 ** Symmetrix Agent #3 Symmetrix Agent #4 (111 Wall St.) Symmetrix Agent #3 Symmetrix Agent #4 (111 Wall St.) Symmetrix Agent #6 ** (111 Wall St.) ** New VMAX Mgmt and Windows OS Console Console & Performance, Manager GUI Total Servers: 12 Total Servers: 17

  28. Architectural Factors (390/111) • As Sybase 15 is discovered, the discovery will be via proxy. • This will require an increase of CMA proxy agent to 6.

  29. RUT : Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Phase I ECC Deployment Large Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository Store #1 ECC Server Repository SPECint_rate_base2006 82.6 • 12 Month Forecast • Managed Objects • Host Device Logical • Paths 41,833 • Arrays 57 • Symmetrix 28 • VMAX 0 • CLARiiON 26 • HDS 3 • Switches 47/5228 • ESX (SAN) 75 Max • Databases 166 • Sybase 133 • Oracle 12 • SQL Server 21 DSS: StorageScope/DSS ST03: Store #1 ST04: Store #2 ST05: Store #3 2 vCPU 2 GB vMemory DSS: StorageScope/DS ST04: Store #2 ST05: Store #3 • Current • Managed Objects • Host Device Logical • Paths 41,833 • Arrays 57 • Symmetrix 28 • VMAX 0 • CLARiiON 26 • HDS 3 • Switches 0 • ESX 0 • Databases 166 • Sybase 133 • Oracle 12 • SQL Server 21 AG01 CLARiiON, HDS, Oracle AG02: CLARiiON, Mapping AG03: CLARiiON AG01: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG02: CLARiiON, FCC, SMI Agent Provider, VMWARE AG03: CLARiiON, FCC, SMI Agent Provider AG04: CMA (DB), Oracle, Centera AG05: CMA (DB) (6.0), Oracle (6.0) AG06: WLA 2 vCPU 2 GB vMemory Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent Console Console & Performance Manager GUI Total Servers: 11 Total Servers: 15

  30. Architectural Factors (Rutherford) • As Sybase 15 is discovered, the discovery will be via proxy. • This will require an increase of CMA proxy agent to 4.

  31. SS: Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Phase I ECC Deployment Large Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository Store #1, Centerra ECC Server Repository SPECint_rate_base2006 82.6 DSS: StorageScope/DSS ST04: Store #2 ST05: Store #3 DSS: StorageScope/DSS ST03: Store #1 ST04: Store #2 ST05: Store #3 • Current • Managed Objects • Host Device Logical • Paths 41,833 • Arrays 33 • Symmetrix 14 • CLARiiON 9 • HDS 10 • Switches 0 • ESX 0 • Databases 53 • Sybase 12 • Oracle 9 • SQL Server 32 • 12 Month Forecast • Managed Objects • Host Device Logical • Paths 67,346 • Arrays 37 • Symmetrix 14 • CLARiiON 9 • HDS 10 • Switches 64/8028 • ESX (SAN) 75 Max • Databases 59 • Sybase 12 • Oracle 9 • SQL Server 32 2 vCPU 2 GB vMemory AG01: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG02: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG03: CMA (DB), Oracle, FCC, SMI Agent Provider AG04: CMA (DB) (6.0), Oracle (6.0) AG05: WLA AG01: CLARiiON, Oracle AG02: HDS, CMA 2 vCPU 2 GB vMemory Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent Console & Performance Manager GUI Console CMA, Oracle Total Servers: 9 Total Servers: 13

  32. Architectural Factors (Silver Spring) • As Sybase 15 is discovered, the discovery will be via proxy. • This will require an increase of CMA proxy agent to 2.

  33. GTDC: Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Phase I ECC Deployment Medium Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository SPECint_rate_base2006 ??? ECC Server Repository Store #1 • 12 Month Forecast • Managed Objects • Host Device Logical • Paths 20,934 • Arrays 78 • Symmetrix 8 • VMAX 0 • CLARiiON 22 • NAS(Celerra) 46 • Switches 16/2100 • ESX (SAN) 75 Max • Databases ??? • Sybase • Oracle • SQL Server DSS: StorageScope/DSS ST03: Store #1 ST04: Store #2 2 vCPU 2 GB vMemory • Current • Managed Objects • Host Device Logical • Paths 10,467 • Arrays 15 • Symmetrix 4 • CLARiiON 11 • Switches 0 • ESX 0 • Databases ??? • Sybase • Oracle • SQL Server DSS: StorageScope/DSS ST03: Store #2 AG01: CLARiiON, Oracle AG02: Mapping, VMWARE AG01: CLARiiON, FCC, VMWARE AG02: CLARiiON, FCC, VMWARE AG03: CMA (DB), Oracle, NAS (Celerra) AG04: CMA (DB) (6.0) , Oracle (6.0) AG05: WLA, NAS (Celerra) AG06: NAS (Celerra) AG07: NAS (Celerra) 2 vCPU 2 GB vMemory Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent NOTE: Array increase due to Celerra arrays Console & Performance Manager GUI Console Total Servers: 8 Total Servers: 14

  34. Architectural Factors (GTDC)

  35. SWDC: Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Phase I ECC Deployment Large Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository Store #1, Centera ECC Server Repository SPECint_rate_base2006 82.6 DSS: StorageScope/DSS ST03: Store #1 ST04: Store #2 ST05: Store #3 ST06: Store #4 DSS: StorageScope/DSS ST04: Store #2 ST05: Store #3 • Current • Managed Objects • Host Device Logical • Paths 166,383 • Arrays 66 • Symmetrix 26 • CLARiiON 28 • HDS 12 • Switches 0 • ESX 0 • Databases 52 • Sybase 20 • Oracle 12 • SQL Server 20 • 12 Month Forecast • Managed Objects • Host Device Logical • Paths 216,298 • Arrays 90 • Symmetrix 34 • VMAX 4 • CLARiiON 36 • HDS 16 • Switches 54/8584 • ESX (SAN) 75 Max • Databases 68 • Sybase 26 • Oracle 16 • SQL Server 26 2 vCPU 2 GB vMemory AG01: CLARiiON, Oracle AG02: CLARiiON, HDS, CMA AG03: No Agnents AG01: HDS, CLARiiON, FCC, SMI Agent Provider, VMWARE AG02: CLARiiON,HDS, FCC, SMI Agent Provider, VMWARE AG03: CLARiiON, HDS CMA (DB), Oracle, FCC, SMI Agent Provider, Centera AG04: CMA (DB) (6.0), Oracle (6.0) AG05: WLA 2 vCPU 2 GB vMemory ** New VMAX Mgmt and Windows OS Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix Agent Symmetrix ** Agent Console CMA, Oracle Console Console & Performance Manager GUI Total Servers: 11 Total Servers: 15

  36. Architectural Factors (SWDC) • As Sybase 15 is discovered, the discovery will be via proxy. • This will require an increase of CMA proxy agent to 2.

  37. MWDC: Capacity: 2,050 Hosts 262,400 Host Device Logical Paths; 175 arrays; 1,200 DBs; 75 ESX’s 132 switches, 8,448 Ports Phase I ECC Deployment Medium Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing ECC Server Repository Store #1 ECC Server Repository SPECint_rate_base2006 ??? 2 vCPU 2 GB vMemory DSS: StorageScope/DSS ST01: Store #1 ST02: Store #2 DSS: StorageScope/DSS ST04: Store #2 • Current • Managed Objects • Host Device Logical • Paths 37,790 • Arrays 48 • Symmetrix 9 • VMAX 0 • CLARiiON 37 • HDS 2 • Switches 0 • ESX 0 • Databases 1 • Sybase 1 • Oracle • SQL Server • 12 Month forecast • Managed Objects • Host Device Logical • Paths 56,685 • Arrays 75 • Symmetrix 14 • VMAX 2 • CLARiiON 56 • HDS 3 • Switches 14/2736 • ESX (SAN) 75 Max • Databases 1 • Sybase 1 • Oracle • SQL Server AG01: CLARiiON, Oracle, VMWARE AG02: CLARIION, HDS, CMA AG03: No Agents AG01: CLARiiON, FCC, VMWARE AG02: CLARiiON, FCC, HDS, VMWARE AG03: CLARiiON, CMA (DB), Oracle AG04:CMA,(DB) (6.0) Oracle (6.0) AG05: CLARiiON, FCC AG06: WLA AG07: CLARiiON 2 vCPU 2 GB vMemory Symmetrix Agent Symmetrix Agent Symmetrix Agent ** (Decommission) Symmetrix ** Agent ** New VMAX Mgmt and Windows OS Console Console & Performance Manager GUI Total Servers: 9 Total Servers: 14

  38. Architectural Factors (Mid West)

  39. Tampa: Capacity: xx Hosts xx Host Device Logical Paths; xx arrays; xx DBs; xx ESX’s xx switches, x Ports Phase I ECC Deployment Small Configuration Virtual Physical 6.1 Deployment New 6.0 Deployment Existing SPECint_rate_base2006 ??? ECC Server Repository Store StorageScope/DSS ECC Server Repository Store StorageScope/DSS No VMWARE at this site • Current • Managed Objects • Host Device Logical Paths 2,017 • Arrays 10 • Symmetrix 1 • CLARiiON 9 • Switches 0 • Databases 53 • Sybase 11 • Oracle 38 • SQL Server 4 • 12 Month Forecast • Managed Objects • Host Device Logical Paths 2,017 • Arrays 10 • Symmetrix 1 • CLARiiON 9 • Switches 15/621 • Databases 53 • Sybase 11 • Oracle 38 • SQL Server 4 CLARiiON Agent, CMA (DB), FCC, SMI Agent Provider CLARiiON Agent Oracle, FCC, SMI Agent Provider, WLA Oracle (6.0), CMA (DB) (6.0) All Windows 2000 Servers End of Support for Windows 2000 June 2010 Symmetrix Agent (JAX) Symmetrix Agent (JAX) Console ServerCMA (DB), CLARiiON Console& Performance Manager GUI Total Servers: 4 Total Servers: 6

  40. Architectural Factors (Tampa) • As Sybase 15 is discovered, the discovery will be via proxy. • This will require an increase of CMA proxy agent to 1.

More Related