1 / 36

Industry Trends and Perspectives: What’s Hot For 2008

Industry Trends and Perspectives: What’s Hot For 2008. Greg Schulz, Founder & Sr. Analyst, The StorageIO Group Author, Resilient Storage Networks (Elsevier). The Green and Virtual Data Center (Auerbach) at Amazon.com. Part I – Hot Storage Issues, Trends and Technologies For Channel Pros.

Télécharger la présentation

Industry Trends and Perspectives: What’s Hot For 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Industry Trends and Perspectives:What’s Hot For 2008 Greg Schulz, Founder & Sr. Analyst, The StorageIO Group Author, Resilient Storage Networks (Elsevier) The Green and Virtual Data Center (Auerbach) at Amazon.com

  2. Part I – Hot Storage Issues, Trends and Technologies For Channel Pros What’s the buzz out there?

  3. What’s the buzz out there? 8 Gb Fibre Channel (8GFC), 10GbE, Agent-less, Authentication, Archiving, Backup, Backup Service Provider (BSP), BC/DR, Benchmarking, Blade Servers, Bulk Storage, CAS, Capacity Planning, Capacity Per Watt, Converged Enhanced Ethernet (CEE), CIFS, Cloud Storage, Clustered Storage, CNA, Compliance, Compression, Converged Networks, D2D2D, Data Management, Data Migration, Deduplication, Dedupe Debates, DPM, e-Discovery, Environmental Health and Safety (EHS), Encryption, Event Correlation, e-Waste, Fibre Channel over Ethernet (FCoE), File Management, FLASH, Green, Grid, HA, I/O Virtualization (IOV), InfiniBand, Infrastructure Resource Management (IRM), IOPS Per Watt, IPM & MAID 2.0, iSCSI, Multi-Protocol Storage, Managed Service Provider (MSP), NAS, NFS, NPVID, Partitions, Power Cooling Floor-space EHS (PCFE), PCI SIG IOV, Performance, pNFS, Removable Hard Disk Drive (RHDD), RAID 6, Replication, RoHS, Replication, CDP, SAN, SAS, SATA, Security, Snapshots, SRM, SSD, Tape, Thin Provision, Tier 0, Unstructured Data, VCB, Virtualization, Vmotion, VMware, VTL, WAAS, WADS, WAFS, WADM, Web 2.0 Storage

  4. Industry Trends – Information Security Is more data being lost or stolen today than in the past? Lost tapes are actually on the decline, however… Encryption Data At Rest and In-Flight, FDE and Drive Trust, Host Software and Storage Encrypt, Key Management, Secure Digital Destruction Authorization, Authentication, Identity Management Lost tapes make good news copy, however, lost or stolen PDAs, USB devices, laptops and HDDs removed from retired storage systems are a growing threat risk. Reported along with unreported events are on the rise! Growing Awareness! Lost Data Events A key question is, can you or your business afford the risk of data being lost or stolen? Time

  5. Industry Trends – Compute Continuum We are in a consolidation phase (again!) Cell Phones, PDAs, Pocket PCs Desktop PCs & Laptops Midrange & Servers Mainframes Converged Phones & Computers From Desktop to Laptop x86 and VMs From Proprietary to x86 & Hypervisors & Open LPARs/VMs Open Networking Native Linux Distribute Distribute Distribute Consolidate Consolidate 1950s 1960s 1970s 1980s 1990s 2000s 2010s SaaS Software or Storage as a Service Service Bureau Info Utilities Managed Service Providers Grid, Cloud, Web 2.0 Outsource & In-source xSPs Client Server

  6. Industry Trends – Increased Density Rising demand, denser solutions, PCFE and complexity • More processing power per footprint (sq. foot or meter, cabinet U) • Performance density improvements and cost reductions continue • Same floor space occupied to host more compute capabilities • More processing cycles will be needed moving forward • More processing cycles per watt of energy consumed • Power, cooling, floor space and EHS improvements 128 Servers (Blade Centers) Single Large Server Same Footprint Different Generations over Time 24 Servers Eight Servers Four Servers Source: “The Green and Virtual Data Center” (Auerbach)

  7. Web 2.0 and Online Data Data Created Continued Access Activity 8 Time Profile: Data is created, worked with and then may go idle briefly, then accessed, then idle, then active, then idle, then active… Examples: Web, reference and lookup, fixed content, Web 2.0 and social networking, media and entertainment, some email, search, seasonal or event and research-based data Solution: Online storage with variable performance to meet changing workload demands, bulk and clustered storage, MAID 2.0 and IPM-enabled storage, caching Industry Trends – Shifting Landscapes Common challenges and issues – old vs. new rules! Legacy and Transactional Data Data Created Data Goes Dormant Activity 8 Time Profile: Data is created, worked with and then goes dormant after some period of time with probability of little to no future access or use Examples: Database, email, transactional, general file serving, project-oriented data Solution: Ideal candidate for archiving off of primary or online storage to off-line and removable media or MAID-based storage combined with purging or deletion of data no longer needed to meet compliance or other commitments Source: “The Green and Virtual Data Center” (Auerbach)

  8. Hot Storage Topic – Clustered Storage The many faces of clustered storage – not just for HPC!

  9. Industry Trends – Growing Green Gap Confusion leading to inactivity and missed opportunity The Green Gap Messaging Issues Focus on green house gases (GHG) Carbon credit offsets Ecological sustainment Power avoidance Save money Global Concern with available power Energy rebates and certificates Economic sustainment Energy efficiency Cost to be green Local Limits on generate and transmission Rising energy costs and availability Aging and expensive infrastructure Emerging eco and ETS regulations Growing data footprint More servers and storage Increase density, reduce cost EHS, RoHS, WEEE, E-Waste Supply Demand Balancing Act See report “Analysis of EPA report to Congress” at www.storageio.com/xreports.htm

  10. VM VM VM VM Email Web SQL File Windows Windows Windows Linux \\Shared Email Messaging CAD,EDA, SW Dev Spreadsheets PPTs, PDFs Video/Audio File Serving Billing, E-Tail Database, DSS Vol001 Vol002 \\SharedC1 Vol002 Vol001 VolCD VolCC \\Shared Hot Storage Topic – IT Virtualization Requires real resources: server, network, storage, facilities Mainframes, Open Systems Networked Volumes & File Shares Virtual Server Environment Blade Servers Switch Storage Servers FAN, LAN, SAN, WAN, MAN Replicate Local PIT Snapshots Tape Rotation Block LUNs (iSCSI & FC) File Sharing (NFS & CIFS) FAN, LAN, SAN, MAN, WAN Power, Cooling, Floor-space, Environmental (PCFE)

  11. Part II – Opportunities to Address Your Customers’ Pressing Storage Issues New and Emerging Technologies and Solutions

  12. Email Messaging CAD,EDA, SW Dev Spreadsheets PPTs, PDFs Video/Audio File Serving Billing, E-Tail Database, DSS \\SharedC1 VolCC VolCD Tiered Data Protection Balance cost, data loss, availability and applicable threats RTO = Recovery Time Objective = When data can be usable or available RPO = Recovery Point Objective = What point data is recovered to, how much data can you afford to potentially lose Synchronous data mirroring, replication, continuous availability, nonstop processing. RTO and RPO near or at zero Relative Protection Cost Asynchronous remote data mirroring, replication, snapshot and copy. HA failover cluster. Longer RTO and/or RPO. Remote tape or disk-to-disk-to- tape backup, copies and vaulting. Remote archiving. Extended RTO and RPO. Continuous Minutes Hours Days Weeks Months RTO and RPO timeline and data lifecycle

  13. Relative Available IT Resources IT Capacity Constrained Business Growth Inhibited Economic Penalties Lost Opportunity Compute Capacity Storage Capacity I/O Performance (IOPS & Bandwidth) Industry Trends – PCFE Issues Rising demand, denser solutions, more PCFE supply issues PCFE Constrained Time Available PCFE Threshold PCFE Capacity Threshold Ceiling Cooling/Distribution Networking Available IT Resources/Demand Servers Storage Other Source: “The Green and Virtual Data Center” (Auerbach)

  14. E-Waste EHS RoHS Mask Or Move Issues HVAC Alternative Energy Best Practices and Policies / Metrics Consolidation Financial Incentives and Rebates Boost Energy Efficiency Reduce Data Footprint Energy Avoidance Tiered Servers Storage Hot Storage Topic – PCFE aka “Green” PCFE = Power, Cooling, Floor space, EHS Wheel of Opportunity: Economic and Ecological Sustainment EHS = Environmental Health Safety Source: “The Green and Virtual Data Center” (Auerbach)

  15. Hot Storage Topic – Cross Domain IRM IT Infrastructure Resource Management (IRM) • Infrastructure Resource Management • (IRM) Functions and Activities • Namespace and virtualization • Measurements and metrics • Monitoring and reporting • Modeling, analysis, planning • Resource usage and allocation • Performance and capacity planning • Thin provisioning and purposing • Diagnostic and resolution • Change and configuration validation • Data protection and footprint reduction • Policy management and service levels • Facilities and asset management • Logical and physical security • Procurement and disposition Processes and Tools Source: “The Green and Virtual Data Center” (Auerbach)

  16. Categories & Price Bands Usage Cases How Measured Easy to Use Reflective of Diversity of Storage Active & Idle, etc. Needs to Be Applicable to Usage Model Best Practices Metrics and Measurements Why, where, how and what to measure now and future Source: “The Green and Virtual Data Center” (Auerbach)

  17. Industry Trends – I/O Performance Gap Growing server processing to storage capacity and I/O gap Processor to disk storage capacity Performance Disk storage capacity to I/O performance gap Time Server processor performance curve Disk storage capacity curve Disk storage performance curve (IOPS) See “Addressing Data Center I/O Performance Gap” www.storageio.com/xreports.htm

  18. Email Messaging CAD,EDA, SW Dev Spreadsheets PPTs, PDFs Video/Audio File Serving Billing, E-Tail Database, DSS \\SharedC1 VolCD VolCC Tiered Storage and Tiered Access Balance performance, availability, capacity, energy usage Accelerate Performance “Time is Money” Balancing Act PACE Footprint RAM PCFE FLASH Cost Service Level Fast HDD Consolidate Space Capacity Performance Relative Comparison Similar Capacities Reduce Capacity Costs FAT HDD Price Tape & Optical Power Tier-0 Tier-1 Tier-2 Tier-3 Different Price Bands and Categories Enterprise Midrange SMB SOHO Price Bands Source: “The Green and Virtual Data Center” (Auerbach)

  19. Hot Storage Topic – I/O Virtualization I/O virtualization – converged networks, IOV and FCoE I/O, I/O, it’s off to virtual work we go… Traditional Approaches Separate Networks & Interconnects (Fibre Channel, GbE, IBA, Etc.) Evolving Approaches Unified & Converged Interconnects (Virtualized FC, GbE, FCoE, Etc. Physical Data Center Ethernet or IBA)

  20. Many Faces of I/O Virtualization I/O Virtualization and Consolidated I/O and Networking • Sharing of physical adapters and unique addressing • Fibre Channel N_Port Virtual IDs – Unique N_Port addresses • Virtual Machine NICs and HBAs – E.g. VMware, Virtual Iron • Virtual NICs and Virtual HBAs for virtual machines • PCI bus extension, switching and sharing – very short distances • PCI SIG SR-IOV and MR-IOV: Share PCI adapters • Converged I/O and networking • Virtual and converged adapters and NICs • Transform physical adapter into virtual adapters and NICs • Converged networks and fabrics • InfiniBand and Converged Enhanced Ethernet and FCoE Fibre Channel over Ethernet (FCoE); Single-Root IOV (SR-IOV); Multi-Root IOV (MR-IOV)

  21. Copies – Data proliferation and expanding data footprint DSS, Training, Test, Dev QA, Operational, Needs Backup, BC, DR, HA, Archive, Compliance In addition to storage space capacity, IOPS and MBPS to move data needs to be considered. 10 TB 10 TB 10 TB 10 TB 8 TB 8 TB 2 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 10 TB 8 TB 8 TB 8 TB 8 TB 8 TB 8 TB 8 TB 8 TB 8 TB 2 TB 2 TB 2 TB 2 TB 2 TB 2 TB 2 TB 2 TB 2 TB 8 TB 2 TB Challenge: More data to back up, protect and manage Solution: Reduce footprint impact: Archive, compress, dedupe, tiered storage See “Business Benefits of Data Footprint Reduction” www.storageio.com Industry Trends – Data footprint growth More data being stored, copied, backed up, protected Sparse, Duplicate Files and Content Original Data Primary Database, Email, File serving App-a App-b App-c RAID 1+0 RAID 1 RAID 5 Multiple data footprint by data protection factor (e.g. RAID level and mirroring) along with spares and free space to account for actual disk space Source: “The Green and Virtual Data Center” (Auerbach)

  22. Hot Storage Topic – Data Footprint Reduction Archiving, compress (on- and off-line), deduplication • Develop an overall data footprint reduction strategy • Address online primary, secondary and off-line data • Combine archiving, compression and dedupe in strategy • Archiving and pruning with data classification • Database, email, unstructured block and file • Big benefit, costly to deploy (people, hardware, software) • Compression for online and off-line storage • Can be applied to most any data type for some benefit • Online real-time compression for active primary data • Single Instance Storage (SIS) and deduplication • Initially targeted at backup and archive • Look into scaling capabilities and claims by vendors See “Business Benefits of Data Footprint Reduction” www.storageio.com

  23. Total Server and Storage Market Size • Issues that inhibit consolidation: • QoS and performance barriers • Politics and financial constraints • Competitive or legal purposes • Security and compliance Tomorrow Non-Consolidated Servers or Storage • Emulation • Abstraction • Aggregation • Migration Only a fraction of all servers or storage consolidated! Market and IT Virtualization Opportunity! Consolidated Server and Storage Using Virtualization Market and IT Opportunity = Life Beyond Consolidation Using server virtualization for IT resource management Enabling abstraction and transparency for massive scaling, BC, DR and routine infrastructure resource management (IRM) operational functions Today The Many Faces of Virtualization Consolidate, Abstract, Emulate, Migrate and Manage Source: “The Green and Virtual Data Center” (Auerbach)

  24. The Many Faces of Virtualization Consolidate, Abstract, Emulate, Migrate and Manage Consolidation Single Server Consolidation with HA Redundant Servers Scaling Beyond a Server Software Changes Scaling Beyond a Server Single Operating System Source: “The Green and Virtual Data Center” (Auerbach)

  25. Data Protection Management Virtualized BC/DR Initially Oversubscribed Add Physical Resources As Needed PMs VMs VMs VMs PMs PMs PMs PMs PMs VMs PM PMs PMs PMs VMs VMs Production Primary Site 32 Physical Servers 32 VMs 1:1 VM to PM BC/DR Site 8 Physical Servers 32 VMs 4:1 VM to PM Remote Shared Storage Local Shared Storage Local Shared Storage Remote Shared Storage Network Network Snapshots and Replication The Many Faces of Server Virtualization Leveraging Virtualization to Enable HA, BC and DR Traditional BC/DR 1 to 1 Resource Allocation Or Selective Recovery Production Primary Site 32 Physical Servers BC/DR Site 32 Physical Servers Snapshots and Replication Source: “The Green and Virtual Data Center” (Auerbach) PM = Physical Machine

  26. Remote Storage The Virtual Data Center Different approaches and locations for virtualization Wide Area, Internet and Cloud Networking • Data movement and access between sites • Remote-office/branch-office data access • HA, BC, DR for business sustainment • Leverage off-site managed services • Remote data archiving • Privately owned facilities • Hosted or colocation • BC/DR standby hot/cold site • Cloud or SaaS and MSP Firewalls Internet MAN & WAN Data replicated for HA, BC, DR Clustered and non-clustered servers Remote backup and archives Source: “The Green and Virtual Data Center” (Auerbach) Managed Service Provider (MSP), Software or Storage as a Service (SaaS)

  27. What You Can Do Today and Tomorrow Boost energy efficiency – more work per energy used Source: “The Green and Virtual Data Center” (Auerbach)

  28. Part III – Call to Action What you can do now to address customer issues How to stand out in the crowd!

  29. What You Can Do Today! Virtual environments need physical resources and IRM • Gain control of virtual and physical resources • More data to protect for longer periods of time • Fill in the gaps and add plug-ins to virtualization frameworks • Leverage new technologies and capabilities • Tiered servers, storage, networks, data protection and access • Data protection management including site recovery manager • High-availability virtual server and storage migration • Data footprint reduction: Archive, real-time compress, dedupe • Disk-based snapshots, backup, replication and archiving • Disk-based virtual tape libraries and removable media • Encryption of fixed and removable media • Virtualization and application aware data protection

  30. VM VM VM VM VM VM WebApp Email Apps Apps File File Windows Windows Windows Windows Windows Linux Migration Migration Replicate Email Messaging CAD,EDA, SW Dev Spreadsheets PPTs, PDFs Video/Audio File Serving Billing, E-Tail Database, DSS \\SharedC1 VolCD VolCC Different Facets of Server Virtualization Consolidation or Aggregation, Emulation and Transparency Consolidation of Multiple Systems Boost Utilization of Servers or Storage Enable: Physical to Virtual (P2V), Virtual to Virtual (V2V) Requires: 3rd party Replication, Backup, Snapshots, Data Protection Management, Shared Storage HA, BC, DR Load Balancing Virtual Infrastructure Virtual Infrastructure Servers or Blade Centers Disk Storage DAS, SAN or NAS Source: “The Green and Virtual Data Center” (Auerbach)

  31. VM VM VM VM WebApp Email Apps File Windows Linux Linux UNIX Pre/Post Processing Migration Vol-C Vol-D Vol-B Vol-A Hot Storage Topic – Data Protection Opportunity to re-architect data protection practices Data Protection Management Tools Managed Services VCBs, Snapshots, Replication, Application Aware, HA vs. BC/DR LAN, MAN or WAN Backup Server Data Movement Over SAN or DAS Virtual Infrastructure VTL / Disk Library (Block or File) Tape Devices D2D, D2D2D, D2T, D2D2T, VTLs, Encrypt, Compress & Dedupe Disk Storage Snapshots

  32. What You Can Do Today Addressing different issues – no single magic bullet! AVS = Adaptive Voltage Scaling IPM = Intelligent Power Management

  33. General Comments Basic premises – gain management insight and control • Look beyond consolidation to enable and sustain growth • Be in position to support future growth. It’s just a matter of time! • You can’t go forward if you can’t go back! • Time to re-architect data protection, BC and DR with new techniques. • You can’t delete what you have not preserved • Assuming customer data has some value, preserve before deletion. • Archiving is for more than regulatory compliance purposes • Implement tiered storage, boost performance, address PCFE. • You can’t manage what you or your customer don’t know about • Identify what data, files and objects you have: insight. Lean more at www.storageio.com and www.thegreenandvirtualdatacenter.com

  34. Closing Comments Basic premises – gain management insight and control • Many approaches depending on your customers’ issues • Help customers do more with what they have to sustain growth • Help customers shift from energy avoidance to energy efficiency • Avoid simply moving IT problems around • Help your customers gain control of data and infrastructure issues • Solve problems and issues to enable your customers to grow • Instead of race to replace tape, revamp data protection architecture • Instead of race to consolidate data centers, enable remote management • Balance between future and what works today • Leverage what works and what customers are buying • Land sales and revenue on shipping products while selling the future • Help your customers develop strategies for moving forward

  35. Closing Comments Data protection, PCFE/green topics are here to stay! • Where you can learn more: • Feel free to call or email me with questions or comments • See Resilient Storage Networks (Elsevier) • www.storageio.com (see portfolio for articles etc.) • www.thegreenandvirtualdatacenter.com “The Green and Virtual Data Center” (Auerbach) Order your advance copy now on Amazon.com

  36. Thank You!Greg@storageio.com www.storageio.com

More Related