1 / 35

Build an Enterprise Storage Solution with Windows Server 2012 R2

Build an Enterprise Storage Solution with Windows Server 2012 R2. Walter Pitrof Sr. Technology Solution Professional Microsoft Switzerland Email: walterp@microsoft.com. Customers Discuss Storage. Lower the cost of storage Ease of File, Performance of Block No Downtime Servicing

seven
Télécharger la présentation

Build an Enterprise Storage Solution with Windows Server 2012 R2

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Build an Enterprise Storage Solution with Windows Server 2012 R2 Walter Pitrof Sr. Technology Solution Professional Microsoft Switzerland Email: walterp@microsoft.com

  2. Customers Discuss Storage • Lower the cost of storage • Ease of File, Performance of Block • No Downtime Servicing • Help me secure my data • Fully Leverage Storage Array Capabilities • Native Access to SAN from VM with redundant IO (MPIO) • Scalable Virtual Disks • Storage Metering

  3. File System

  4. File system enhancements Resilient File System (ReFS) CHKDSK NTFS improvements • Rapid recovery from file system corruption without affecting availability • Data corruption virtually eliminated through allocate-on-write • Period checksum validation of file system meta-data • Seamless data integrity protection • Seconds to fix corrupted data • No offline time when used with CSV • Disk scanning process separated from repair process • Online scanning with volume and offline repair Rapid recovery from file system corruption without affecting availability Resilient against power outage corruption Periodic checksum validation of file system metadata Improved data integrity protection Ideal for file server volumes Source: “Microsoft Internal Testing" http://blogs.msdn.com/b/b8/archive/2012/05/09/redesigning-chkdsk-and-the-new-ntfs-health-model.aspx

  5. Storage Performance

  6. Hyper-V: Over 1 Millions IOPs from a Single VM • Industry Leading IO Performance • VM storage performance on par with native • Performance scales linearly with increase in virtual processors • Windows Server 2012 Hyper-V can virtualize over 99% of the world’s SQL Server.

  7. VHDX

  8. New virtual hard disk format • Features • Storage capacity up to 64 TBs • Corruption protection during power failures • Optimal structure alignment for large-sector disks • VHDX Large allocations and 1 MB aligned Data region (large allocations and 1 MB aligned) Block Allocation Table (BAT) User data blocks • Benefits • Increases storage capacity • Protects data • Helps to ensure quality performance on large-sector disks Intent log Sector bitmap blocks Header region Metadata region (small allocations and unaligned) Metadata table User metadata Header File metadata

  9. VHDX Perf:32KB Random Writes IOPS 10% 10% Queue Depth 16

  10. Storage Spaces

  11. New Approach to Storage Strategic shifts to reducing storage costs with Windows Server 2012 Software-Defined Storage File Based Storage High Performance SMB Protocol for Hyper-V Storage over Ethernet networks Storage Spaces Cost-Effective Business Critical Storage

  12. Storage Spaces Windows Application Server or File Server • Virtualization of storage with Storage Pools and Storage Spaces • Storage resilience and availability with commodity hardware • Resiliency and data redundancy throughn-way mirroring (clustered or unclustered) or parity mode (unclustered) • Utilization optimized through thin and trim provisioning and enclosure awareness • Integration with other Windows Server 2012 R2 capabilities • Serial Attached SCSI (SAS) and Serial AT Attachment (SATA) interconnects Physical or virtualized deployments File Server Administration Console Integrated with otherWindows Server 2012 capabilities Hyper-V SMB Multichannel SMB Direct Failover Clustering NTFS (3.0,4.1) Cluster Shared Volume NFS Windows Storage Mgmt. WindowsVirtualizedStorage Storage Space Storage Space Storage Space Storage Pool Storage Pool PhysicalStorage (Shared) SAS or SATA http://technet.microsoft.com/en-us/library/dn387076.aspx

  13. Reduced Mean Time To Recovery (MTTR) Performance improvements to radically reduce MTTR Mirror Spaces Rebuild Parallelized Recovery Increased Throughput Dual parity: Stores two copies of the parity information on a parity space, which helps protect rom two simultaneous physical disk failures and optimizes storage efficiency. Utilization of spare capacity: • Hot Spare no longer necessary in R2Automatically rebuild storage spaces from storage pool free space 3TB HDDs, 2-way, 4-column Mirror Space Source: Internal Testing, No Foreground Activity Storage Space

  14. Data Deduplication

  15. Efficient storage through Data Deduplication • Maximize capacity by removing duplicate data • 2:1 with file shares, 20:1 with virtual storage • Less data to back up, archive, and migrate • Increased scale and performance • Low CPU and memory impact • Configurable compression schedule • Transparent to primary server workload • Improved reliability and integrity • Redundant metadata and critical data • Checksums and integrity checks • Increase availability through redundancy • Faster file download times with BranchCache VHD Library Software Deployment Share General File Share 0% 20% 40% 60% 80% 100% User Home Folder (My Docs) Average savings with Data Deduplication by workload type Source: “Microsoft Internal Testing"

  16. Evaluating Deduplication

  17. Storage tiering

  18. Storage tiering Improved storage cost-performance with industry-standard hardware Use solid-state drives (SSD) and hard-disk drives (HDD) in tiered storage space Can “pin” high priority files to the SSD tier Storage Spaces Solid State Drives (SSD) Hot data Storage tiering Cold data Hard Disk Drives (HDD)

  19. Write-Back Caching

  20. Write-Back Caching (WBC) Hyper-V Compute Nodes Complements Tiering Tiering – Balances capacity & performance WBC – Short-term absorption of I/O bursts Seamless Integration & Management Utilizes available SSD capacity from pool WBC enabled by default Configurable through PowerShell Reads/Writes Accumulates Data Activity Seamless Integration Storage Space SSD Tier & WBC 400GB EMLC SAS SSD Hot Data Cold Data HDD Tier 4TB 7200RPM SAS HDD

  21. Storage Deployment Approaches

  22. Balanced Storage Deployment Approaches • How to build a deployment with: • 16 TB Capacity • 180,000 IOPS (4k, random) • HDD Only Deployment • MeetCapacity with 6 HDDs • MissIOPS by 179,100 • SSD Only Deployment • MissCapacity by 12.8 TB • MeetIOPS with 4 SSDs • Balanced Deployment: • MeetCapacity with 6 HDDs • MeetIOPS with 4 SSDs • Mix of HDD & SSD • High Capacity HDDs • High Performance SSDs • Best IOPS/$ ? 3TB SAS HDDs, 150 IOPS, $350 MSRP 800GB SAS SSDs, 50,000 IOPS, $3,000 MSRP

  23. Demo Storage SpacesStorage tieringDeduplication

  24. Server Message Block (SMB) 3.0

  25. SMB 3.0 Direct-attached storage (DAS) Equivalence • Top-to-bottom performance analysis and tuning • SMB server optimization • New tracing instrumentation to identify bottlenecks • Substantial refactoring of SBM2 client as well • Windows Server 2012 at 98% of DAS transactional performance • Identical servers and storage • 28 x 10KRPM HDD

  26. Network fault tolerance with SMB Multichannel SMB client SMB server Network • Automatic detection and use of multiple network connections between SMB client and server • Helps server applications be resilient to network failure • Transparent Failover with recovery of network failure if another connection is unavailable • Improved throughput • Bandwidth aggregation through NIC Teaming • Multiple nodes/CPUs for network processing with RSS-capable network adapters • Automatic configuration with very little administrative overhead NIC NIC File copy File copy NIC NIC

  27. Demo SMB Multichannel

  28. Improved network performance through SMB Direct (RDMA*) • Higher performance through offloading of network I/O processing onto network adapter • High throughput with low latency and ability to take advantage of high-speed networks (such as InfiniBand and iWARP) • Remote storage at the speed of direct storage • Transfer rate of around 50 Gbs on a single NIC port • Compatible with SMB Multichannel for load balancing and failover Without RDMA With RDMA File Client File Server Application Application App Buffer App Buffer SMB Client SMB Client SMB Server SMB Server SMB Buffer SMB Buffer SMB Buffer SMB Buffer Transport Protocol Driver Transport Protocol Driver Transport Protocol Driver Transport Protocol Driver OS Buffer OS Buffer NIC Driver NIC Driver NIC Driver NIC Driver Driver Buffer Driver Buffer NIC rNIC* rNIC* NIC iWARP Adapter Buffer Adapter Buffer Adapter Buffer Adapter Buffer InfiniBand http://workinghardinit.wordpress.com/2013/06/14/verifying-smb-3-0-multichannelrdma-is-working-in-windows-server-2012-r2/ *Remote Direct Memory Access *e.g. Intel® NetEffect™ Server Cluster Adapter Family

  29. SMB as a transport for Live Migration of VMs Delivers the power of SMB to provide: RDMA (SMB Direct) Steaming over multiple NICs (SMB Multichannel) Provides highest bandwidth and lowest latency Hyper-V Live Migration over SMB Live Migration can take advantage of high speed networking Live migration can stream over multiple networks for improved bandwidth RDMA enables offloading CPU resources to NIC during live migration

  30. SMB Direct Performance Enhancements(R2) Hyper-V Performance 50% improvement for small IO workloads with SMB over RDMA Increased 8KB IOPs from ~300K IOPS to ~450K IOPS per interface SMB Direct Scale-out File Server Efficiency Increased efficiency and density of hosting workloads with small I/O’s such as OLTP database in a VM Optimizes 40Gbps Ethernet and 56Gbps InfiniBand VHD 50% improvement for small IO workloads http://technet.microsoft.com/en-us/library/hh831474.aspx

  31. Optimized Rebalancing of Scale-out File Server Hyper-V host Scale-Out File Server clients are now redirected to the “best” node for access Avoids unnecessary redirection traffic Driven by ownership of Cluster Shared Volumes SMB connections managed per share • No longer per file server Dynamically moves as CSV volume ownership changes • Clustering is now also balancing CSV volumes automatically Automatic behavior, no administrator action \\SOFS\Share2 SMB Scale-out File Server File Server 1 File Server 2 Share1 Share2 Share1 Share2 Storage Spaces CSV and SMB shares automatically rebalanced Improved network efficiency through drastically reducing redirection traffic

  32. Demo SMB 3.0 – File Copy SMB 3.0 – IOPs

  33. Windows File Server Cluster Solution Partners Certified Storage Spaces Hardware High-Performance Servers and Storage http://www.raidinc.com/ http://www.dataonstorage.com/ http://www.fujitsu.com/fts/ http://www.quantaqct.com/ http://www.supermicro.com/

More Related