1 / 24

Fast Track & Project Madison Overview

Fast Track & Project Madison Overview. Doug Lanman Data Warehousing SSP North Central, Midwest and Heartland Districts SQL Server Data Warehousing. Agenda . Fast Track Overview The Bridge to Madison – Hub & Spoke Madison Overview MTP & TAP programs Quick Start Summary.

irish
Télécharger la présentation

Fast Track & Project Madison Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Fast Track & Project MadisonOverview Doug Lanman Data Warehousing SSP North Central, Midwest and Heartland Districts SQL Server Data Warehousing

  2. Agenda • Fast Track Overview • The Bridge to Madison – Hub & Spoke • Madison Overview • MTP & TAP programs • Quick Start • Summary Microsoft Confidential

  3. The Appliance Model for Data Warehousing • Building a traditional DW • Time consuming • Expensive • Performance varies • Scalability issues Potential bottlenecks in standard DW architecture • The DW appliance model • Pre-built & tuned h/w + s/w • Views entire stack holistically • Known performance & scalability • Encapsulates best practices • Leverages Sequential I/O Lower TCO Faster deployment Benefits Better performance Minimised DBA time

  4. What is SQL Server Fast TrackData Warehouse? A new offering to help Customers and Partners accelerate their Data Warehouse deployments. Seven new SMP Reference Architectures

  5. Fast Track Data Warehouse Components • Software: • SQL Server 2008 Enterprise • Windows Server 2008 • Configuration guidelines: • Physical table structures • Indexes • Compression • SQL Server settings • Windows Server settings • Loading • Hardware: • Tight specifications for servers, storage and networking • ‘Per core’ building block <Session Name> Microsoft NDA-only

  6. SQL Server Fast Track Data Warehouse for HP • 2 Processor Configuration • Server: HP ProLiant DL385 G5p with 2 Quad-core AMD Opteron processors • Storage server: EMC or MSA Storage • Scalability: 4 – 8 TB • 4 Processor Configuration • Server: HP ProLiant DL 585 G5 with 4 Quad-core AMD Opteron processors • Storage server: EMC or MSA Storage • Scalability: 4 – 16 TB • 8 Processor Configuration • Server: HP ProLiant DL 785 G5 with 8 Quad-core AMD Opteron processors • Storage server: EMC or MSA Storage • Scalability: 16 – 32 TB • Note - Compression assumes 2.5:1

  7. SQL Server Fast Track Data Warehouse for DELL • 2 Processor Configuration • Server: Dell Power Edge 2950 MLK with 2 Quad-core Intel Xeon processors • Storage server: EMC CX4-240 • Scalability: 4 – 8 TB • 4 Processor Configuration • Server: Dell Power Edge R900 with 4 6-core Intel Xeon processors • Storage server: EMC CX4-240 • Scalability: 12 – 24 TB • Note - Compression assumes 2.5:1 • - Fully loaded only adds drives to minimum HW required • - Data space can be increased by using 450GB drives

  8. Fast Track Benefits Summary • Appliance-like time to value • Reduces DBA effort; fewer indexes, much higher level of sequential I/O • Choice of HW Platforms • Dell, HP, Bull – more in future • Low TCO Through • Commodity Hardware and value pricing; Lower storage costs. • High Scale • New reference architectures scale up to 32 TB (assuming 2.5x compression) • Reduced Risk • Tested by Microsoft; better choice of hardware; application of Best Practice <Session Name> Microsoft NDA-only

  9. The Bridge to Project "Madison" • Fast Track offers appliance-like ease of deployment, scalability and performance for SMP • Madison to offer massively parallel (MPP) scale and performance • Madison hub-and-spoke architecture includes support for SMP spokes

  10. Data Source Data Source Data Source Data Source Data Source Data Source Madison Hub and Spoke Architecture – Centralized Vs Decentralized Enterprise Data Warehouse • Centralized EDW Model Is Challenged • Too Expensive & Inflexible • Complex ETL • Overwhelmed By Mixed Workload • SiloedData Marts • Outgrow their platforms • No Centralized Management DM3 DM4 DM2 DM1 • Madison Enables Best Of Both Worlds , Hub and Spoke

  11. Madison and Fast Track Hub and Spoke Departmental Reporting Regional Reporting High Performance HQ Reporting Central EDW Hub ETL Tools <Session Name> Microsoft NDA-only

  12. Benefits of Hub-And-Spoke • All systems connect via a dedicated high speed network • Parallel database copy – speeds of up to 500 GB per min • Simplify data mart ETL / ELT processes with publishing model • Separate management and user workloads • Integrate SMP SS08 and MPP systems • Independently expand any system • Add spokes without impacting other users • Deploy development and test environments that leverage parallel connectivity Microsoft Confidential

  13. MPP (Madison) Overview Project Madison Reference Hardware Platforms INDUSTRY STANDARD SERVERS INDUSTRY STANDARD NETWORKING INDUSTRY STANDARD STORAGE

  14. Madison Node Database Server Storage Server

  15. Madison Architecture Database Servers Storage Servers Control Nodes Active / Passive Dual Fiber Channel Dual Infiniband Landing Zone Backup Node Spare Database Server

  16. The Demo • Report • Retailer: day-part analysis • (Sales+Time+Date+Prod type) • Results • 625K rows returned in 11 seconds from 1 trillion row table • Final product will be even faster! • Query • No cheating (cache flushed) • Inner joins

  17. Madison Beta Programs • Two Programs • MTP – Madison Technology Preview • 20 – 30 participants • Duration of 4 to 6 weeks • TAP – Beta production implementation • 6 – 8 customers • First iteration 9 to 12 weeks • Requirements • Focus on EDW and large data marts • Migration projects, not green field • Open to customers & prospects • 30+ TB of data…at least 4 100+ TB

  18. Microsoft Commitment • MTP • High touch Support • MS or partner will provide HW and will host the MTP • Customer may have opportunity to engage with TAP • MS will work with customer to define scope and success criteria • MS will perform the bulk of MTP work (2 -3 resources) • TAP • Customer must procure the Madison reference architecture and conduct the TAP in their own data center • Premier support will be provided • Services will be provided (2 -3 resources) • Training / mentoring will be provided • MS will work with customer to define scope and success criteria

  19. Customer Commitment • MTP • Customer to provide data, queries, concurrency model, existing data model, etc. • Customer to provide SME and DBA to answer questions of MTP team • Customer to provide existing benchmarks • Customer to define priorities for testing and areas of interest • Customer to attend 2-3 day MTP interactive session and review • TAP • Customer to provide data, queries, concurrency model, existing data model, etc. • Customer to provide SME, DBA and other resources to work with MS TAP team • For onsite – customer to provide building access, internet access, etc • Customer to provide existing benchmarks

  20. Summary • Fast Track data warehouse reference architectures are available today • Scale up today with SMP, scale out tomorrow with MPP • Hub-and-Spoke will integrate SMP reference architectures with Madison • Madison will scale SQL Server to 1PB • Madison will set a new bar in appliance pricing and performance • MTP and TAP for Madison are this year!

  21. DellEDW Systems Architecture • “Hubs” – 400TB Total • 1 primary, 1 DR System • Mirrored DR via ETL • Mirror not shown • “Spokes” – 350TB Total • 3 DA v3 Appliances • 1 SSE 2008 “SMP” Spoke • Dedicated IB Network • “Grid” enabled appliance network • SQL “Copy” between appliances • Up to 500GB/min transfer • Teradata Migration • Direct migration of historical data • Automated Extract & Load

  22. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More Related