110 likes | 239 Vues
This comprehensive guide explores the essential elements of a data warehouse system, focusing on its lifecycle and architecture. It covers the roles of data marts, user access, and ad-hoc query tools, illustrating how data is sourced, cleaned, and transformed for analytical purposes. Key components include dimensional modeling, physical design, and the use of tools like Oracle Data Mart Designer. By understanding the business requirements and the technical infrastructure, organizations can successfully implement and manage data warehouses to drive decision-making and enhance business intelligence.
E N D
ACCTG 6910Building Enterprise & Business Intelligence Systems(e.bis) The Data Warehouse Lifecycle Olivia R. Liu Sheng, Ph.D.Emma Eccles Jones Presidential Chair of Business
Basic Elements of a Data Warehouse System The Data Warehouse Presentation Servers Source System (Legacy) Data Staging Area End User Data Access Data Mart #1: OLAP ( ROLAP and/or MOLAP) query services; dimensional! Subject oriented; locally implemented; user group driven; may store atomic data; may be frequently refreshed; conform to DW Bus Populate, replicate, recover Ad Hoc Query Tools Storage: Flat files (fastest); RDBMS; Other Processing: Clean; Prune; Combine; Remove duplicates; households; standardize; conform dimensions; store awaiting replications; archive; export to data marts No user query services feed Relational extract Report Writers feed Flat files Spreadsheets extract Populate, replicate, recover End User Applications Conformed dimensions and facts feed DW BUS Data Mart #2 Populate, replicate, recover feed Models: forecasting; scoring; allocating; data mining; other downstream Systems; other parameters; special UI DW BUS Conformed dimensions and facts ERP Legacy extract Data Mart #3 Uploaded cleaned dimensions Uploaded model results
TechnicalArchitectureDesign ProductSelection &Installation End-UserApplicationSpecification End-UserApplicationDevelopment The Business Dimensional Lifecycle Business Requirement Definition DimensionalModeling PhysicalDesign Data StagingDesign &Development ProjectPlanning Deployment Maintenance, Monitoring,Evaluation & Growth Project Management
Dimensional Modeling • Logical Design (Design appropriate table structures and relationships) • Tool: Oracle Data Mart Designer
Physical Design • Storage Structure • Performance Tuning • Indexes and aggregation • Tool: Data Mart Designer
Data Staging • Extraction • (Cleansing and ) Transformation • Loading (Transportation) • Tool: Oracle Data Mart Builder
Data Staging Extraction Transformation Transportation
End User Application Specification and Development • On-Line Analytic Processing (OLAP) • Reporting • Ad-hoc query • Graphical Analysis • Tool: Oracle Data Mart Discoverer
OLAP Reporting
OLAP Drill-up&Drill-down Query
OLAP Graphical Analysis