Introduction to Information Storage and Management

1. Section 1 : Storage System Introduction to Information Storage and Management Chapter 1

2. Chapter Objectives Upon completion of this chapter, you will be able to: • Describe who is creating data and the amount of data being created • Describe the value of data to business • List the solutions available for data storage • List and explain the core elements of data center • Describe the ILM strategy • Describe storage evolution

3. Lesson : Information Storage Upon completion of this lesson, you will be able to: • Describe the importance of information to individuals and to businesses • Define data and information • Discuss the categories of data • Describe the storage architectures and their evolution

4. Why Information Storage • “Digital universe – The Information Explosion” • 21st Century is information era • Information is being created at ever increasing rate • Information has become critical for success • We live in an on-command, on-demand world • Example: Social networking sites, e-mails, video and photo sharing website, online shopping, search engines etc

5. Nearly a quarter of the world's population – roughly 1.4 billion people – will use the Internet on a regular basis in 2009.

6. 50 billion photos taken every year

7. Online Video 4,700,000,000 video streams monthly

8. England has approximately 4 million surveillance cameras 1 for approximately every 14 Britons

9. Storage requirements: Facebook 10,000,000,000 photos 2-3 Terabytes of photos are being uploaded to the site every day One petabyte of photo storage Serve over 15 billion photo images per day Photo traffic now peaks at over 300,000 images served per second

10. People Needs Work wherever, whenever, and with whatever

11. People Needs Work wherever, whenever, and with whatever Compute diversity must be embraced

12. People Needs Work wherever, whenever, and with whatever Compute diversity must be embraced Collaborate across “classic” boundaries

13. People Needs • Work wherever, whenever, and with whatever • Compute diversity must be embraced • Collaborate across “classic” boundaries • Business and social personas as one

14. Context RIGHT Information RIGHT Time RIGHT Place

15. Community Maximize constituents with common interest Collaborate without boundaries Embrace culture of open innovation Going external (future) >100+ communities>no knowledgeable outsourcers

16. Compliance • Web 2.0 without risk • Manage all content types across platform • Tools for proactive/reactive discovery • Discovery/management without disrupting end-users

17. Leverage Leverage Optimize Optimize Protect Protect Store Store Information management is a big challenge InformationInfrastructure

18. A Vocabulary for Measuring Information If a Grain of Sand were One Byte of Information . . . 1 Megabyte =1 million bytesa tablespoon of sand 1 Gigabyte =1 billion bytespatch of sand—9” square, 1’ deep 1 Terabyte =1 trillion bytesa sandbox—24’ square, 1’ deep 1 Petabyte =1,000 terabytesa mile long beach—100’ wide , 1’ deep

19. A New Vocabulary for Measuring Information If a Grain of Sand were One Byte of Information . . . 1 Exabyte =1,000 petabytesthe same beach—from Maine to North Carolina 1 Megabyte =1 million bytesa tablespoon of sand 1 Gigabyte =1 billion bytespatch of sand—9” square, 1’ deep 1 Zetabyte =1,000 exabytesthe same beach—along the entire US coast 1 Terabyte =1 trillion bytesa sandbox—24’ square, 1’ deep 1 Yottabyte =1,000 zetabytesenough info to bury the entireUS under 296 feet of sand 1 Petabyte =1,000 terabytesa mile long beach—100’ wide , 1’ deep

20. What do you Think ? • What is your contribution to the digital Universe ( how many Mb’s have you generated till date ?? ) • <100 GB • 100 GB - 500 GB • 500 GB – 1 TB • > 1 TB

21. Data is converted into more convenient form i.e. Digital Data Increase in data processing capabilities Lower cost of digital storage Affordable and faster communication technology Who creates data? Individuals Businesses Video 01010101010 10101011010 Photo 00010101011 01010101010 10101010101 Book 01010101010 Digital Data Letter What is Data “Collection of raw facts from which conclusions may be drawn”

22. PDFs E-Mail Attachments X-Rays Unstructured (80%) Check Manuals Instant Messages Images Documents Forms Web Pages Contracts Rich Media Invoices Audio Video Structured (20%) Categories of Data • Data can be categorized as either structured or unstructured data • Over 80% of enterprise information is unstructured Rows and Columns

23. What do individuals/businesses do with the data they collect? They turn it into “information” “Information is the intelligence and knowledge derived from data” Businesses analyze raw data in order to identify meaningful trends For example: Buying habits and patterns of customers Health history of patients Centralized information storage and processing Network Network Wired Wireless Wireless Wired Uploading Accessing information information Users of Creators of Information information Virtuous cycle of information Demand for more Information Define Information

24. Value of Information to a Business • Identifying new business opportunities • Buying/spending patterns • Internet stores, retail stores, supermarkets • Customer satisfaction/service • Tracking shipments, and deliveries • Identifying patterns that lead to changes in existing business • Reduced cost • Just-in-time inventory, eliminating over-stocking of products, optimizing shipment and delivery • New services • Security alerts for “stolen” credit card purchases • Targeted marketing campaigns • Communicate to bank customers with high account balances about a special savings plan • Creating a competitive advantage

25. Storage • Data created by individuals/businesses must be stored for further processing • Type of storage used is based on the type of data and the rate at which it is created and used • Examples: • Individuals: Digital camera, Cell phone, DVD’s, Hard disk • Businesses: Hard disk, external disk arrays, tape library • Storage model: An evolution • Centralized: mainframe computers • Decentralized: Client –server model • Centralized: Storage Networking

26. Multi Protocol Router FC SAN LAN IP SAN SAN / NAS RAID Array JBOD Internal DAS Time Storage Technology and Architecture Evolution

27. Lesson Summary Key points covered in this lesson: • Importance of information • Data, information and storage • Categories of data • Storage architectures and their evolution Additional Task for Students Research on Storage Technologies & Architecture evolution ( RAID & Storage Networking )

28. Lesson: Data Center Infrastructure and Introduction to ILM Upon completion of this lesson, you will be able to: • List the five core elements of a data center infrastructure • Describe the requirements of storage systems for optimally supporting business activities • Explain the importance of Information Lifecycle Management • List the activities in developing the ILM strategy

29. Pillars of Information Technology IT World as We Know It Today S e c u r i t y

30. Server/ OS Client Application User Interface DBMS Storage Array LAN FC SAN Example of an Order Processing System

31. Availability Security Data Integrity Manageability Capacity Performance Scalability Key Requirements for Data Center Elements

32. Challenges in Managing Information • Exploding digital universe • Multifold increase of information growth • Increasing dependency on information • The strategic use of information plays • Changing value of information • Information that is valuable today may become less important tomorrow. Additional Task Research on Tiered Storage Model

33. Protect New Process Deliver Warranty order order order claim Time Value Fulfilled Aged Warranty order data Voided Migrate Create Access Archive Dispose Information Lifecycle Management A proactive strategy that enables an IT organization to effectively manage the data throughout its lifecycle

34. AUTOMATED Implement policies with information management tools Classifydata /applications based on business rules Integrated management ofstorage environment Organizestorage resources toalign with data classes FLEXIBLE Information Lifecycle Management Process Policy-based Alignment of Storage Infrastructure with Data Value

35. Benefits of Implementing ILM • Improved utilization • Tiered storage platforms • Simplified management • Processes, tools and automation • Simplified backup and recovery • A wider range of options to balance the need for business continuity • Maintaining compliance • Knowledge of what data needs to be protected for what length of time • Lower Total Cost of Ownership • By aligning the infrastructure and management costs with information value

36. Lesson Summary Key points covered in this lesson: • The five core elements of a Data Center infrastructure • Key requirements of storage systems to support business activities, as well as some of the constraints • ILM strategy • Importance • Characteristics • Activities in developing ILM strategy • IML implementation • Benefits of ILM

37. Chapter Summary Key points covered in this chapter: • Importance of data, information, and storage infrastructure • Types of data, its value, and key management requirements of a storage system • Evolution of storage architectures • Core elements of a data center • Importance of the ILM strategy

38. What do you Think ? • If you were to send a 1.1 MB e-mail to 4 of your friends, by the time your 4 friend receive that e-mail, What is your contribution to the digital Universe ( how many Mb’s ) • < 5 MB • 10 – 30 MB • 30 – 50 MB • > 50 MB

39. START 1.1 MB SENT TO FOUR COLLEAGUES FINISH 51.5 MB! Original MB Document + 1.0 E-mail with Attachment E-mail Text 0.1 Local E-mail Copy 1.1 E-mail Server 1.1 E-mail with doc 1.1 MB 2.2 MB Desktop Backup 1.0 Redundant Server 2.1 Tape Archive 4.2 E-mail with doc 1.1 MB Document 1 MB E-mail with doc 1.1 MB 9.5 Copies (4) E-mail Local Copies 4.4 E-mail with doc 1.1 MB Server Copies 4.4 Server Backup 4.4 1.1 MB 1.0 MB 2.1 MB 2.1 MB Tape Archive 8.8 2.2 MB 2.2 MB 2.2 MB E-mail with doc 1.1 MB 22.0 E-mail Server/ Desktop Backup Redundant Backup Backup Transient Overhead 20.0 8.8 MB TOTAL 51.5 4.2 MB Tape Back-up Tape Back-up How Much Data do YOU Create? Source: IDC White Paper, "The Diverse and Exploding Digital Universe," Sponsored by EMC, March 2008

40. Study on Exploding Digital Universe Sponsored by EMC Corporation

41. 1/5th Year 2001 The data generated was the equivalent of one stack of books reaching 1/5 of the way towards the sun

42. Year 2007 The amount of digital information created equaled 21 stacks of books 21 Stacks of Books 150 Million KMs

43. Digital Information: Created and Replicated Worldwide 2,502Exabytes 5 2,500 4 -FOLD Exabytes DVD RFID Digital TV MP3 players Digital cameras Camera phones, VoIP Medical imaging, Laptops, Data center applications, Games Satellite images, GPS, ATMs, Scanners Sensors, Digital radio, DLP theaters, Telematics Peer-to-peer, Email, Instant messaging, Videoconferencing, CAD/CAM, Toys, Industrial machines, Security systems, Appliances YEARS Growth in 2,000 1,500 1,000 486Exabytes 500 0 2008 2009 2010 2011 2012 Source: IDC Digital Universe White Paper, Sponsored by EMC, May 2009

44. The Digital Information World in 2012 The Paradox of Responsibility 70% Will be createdby individuals Source: IDC Digital Universe White Paper, Sponsored by EMC, May 2009

45. The Digital Information World in 2012 The Paradox of Responsibility 85% Will be the responsibilityof organizationsto ensureinformation’s security, privacy,reliability, andcompliance 70% Will be createdby individuals Source: IDC Digital Universe White Paper, Sponsored by EMC, May 2009