1 / 54

Configuring File Systems

Configuring File Systems. Upon completion of this module, you should be able to: Define file system components and storage pools Describe file system features including file system automatic extension and virtual provisioning Create file systems using Automatic Volume Manager

shakti
Télécharger la présentation

Configuring File Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Configuring File Systems Upon completion of this module, you should be able to: Define file system components and storage pools Describe file system features including file system automatic extension and virtual provisioning Create file systems using Automatic Volume Manager Explain how to manage file systems Configuring File Systems

  2. Configuring File Systems Lesson 1: UxFS File System This lesson covers the following topics: UxFS file system Automatic Volume Manager (AVM) Storage pools Configuring File Systems

  3. VNX File System Overview • Method of cataloging and managing files and directories on a storage system • VNX for File uses UxFS file system • Groups file data with its metadata for an improved locality of reference • VNX file systems can be created automatically or manually Configuring File Systems

  4. Creating File Systems Automatically • Automatic Volume Manager (AVM) is a feature used to create VNX file systems automatically • The AVM algorithm creates the underlying file system structure * We will be covering file systems via AVM in this module Configuring File Systems

  5. AVM File System Structure Configuring File Systems

  6. File System Components: dVols • The underlying storage for all other volume types • Disk volumes are created when LUNs are presented to the VNX for File via: • The file storage provisioning wizard • Adding LUNs to ~filestorage storage group • Each dVol maps to a LUN on the storage system • LUNs may come from RAID Groups or Block storage pools LUN 207 dvol 21 LUN 208 dvol 22 Configuring File Systems

  7. File System Components: Stripe Volumes • Volumes are stripped together and presented as one logical volume • Achieve greater performance and higher aggregate throughput • AVM decides on the number of dVols to stripe depending on the LUN type • Up to 4 dVols when RAID Group LUNs are used • Up to 5 dVols when Pool LUNs are used Stripe Volume 80 GB dvol 19 20 GB dvol 10 20 GB dvol 21 20 GB dvol 12 20 GB Configuring File Systems

  8. File System Components: Slice Volumes • Method of making smaller volumes from larger volumes • Satisfies a file system request without utilizing the entire stripe volume • Space left over on the stripe volume can be used for other file systems • Slicing is the default when creating file systems Slice Volume 20 GB Stripe Volume 80 GB Configuring File Systems

  9. File System Components: Metavolume • A metavolume is a concatenation of one or more volumes • In order to create a file system, a metavolume must first exist • A file system is able to dynamically expand by adding more volumes to the metavolume File System 20 GB Slice 20 GB Metavolume Slice 30 GB File System 30 GB Metavolume Configuring File Systems

  10. Disk Volume Types • Disk volumes are categorized in AVM by the physical disk associated with the LUN and the LUN type * Complete Disk Types listing in Managing Volumes and File Systems with VNX™ AVM product document Configuring File Systems

  11. AVM Storage Pools • Storage pools are containers that hold stripe volumes ready for use by AVM • Storage pools with RAID Group LUNs • System-defined pools • 256 KB stripe element size • User-defined pools • Storage pools with Pool LUNs • Mapped pools Member Volumes Stripe 1 80 GB Stripe 2 80 GB Storage Pool = 160 GB Configuring File Systems

  12. System-defined Pools Configuring File Systems

  13. Mapped Pools • When Pool LUNs are presented to the VNX File, a mapped pool is created by AVM • The mapped pool is deleted when all Pool LUNs are removed from the ~filestoragegroup • Advanced Block storage features such as FAST-VP, Thin LUNs and Compression are supported MappedPool 1 : 1 Configuring File Systems

  14. Striping with Pool LUNs • Before striping, AVM will divide available Pool LUNs/dVols in Thick and Thin groups • All Thick LUNs will be used first before using any Thin LUNs • Up to 5 dVols of the same size, data services, and SP balanced will be striped, with a minimum of two Stripe Then 4 First 5 Stripe Stripe Stripe Then 2 Then 3 Configuring File Systems

  15. Concatenating with Pool LUNs • If AVM can’t find available LUNs of the same size for striping, then: • Concatenate enough Thick LUNs to meet size requirements • If no Thick LUNs are available, use Thin LUNs • If not possible, put Thick and Thin together • If that is not possible, file system creation/extension fails! LUN1 LUN1 LUN1 LUN2 LUN2 LUN 1 LUN 1 LUN 2 LUN 2 LUN 2 Configuring File Systems

  16. AVM Considerations • All volumes of a file system must be stored on the same storage system • AVM storage pools must contain only one disk type and cannot be mixed, unless if using Pool LUNs • When creating Pool LUNs: • Pool LUN count should be divisible by 5 to assist AVM striping • Balance SP ownership • If File Thin Provisioning is desired, use a Thin Enabled file system on RAID Group LUNs or Thick LUNs, instead of Thin LUNs Configuring File Systems

  17. Configuring File Systems Lesson 1: Summary During this lesson the following topics were covered: UxFS file system Automatic Volume Manager (AVM) Storage pools Configuring File Systems

  18. Configuring File Systems Lesson 2: File System Features This lesson covers the following topics: VNX automatic file system extension feature VNX file system thin provisioning feature File system deduplication Provisioning Monitoring Configuring File Systems

  19. Auto Extend Overview • AVM automatically extends a file system based on High Water Mark • Enabled at creation time or at a later time via the file system properties page Configuring File Systems

  20. File System Extension Process • Another slice is taken from the same stripe volume, if possible, to create another metavolume File System v110 20 GB meta v117 20 GB meta s69 20 GB slice s71 20 GB slice v107 80 GB stripe Configuring File Systems

  21. Auto Extend Considerations • All file system commands are blocked until file system extension is complete • Auto extend options may only be modified if file system is mounted read/write on the Data Mover • Enabling automatic file system extension does not reserve space in the storage pool • Administrators need to ensure there is enough space in the pool for file system extension Configuring File Systems

  22. Thin Provisioning Overview • Allocate file system storage on a need basis • File system grows on demand as data is being written • Auto Extend must be enabled to use thin provisioning on a file system • Max Capacity must be specified • NFS/CIFS clients and applications will see the virtual maximum size instead of the actual allocated size Configuring File Systems

  23. Configuring Thin Provisioning Configuring File Systems

  24. File A File A File B File B File A File B File C File A File C File Deduplication Overview • Deduplicate and compress redundant data at the file-level • If two or more files are identical, only one instance of the file will be used • Increased storage efficiency • File system must have at least 1 MB of free space • Active files will not be deduplicated File A File B ActiveFile File A File B File A File C Configuring File Systems

  25. File Deduplication Policy Engine • The File Data Deduplication policy engine specifies which data to be processed based on the file’s: • Modification time - at least 15 days • Last access time - at least 15 days • Size - 24KB to 8TB • File extension • None of the file’s metadata (attributes, name, timestamps) is affected by the deduplication process Configuring File Systems

  26. Hash Table Policy Engine Deduplication Walkthrough Hidden Store PP1FED81 PP1FED81 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Write hash, erase file, leave stub. YES NO Production File System Configuring File Systems

  27. Hash Table Policy Engine Deduplication Walkthrough (continued) Hidden Store PP1FED81 PP1FED81 HG3FEF23 HG3FEF23 HG3FEF23 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Write hash, erase file, leave stub. YES NO Production File System Configuring File Systems

  28. Hash Table HG3FEF23 Policy Engine Deduplication Walkthrough (continued) Hidden Store PP1FED81 PP1FED81 HG3FEF23 HG3FEF23 • Eligible? (policy check) Size is too small NO Production File System Configuring File Systems

  29. Hash Table HG3FEF23 Policy Engine Deduplication Walkthrough (continued) Hidden Store PP1FED81 PP1FED81 HG3FEF23 HG3FEF23 • Eligible? (policy check) Access time check did not pass, this is an active file NO Production File System Configuring File Systems

  30. Hash Table HG3FEF23 Policy Engine Deduplication Walkthrough (continued) Hidden Store PP1FED81 PP1FED81 HG3FEF23 HG3FEF23 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Erase file, leave stub. YES YES Production File System Configuring File Systems

  31. File Deduplication Considerations • Increase storage efficiency by running File Deduplication on: • Secondary or archival data if the primary storage has a short retention period • Both primary and secondary data if there is a longer primary storage retention period • Heavy utilized Data Movers will take longer to deduplicate files • Use file extension to limit the deduplicationon non-compressible, non-duplicate files • A deduplicated file system may be backed up and restored using NDMP Volume Based Backup without any re-duplication of files Configuring File Systems

  32. Provisioning Monitoring • System > Monitoring and Alerts > Statistics for File • Three weeks worth of data • Able to export or print data Configuring File Systems

  33. Configuring File Systems Lesson 2: Summary During this lesson the following topics were covered: VNX automatic file system extension feature VNX file system thin provisioning feature File system deduplication Provisioning Monitoring Configuring File Systems

  34. Configuring File Systems Lesson 3: Creating File Systems This lesson covers the following topics: File system size considerations File system creation with AVM View existing file systems Extending a file system manually Renaming an existing file system Delete a file system Configuring File Systems

  35. Size Considerations Configuring File Systems

  36. Viewing Existing File Systems • Storage > Storage Configuration > File Systems Configuring File Systems

  37. File System Creation Configuring File Systems

  38. File System Properties Configuring File Systems

  39. File System Volumes Configuring File Systems

  40. VNX File System Wizard Configuring File Systems

  41. Extending File Systems Configuring File Systems

  42. Extending File Systems (continued) • A new metavolume was created (v117) and concatenated to the original v110 metavolume Configuring File Systems

  43. Renaming a File System • A file system may be renamed after it has been created, mounted, or exported • Renaming is done from the Properties page • File system mountpoint and export will still need to be renamed filesystem_8 Configuring File Systems

  44. Deleting a File System • After an AVM file system is deleted, underlying volume structure is also deleted and storage is returned to the pool Configuring File Systems

  45. Configuring File Systems Lesson 3: Summary During this lesson the following topics were covered: File system size considerations File system creation with AVM View existing file systems Extending a file system manually Renaming an existing file system Delete a file system Configuring File Systems

  46. Configuring File Systems Lesson 4: File System Administration This lesson covers the following topics: Obtain status on a file system File system capacity management Evaluating file systems status Configuring File Systems

  47. VNX File System Statistics Configuring File Systems

  48. Capacity Management • 26 weeks of historical usage data • Graph and properties can be printed • Graph usage data can be exported as CSV file Configuring File Systems

  49. server_stats Overview • Provides real-time performance statistics for a specified Data Mover, including file systems • CLI only • Displayed in a time-series style • Statistics are displayed at the end of each polling interval Configuring File Systems

  50. server_stats Command Syntax [nasadmin@VNXB ~]$ server_stats USAGE: server_stats <movername> -list | -info [-all|<statpath_name>[,...]] | -service { -start [-port <port_number>] | -stop | -delete | -status } | -monitor -action {status|enable|disable} |[ [{ -monitor {statpath_name|statgroup_name}[,...] | -monitor {statpath_name|statgroup_name} [-sort <field_name>] [-order {asc|desc}] [-lines <lines_of_output>] }...] [-count <count>] [-interval <seconds>] [-terminationsummary {no|yes|only}] [-format {text [-titles {never|once|<repeat_frequency>}]|csv}] [-type {rate|diff|accu}] [-file <output_filepath> [-overwrite]] ] Configuring File Systems

More Related