1 / 37

Unigroup : OpenAFS Distributed Storage

Unigroup : OpenAFS Distributed Storage. The YFS Mission. To provide the world with a next generation storage platform for unstructured data, enabling deployment of mobile applications, virtualization solutions, and software.

jayme
Télécharger la présentation

Unigroup : OpenAFS Distributed Storage

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Unigroup: OpenAFS Distributed Storage

  2. The YFS Mission To provide the world with a next generation storage platform for unstructured data, enabling deployment of mobile applications, virtualization solutions, and software. To support the on-going development of relevant critical path standards and open source technologies.

  3. What are AFS and OpenAFS? • AFS is: • A global file system name space (/afs) • A family of file system RPCs used to manipulate the contents of the name space • A class of client and server implementations that provide access to the name space • OpenAFS is: • One of the oldest open source communities • One of the largest open source projects • The most widely deployed implementation of AFS

  4. A Very Brief History of AFS • Andrew File System • Part of the Carnegie Mellon University and IBM Andrew Project of the 1980s • First reference to “Cloud Storage” in early papers • I.P. owned by IBM not Carnegie Mellon • AFS commercialized by Transarc / IBM • Shifted focus to DCE DFS • Open source era began in 2000

  5. 11 Years of Open Source • Large active team. • 40 devs in last 12 months. • 249 since formation. • Nearly 1 million lines of code and documentation. • Approaching 10,000 contributions. • Basic COCOMO effort analysis • 217 person years • $23 million

  6. AFS satisfies Operational Requirements

  7. High Level Architecture Replication of data volumes ensure high availability and disaster recovery Separate location and data servers allow for strong scalability and seamless maintenance Rich security services provide secure access on open networks and federated collaboration File Server Location Server File Server Data Data Authenticated Callbacks notify clients of changes to data, metadata and lock status Apps Apps OS AFS Cache AFS Client OS AFS Client AFS Cache AFS cache stores recently accessed file, directory and location data reducing network traffic Client Device Desktop, Laptop, Mobile Client Device Portable cross platform client

  8. AFS Volumes are File Systems • Each has an owner • Each belongs to a specific cell which determines which protection database is used for access control • Each can be migrated, replicated and backed up independently • Each can mount other volumes within the same or different cells

  9. Graph of Cell Volume Structure

  10. How to Make Stuff Go Fast • The fastest RPC is the one that is never sent • AFS caches data and metadata to avoid repetitive fetches from the file servers • Cached info: • Object Status (size, timestamps, data version) • Per user permissions • Lock state • Unix mode bits / attributes • Accessed data extents (offset, length)

  11. What about multi-user access? • For each read-write object and each read-only volume a callback promise is registered with the file server the data was accessed on. • When any change occurs to the state of the object or volume, the file server notifies all registrants that some change *might* have occurred. • It is up to the client to decide if updated data is required.

  12. Cache Coherency Matters

  13. Title • Bullets

  14. Title • Bullets

  15. Title • Bullets

  16. Title • Bullets

  17. Title • Bullets

  18. Title • Bullets

  19. Title • Bullets

  20. Title • Bullets

  21. Title • Bullets

  22. Title • Bullets

  23. Title • Bullets

  24. Products and Services:Enhanced DesktopClients • Enhanced user interface integration • Troubleshooting wizards • Integrated update service • OS Vendor certification • Microsoft Windows only

  25. Products and Services:iOS Mobile Clients • Features • File Browser • Integrated document viewing • Open documents with third party applications • Save documents from third party applications • Integrated authentication • User to User Document Sharing Service • Core Application Frameworks available for integration in custom apps

  26. Products and Services:Monitoring and Management Service • Capable of monitoring multiple cells • Collects server performance data • Performs cell consistency checks • Alert generation • Cell introspection • Browser and mobile application

  27. Products and Services:Storage Appliances Integrated Turnkey Storage Appliances offering a superset of OpenAFS functionality

  28. Products and Services:Training and Support 24-7 Crisis Resolution Services Troubleshooting and Configuration Services On-site and remote training classes for system administrators and end users Custom feature development Services provided for both OpenAFS and YFS

  29. Storage Appliance Road Map 1st Gen 1st Gen 2012 Q1 • Base file system platform • Large volume support • GSS Authentication • AES-256 RFC3962 encryption • High scalability • R/W replication • IPv6 • Parallel reads • Unicode directories • Disaster recovery capabilities • No single points of failure • Departmental file servers • Byte range locks • Authenticated Fine Grained Coherency • Many-to-One Authnto Authz Ids • Arbitrary file system import • Automated client update services • Automated Troubleshooting Tools • Mobile clients and SDKs for custom applications • Integrated Monitoring and Management Interface

  30. Storage Appliance Road Map 1st Gen 1st Gen 2nd Gen 2nd Gen 2012 Q1 2013 Q1 • Base file system platform • Large volume support • GSS Authentication • AES-256 RFC3962 encryption • High scalability • R/W replication • IPv6 • Parallel reads • Unicode directories • Disaster recovery capabilities • No single points of failure • Departmental file servers • Byte range locks • Authenticated Fine Grained Coherency • Many-to-One Authnto Authz Ids • Arbitrary file system import • Automated client update services • Automated Troubleshooting Tools • Mobile clients and SDKs for custom applications • Integrated Monitoring and Management Interface • Advanced volume storage • Data integrity • De-duplication • Compression • Self-healing • Snapshots & clones • Storage pools • Additional features • TCP transport • Disconnected clients • Event driven server arch. • Multiple data streams • Extended Attributes • Peer to peer data sharing • Hypervisor Integration

  31. Storage Appliance Road Map 1st Gen 1st Gen 2nd Gen 2nd Gen 2012 Q1 2013 Q1 • Base file system platform • Large volume support • GSS Authentication • AES-256 RFC3962 encryption • High scalability • R/W replication • IPv6 • Parallel reads • Unicode directories • Disaster recovery capabilities • No single points of failure • Departmental file servers • Byte range locks • Authenticated Fine Grained Coherency • Many-to-One Authnto Authz Ids • Arbitrary file system import • Automated client update services • Automated Troubleshooting Tools • Mobile clients and SDKs for custom applications • Integrated Monitoring and Management Interface • Advanced volume storage • Data integrity • De-duplication • Compression • Self-healing • Snapshots & clones • Storage pools • Additional features • TCP transport • Disconnected clients • Event driven server arch. • Multiple data streams • Extended Attributes • Peer to peer data sharing • YFS hosted storage services and facilities build out using YFS rack servers • YFS hosted storage services and facilities build out using YFS rack servers Hardware encryption module • Consumer storage appliance

  32. Storage Appliance Road Map 1st Gen 1st Gen 2nd Gen 2nd Gen 3rd Gen 3rd Gen 2012 Q1 2013 Q1 2014 Q1 • Base file system platform • Large volume support • GSS Authentication • AES-256 RFC3962 encryption • High scalability • R/W replication • IPv6 • Parallel reads • Unicode directories • Disaster recovery capabilities • No single points of failure • Departmental file servers • Byte range locks • Authenticated Fine Grained Coherency • Many-to-One Authnto Authz Ids • Arbitrary file system import • Automated client update services • Automated Troubleshooting Tools • Mobile clients and SDKs for custom applications • Integrated Monitoring and Management Interface • Improved Package Management • Namespaces • Volumes • Application deployment • Hybrid cloud deployments • Integrated Search • Named Pipes • Advanced volume storage • Data integrity • De-duplication • Compression • Self-healing • Snapshots & clones • Storage pools • Additional features • TCP transport • Disconnected clients • Event driven server arch. • Multiple data streams • Extended Attributes • Peer to peer data sharing • Hypervisor Integration • YFS hosted storage services and facilities build out using YFS rack servers • YFS hosted storage services and facilities build out using YFS rack servers Hardware encryption module • Consumer storage appliance

  33. YFS Storage Appliance v1 Salvager, Vol Mgmt, Backup File Server Volume Location DB Protection DB Monitor DebiankFreeBSD(Linux with BSD Kernel) Microsoft OEMStorage Server 2008 R2 OEM Hardware Hardware RAID OEM PartnerOn-site Service +

  34. YFS Storage Appliance v2 Salvager, Vol Mgmt, Backup File Server Volume Location DB Protection DB Monitor DebiankFreeBSD Microsoft OEM Storage Server 2008 Pooled storage devices OEM Hardware Hardware RAID + OEM Partner On-site Service

  35. Hypervisor Integration Guest Guest Guest Hypervisor Virtual FS Hypervisor Virtual FS Hypervisor Virtual FS Virtualized cache access YFS cache Host

  36. Demos iOS applications Monitoring tools

  37. 255 W 94TH STNew York NY 10025 USA+1 212 769-9018sales@your-file-system.com http://www.your-file-system.com

More Related