Managing Venue Data Storage Using AccessGrid DataStoreClient
This guide provides an overview of the Venue Data Storage capabilities utilizing the AccessGrid DataStoreClient. It explains the structure of the Venue data storage system, emphasizing the importance of a single-level list with no duplications. Developers will learn how to interface with the data store, including uploading and downloading files, querying matching files, and accessing metadata. Example scripts illustrate key operations, making it easier to integrate these tools into application development. For further hands-on practice, exercises are provided for creating a basic file browser.
Managing Venue Data Storage Using AccessGrid DataStoreClient
E N D
Presentation Transcript
Venue Data Storage Susanne Lefvert lefvert@mcs.anl.gov University of Chicago
Venue Data Storage • Single level list • No duplications allowed • Double-click to open • Right-click for options • Venue data versus Personal data
Venue Data Storage • The data storage resides on the file system of the server. Each venue has a directory with files in the Data folder. • Venue has a set of data descriptions • Meta information about each data object • Transfer details • Each data upload is actually two file transfers • Meta data • Actual files using GSI HTTP
DataStoreClient • Tool for developers • Hides details about • SOAP communication • Data cache • Upload/Download • File listing • API • AccessGrid.DatastoreClient • AccessGrid.Descriptions.DataDescription http://www.mcs.anl.gov/fl/research/accessgrid/documentation/developer/api/
Example: Script from AccessGrid.DataStoreClient import GetVenueDataStore from AccessGrid.Toolkit import CmdlineApplication # Initialize AG application app = CmdlineApplication() args = app.Initialize() # Create data store interface venueUrl = "https://localhost:8000/Venues/default" dataStoreClient = GetVenueDataStore(venueUrl) # Upload a file to venue dataStoreClient.Upload("test.doc") dataStoreClient.Upload("test.ppt")
Example: Script # Get data from venue dataStoreClient.LoadData() # Get file names that matches a specific pattern files = dataStoreClient.QueryMatchingFiles("*.doc") # Get data description for a file name data = dataStoreClient.GetFileData(files[0]) # Download a file from venue dataStoreClient.Download("test.doc", "localFile.doc") # Remove file from venue dataStoreClient.RemoveFile("test.doc") dataStoreClient.RemoveFile("test.ppt")
Exercises http://www.mcs.anl.gov/fl/research/accessgrid/documentation/tutorial/AGTk_2.4 Exercise 8 – Data Storage • Trying the DataStoreClient test script. • Creating a venue file browser