1 / 15

Running a Scientific Experiment on the Grid

Running a Scientific Experiment on the Grid. by Tomasz Szepieniec IFJ PAN & CYFRONET. Vilnius, 13 rd May, 2008. Scientific Experiment. What it is?

nimrod
Télécharger la présentation

Running a Scientific Experiment on the Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Running a Scientific Experiment on the Grid by Tomasz Szepieniec IFJ PAN & CYFRONET Vilnius, 13rd May, 2008

  2. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Scientific Experiment What it is? set of observations performed in the context of solving a particular problem or question, to retain or falsify a hypothesis or research concerning phenomena. (wikipedia)‏ computations which a researcher need to run, to make progress in his/her research Examples: Monte Carlo simulations Massive protein folding for testing releases of folding software Simulation of a scheduling process using a new algorithm Prepare an advance visualization of simulation results

  3. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Why running it on Grid? Because time matters Single sequential job? NO - a processor on your desktop has the same power Make sense if the process is done in parallel high throughput computing multithreaded, parallel computation is our future! Storing and sharing huge data is now possible Access to specific machines hardware supporting specific type of computation huge parallel installations software available for lower/no cost

  4. GAUSSIAN VO • VO for GAUSSIAN users • operated by in EGEEII &III by CYFRONET (Krakow, Poland)‏ • For users • everyone that accept the policy can join • easy to start – ready scripts.. • http://egee.grid.cyfronet.pl/Applications/gaussian-vo/ • For admins • sites with GAUSSIAN site licence can join • http://egee.grid.cyfronet.pl/Applications/gaussian-vo-how-to-support/ T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius

  5. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Working group view: miracle of sharing resources If there is a shortage of resource,SHARING is the solution Typical stages of an experiment: Preparing, Computing, Analyzing, (Writing a paper)‏ It does not refer to some researcher (e.g. solving Sierpinski problem)‏ Sharing gives you more than you can obtain by keeping your part only Unmet demand resources Unused resources demand Figure copied from P. Plaszczak „Grid Computing”

  6. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Jump in? Before jumping see the other side…

  7. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Additonal effort required • Access to data becomes transfers • You should think about the following: • How many times I need to use it? • Location and size of data • Speed-up including overheads • Parallel execution • Licensed software • Other people that uses produced data • Security level required

  8. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Also technical problems • Job sometimes fails – resubmission is required • Some sites are just wrongly configured! • We should not overflow VOs but use it efficiently • In some failures only the application operator should make decision what to do • Jobs are to quick (e.g. 10min)= submission overhead to large – we need put more workload to single grid job

  9. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Virtual Labolatory is all we need Figure copied from EU IST Virolab Project

  10. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Guideline #1 It is better to spend 60 minutes on preparing a tool than 3 minutes every day of doing work manually

  11. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Example: Rendering Application • Application: Visualization for L-system editor; user want to quickly create movie showing the results. • Goal: Limit movie generation time • Mean: Make parallel scenes rendering on the grid, using interactive connections between master and workers by Krzysztof Abramowicz, Cyfronet

  12. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Results: Quick preview for user

  13. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Guideline #2 The best possible grid is invisible.

  14. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Example: Grid application without grids by JUMC Team in EUChinaGrid Project, Kraków, Poland

  15. T.Szepieniec AT cyfronet.pl; 13May 2008, Grid Open Day, Vilnius Kind suggestions of conclusions • For researchers: To have more time for science, you need tools that improve your efficiency. The grid is one of them. • For grid developers and industry: Between an user and a grid middleware there is a gap that you are to bridge with tools that hide all which is not necessary for researcher to do science.

More Related