1 / 32

EGEODE usage overview in EGEE infrastructure

EGEODE is a virtual organization that enables sharing of IT resources and best practices among geoscience research centers. It offers a seismic processing platform for research and education, with standard tools for signal processing, simulation, and inversion. EGEODE also provides a global workflow for velocity analysis, time and depth imaging, and reservoir geophysics. The organization has seen significant usage and collaboration with CNRS labs, with over 2000 Geocluster batch jobs and 200GB of seismic data in 2008.

slovelady
Télécharger la présentation

EGEODE usage overview in EGEE infrastructure

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EGEODE usage overview in EGEE infrastructure Gaël Youinou CGGVeritas 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  2. Contents 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy EGEODE  Virtual Organisation • Applications • Global Workflow EGEODE Statistics and Usage • ISTEP - Laboratoire de Tectonique Paris6 • UMR – Géosciences Azur • UPMC - Sisyphe • IPG/EOST - Strasbourg • IPGP Jussieu Paris • ENS Géologie Paris EGEE-III Earth Science Cluster • KEREON: Grid file explorer • Automatic application test Conclusion

  3. EGEODE  Virtual Organisation 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy EGEODE Virtual Organization « Expanding GEosciences On DEmand » • Virtual Organization to share IT resources and best-practices • Opened to all Research centers in geosciences, initially geophysics • Close collaboration with ESR « Earth Sciences Research » VO (Earth Observation, Climate, Hydrology, Solid Earth Geophysics)

  4. EGEODE Application 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy Seismic processing generic platform for research and education • Based on Geocluster (GCT), an industrial application, used in production at CGGVeritas • Key technology for earth sciences in Oil&Gas and Environment • Ported to EGEE infrastructure for Academia (2005)

  5. EGEODE Application • Seismic processing generic platform for research and education (cont’d) • Include several standard tools for signal processing, simulation and inversion (model optimization) • Open • Any user can write new algorithms in new modules • Free access for academic research • Controlled by license keys • Added value • Capability to solve complex problems and to validate innovative algorithms on real size data sets • Close the gap between Research and Industrial environment • Attract and keep brightest researchers • Framework for Industry/Research collaboration 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  6. EGEODE Global workflow • Velocity • Analysis • (1D,2D) • Time • Imaging • (3D) • Depth • Imaging • (3D) • Reservoir • Geophysics • Pre-processing • (1D, 2D) • Rock properties Run on EGEE • Structural model • Velocity model • 3D seismic 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  7. EGEODE VO Statistics and Usage EGEODE VO statistics • 6 CNRS laboratories • ISTEP - Laboratoire de Tectonique Paris6 • UMR – Géosciences Azur • UPMC - Sisyphe • IPG/EOST - Strasbourg • IPGP Jussieu Paris • ENS Géologie Paris • UNIL – Université de Lausane • ~30 users • 2000+ Geocluster batch jobs in 2008 • 200 Gb of seismic data 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  8. ISTEP - Laboratoire de Tectonique Paris6 Hardware • Local UI (Jason) • GCT4100 &GCT3100 versions on local workstations Grid usage • Geocluster • Joint inversion of geophysical data (gravity, seismic) EGEODE • 4 users (permanent members and students) • 2D Multichannel seismic (360 channels), 5500 km of lines • Sequence: time variant amplitude adjustment, spherical divergence correction, spiking deconvolution, Radon (τ, p) domain antimultiple, controlled frequency-wave number (F, k) domain antimultiple and (F, k) domain filtering, dynamic correction, stack, migration 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  9. ISTEP - Laboratoire de Tectonique Paris6 EGEODE (cont’d) • TIKIM (Kirchhoff prestack time migration) was tested by a student • No use of Geovel (velocity picking) yet Dissemination • Autin Julia, PhD Thesis dec. 2008 • Basuyau Clémence, PhD Thesis, 2011. Articles expected SWOT Analysis • Advantages: Almost no installation and software management is necessary; High level of computation capacity • Drawbacks: Input and output data management; For short job (2D seismic) grid is not necessary; The module KIRCH (post-stack Kirchhoff Migration) and a similar interface as Geopad to manage the project, data, … are lacking 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  10. ISTEP - Laboratoire de Tectonique Paris6 Training • Training on the grid Collaborations • With CNRS labs who are providing hardware or expertise • IPSL’s UI ? 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  11. UMR - Geoazur Hardware deployments • 1 local UI Sun Fire X2200 Opteron dual core 2,2GHz, 4Go Ram, SL 4.4) • 1 CE and 1 WN virtualized with VMware ESXi on a Sun Fire X2200 (Opteron dual core 2,66GHz, 32Go Ram, SL 4.7) • Short term planned installations 2 WN and 1 SE • NX clients are used for remote access to our local UI Grid usage • Seismic data processing on Geocluster • Others software deployed on the Grid are used Seismic Unix and GMT (Generic Mapping Tools) 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  12. UMR - Geoazur EGEODE • Users into the laboratory 3 permanent members, students • Processed studies 2D marine multichannel seismic Around 3000 km of seismic lines are recorded during a survey • Seismic processing workflow • Minimum phase conversion (WAPCO) • Static application (HISTA) • High frequency filtering - time gain function , spherical divergence compensation (REFOR, SDICO) • corrections of amplitude anomalies (EDITE, EXPEN, HARMO, SPARN, DYNQ) • Deconvolution (TRITA, (DECON)) 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  13. UMR - Geoazur EGEODE (cont’d) • Velocity analysis VESPA, VELCOM • NMO correction (FANMO) - trace muting (MUTES) • F-K multiple attenuation (FKMUL, FKFIL)- 2D Kirchhoff DMO (QRDMO, KIDMO) • Trace stacking (STACK)- frequency filtering (FILTR) • 2D post stack migration (KIRCH, FKMIG)- amplitude equalization - Plots (DYNQ, AMCO, FKFIL, PLOTX) 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  14. UMR - Geoazur EGEODE (cont’d) • Feedback information on Geocluster utilization Few difficulties have been encountered when transferring older Geovecteur and local Geocluster sequences to the Grid The Kirchhoff prestack time migration (TIKIM) is still in phase of test Interactive applications on the Grid offer the same performances as working on a local version of the software Dissemination • PhD students were used to working on Geovecteur for their processing workflow This practice tends now to disappear to the benefit of Geocluster usage A Master student is actually working on Geocluster and will transfer very soon her job flow to the Grid 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  15. UMR - Geoazur SWOT Analysis • In practice the installation and the setup of a EGEE UI is very simple compared to a local installation of Geocluster, however the installation of CE and WN requires good knowledge in system and network administration • Requests for GCT module: a module that takes seismic section as input and generates images in Postscript format file 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  16. UMR - Geoazur Training • Feedback information on CGGVU training courses Very good dedicated program, well adapted to our 2D marine processing sequences and data • Futures needs Deconvolution and multiple attenuation Conclusion • The execution time of a job on the Grid indicates good performances, however when large files are transferred to the Grid, this has direct impact to the execution time of a job In this case, it’s more comfortable to work on a local version of Geocluster • We plan ton install a SE on the laboratory to improve access to the data 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  17. UPMC - Sisyphe Hardware • Inside laboratory Small cluster of 9 nodes (bi-processor 32bit) Three years old Access only from local network Study for a computing server gathering several labs of Earth Siences inside UPMC, including Sisyphe. • Nx server Only UI2 from CGGVeritas Grid usage • Geocluster • Geovel • Other in-house codes (Fortran 90) 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  18. UPMC - Sisyphe EGEODE • Number of users For now 3 • Type of studies Seismic processing (Geocluster, Geovel), development of a modeling code in CSEM (Controlled Source ElectroMagnetic) • Type of jobs Sequential for Geocluster, MPI for CSEM modeling • Geocluster feedback Simplicity of utilization, but lack of staff for solving technical problems quickly on the site (sometimes long waiting time) • Geovel feed back Simplicity of utilization, but random bugs 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  19. UPMC - Sisyphe Dissemination (PhD thesis) • “Contrôle de la qualité du traitement des données sismiques du bassin sédimentaire de la Côte d’Ivoire – Apport de la géostatistique – Tentative de retraitement” (Marie Oussou) • “Etude par simulation de méthodes électromagnétiques employées au suivi d’un réservoir en production” (Cyril Schamper) SWOT Analysis • Pros/Cons in comparison to a local use of Geocluster: access from everywhere via internet • Needs for GeoclusterNothing particular, exhaustive information 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  20. UPMC - Sisyphe Training • No training Learning by experiencing Collaborations • Collaboration with other VO With ESR if needed • Collaboration with other CNRS labs (material and expertise) Occasionally with researchers from IPGP who administrate ESR VO 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  21. IPG - Strasbourg Hardware • Local UI bi-pro Xeon E5345 quad-core 2,33 GHz, RAM 8Gb) • Nx server usage (local server, server installed on UI2 based in CGGVeritas) Grid usage • Only Geocluster • Local cluster available, access to distant academic clusters EGEODE • 3 (1 permanent member, 2 students) • Type of studies: PSV-3C and conventional seismic processing • PSV-3C tests, fluvial seismic • Geometry, anti-multiples, migration 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  22. IPG - Strasbourg EGEODE (cont’d) • License sharing (SDI Montage) • Specific software (XPS, Geoland) installed on UI2 located in CGGVeritas Dissemination • Internship reports, current work SWOT Analysis • Advantages: Access to the state of the art software including last versions of new applications (Kereon, Jxjob); Shared resources (CPU’s, disks, …) • Drawbacks: Tapes, cartridges or file management; Delays (execution, end of jobs – listings); No easy procedure for UI installation 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  23. IPG - Strasbourg Training • CGGVeritas University training Useful and necessary • Tutorial or HowTo on complex applications (geoland, XPS) would be nedeed Collaborations • Collaborations with EGEODE users 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  24. IPG - Paris Hardware • No hardware installed locally Grid usage • Only Geoclustrer EGEODE • Pre-stack migration jobs will be ported ASAP on the grid Training • Well adapted training on TEAMVIEW, GEOVEL and TIKIM • No more need today Collaborations • With IPSL or the “Laboratoire de Tectonique“ 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  25. ENS Géologie Paris 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy User report on Geocluster and EGEODE VO in academic research

  26. ENS Géologie Paris 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy Marine geophysics in the Geol Lab, geodynamics team • Episodic cruises, episodic processing needs • Basic seismic processing lessons for students using CGG software • Long periods without activity, as marine geophysics is a component amongst wider topics in geodynamics • Software used before Geocluster/EGEODE Geovector 6100! Updates are time consuming for researchers when compared to the episodic use As a result we cannot follow state of the art processing methods

  27. ENS Géologie Paris 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy Problems solved by Geocluster & EGEODE VO in such an environment • Updates are progressive through the CGGVeritas servers • Stability of the UI platform • No need to invest in a Cluster for just an episodic use The laboratory can just share a few nodes on the grid 24/7 and use this shared capacity in a short time on more nodes when needed • New tools (Teamview, Chronovista...) • Prestack time migration (TIKIM) now possible

  28. EGEE-III Earth Science Cluster KEREON: Explorerfor local and lfc grid files • Browse directories • Upload and download files • Rename files and directories • Delete files and directories • Replicate lfc files • Read the properties of files and directories • A GUI to manage data on the grid • User can browse the grid storage services and catalogs as easier as for a local file system. • Allow the user to exchange data between the local UI and the grid storage services very easily • Without typing any command line, only by mouse click 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  29. EGEE-III Earth Science Cluster Automatic application test • Create a tool (like SAM) who • Check all sites automatically for an application • Ban some of them if they are not appropriate for the application • This information could be used before sending a new job 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  30. Conclusion EGEODE  Virtual Organisation • Advantages • Almost no installation and software management is necessary • High level of computation capacity • Shared resources (CPU’s, disks, …); No need to invest in a Cluster for just an episodic use • Access from everywhere via internet • Access to the state of the art software including last versions of new applications • Drawbacks • Input and output data management • For short job (2D seismic) grid is not necessary • UI installation very simple however the installation of CE and WN requires good knowledge in system and network administration • Good performances, however when large files are transferred to the Grid, this has direct impact to the execution time of a job (more comfortable to work on a local version) 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  31. References EGEE project: http://www.eu-egee.org EGEE Earth Science Cluster Portal: http://esc.wdcb.ru/ ES Workplan: https://edms.cern.ch/file/937512/1/work-plan-ES-v4.0.doc BEinGRID project: http://www.beingrid.eu DEGREE project: http://www.eu-degree.eu Geocluster: http://www.cggveritas.com/default.aspx?cid=4-13-1925 EGEODE: http://www.egeode.org Kereon Online demonstration: http://www.egeode.org/egeode/packages/KEREON/1.4.6/kereon.html Installation document: http://www.egeode.org/egeode/packages/KEREON/1.4.6/kereon-installation.pdf 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

  32. CGGVeritas is the world’s leading international pure-play geophysical company delivering a wide range of technologies, services and equipment to its broad base of customers mainly throughout the global oil and gas industry Focused on Performance . Passion for Innovation . Powered by People . Delivered with Integrity We look forward, as CGGVeritas, to serving you in the future. 4th EGEE User Forum 2-6 March 2009 Le Ciminiere, Catania, Sicily, Italy

More Related