1 / 13

JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIV Hiromichi Fukui

JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIV Hiromichi Fukui. Background. JAXA and KEIO Univ start to try establishing “Digital Asia” system In Digital Asia, it required to - semi-real time data processing, analyzing

risa
Télécharger la présentation

JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIV Hiromichi Fukui

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIV Hiromichi Fukui

  2. Background • JAXA and KEIO Univ start to try establishing “Digital Asia” system • In Digital Asia, it required to - semi-real timedataprocessing, analyzing JAXA and Keio Univ had computing GRID experiments as a data processing part.

  3. Purpose • Accumulate knowledge, know-how to process remote sensing data by GRID Computing. • To study technology elements to realize near realtime system on developing Digital Asia.

  4. Trial Area Computational GRID Image processing Geometric rectify process Composit process Raidometric rectify process NDVI process

  5. Test Environment Software Hardware ・GLI250m processing program LTSK10_250m　（Composite） LTSK1_250m　 （Radiometric） ・GRID middleware CyberGRIP System User Management Server GigabitEthernet Computing Server

  6. シーン11 シーン1 シーン12 シーン2 Processed image シーン11 シーン11 シーン11 シーン11 シーン1 シーン1 シーン1 シーン1 image processing Image processing シーン12 シーン12 シーン12 シーン12 Image processing image processing シーン2 シーン2 シーン2 シーン2 Computing GRID Overview Management server ＰＣ Required spec of server Systemwalker CyberGRIP Master User ・ＯＳ Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) ・Disk ２０MB ・memory ３０MB + User X 13MB) Processing program sceine Required spec of node ・ＯＳ [Windows] Windows SV 2003SE/EE Windows 2000 SV/AS/Pro Windows XP Professional [Linux] Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Red Hat Linux 9 ・Disk ５MB ・memory　 ５０MB Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Computing node ＰＣ

  7. 60 51.94 50 Processing ours 40 30 17.20 20 10 5 machines 0 Non Grid Grid env Estimation of scalability • ５２ Hours ->１７hours （66%）reduction • ※ (コンポジット処理 +大気補正処理) × 5ジョブの場合

  8. 200４/11

  9. Cyber GRIP • Fujitsu is making efforts to standardizeto OGSA,JDSL …

  10. Data processing Data processing Receiving Station （センサA用） （センサX用） Recording system Next step For semi-realtime data processing Satellite data Data GRID Data GRID データ データ データ データ data preservation data preservation ・・・・・・ データ データ Computing GRID Processing flow Alignment among the process Automatic flow control Exec multiple job pallarelly Realize by JGES function Realize by OJC function

  11. Next step management of flow control Data acquisition or submit job after complete previous job Automatic parameter generation Parameter File Parameter file Parameter file Parameter file データ データ データ データ Geo rectify Radio rectify composit NDVI 制御ファイル Processing flow control by OJC 　　・dynamic feedback by the results and resubmit jobs データ 低クォリティ結果時に 処理パラメータや入力データ選択へのフィードバック／再実行

  12. Thank you

More Related