A P2P Distributed Computing Platform: Korea@Home

1. A P2P Distributed Computing Platform:Korea@Home 2004.1.28(Wed) C.Y. ‘Connor’ Park chan@kisti.re.kr KISTI Supercomputing Center

2. Overview • Korea@Home (KatH) : A Software Platform for Distributed Computing using Volunteer Computer Resources • Features • Hybrid Peer-to-Peer architecture • Secure PKI-based Security and Digital Signature • Web Services with SOAP messaging

3. Motivation • To take advantage of and stimulate ‘Broadband Network Infrastructure in Korea’ • To meet the growing needs of computing power for applications • Funded by ‘Ministry of Information and Communication (MIC)’

4. Broadband Network Infrastructure in Korea • Over 10M Broadband network (xDSL, Cable) households (over 70% penetration) – 2002.11 • Over 58.4% of PCs with Pentium3+

5. Science SETI@Home, climateprediction.net Life Science Folding@Home, FightAIDS@Home Cryptography Distributed.net, RSAttack576 Mathematics Mersenne Prime Search, Pi(x) Project Internet Grub, CycleTrader Financial MoneyBee Games ChessBrain Miscellaneous DALiWorld Similar Projects from http://www.aspenleaf.com/distributed/index.html

6. Project History • 2002. 4. • MIC launchedthe pilot project ‘Korea@Home’ • Application : Virtual Screening for New Drug Design • 2002. 8. • First pilot production and test • Client/Server Architecture Model • 2002. 12. • Second pilot production and test • 2003. 4. • Regularize the project “P2P Internet-based Distributed Computing Platform Development” • 2003. 9. • Announcement of Hybrid P2P-style Distributed Computing Platform

7. Cooperation Cooperation Cooperation Architecture Agent Agent Agent Distribution Distribution Internet Distribution Agent Distribution Subscription Job Request Large-scale Application Resource Management

8. Agent Agent Agent Agent KatH Server Job Distribution • Authentication • Working Specification Request • Is there any job for me to work? • Who has the job data? Internet • Getting data, working, and returning result to server

9. 2002 Pilot Projects • Application : Virtual Screening for New Drug Design • Client-Server Architecture • An Agent • Receives about 400KB-size file • Executes during 20 minutes per working unit • Returns about 190KB-size file • Total number of working job units : 50,000

10. Calculating Active Site PMI Calculating Ligand PMI Structure Analysis Virtual Screening Target Protein Chemical DB Share Analysis Clinical Demo Mass-produce New Drug Disease Protein Ligand DB Virtual High-Throughput Screening + + Client 1 + + Client 2 Server + + Looking for Drug Candidate Client 3 Internet

11. Experimental Results • 1st Test • 1,217 installed agents • 2002.8.22-9.2 • Max 53.5 Gflops / Avg. 31.78 Gflops • 2nd Test • 6,472 installed agents • 2003.2.6-2.14 • Max 644 Gflops / Avg. 470.6 Gflops ※ World Top Rank 124 - 629.7 Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192 (from http://www.top500.org, 2003.6)

12. Intention of Participation Korea@Home Understanding Intention of Providing Resources Providing with Compensation (7.2%) Don’t (2.9%) Don’t Know (33.3%) Well-Understanding (44.9%) Keep up Providing (59.5%) Providing later (30.4%) Understanding roughly (21.8%) • 67.7% of Netizen already know what is Distributed Computing and Korea@Home. • 89.9% of Netizen have intention of providing their PC resources.

13. 2003 Progresses • P2P data distribution • New Applications • Virtual Screening for New Drug Design • Global Risk Management for financial investment • 3D image rendering • Supplementary plug-in • Remote backup service

14. Futurework • Make P2P agents more intelligent and cooperative with each other. • A set of APIs for application developers • Fault-tolerance : checkpointing & rollback recovery • IPv6 version • Open-Source (?) • Windows-only  Unix version

15. Thanks a lot! ^^ chan@kisti.re.kr, http://www.koreaathome.org

16. Design Goals • Application Developers (Job Requester) • Convenience • They should be able to use easily. • Flexibility • The platform is general enough to be used by various applications. • Correctness • The platform should return correct results.

17. Design Goals • PC agents (Resource Providers) • Transparency • PC users are not disturbed in their own works. • Reliability • It’s reliable not to make any security and privacy problem. • Reward • There is any kind of compensation, even just in mind.

18. Design Goals • Platform • Scalability • Performance should be improved according to the growth of agents. • Adaptability • It should put up with the dynamic features of Internet.

19. Implementation Choices • Web Services • SOAP messaging over https • Request-Response Model • It is Agents’ duty to make most decisions. • PKI-based certification and Digital Signature for files Make server as simple as possible, and Make PC agents more intelligent

20. Functional Classification • Resource Management • Authentication, Certification • Simple accounting • Scheduling and Job distribution • Job distribution with hybrid P2P style • Result gathering • Client Management • Client authentication • Application preparation to work • Digital signing • Result returning to client

21. Networking Issues • Network Security • DoS, Spoofing, Sniffing, … • Variable Connection • Dial-up, cable, xDSL, T1/E1, … • IPv6, WiFi, Bluetooth, … • Network Unobtrusiveness • Background/shared communication • Transparency (Firewall/NAT)