1 / 17

2009

????. ????????????. ????. ????????????????????????????????????NFS, AFS, LustreGFS?????OpenMP, MPI(??????)MapReduceDryad(??????). ????(?). MapReduce?????????PageRank?????Canopy Clustering????????BigTableChubby. ????. ??0Hadoop?????,????????1MapReduce????:?????????????:????????

maeko
Télécharger la présentation

2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. ???????????????? ???????????? 2009??

    2. ???? ???? ?? ?? ????

    3. ???? ???????? ?????????? ????? ?????? ??????? NFS, AFS, Lustre GFS ????? OpenMP, MPI(??????) MapReduce Dryad(??????)

    4. ????(?) MapReduce???? ?????PageRank ?????Canopy Clustering?? ?????? BigTable Chubby

    5. ???? ??0 Hadoop?????,?????? ??1 MapReduce????:?????????? ???:?????? ??2 MapReduce??:PageRank?? ???:Wikipedia??(??????) ??3 MapReduce??:???? ???:Netflix?? ????????????

    6. ???? http://code.google.com/edu/ Google????????,??parallel???????????????? http://hadoop.apache.org/ Hadoop????? http://developer.yahoo.com/hadoop/tutorial/ Yahoo?hadoop????,???????????????? Hadoop ????(???????hadoop???,??????????????) http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29 http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Multi-Node_Cluster%29 http://net.pku.edu.cn/~course/cs402/2008/resource.html

    7. ??????? ??????????? ??????2007course??? ????

    8. ???? ????:20?,???????,4G??,?????,250G???? ??,???? ??:15? ??,????????,??,Java ??:5? ???:??,??????????,???????,MapReduce????,??????,??hadoop???????MapReduce?? ???:??,??PageRank????Canopy Clustering??,???????1,2,3,???????????? ???~???:?????,??,??????????,??????????

    9. ????????? ??:2~3?????? ??????,???? NBody???,??????? ??????????

    10. Course Example: 2007

    11. Staff Kang Chen Instructor ck99@mails.tsinghua.edu.cn Dahai Li Project Lead dahaili@google.com Kai Wang Project Lead kaiwang@google.com Yubing Yin Teaching Assistant burningice9@gmail.com

    12. Thanks to: Kuang Chen Christophe Bisciglia Albert Wong Hannah Tang

    13. Goals and Expectations 5 Lectures Readings Homework + discussion 4 Labs Final projects Final project proposal Project reports Project review @ Google

    14. Course Information

    15. Timetable

    16. Lecture and Labs

    17. ??

More Related