1 / 25

CERN IT Department Overview of Activities

This overview provides information on the general services, collaborative tools, networking infrastructure, and grid computing activities of the CERN IT Department.

mmcconnell
Télécharger la présentation

CERN IT Department Overview of Activities

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CERN IT DepartmentOverview of Activities Frédéric Hemmer IT Department Head CERN 10 February 2010

  2. Outline • General Services • Collaborative Tools • CDS/Invenio • Indico • Networking • Internal • Wireless • External • CIXP • Computer Security • CNIC/PLC • Spam • Intrusion Detection • Grid Computing • Tier-0 • WLCG • Data Storage • EC Projects • Openlab • Competency Centres • Workshops – Summer Student program • UNOSAT CERN IT Department - Frédéric Hemmer

  3. General Services • Data Centre Operations (Tier 0) • 24x7 operator support and System Administration services to support 24x7 operation of all IT services. • Hardware installation & retirement (~7,000 hardware movements/year) • Management and Automation framework for large scale Linux clusters • Installed Capacity • 6’300 systems, 39’000 processing cores • CPU servers, disk servers, infrastructure servers • 13’900 TB usable on 42’600 disk drives • 34’000 TB on 45’000 tape cartridges • (56’000 slots), 160 tape drives • Tenders in progress or planned (estimates) • 2’400 systems, 16’000 processing cores • 19’000 TB usable on 20’000 disk drives CERN IT Department - Frédéric Hemmer

  4. General Services (II) • E-Mail and Distribution Lists • Up to 2 M incoming messages/day, 99% detected as spam • 18’000 mailboxes (~ 68% owned by physics community) • Web Services • 8’725 Web sites (~45% owned by physics community, 30% AFS-based) • Active Directory, CERN Certification Authority & CERN Authentication • Central authentication service for Linux and Windows computers and applications • Online X509 Certificate Authority • Windows Services • 60 TB of DFS workspaces (60 TB) • ~ 6’000 active PCs managed by CMF • Windows Terminal Servers and Custom Servers • 120 ‘custom servers’ (not for public use) hosted for various departments • including 62 Windows Terminal Servers CERN IT Department - Frédéric Hemmer

  5. General Services (III) • Database and Application Deployment Services • Mainly based on Oracle software • AIS DBs and Applications, EDMS, Accelerator DBs, IT DBs, CASTOR DBs, Physics databases (Calibration, Alignment, etc...), Public J2EE Service, etc... • 120 General Purpose Databases, 240 TB of NAS storage • 130 Web /Application Servers with 700 virtual hosts • 50 Terabytes of worldwide replicated Physics databases • Engineering and Software Development Services • Mechanical and electronic CAE, field calculations, structural analysis, simulations, mathematics, etc • 50 packages, 1000 users • Twiki Service • 6000 users, 36’000 pages updated per month • Version Control Services (CVS/SVN) • 2000 users, 200 projects • Audiovisual Service: support, record and archive official committees and events • VideoConference Service: provide video conferencing in rooms across site • Video Conferencing System (Indico) • Distributed and used worldwide • CDS-Invenio, a Digital Library Open Source Software produced, used and maintained at CERN • free support via mailing lists • commercial-like support via a maintenance contract CERN IT Department - Frédéric Hemmer

  6. Invenio • Comprehensive solution for the management of document repositories of moderate to large size • Currently installed and in use by over a dozen scientific institutions worldwide. Some examples: • MeIND - HBZ NRW, Cologne, Germany • EPFL Infoscience - Lausanne, Switzerland • Aristotle University of Thessaloniki – Greece • Dipòsit de Documents, UniversitatAut. de Barcelona, Spain • RomDoc - UPB-CTTPI, Bucharest, Romania • RepozytoriumEnyPolitechnika - Wroclaw Univ. of Tech., Poland • Pacific Rim Library - Hong Kong • Academic Repository of Rwanda – KIST, Kigali, Rwanda • Being deployed: AstroParticle Data System, NASA/Smithsonian, ILO CERN IT Department - Frédéric Hemmer

  7. Invenio in Africa A digital library workshop initiated by UNESCO was organized in Sep 2009 in Kigali to train librarians on how to use CDS-Invenio, attended by librarians from Rwanda, Cameroun, Ghana and Mozambique The Academic Repository of Rwanda was set up and additional training was provided by CERN A fruitful collaboration is on-going with the Kwame Nkrumah University of Science and Technology, Kumasi, Ghana Invenio solution is under consideration for the Documentation Centre on Genocide documents and for the Parliament of Ghana documentation CERN IT Department - Frédéric Hemmer

  8. Networking • Design, implementation and support of CERN’s internal and external networking infrastructure in support of desktop, technical and scientific computing • Several 10 Gbps backbones in a multi manufacturer environment: • GPN, TN, ENs, LCG and External networks • Switching capacity of the internal LCG network is 4.8Tbps • Deployment and maintenance of network star points and wireless network services • More than 400 star points and ~50 000 UTP sockets • ~450 wireless base stations • Management CERN Firewall and provision of Internet connectivity • >10 Gbps Internet connectivity • Internal and external firewalling • Development and management of tools for network and telecom monitoring, user request provisioning and issue tracking • Central database for automatic network equipment configuration • About 19 000 network and telecom connectivity requests per year CERN IT Department - Frédéric Hemmer

  9. WLCG LHCOPN (simplified) CERN IT Department - Frédéric Hemmer

  10. Telephony and CIXP • Provision and support of telephony services • Telephone exchange network of 10 000 lines • IP telephony, Audio conferencing, Switchboard, Call centres • GSM Mobile services • Dedicated VPN of more than 4300 subscriptions • Including LHC Tunnel coverage • VHF network for the fire brigade • Integrated operation services for both network and telecom services • Several support contracts using same software tools • Management of the CERN Internet Exchange (CIXP) • Around 40 clients (telco operators, institutions) CERN IT Department - Frédéric Hemmer

  11. Computer Security CERN IT Department - Frédéric Hemmer

  12. Tier 0 at CERN: Acquisition, First pass processingStorage & Distribution Frédéric Hemmer

  13. WLCG Grid Computing • Tier-0 (CERN): • Data recording • Initial data reconstruction • Data distribution • Tier-1 (11 centres): • Permanent storage • Re-processing • Analysis • Tier-2 (~130 centres): • Simulation • End-user analysis Frédéric Hemmer

  14. Data & Storage Services • The data management challenges • Storing 15’000’000 gigabytes of data every year • Ensure that any file, including the smallest kilobyte is available, anywhere from the internet, within a short time (small latency) • Cope with ever-changing storage technologies • Long term data preservation • All past data must be kept readable for the future • Castor • Software for data management at CERN (Castor) and for partner data centres • 1000 servers, 2000 cores, 10000 disks • AFS distributed filesystem operations (30 TB, 500 Million files) • Backups (~2 PB, 1 Billion files) CERN IT Department - Frédéric Hemmer

  15. 2009 Tier 0-1 Data Transfers Final readiness test (STEP’09) Preparation for LHC startup LHC physics data More than 8 GB/s peak transfers from Castor fileservers at CERN

  16. Grid Computing Now

  17. Impact of the LHC Computing Grid in Europe • LCG has been the driving force for the European multi-science Grid EGEE (Enabling Grids for E-sciencE) • EGEE is now a global effort, and the largest Grid infrastructure worldwide • Co-funded by the European Commission (Cost: ~170 M€ over 6 years, funded by EU ~100M€) • EGEE already used for >100 applications, including… • Archeology • Astronomy • Astrophysics • Civil Protection • Comp. Chemistry • Earth Sciences • Finance • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • … >250 sites 48 countries >50,000 CPUs >20 PetaBytes >10,000 users >150 VOs >150,000 jobs/day Frédéric Hemmer

  18. Similarity Search Measurement of Pulmonary Trunk Temporal Modelling RV and LV Automatic Modelling Visual Data Mining Surgery Planning Genetics Profiling Treatment Response Personalised Simulation Inferring Outcome Semantic Browsing Biomechanical Models Tumor Growth Modelling

  19. Grid related collaborating projects and other IT-EC projects • ~39 2-yr project-funded posts (~26 EGEE posts) – on project and IT group-related activities • Total requested EC contribution (except PARTNER project): 12.1 M EUR IT Department Meeting - Frédéric Hemmer

  20. Collaboration with Industry: CERN openlab • A science – industry partnership to drive R&D and innovation • Started in 2002, now in phase 3 Motto: “you make it – we break it” • Evaluates state-of-the-art technologies in a very complex environment and improves them • Test in a research environment today what will be used in industry tomorrow • Training: • CERN School of Computing • openlab student programme • Topical seminars January 2010

  21. CERN openlab phase III • Covers 2009-2011 • Status • Partners: HP, Intel, Oracle and Siemens • Topics • Global wireless coverage for CERN (HP Procurve) • Power-efficient solutions (Intel) • Performance Tuning (Oracle) • Control systems and PLC security (Siemens) • Advanced storage systems and/or global file system (partner to be identified) • 100Gb/s networking (partner to be identified) January 2010

  22. openlab people: students in 2009 Summer 2009

  23. Collaboration with Institutions: UNOSAT CERN IT Department - Frédéric Hemmer

  24. Frédéric Hemmer

More Related