merritt-ferrell
Uploaded by
10 SLIDES
250 VUES
100LIKES

Exploring Xrootd and EOS: Insights from Wahid Bhimji at the University of Edinburgh

DESCRIPTION

Dive into the intricate world of file access technologies as Wahid Bhimji from the University of Edinburgh discusses the significance of Xrootd in high-energy physics. Covering experimental usage across major collaborations like ALICE, ATLAS, and CMS, this overview elucidates the transition from CASTOR to the disk-only EOS solution developed at CERN. With insights on installation, configuration, and performance monitoring, this resource is essential for researchers and system administrators looking to optimize data access in modern particle physics experiments.

1 / 10

Télécharger la présentation

Exploring Xrootd and EOS: Insights from Wahid Bhimji at the University of Edinburgh

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. XrootdRedux Wahid Bhimji University of Edinburgh, Wahid Bhimji – Files access

  2. Redux… • “I probably wouldn’t invest time in looking at DPM/dCache+xrootd.” • G. Cowan HEPSYSMAN June 06 • “Unless the experiments really say that they want it.” Wahid Bhimji – Files access

  3. Redux ? Experiments: • ALICE always have used it • ATLAS like the sound of the redirector • CMS have jobs streaming over the WAN with it Other: • CERNs new disk-only CASTOR replacement EOS is based on it • Widespread use and backing of SCALA in US Wahid Bhimji – Files access

  4. What is it? • Andy’s Xroot Intro….. Wahid Bhimji – Files access

  5. Installing on DPM https://twiki.cern.ch/twiki/bin/view/LCG/DpmXrootAccess22 • DPM_XROOTD="yes” in YAIM • Main configat /opt/lcg/etc/xrd.dpm.cf /sbin/service dpm-xrd start /sbin/service dpm-cms start /sbin/service dpm-manager-cms start # head node only /sbin/service dpm-manager-xrd start # head node only Check that in /etc/shift.conf: DPM PROTOCOLS rfiogsiftp https xroot Open ports 1094 / 1095 Wahid Bhimji – Files access

  6. Performance / Test • Xrdcp • Root / Athena reading Wahid Bhimji – Files access

  7. EOS When 25 filesystems just isn’t enough Wahid Bhimji – Files access

  8. Why EOS • CASTOR is not popular • People now want disk only solutions • There are plenty of existing choices • So CERN decided to build another • Sounds stupid but then why not • Builds on existing technology (xrootd) • Customised for HEP use (ROOT, file based replication, strong authentication) Wahid Bhimji – Files access

  9. But anecdotally… • Always seems broken when I’m on shift…. • They have some heavy hardware so performance not directly comparable • Not POSIX – though FUSE planned • Noone outside CERN using it (that I know) BUT • Not likely to go away… maybe we should try it Wahid Bhimji – Files access

More Related