Enhancing Quality Assurance in Large-scale STAR Production with AutoQA System
60 likes | 191 Vues
This document outlines the procedures for testing and quality assurance (QA) of large-scale DST production within the STAR experiment. It discusses offline QA practices using ROOT-based macros to generate event-wise histograms and scalars for various DST types, including real and simulated data. The AutoQA system, developed in PERL, automates the QA process, providing web-based access to results and ensuring that data quality is maintained across different platforms. Key differences in QA approaches for real data versus nightly productions are also highlighted.
Enhancing Quality Assurance in Large-scale STAR Production with AutoQA System
E N D
Presentation Transcript
STAR Quality Assurance • Purpose • Testing quality of large scale DST production • Offline QA • Histograms and scalars • AutoQA System • Web-based, uses PERL scripts ALICE/STAR Apr 8, 2000 Curtis Lansdell
Offline QA • ROOT-based macros report via histograms and/or scalars • Event-wise • # TPC hits; is particular table present • Run-wise • mean, rms, min, max # tracks per event in 40 events • 3 DST types produced at STAR • Real data • Cosmic ray events • Simulated data • Mock Data Challenges • Nightly data • Library status check (DEV, NEW, PRO) ALICE/STAR Apr 8, 2000 Curtis Lansdell
Offline QA II • Used differently for various DST types • E.g., Real data vs. Nightly production • Real – infrastructure should be stable • Focus more on quality of data • Nightly – infrastructure probed more • Stability of libraries on different platforms (Linux, Solaris) • Different event generator settings exercise code ALICE/STAR Apr 8, 2000 Curtis Lansdell
AutoQA System • Written in PERL • Builds QA database • Provides web access to results • Jobs run periodically • Finds DST data on disk • Executes macros via PERL scripts automatically • External control files allow certain macros to run • Depends on type of data being analyzed • Evaluates test results & saves to DB STAR->Computing->QA ALICE/STAR Apr 8, 2000 Curtis Lansdell
More on AutoQA • DEV and NEW • Uncovers conceptual and programming errors on limited number of events • PRO • Verify stability of production over large number of events ALICE/STAR Apr 8, 2000 Curtis Lansdell
Work in Progress • Generalize AutoQA through interface to mySQL • Run macros under LSF on RCAS for QA of large scale production (PRO) • Apply AutoQA framework to Online data-taking to verify stability ALICE/STAR Apr 8, 2000 Curtis Lansdell