1 / 8

WRF-Var Regression Testing: Methodology and Future Work Insights

This document outlines the regression testing process for the WRF-Var model, including flow charts, run scripts, and outputs. The analysis compares serial and MPI executions. Testing is performed on specific cases stored in given directories, documenting passage or failure of each case. Key details, such as compilation success and output differences at specific iterations, are provided. Future work will focus on archiving output for comparisons, expanding tests to Linux and Mac environments, and publishing results online.

kyla-guzman
Télécharger la présentation

WRF-Var Regression Testing: Methodology and Future Work Insights

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction on WRF-Var Regression Test Ruifang Li MMM Lir@ucar.edu Phone: 303 4978938

  2. WRF-Var Regression Test • Flow Chart • Run Script • Script Output • Future Work

  3. Flow Chart Regtest_var.output Set up Initial variables REG_ROOT = /ptmp/$user CASES = /ptmp/lir/CASE FAIL_MAIL = ( ${user}@ucar.edu ) COMPOPTS_VAL = (Serial MPI) Num_Procs = 4 GENERATE_BASELINE = FALSE COMPARE_BASELINE = FALSE . . . Compare case output Compare cost function of Serial and MPI run, Get the first iteration in which cost function is different . WRF-var source code .Trunk .user’s tarfile Wrfvar.tar Test cases .Each case is tested by Serial and MPI executable. (da_wrfvar.exe) Compile .Serial .MPI error error Exit and Send email to user with error message

  4. Run Script • Code comes from trunk • Bsub < regtest_var.csh • Code comes from user • Make a tar file named wrfvar.tar • Put wrfvar.tar in the same directory as regtest_var.csh • Bsub < regtest_var.csh

  5. Regression Test output • WRF-Var source code svn info: • Path: WRFDA • URL: https://svn-wrf-model.cgd.ucar.edu/trunk • Repository Root: https://svn-wrf-model.cgd.ucar.edu • Repository UUID: b0b5d27b-6f0f-0410-a2a3-cb1e977edc3d • Revision: 3590 • Node Kind: directory • Schedule: normal • Last Changed Author: xinzhang • Last Changed Rev: 3589 • Last Changed Date: 2009-02-09 22:09:16 -0700 (Mon, 09 Feb 2009) • WRF-Var source code are located at /ptmp/lir/wrfvar_regression.905395 • WRF-Var test cases are located at /ptmp/lir/wrf_test/data/CASE • Architecture AIX machine: be1104en.ucar.edu • Number of MPI processes to use: 4 • Test conducted by Li Ruifang 8938 MMM • Test run from directory /ptmp/lir/wrf_test/wrf_var/regression/script • This is a bit-wise (traditional) regression test. • Compiler version info: • FORTRAN: xlfrte 11.1.0.5 • OS version info: • AIX: bos.mp 5.3.8.2 • WRF-Var compile successfully for Serial option • WRF-Var compile successfully for MPI option

  6. Regression Test ouput cont’ • ############################################################################### • WRF-Var IS STARTING TO TEST EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE • ############################################################################### • CASE cwb ....................................... • Serial Run ...... PASS • MPI Run ...... PASS • CASE test1 ....................................... • FAIL: either be.dat or ob.ascii or fg or namelist.input not exist for CASE test1 • ############################################################################### • COMPARING SERIAL AND MPI OUTPUT FOR EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE • ############################################################################### • CASE cwb ............................................................................................. • Output starts to differ at iteration Serial vs MPI • 21 3.03954669D+04 2.75530512D+01 2.50729942D-0 | 21 3.03954668D+04 2.75530512D+01 2.50729942D-0

  7. Test New Case • Make a directory for new case • Copy fg, ob.ascii, be.dat, namelist.input to new case directory

  8. Future Work • Archive Serial/MPI run’s output and compare with next run’s output. • Test on Linux and Mac ( now on bluefire). • Put each run’s output on wiki page • Test more cases • Test update_be, wrf, wps

More Related