1 / 30

Model calibration using

Model calibration using. Major steps of hydrologic modeling. (Hydrologic) data Relate to model inputs. Parameter estimation or model calibration. Model -- parameters. Predictions. Prediction uncertainty. Societal decisions. What is Model Calibration?.

felcia
Télécharger la présentation

Model calibration using

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Model calibration using

  2. PEST program

  3. Major steps of hydrologic modeling (Hydrologic) data Relate to model inputs Parameter estimation or model calibration Model -- parameters Predictions Prediction uncertainty Societal decisions

  4. What is Model Calibration? Adjustment of the parameters of a mathematical or numerical model in order to optimize the agreement between observed data and the model's predictions. American meteorological society The process of adjusting model inputs so that model calculations match what we measure in the real-world. So, a good model calibration is not sufficient to develop a good model. Also need good data, a good model, and an adequate optimization method. PEST program

  5. Real world data PEST program

  6. Attempt 1 for model calibration PEST program

  7. Attempt 2 for model calibration PEST program

  8. Attempt 3 for model calibration PEST program

  9. Calculation of residuals for model calibration PEST program

  10. Statistical measures involving residuals PEST program

  11. PEST is a nonlinear parameter estimation package capable of estimating parameters for any computer model. It solves a nonlinear least squares problem and minimizes the differences between the model's outputs and field measurements such as the calculated and measured discharges. PEST adapts to the model, the model does not need to adapt to PEST. PEST program

  12. Minmizing Sum of Squared Residuals (SSR) The use of this equation, as an objective function to be minimized, implies certain assumptions about the residuals (Clarke, 1973): • That the time series of residuals have zero mean and constant variance • That the time series of residuals does not have a significant autocorrelation If confidence intervals are to be given for the estimated model parameters, then: c) residuals have to be distributed normally. PEST program

  13. The role of PEST • (initial) Parameter Sensitivity Analysis : conducted on a larger parameter space, which allows excluding from the further analysis those parameters that have a relatively small impact on the model response. • 2. Calibration: (parameter estimation): PEST “calibrates” a model by reducing the discrepancies between model outputs and field observations to a minimum in the weighted least squares sense. • 3. Predictive analysis: Once a parameter set has been determined for which model behavior matches system behavior as well as possible, it is then reasonable to ask whether another parameter set exists which also results in reasonable simulation by the model of the system under study. PEST program

  14. PEST template, instruction, and control files • Template file: tells PEST how to write parameters in the model input file • 2. Instruction file: tells PEST where it has to look for the model-generated output, and how to read it e.g. which column contains the simulated discharges. • 3. PEST conrol file: contains:User-supplied initial parameter values, range of permissible values that a parameter can take, observations, maximum number of iterations, etc. PEST program

  15. Optimization algorithm can be classified into two categories: • Global search e.g. Shuffled Complex Evolution-University of Arizona (SCE-UA, 1992). • searches the entire parameter space and do a controlled random search in the direction of global optimum. • 2. Local search e.g. PEST program (Doherty, 1994). Estimate parameters with observations using a gradient-based method. • Gradient methods are much faster but can get stuck in local minima. PEST program

  16. Local and global minima It shows that for any given goal function, there exits many parameter sets for which the goal functions are not significantly different from each other, i.e., there are many potential solutions based on quite different parameter sets. Response surface for an inverted goal function. Local minima are represented as peaks. PEST program

  17. Based on Objective Function, the automated calibration procedures can be classified as: • Single objective procedures e.g. mean squared errors in PEST program. • PEST trys to minimize the objective function in order to obtain a better fit between predicted and observed values. PEST offers the best parameter set. • 2. Multiple objective procedures. • The generated output from this approach is a set of solutions (called pareto solutions) instead of a unique solution. PEST program

  18. When is a Model Calibrated? As the problem of parameter optimization is not unique, it is important that we define when a model is calibrated and what the magnitude of the prediction uncertainty is. PEST program

  19. To see when a model is calibrated: • Calculate the 95% prediction uncertainty PEST program

  20. 2. Normally, more than 80 percent of obsevations should be braketet by 95% confidence intervals (the upper and lower limits of the best parameter sets) a) is not a parameter calibration problem, b)calibration can obtain smaller uncertainty distribution, c) it can be expected that some measured data can fall outside the 95PPU. PEST program

  21. 3. Upon reaching the above criteria, if there exits a significant r2 and/or Nash-Sutcliff coefficient between the best simulation and the measured data for a calibration and a test (validation) data set, then the model can be considered calibrated. PEST program

  22. Calibration issues • After analysing residuals to check whether they are independent, homoscedastic and normally distributed with zero expectation; • We need to consider following questions: • What is the data quality and error (data uncertainty)? How does it affect predictions? • What is the sensitivity of model matches to changes in model inputs? (non-uniqueness in solutions) • How good is good enough, for a well calibrated model? PEST program

  23. Thank you PEST program

  24. PEST program

  25. WetSpa model parameter sensitivity for the Illinois River basin PEST program

  26. Streamflow simulation using WetSpa at Illinois River basin, Oklahoma, USA PEST program

  27. PEST program

  28. PEST input template for WetSpa PEST program

  29. PEST Instruction file for WetSpa PEST program

  30. PEST conrol file for WetSpa PEST program

More Related