1 / 9

Model Assessment and Validation

Model Assessment and Validation. Model Validation. Models should be based on objective research, expressed mathematically and should be shown to be useful and pass critical tests. Declaration of Independence: Modelers are independent of the system?. Validation Errors. Example. Type III Error.

lida
Télécharger la présentation

Model Assessment and Validation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Model Assessment and Validation

  2. Model Validation Models should be based on objective research, expressed mathematically and should be shown to be useful and pass critical tests. Declaration of Independence: Modelers are independent of the system?

  3. Validation Errors

  4. Example

  5. Type III Error The modeler sets out on the wrong track altogether. The result is that the model does completely the wrong thing and is of no value at all.

  6. Open Box (White-box) Validation We know the inner workings of our model – compare to Black-box

  7. Validation Difficulties • The theory we are assuming for the real application is complex • When model is designed to look at modifications and new circumstances, we do not know how things will react in the real world. • Prediction issues

  8. Interpretive Models • 3 R’s • Reductionism: complex systems can be reduced to simpler component parts without loss of information. • Repeatability: Can we achieve repeatability – the scientific principle. • Refutation: no experiment can prove conclusively that a theory is true. (Karl Popper)

  9. Cognitive Maps Validation Cognitive Maps (A person’s mental image of a situation) If people cannot have common concepts in their respective Cognitive Maps – are the maps invalid?

More Related