Download
1 / 5
50 likes | 168 Vues
In the realm of ubiquitous computing (ubicomp), ensuring that systems meet their intended benefits and specifications can be challenging. This paper discusses the importance of validation and verification processes in evaluations, highlighting different testing methodologies including bed-of-nails and functional-paths testing. It stresses the significance of comprehensive testing approaches that encompass the entire system and the need for independent verification of use cases. Practical recommendations are provided, urging evaluators to start with known examples of correct behaviors to guide effective assessment practices.
E N D
Verification through User Value:Or ‘How to AvoidDrinking Your Own Bathwaterin Ubicomp Evaluations’ Dr. Christopher A. Miller Harry B. Funk 30 September 2001 Ubicomp-01 Atlanta, GA
Validation – did we do what was spec’ed? • Verification – did we provide intended benefit? Validation and Verification • Evaluation – did we do a good job?
Bed of nails testing • Functional paths testing Comprehensive Test • Want entire system tested
? = Gold Standard requires knowing the “right” outcome • Testing complex systems…
Independently verify benefit of use cases Expand cases to cover functional logic Take care to ensure metrics are broad enough Recommendations • Start with use cases – known, specific examples of ‘correct’ behavior
