Advancements in Testing Transition Systems at Radboud University Nijmegen
This overview presents the latest research in testing transition systems at Radboud University Nijmegen. It discusses integrating data with ioco, specification mining, and model-based testing utilizing tools like TorX. Key topics include on-the-fly test generation, execution strategies for reactive systems, and specifications in languages such as LOTOS and Promela. The research also delves into properties of input/output programs, enhancing testing processes, and reverse engineering specifications. Insights into current and future projects highlight significant advancements in testing methodologies.
Advancements in Testing Transition Systems at Radboud University Nijmegen
E N D
Presentation Transcript
Testing Research in NijmegenOverview • Introduction • Integrating Data with ioco • Specification Mining Jan Tretmans Lars Frantzen Tim Willemse
IUT confto spec i ioco s s LTS spec test tool test tool gen : LTS (TTS) test generation tool i || der(s) pass IUT passes tests IUT confto spec i ioco s exhaustive exhaustive sound sound i IOTS IUT t || i test execution tool passfail passfail Model Based Testing with Transition Systems
user: manual automatic next input offer input IUT check output TorX observe output specification pass fail inconclusive A Tool for Transition Systems Testing: TorX • On-the-fly test generation and test execution • Implementation relation: ioco • Mainly applicable to reactive systems / state based systems; • specification languages: LOTOS, Promela, FSP, Automata
Extensions Status test case with data ?coin1 n: int ? money ?coin2 ! money ? ?coin3 and action refinement [ n 35 ] -> [ n 50 ] -> ? button1 ? button2 ! button2 Vc := 0 c := 0 c := 0 Vt := 0 dVt/dt = 3 dVc/dt = 2 c < 10 c < 15 ? coffee [Vt= 15 ] -> [ c 5 ] -> [Vc= 10 ] -> ! coffee ! tea ? tea fail fail pass Testing Transition Systems: model and time and hybrid
IUT i(x) = x Testing Propertiesof Input/Output Programs: Gst • Specification: property over x and y • property(x,y) = x 0 |yy - x| • Implementation is function i :: X Y • Test set T X • A tool like GST (or QuickCheck) generates thousands of testsby systematic traversal of all values of type X • But still: what is a "good" set ? y: real post: |yy - x| x: real pre: x 0
Current and Future ResearchRadboud • Testing transition systems with data • integrating data with ioco • Specification mining • reverse engineering of specification from observations • Approximate correctness • some systems are more correct than others • test selection • Gst • specification/model testing • Model Based Testing with UML • use of industrial modelling techniques • Integration of real-time and data testing
Current and Future ResearchRadboud • Tools for transition system testing • TorX • generic test environments • automatic generation of test adapter and test interface • TorXakis - experimenting with data/symbolic testing • Applications • web page testing Gst • smart card testing Gst / TorX(akis) • ASML DCB (Laser Dose Control) TorX
Testing Projects • Atomyste - ATOm splitting in eMbedded sYStem TEsting Uni. of Twente Radboud Uni. Nijmegen • Stress- Systematic Testing of Real-time Embedded Software Systems Uni. of Twente Radboud Uni. Nijmegen • Tangram - Model Based Testing and Diagnosis ASML, ESI, TUD, TUE, UT, RU, S&T, TNO • Tarot - EU FP6 Marie Curie • Artist 2 - EU FP6 Network of Excellence