1. Pilot Validation Methodology for Agent-Based Simulations Workshop 02 October 2007

2. Pilot Validation Methodology for Agent-Based Simulations WorkshopAdministrative Remarks 02 October 2007

3. Agenda • Presentation by Dr. Andreas Tolk (Old Dominion University): “Constraints for V&V of Agent Based Simulation: First Results” • Presentation by Mr. Paul Wehner (MITRE): “ABMs and the Validation Hurdle - An Illustration” • Introduction to Topic #2: Invalidation Tools and Techniques • Topic #2 Breakout Discussions • Lunch • Topic# 3: ABS-Application Pairings • Presentation - TBD • Wrap-Up

4. Pilot Validation Methodology for Agent-Based Simulations WorkshopConstraints for V&V of Agent Based Simulation: First Results Dr. Andreas Tolk Old Dominion University 01 October 2007 (0905 to 0950)

5. Pilot Validation Methodology for Agent-Based Simulations WorkshopABMs and the Validation Hurdle - An Illustration Dr. Alfred Brandstein Mr. Paul Wehner MITRE 01 October 2007 (0950 to 1035)

6. Pilot Validation Methodology for Agent-Based Simulations WorkshopIntroduction to Topic #2: Invalidation Tools & Techniques Ms. Lisa Jean Moya WernerAnderson, Inc. 01 October 2007 (1035 to 1055)

7. Invalidation Techniques • Comparison to other models • Turing test • Intuition • Intuition • Functionality assessment • Completeness assessment • Formal Methods • Algorithm review • Input range validation • Control parameter review • Component testing • SME validation • Executable compared to concept/referent • Results validation • Mini-analysis • Accuracy • Theoretical model compared to concept/referent • Assumption testing • SME Review • Mathematical model compared to theoretical model • Boundary analysis • Algorithm review • Spreadsheet Modeling • Software code compared to mathematical model • Existence of required outputs • Symbolic debugger • Code walk through • Data compared to executable • Existence of required inputs

8. Pilot Validation Methodology for Agent-Based Simulations WorkshopBREAK 1055 - 1105 Please Assemble in Breakout Rooms By 1105

9. Pilot Validation Methodology for Agent-Based Simulations WorkshopTopic #2: Invalidation Tools & Techniques 1105 - 1220 Takes Place in Breakout Rooms

10. Pilot Validation Methodology for Agent-Based Simulations WorkshopWrap-Up for Topic #2: Invalidation Tools & Techniques 1230 - 1300 Takes Place in Auditorium

11. Pilot Validation Methodology for Agent-Based Simulations WorkshopLUNCH BREAK 1300 - 1400 Please Return To Breakout Rooms After Lunch

12. Pilot Validation Methodology for Agent-Based Simulations WorkshopTopic #3: ABS-Application Pairings Dr. Michael Bailey Operations Analysis Division Marine Corps Combat Development Command 01 October 2007 (1035 to 1055)

13. Pilot Validation Methodology for Agent-Based Simulations WorkshopBREAK 1515 - 1530 Return to Breakout Rooms after Break

14. Pilot Validation Methodology for Agent-Based Simulations WorkshopOpen Discussion/Overall Wrap-Up 1615 - 1645