![Page 1: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/1.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
02 October 2007
![Page 2: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/2.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Administrative Remarks
02 October 2007
![Page 3: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/3.jpg)
Agenda
• Presentation by Dr. Andreas Tolk (Old Dominion University): “Constraints for V&V of Agent Based Simulation: First Results”
• Presentation by Mr. Paul Wehner (MITRE): “ABMs and the Validation Hurdle - An Illustration”
• Introduction to Topic #2: Invalidation Tools and Techniques
• Topic #2 Breakout Discussions• Lunch• Topic# 3: ABS-Application Pairings• Presentation - TBD• Wrap-Up
![Page 4: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/4.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Constraints for V&V of Agent Based Simulation: First Results
Dr. Andreas Tolk
Old Dominion University
01 October 2007 (0905 to 0950)
![Page 5: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/5.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
ABMs and the Validation Hurdle - An Illustration
Dr. Alfred Brandstein
Mr. Paul Wehner
MITRE
01 October 2007 (0950 to 1035)
![Page 6: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/6.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Introduction to Topic #2: Invalidation Tools & Techniques
Ms. Lisa Jean Moya
WernerAnderson, Inc.
01 October 2007 (1035 to 1055)
![Page 7: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/7.jpg)
Invalidation Techniques– Executable compared to concept/referent
• Results validation• Mini-analysis• Accuracy
– Theoretical model compared to concept/referent
• Assumption testing• SME Review
– Mathematical model compared to theoretical model
• Boundary analysis • Algorithm review• Spreadsheet Modeling
– Software code compared to mathematical model
• Existence of required outputs• Symbolic debugger• Code walk through
– Data compared to executable
• Existence of required inputs
• Comparison to other models• Turing test• Intuition
• Intuition • Functionality assessment
• Completeness assessment• Formal Methods• Algorithm review
• Input range validation• Control parameter review• Component testing
• SME validation
![Page 8: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/8.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
BREAK
1055 - 1105
Please Assemble in Breakout Rooms By 1105
![Page 9: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/9.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Topic #2: Invalidation Tools & Techniques
1105 - 1220
Takes Place in Breakout Rooms
![Page 10: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/10.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Wrap-Up for Topic #2: Invalidation Tools & Techniques
1230 - 1300
Takes Place in Auditorium
![Page 11: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/11.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
LUNCH BREAK
1300 - 1400
Please Return To Breakout Rooms After Lunch
![Page 12: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/12.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Topic #3: ABS-Application Pairings
Dr. Michael Bailey
Operations Analysis Division
Marine Corps Combat Development Command
01 October 2007 (1035 to 1055)
![Page 13: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/13.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
BREAK
1515 - 1530
Return to Breakout Rooms after Break
![Page 14: Pilot Validation Methodology for Agent-Based Simulations Workshop](https://reader036.vdocuments.net/reader036/viewer/2022083005/56813997550346895da12d82/html5/thumbnails/14.jpg)
Pilot Validation Methodology for Agent-Based Simulations
Workshop
Open Discussion/Overall Wrap-Up
1615 - 1645