Slide 1

Slide 2

TECH 50800 Project JagWaRz Administrator Console Measure Phase October 29, 2014 Vicky L. Smith

Slide 3

Brief Review of Project Charter Business Case: Connie Justice, the project Champion, is course coordinator for most the networking and information security courses in CIT. She wants to get this tool implemented within the curriculum by the Fall semester 2015. Problem: During the testing of JagWaRz, administrators reported dissatisfaction with the usability of the administrator console. They felt it took too much time and effort to set up or modify a game. Goal: Improve the administrator console by 4-01-15 to the point where 75% of instructors agree to implement the tool in the classroom. Process Boundaries: The process starts when an administrator creates a new game construct. The process includes creating a game, adding challenges to a game, editing challenges, and re-ordering challenges. The process stops when game and challenge creation or modification is complete.

Slide 4

SIPOC

Slide 5

CTQ Tree(s) CustomerCTQKPOVKPIV Database Structure Add ChallengesCode Functionality User Interface Living Lab Staff Database Structure Ease of UseEdit ChallengesCode Functionality User Interface CIT Instructors Database Structure Reorder ChallengesCode Functionality User Interface

Slide 6

Process Map

Slide 7

Process Observation Worksheet TIME OBSERVATIONS Date: Process:Create and Modify JagWaRz Game Observer: StepDescription12345678910 1Create Game 2Add Access Control Challenge 1 3Add Attack Exploitation Challenge 2 4Add Wireshark Challenge 3 5Add Maltego Challenge 2 6Add Nmap Challenge 1 7Add Access Control Challenge 3 8Edit Attack Exploitation Challenge 2 9Edit Maltego Challenge 2 10 Insert Attack Exploitation Challenge 3 in 3rd Slot & reorder challenges below 11 Insert Attack Exploitation Challenge 2 in 5th Slot & reorder challenges below Total Time for 1 Cycle (Minutes)

Slide 8

Data Collection Plan

Slide 9

Measurements Time to create a game Time to add a challenge Time to edit a challenge Time to insert a challenge and reorder remaining challenges Sampling 11 Step protocol developed to test those items being measured Observer: Vicky Smith Measurements measured in minutes and seconds Sampling frequency irrelevant One measurement will be collected from each participant

Slide 10

Data Collection TIME OBSERVATIONS Date:10/28/2014Process:Create and Modify JagWaRz Game Observer:Vicky Smith StepDescription12345678910 1Create Game3:003:12 2Add Access Control Challenge 12:453:18 3Add Attack Exploitation Challenge 22:152:54 4Add Wireshark Challenge 32:452:23 5Add Maltego Challenge 22:201:35 6Add Nmap Challenge 12:152:35 7Add Access Control Challenge 33:002:57 8Edit Attack Exploitation Challenge 22:322:47 9Edit Maltego Challenge 22:221:18 10 Insert Attack Exploitation Challenge 3 in 3rd Slot & reorder challenges below17:2916:29 11 Insert Attack Exploitation Challenge 2 in 5th Slot & reorder challenges below9:578:25 Total Time for 1 Cycle (Minutes)50:4047:53