evaluating a game simulation kit in second life dr. cynthia calongne institute for advanced studies...

Evaluating a Game Simulation Kit in Second Life

Dr. Cynthia Calongne

Institute for Advanced StudiesColorado Technical University

NMC Symposium March 25, 2009

Operation Codename: AnacondaGlobal Learning Forum

Briefing Slides by Dr. Andrew Stricker

Licensed under aCreative Commons Share Alike

with Attribution License

2

Air Force Simulations

3

Explorations

4

MyBase Visitor Center

Spinoza Quinnell and Lyr Lobo

5

AF Global Learning Forum - Serious Game Simulation

6

Game Simulation Kit Team

(l to r) Toni Weezels, Harley Weissman, Spinoza Quinnell, Scarlett Stand, Ry Auerbauch and Apollo Segall

88

Air Operations Center (AOC)

Sample game scoring system and group dynamics

9

Participants in the Game Simulation Test

10

Hostage Rescue: Armed and dangerous

11

Operation Codename: Anaconda

Communications: MNF Command Authority, Colonel Stone

Ops Intel: A small group of insurgents, a mujahideen proxy military force for al-Qaeda, on the island of Ayab (50 miles from the coast of Murma) are holding one or two hostages. The insurgent leader’s identity is unknown but from information provided by the escaped interpreter, a rendered portrait is depicted on the right. It is likely the insurgents expect a rescue attempt by a coalition force. It is also expected the insurgent leader will attempt to relocate the physician hostage off of Ayab before a rescue attempt can be executed.

OPERATION PRE-BRIEF

Rendered drawing: identity unknownSlide courtesy of Dr. Andrew Stricker

12



Ops Intel: One of the hostages, pictured on the right, is an internationally known physician associated with the World Relief Organization. She and a small team of relief workers went to the isolated island of Ayab following a typhoon to provide medical assistance and evacuation of island inhabitants before another expected typhoon hits the island in the next 48 hours. The escaped interpreter reported the physician was wounded in the leg and the other remaining hostage was shot dead on the attempted escape.

Slide courtesy of Dr. Andrew Stricker

Dr. Algernon Loire

OPERATION PRE-BRIEF

13



Ops Intel: The island of Ayab has an abandoned WWII era u-boat base located on a lagoon inlet from the south bay. The island is hilly and rocky with sparse vegetation. It is believed the insurgents have fortified the u-boat base. Satellite photos suggest the presence of

underground tunnels.


South lagoon andU-boat base location

OPERATION PRE-BRIEF

14

Operation Codename: AnacondaCommunications: MNF Command Authority, Colonel Stone

COA: The team will be inserted on the southeast side of the lagoon entrance under the cover of darkness. Using zodiac crafts the team will proceed to the lower u-boat docking area and recon the warehouse. An exit defense zone will also be established for the extraction. Via intercepted cell phone calls, MNF intel reports the hostages are likely located in the underground u-boat

quarters. Extraction of the hostages should proceed back to the defense zone for zodiac evac. Be prepared to adapt COA depending on situational

factors. Mission duration NTE 2 hrs.

OPERATION PRE-BRIEF

Content by Dr. Andrew Stricker, 2008

15



Ops Intel: Defense satellites are being positioned to provide for near continuous coverage of Ayab. Mission communication will be via secured MNF satellite uplink and downlink channels. Additionally, a predator UAV is being positioned to provide assistance as needed.


OPERATION PRE-BRIEF

16



Ops Intel: Historical Ayab photos on the right depict fortified bunkers from the u-boat base area and warnings of a mine field. Expect the insurgents to use the bunkers and tunnels to resist extraction of the hostages. Insurgents are expected to be well armed with AK-47s and rocket propelled launchers.


OPERATION PRE-BRIEF

17



Operation ROEs:

-Proceed only via operation directives obtained from MNF communications (Operation Flags)

-Reach Operation Flags (1 to 8) by allotted time constraints

-Use only minimal force necessary for safe extraction of hostages

-Respect civilian property and protect innocent civilians from harm


OPERATION PRE-BRIEF

18



-Remember MNF Operation ROEs

-Review the COA

-Rehearse operation roles

-Gear up for insertion into Ayab


OPERATION PRE-BRIEF

19

Strategic areas in the Game Simulation Kit

20

1st view of the simulation range, looking to the left

21

Lyr Lobo sneaks around the range

22

Assessment Rubric

Skill Levels:

Rating Scale:Absent Emerging Developing Mastering

0 1 2 3 4 5 6

Levels of AssessmentKnows it matters (values)

Knows how Does Thinks (adapts)

Slide courtesy of Nancy F. Smith

23

Assessment Rubric

Context of Challenge1 2 3 4 5

Initial exposure to situation or challenge

Assessment of situation

COA determination

Implementa-tion of COA

Feedback & interpretation


24

Game Rules Rubric

Other activities to be observed

Time Limits, Use of Weapons, Use of Devices (other than weapons), Flying, etc.

Activity Distinguished Proficient Minimally Proficient

Unsuccessful

Use of Comm Outside of Group Channel

3 PointsNo use of outside comm (e.g., IM, email)

2 Points1 instance of outside comm

1 Point2 instances of outside comm

0 Points3 or more instances of outside comm


25

Game activities

Pre-briefing Game preparation Elevator down Game play Find the 1st flag Share information Select a strategy Navigate to flags Achieve objectives Rescue the hostages

Scenes from the Game

33After the alpha test - under fire!

34

Post-Test Debriefing

• Observations– Initial confusion– How to reload the

weapon– Group name uncertain

• Blue Team

• Strengths– Sharing the flag orders– Teamwork

• Second Life observations– Tight camera angles in

corridors

– Where do we go?• Had to explore, discover and

solve problems

– Who is the enemy?• Shot a friend -- oops!

Four game participants CTU Students - first term in SL

35

Participant Feedback

• Experience– Exhilarating experience

– Fun, immersive game!

– Realistic environment

– Shared leadership roles

– Ideal for teamwork

– Great for group decisions

– Great communications

– Unfamiliar terrain added to the realism

• Next test– Use the rubrics

– Monitor the voice communications

– Analyze the chat log

• Post debrief– Discuss the team

decisions and leadership roles

36

Participant Recommendations

• After the initial game test with novice users– Add a portable game map?

– More briefing time - for novices

• Practice military communication protocol

– For realistic human movement simulation

• Navigation for crouch & turn

• Camera constraints - for realistic viewpoint

• Future Use– Great for testing modern warrior technology

37After the game, testing a military training system

38

CTU Student Rides the Monorail

39

Other Air Force Simulations

40

Acknowledgements

• The Global Learning Forum Team– Second Life Names: Toni Weezels, Harley Weissman, Spinoza Quinnell,

Scarlett Stand, Ry Auerbauch Apollo Segall – Nancy Smith - assessment rubrics– Dr. Andrew Stricker - Spinoza Quinnell - briefing content

• Game Simulation Kit, 5 regions of content, rubrics

• Colorado Technical University Doctoral Students– Arlene Chisley-Wade – Guillermo Quintero– Dennis Musick– John Orosco

41

Evaluating a Game Simulation Kit in Second Life

Dr. Cynthia CalongneLyr Lobo in Second Life

Twitter Lyrlobo

For more information, visit:http://ctusoftware.blogspot.comhttp://www.slideshare.net/lyrlobo

Lyr Lobo

CS 820 Game participants

evaluating a game simulation kit in second life dr. cynthia calongne institute for advanced studies...

Documents

mnf intel

mnf command authority

colonel stone ops intel

isolated island of ayab

colonel stone coa

dangerousoperation codename

underground uboat quarters

rescue attempt