PowerPoint Presentation

Pipeline Considerations for Character and Story-Driven Augmented Reality

Panelists

AR DeveloperAugmented TravelerUnity AR/VR DeveloperAugmented TravelerCo Founder, CTOAugmented Traveler

Introduction

Our work at Augmented Traveler addresses the increasing popularity of AR apps that include rich character-driven stories

A complex pipeline is necessary to manage the production of these apps This panel will discuss the experience of creating a pipeline for PastPort, a time-traveling interactive history AR application

Pipeline Overview

Creative

Maya

Unity

Vuforia

DeploymentIdea

Script development

Location scouting

Storyboards/Concept art

Cast voice actors

Audio (ambient, FX, & music)

UX design/Experience flow

Scene building

Character behaviors & pathing

Prop behaviors & pathing

UI/UX for scene navigationDesign/Build models(characters & props)

Create textures

Rig models

Animate models

Export to Unity

Determine AR targets

Overlays of virtual objects

Create AR behaviors

Tie in to social media backend

Customize for select partners (branding)

Determine distribution with partners

Launch subscription services

Launch customized PastPort services

AR Design Targets, markers, SLAMAR integration

Story concept Its 1499 in Venice Script Audio recordingsScratch & final Narration & dialogueAmbient & effects MusicConceptual Assets

CreativeCharacter designs & costumes 3D models Rigged Models Concept to Final Model Animation

Action designStoryboards Model Choreography Characters/Props Path planning

UIX Design Buttons, widgets, look & flow UI integrationScene design Stand-in scene model

MayaUnityVuforia

Production

Export s master character for a Unity avatarRigging allows the animator to focus on the performanceExport each animation sequence to remix the performance in Unity5

Maya

ModelTexture

Facial BlendShapes

for characters: Mixamo Auto Rigfor props: rig by handCharacter Avatar Exportchar.fbxUnity

Actor Dialogue .wavShot List / Storyboard

Animation SequenceBaked Animationchar@anim.fbxUnity

bone rotations/blendShapesstrip controlsRigLeonardoSalaiLeonardos Giant Crossbow

Rigging

Animation

* Export a master character for a Unityavatar we have to plan early for all possible animations* Rigging allowsthe animator (Charles)to focus on theperformance* Exporteach animationsequenceto remix theperformancein Unity its easy to do updates, proxies* Mixamo is a wonderful tool to standardize rigs, animations, and to share motion* The Mixamo AutoControlRig script would not complete, so facial animation had to be a separate process

6

Unity

Mecanimavatarsanimation controlleranimation sequencesanimation events

ScriptsdialogueSync.csscreenplayController.csnavigateTargets.cseventInteraction.cs

.fbxMayameshesjointstexturesblendShapesanimations

Other toolsGoogle DriveTrelloCollaboratePlaymakerSkypeOpen BroadcasterWorld Clock

Scenesenvironmentcharacterspropscameramaterialsphysicsnavmeshaudio sourcesUIVuforia

Screenplay

Unity

Unity balances three interactions: the physical design (Scene), animation and event control (Mecanim), and programming logic (Scripts).fbx is a sure way to publish assets that you mean to publish one envelope to contain many useful thingsUnity has the Asset Store & significant training resources to solve technical problemsEven when using a technical setup, we reference the screenplay and the actors performance, historical researchWe have a team scattered around the world (Los Angeles, China, Italy, Dallas) and cloud tools make it possible7

3D Virtual Objects [Maya / Unity] Leonardo Salai Crossbow

Vuforia Unity plugin package [Download]Import package to UnityAR Components Intermediate Steps

VuforiaAR Camera [in Vuforia Assets]

Target (marker) assets 2D texture: Piazza [Creative] 3D model target (Maya/Unity)

DeploymentAdd developer license [from Vuforia License Manager]Add AR Camera to Unity scene Configure webcam for editor debuggingVuforia Target Manager Upload images Download as Vuforia ImageTarget dbAdd to Unity Position Piazza ImageTarget in scene Connect db to Vuforia ARCameraAdd GameObjects to scene In hierarchy, set as children of Piazza ImageTarget

8

Deployment!

User testing & refinement

Customize for select partners (branding)

Determine distribution with partners

Launch subscription services

Launch customized PastPort services

Thank youaugmentedtraveler.com

Thank You for Attending!