interactive computer graphics, human computer interaction, virtual reality and digital arts and...
TRANSCRIPT
![Page 1: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/1.jpg)
Interactive Computer Graphics,Interactive Computer Graphics,Human Computer Interaction,Human Computer Interaction,
Virtual RealityVirtual Realityandand
Digital Arts and SciencesDigital Arts and Sciences
Benjamin LokBenjamin Lok
September 20September 20thth, 2004, 2004
![Page 2: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/2.jpg)
OutlineOutline
TopicsTopics• Interactive Computer GraphicsInteractive Computer Graphics• Human Computer InteractionHuman Computer Interaction• Virtual RealityVirtual Reality
JobsJobs ResearchResearch SkillsSkills
![Page 3: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/3.jpg)
Interactive Computer GraphicsInteractive Computer Graphics
A d ob eP h otosh op
W eb D es ig n
G rap h ics D es ig n
V id eo G am es
F lig h tS im u la to rs
S c ien tificV isu a liza tion
D ataV isu a liza tion
A p p lica tion s
V irtu a lR ea lity
R esearch
R ea l-T im e
TVL og os
A n im ation
M ovieS p ec ia l E ffec ts
N on R ea l-T im e
3 D G rap h ics
C om p u ter G rap h ics
![Page 4: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/4.jpg)
MotivationMotivation
We want to understand how to do:We want to understand how to do:
![Page 5: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/5.jpg)
MotivationMotivation
![Page 6: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/6.jpg)
Why should I take this course?Why should I take this course? An excuse to build that An excuse to build that
program/game/project program/game/project you always wantedyou always wanted
A Computer Science A Computer Science course that involves a course that involves a variety of skills (other variety of skills (other than coding!)than coding!)• ArtArt• PsychologyPsychology• SoundSound• CreativityCreativity
To play with fun toysTo play with fun toys To show off your projects!To show off your projects!
![Page 7: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/7.jpg)
Human Computer InteractionHuman Computer Interaction What is a user interface?What is a user interface? Why do we care about design?Why do we care about design?
We see this all the time. We see this all the time. • What’s good about the design of this error box?What’s good about the design of this error box?
The user knows there is an errorThe user knows there is an error• What’s poor about the design of this error box?What’s poor about the design of this error box?
DiscouragingDiscouraging Not enough informationNot enough information No way to No way to resolveresolve the problem (instructions or contact the problem (instructions or contact
info)info)
![Page 8: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/8.jpg)
My ChoiceMy Choice
iPod by Apple iPod by Apple ComputersComputers
Pros:Pros:• portableportable• powerpower• ease of useease of use• # of controls# of controls
Cons:Cons:• scratches easilyscratches easily• no speech for car no speech for car
useuse• proprietaryproprietary
![Page 9: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/9.jpg)
HCI CommunityHCI Community Academics/Industry Academics/Industry
Research Research • TaxonomiesTaxonomies• TheoriesTheories• Predictive modelsPredictive models
Experimenters Experimenters • Empirical dataEmpirical data• Product designProduct design
Other areas (Sociologists, Other areas (Sociologists, anthropologists, anthropologists, managers)managers)• MotorMotor• PerceptualPerceptual• CognitiveCognitive• Social, economic, ethicsSocial, economic, ethics
![Page 10: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/10.jpg)
HCI ToolsHCI Tools SoundSound 3D3D AnimationAnimation VideoVideo DevicesDevices
• Size (small->very large)Size (small->very large)• Portable (PDA, phone)Portable (PDA, phone)• PlasticityPlasticity
Context Context sensitive/awaresensitive/aware
PersonalizablePersonalizable UbiquitousUbiquitous
![Page 11: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/11.jpg)
Usability RequirementsUsability Requirements
Goals:Goals:• UsabilityUsability• UniversalityUniversality• UsefulnessUsefulness
Achieved by:Achieved by:• PlanningPlanning• Sensitivity to user Sensitivity to user
needsneeds• Devotion to Devotion to
requirements requirements analysisanalysis
• TestingTesting
![Page 12: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/12.jpg)
Bad InterfacesBad Interfaces EncumberingEncumbering ConfusingConfusing SlowSlow Trust (ex. windows Trust (ex. windows
crashing)crashing) What makes it hard?What makes it hard?
• Varies by cultureVaries by culture• Multiple platformsMultiple platforms• Variety of usersVariety of users
Think of a game Think of a game you’ve played with a you’ve played with a bad interfacebad interface• UNIXUNIX
![Page 13: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/13.jpg)
ExampleExample Five fastest places to click on for a Five fastest places to click on for a
right-handed user?right-handed user?
![Page 14: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/14.jpg)
ExampleExample What affects time?What affects time?
![Page 15: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/15.jpg)
Virtual Reality DefinitionVirtual Reality Definition
What is virtual reality?What is virtual reality?• Virtual – Virtual –
Being in essence or effect, but not in factBeing in essence or effect, but not in fact Example VRAMExample VRAM
• Reality –Reality – The state or quality of being real. Something The state or quality of being real. Something
that exists independently of ideas concerning that exists independently of ideas concerning it. Something that constitutes a real or it. Something that constitutes a real or actual thing as distinguished from something actual thing as distinguished from something that is merely apparent.”that is merely apparent.”
• What was the first VR?What was the first VR?
![Page 16: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/16.jpg)
What was the first VR?What was the first VR?
![Page 17: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/17.jpg)
Ivan Sutherland’s Ivan Sutherland’s The Ultimate DisplayThe Ultimate Display
““Don’t think of that thing as a Don’t think of that thing as a screen, think of it as a screen, think of it as a window, a window through window, a window through which one looks into a which one looks into a virtual world. The challenge virtual world. The challenge to computer graphics is to to computer graphics is to make that virtual world look make that virtual world look real, sound real, move and real, sound real, move and respond to interaction in respond to interaction in real time, and even feel real time, and even feel real.”real.”
![Page 18: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/18.jpg)
Key Elements of Virtual Reality Key Elements of Virtual Reality ExperienceExperience
Virtual World - content of a given Virtual World - content of a given mediummedium• screen play, script, etc.screen play, script, etc.• actors performing the play allows us to actors performing the play allows us to
experience the virtual worldexperience the virtual world
Immersion – sensation of being in an Immersion – sensation of being in an environmentenvironment• mental immersion – suspension of mental immersion – suspension of
disbeliefdisbelief• physical immersion – bodily entering physical immersion – bodily entering
the mediumthe medium• Related to Related to presencepresence – (mentally – (mentally
immersed) the participant’s sensation immersed) the participant’s sensation of being in the virtual environment of being in the virtual environment (Slater)(Slater)
Walking Experiment atUNC – Chapel Hill
![Page 19: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/19.jpg)
Augmented RealityAugmented Reality
A combination of a A combination of a real scene viewed real scene viewed by a user and a by a user and a virtual scene virtual scene generated by a generated by a computer that computer that augments the augments the scene with scene with additional additional information.information.
Ultrasound Visualization Research atUNC – Chapel Hill
All Virtual Objects All Real Objects
![Page 20: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/20.jpg)
Immersive TechnologyImmersive Technology Head-mounted Head-mounted
DisplayDisplay• Optical SystemOptical System• Image Source (CRT Image Source (CRT
or LCD)or LCD)• Mounting ApparatusMounting Apparatus• EarphonesEarphones• Position TrackerPosition Tracker
![Page 21: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/21.jpg)
Immersive TechnologyImmersive Technology Multi-screen Projection Multi-screen Projection
of stereoscopic images of stereoscopic images (CAVE)(CAVE)
![Page 22: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/22.jpg)
Immersive TechnologyImmersive Technology
Single large Single large stereoscopic stereoscopic displaydisplay• Projection-basedProjection-based• Head-trackedHead-tracked• Possible tracking of Possible tracking of
hands and arms.hands and arms.• Brings virtual Brings virtual
objects into the objects into the physical worldphysical world
![Page 23: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/23.jpg)
User’s perspectiveUser’s perspective
SettingSetting Objects in worldObjects in world Other participantsOther participants Active/PassiveActive/Passive
• Factory SimulationFactory Simulation• Architectural Architectural
WalkthroughWalkthrough
![Page 24: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/24.jpg)
ResearchResearch
Virtual CharactersVirtual Characters• Diana VideoDiana Video
Virtual RealityVirtual Reality• NASANASA
![Page 25: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/25.jpg)
Skill SetSkill Set ““Oh I don’t want to program, I just want to create Oh I don’t want to program, I just want to create
stuff”stuff” Architect or Car analogyArchitect or Car analogy Programming -> tool to create what is in your Programming -> tool to create what is in your
imaginationimagination Programming proficiency goal:Programming proficiency goal: be able to be able to
code anything that you imaginecode anything that you imagine To do what you saw before we use:To do what you saw before we use:
• C/C++, OpenGL, many different librariesC/C++, OpenGL, many different libraries Math, math, and yet more math!!!Math, math, and yet more math!!!
• Differential equations (simulations, physics engines), Differential equations (simulations, physics engines), linear algebra (transforms, 3D manipulations), statisticslinear algebra (transforms, 3D manipulations), statistics
![Page 26: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/26.jpg)
Graduate SchoolGraduate School Programming Team Lead at RockStar GamesProgramming Team Lead at RockStar Games
• Worked on Midnight Club 2Worked on Midnight Club 2 Renderman Developer at PixarRenderman Developer at Pixar
• Worked on the Jellyfish of Nemo and IncrediblesWorked on the Jellyfish of Nemo and Incredibles Software Engineer for Interactive Media for DisneySoftware Engineer for Interactive Media for Disney
• Worked on Toon Town, online capable titlesWorked on Toon Town, online capable titles Worked at 989 Sports, EA Sports, Freedom Force, etc.Worked at 989 Sports, EA Sports, Freedom Force, etc. What did they all have in common?What did they all have in common?
• Published scientific journals in computer sciencePublished scientific journals in computer science• Graduate school in computer scienceGraduate school in computer science• Worked on efficient collision detection, particle systems, Worked on efficient collision detection, particle systems,
curved surfaces, virtual reality, etc.curved surfaces, virtual reality, etc.• All had All had
GRE scores in the top 10%GRE scores in the top 10% Went to a top graduate school (admission is tough)Went to a top graduate school (admission is tough) Strong math and science and coding Strong math and science and coding Why would a CS professor want to work with you?Why would a CS professor want to work with you?
![Page 27: Interactive Computer Graphics, Human Computer Interaction, Virtual Reality and Digital Arts and Sciences Benjamin Lok September 20 th, 2004](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649f505503460f94c727b2/html5/thumbnails/27.jpg)
Interested? Take the following…Interested? Take the following…
Computational Structures in Computational Structures in Computer GraphicsComputer Graphics
Design and Creation of Virtual Design and Creation of Virtual EnvironmentsEnvironments
Human-Computer InteractionHuman-Computer Interaction Computational GeometryComputational Geometry Computer Simulation ConceptsComputer Simulation Concepts