2 multimedia devices
DESCRIPTION
Berbagai Jenis Multimedia DevicesTRANSCRIPT
MULTIMEDIA DEVICES Magister Teknologi Informasi
FT - UGM
Agendas
Human Perception
Human Computer Interface
Trend in Multimedia devices Technology
10/20/2014
2
Multimedia MTI UGM
Human Perception
Human or biological information processing
uses senses – which include sensors for
receiving (but also for producing) signals which
encode information
Perception is a process of understanding
sensory information
10/20/2014
3
Multimedia MTI UGM
What are the Human perceptual Senses?
That should be easy: SENSE: INPUT ___ OUTPUT____ Visual Eyes - Acoustical Ears Vocal Tract Haptic Touch/Warm Motoric Smell Nose Skin/Body??? Taste Tongue -
Notice that: usually multiple senses operate at the same time.There is operation across different senses, for example motoric output can be visual, signal, like hand waving.
10/20/2014
4
Multimedia MTI UGM
What are the Human perceptual Senses?
But senses mean little without processing and command center wchich is brain.
Brain + Senses = Perceptual system
Human senses operate in perfectly coordinated way, they form completely integrated system
This system can receive and processes multimodal signals from external world and produce multimedia output seemingly with no effort
10/20/2014
5
Multimedia MTI UGM
10/20/2014 Multimedia MTI UGM
6
How this is done in the brain we don‟t know exactly and it would be good to know this:
The more we think about it the more we conclude that humans are fantastic multimedia “system”
We use many encoding levels of information from basic to very abstract, for example : Sound
Speech-language
Music
Gesture
Reading
writing
What are the Human perceptual Senses?
10/20/2014 Multimedia MTI UGM
7
There are good reason to think that human sensory
system is optimized to produce and receive
multimodal information – but optimality is done on
many levels:
We can easily produce and receive single media
information eg. When talking on the phone
But we can also easily deal with multiple media
information eg having direct conversation and
looking to face expression
What are the Human perceptual Senses?
What is Multimedia from the Point Of
Human Perception?
10/20/2014 Multimedia MTI UGM
8
Multimedia means using multimodal
information to achieve optimal stimulation
or perceptual system
Often stimulation also depends on
external conditions
Example of Cinema : conditions are
created for optimal stimulation: theater,
darkness, screen and play action + music
What Means of Optimal Stimulation?
10/20/2014 Multimedia MTI UGM
9
It is described as
Concentration,
Full Involvement
Living experience
Cinema illustrates this. But also
playing Computer Games induces
very high stimulation.
Multimedia technology aims to provide (some)
matching of information devices to human
perception system
MULTIMEDIA
SYSTEM:
INTERFACE,
PROCESSING,
DELIVERY OF
INFORMATION
NETWORK
Human Computer Interface
Human Computer Interface.
Multimedia interfaces and applications.
Vision based interfaces
Systems using vision based interfaces.
10/20/2014
11
Multimedia MTI UGM
Human Computer Interface
10/20/2014 Multimedia MTI UGM
12
Different meanings of HCI
The study of people, computer technology and the
ways they interactive with each other.
The design, evaluation and implementation of
computer systems for human use.
The research to study how to make computer
systems more useable.
Aspects of HCI
10/20/2014 Multimedia MTI UGM
13
Design
Intuition, experiences and design principles.
Human factors
Experiments testing the perception, memory and cognition models of human being.
Devices
Physical devices such as mouse, keyboards and other fancy HCI hardware.
Software and systems
Such as windows GUI, shell commands in Unix etc.
HCI Studies
10/20/2014 Multimedia MTI UGM
14
Computers What are they good at and bad at?
Input, output, processing, networking, etc.
People What are people good at?
What is the limitation of human abilities?
Input, output, memory, perception and cognition model.
No average answer. Must accommodate diversities.
Usability More than the size of widgets, where are the buttons and syntax
of commands.
Context Environment, physical constraints, cognition constraints, task, etc
The Quality of HCI
10/20/2014 Multimedia MTI UGM
15
There are fives factors that affect the
design and implementation of HCI
Time to learn.
Speed of performance.
Rate of errors.
Retention over time.
Subjective satisfaction
Multimedia Interfaces
Multimedia interface
combines different sorts of
media modalities to achieve
more natural and more
efficient human computer
communication.
Speech, audio, touch, video input
(patterns, posture, gesture) etc.
“Put that there” is an example
multimedia HCI that combines
speech, gestures and
graphics.
Advantages of Multimedia Interface
10/20/2014 Multimedia MTI UGM
17
More alternative methods.
The flexibility of combining different schemes.
More efficient for specific tasks.
Greater precision of information.
Help handicapped people to use computers.
Vision Based Interfaces
Vision based interfaces uses computer vision
techniques to achieve more effective HCI.
Vision based interfaces are based on techniques
such as:
Hand tracking,
Hand gesture,
Arm gesture
Hand Pointing
Face detection
Head tracking
Gaze
Expression
Lip reading Posture, body gesture and
action recognition
Example Systems
10/20/2014 Multimedia MTI UGM
19
Motion
Capturing
Example Systems
10/20/2014 Multimedia MTI UGM
20
The MIT Kidsroom
Posture recognition
Action
detection
Our Changing World
10/20/2014 Multimedia MTI UGM
21
Changing Computers
Changing Lives
Changing Societies
Changing Computers
10/20/2014 Multimedia MTI UGM
22
Four Computing Eras
GUIs to Gestures
VDUs to Smart Fabrics
Handsets to the World in our Hands
Simple Robots to Autonomous MachinesThat Learn
Hard Disks to Digital Footprints
Shrink-Wrapped to Mash-Ups
Four Computing Eras
10/20/2014 Multimedia MTI UGM
23
Four Computing Eras (ctd.)
10/20/2014 Multimedia MTI UGM
24
GUIs to Gesture
10/20/2014 Multimedia MTI UGM
25
The Reactable: a multitouch
interface for playing
music. Performers can
simultaneously interact
with it by moving and
rotating physical objects
on its surface. Reactable
was developed by Sergi
Jordà and colleagues at
the Universitat Pompeu
Fabra, Barcelona. Icelandic
songstress Björk used one
on her 2007 tour.
GUIs to Gesture
10/20/2014 Multimedia MTI UGM
26
The HotHand device:
a ring worn by electric
guitar players that uses
motion sensors and a
wireless transmitter to
create different kinds of
sound effects by various
hand gestures
VDUs to Smart Fabrics
10/20/2014 Multimedia MTI UGM
27
Animated Textiles
developed by Studio
subTela at the Hexagram
Institute, Montreal, Canada.
These two jackets „synch
up‟ when the wearers hold
hands, and the message
scrolls from the back of
one person to the other.
Handsets to the World in our Hands
10/20/2014 Multimedia MTI UGM
28
Talk to the hand…
From the first mobile
phone „brick‟ to the
latest Apple iPhone: as
the size reduces, the
potential expands.
Simple Robots to Autonomous Machines That Learn
10/20/2014 Multimedia MTI UGM
29
Emotional kitty: a robot
hardware platform called
iCAT uses a set of logical
rules to convey emotional
states as it makes decisions,
with the goal of improving
human-robot interaction.
It looks confused if it‟s in
trouble, smiles if it gets
something right…
Simple Robots to Autonomous Machines That Learn
10/20/2014 Multimedia MTI UGM
30
The Rovio robotic
webcam is wirelessly
connected to the Internet.
It roams around the home
providing an audio and
video link to keep an eye
on family or pets when
you‟re out.
Hard Disks to Digital Footprints
10/20/2014 Multimedia MTI UGM
31
Hard Disk
Thumb Drive
Flash Memory Devices
Sony Microvault
Tiny Drive
Shrink-Wrapped to Mash-Ups
10/20/2014 Multimedia MTI UGM
32
It used to be that only the most highly skilled software developers could write applications, and only professionalcontent producers could provide us with digital data or content that we could use. In the early days of the PC, we all bought our software in shrink-wrapped boxes, spending more money every few years for a new updated version of our operating system, word processor, or spreadsheet application.
Today „New data sources are available to us all the time. We are all fast becoming content producers, publishers and developers as much as we are consumers‟
Changing Lives
10/20/2014 Multimedia MTI UGM
33
Learning Differently
Ubi-learning in the
Ambient Wood
(University of Sussex):
a boy using a digitally
augmented probe
tool that shows realtime
measurements
of light and moisture
on an accompanying
mobile device.
Changing Lives
10/20/2014 Multimedia MTI UGM
34
Audiovox‟s Digital
Message Center is
designed to be attached
to the refrigerator, letting
families scribble digital
notes and leave audio
and video messages for
each other
Changing Societies
10/20/2014 Multimedia MTI UGM
35
A man in Cape Town,
South Africa, selling mobile
phones. In 2007, 77% of
Africans had a mobile
phone, while only 11% had
computer access.
Learning Activity of C-Generation Teacher Task, short Materials,
discussion
Youtube
Blog
Videos
Slideshare
Presentation and
Full Materials
Ziddu (File
Sharing)
Online Journals
Google Books
Material Enrichment
Students
Discussion
Display Technology
10/20/2014 Multimedia MTI UGM
37
Flexible Display
10/20/2014 Multimedia MTI UGM
38
3 D Printer
10/20/2014 Multimedia MTI UGM
39
10/20/2014 Multimedia MTI UGM
40
Exercise
10/20/2014 Multimedia MTI UGM
41
Make a paper and presentation about the recent
progress of Multimedia Devices:
Camera
Scanners
Display
Printer