final honours presentation principal investigator: joão lourenço supervisor: dr hannah thinyane
TRANSCRIPT
![Page 1: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/1.jpg)
Final Honours Presentation
Principal Investigator: João LourençoSupervisor: Dr Hannah Thinyane
![Page 2: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/2.jpg)
Presentation Outline
Introduction Design and Implementation User Study Future Work Conclusion
2
![Page 3: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/3.jpg)
Introduction
Problem Statement Research Motivation and Goals
3
![Page 4: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/4.jpg)
Introduction
Problem Statement Research Motivation and Goals
4
![Page 5: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/5.jpg)
Problem Statement
Migration from 2D output to 3D output3D TVSurround sound speakers
Suggests a need for migration from 2D input to 3D inputMicrosoft Kinect (previously Project Natal)Wii3D
5
![Page 6: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/6.jpg)
Introduction
6
![Page 7: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/7.jpg)
Research Motivation and Goals Intuitive 3D Interaction Techniques are
needed Develop 3D Interaction using Nintendo
Wii Remote Compare Proposed interaction
technique with existing techniques
7
![Page 8: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/8.jpg)
Design and Implementation Hardware Software
OS and FrameworksBluetoothLibrariesPoint TrackerGestures and Gesture RecognitionUser Interface
8
![Page 9: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/9.jpg)
Design and Implementation Hardware Software
OS and FrameworksBluetoothLibrariesPoint TrackerGestures and Gesture RecognitionUser Interface
9
![Page 10: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/10.jpg)
Hardware
2 Nintendo Wii Remotes Personal Computer with Bluetooth
Capabilities 2 WiiGloves
10
![Page 11: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/11.jpg)
Nintendo Wii Remotes
Layout Maximizing Volume
11
![Page 12: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/12.jpg)
Nintendo Wii Remotes
Layout Maximizing Efficiency
12
![Page 13: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/13.jpg)
WiiGlove
Circuit
2 Configurations2 IRs per hand4 IRs on one hand
13
![Page 14: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/14.jpg)
Design and Implementation
14
![Page 15: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/15.jpg)
OS and Frameworks
Windows 7 Microsoft C#.NET 4.0
15
![Page 16: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/16.jpg)
Design and Implementation
16
![Page 17: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/17.jpg)
Bluetooth
Microsoft Windows built-in Bluetooth Stack
17
![Page 18: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/18.jpg)
Design and Implementation
18
![Page 19: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/19.jpg)
Libraries
WiimoteLib 1.7.0.0 – Wiimote Connection
Accord.NET 2.1.1.0 – Statistics Math.NET Iridium 2008.8.16.470 –
Linear algebra 32feet.NET 2.2.0.0 – Bluetooth
Connection
19
![Page 20: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/20.jpg)
Design and Implementation
20
![Page 21: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/21.jpg)
Point Tracker Point tracking and probabilistic estimation
were required to ensure that the system would handle multiple inputs (multitouch) and continue to function even in the event of the loss of points. A loss of points can occur for several reasons:An infra-red source can leave the field of view of
the Wii RemoteAn infra-red source can move behind another
infra-red sourceTwo infra-red sources can come together and
merge
21
![Page 22: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/22.jpg)
Point Tracker
Several ComponentsStereoscopic Triangulation SolverDistance MinimizerPredictive Interpolator
22
![Page 23: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/23.jpg)
Stereoscopic Triangulation Achieved by solving for the point at the
near intersection of two rays Camera intrinsic properties needed
Viewport widthViewport heightHorizontal FOVVertical FOV
23
![Page 24: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/24.jpg)
Stereoscopic Triangulation
24
![Page 25: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/25.jpg)
Stereoscopic Triangulation Using the fields of view, a vector from the
camera position to the detected point was obtained. These vectors can be thought of as rays from the infra-red source to the camera.σ the horizontal field of viewψ be the vertical field of viewx be the horizontal component of the two
dimensional coordinatey be the vertical component of the two
dimensional coordinate
25
![Page 26: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/26.jpg)
Stereoscopic Triangulation
26
![Page 27: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/27.jpg)
Stereoscopic Triangulation With the two rays from the two Wii
Remote Cameras, the intersection of the two rays can be calculated using linear algebra.
27
![Page 28: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/28.jpg)
Stereoscopic Triangulation
28
![Page 29: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/29.jpg)
Stereoscopic Triangulation Physical System – rays would never
perfectly intersect Need to take an estimate
Estimate distance along first vectorEstimate distance along second vectorAverage the two points and make note of
the distance between them
29
![Page 30: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/30.jpg)
30
![Page 31: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/31.jpg)
31
![Page 32: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/32.jpg)
Distance Minimization
The points that are reported by the two Wii Remotes are not necessarily sorted in the same order
32
![Page 33: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/33.jpg)
Distance Minimization
Pairwise permutation of points in matrix form
Minimize distance error per row
33
![Page 34: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/34.jpg)
Predictive Interpolation
Try to predict where a point should be – expected pointsInstantaneous velocityAverage velocity over a period
Minimize the errors between the observed and expected points
34
![Page 35: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/35.jpg)
Predictive Interpolation
35
![Page 36: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/36.jpg)
Predictive Interpolation
The selected point per row is used as the point that the Wii3D System reports
36
![Page 37: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/37.jpg)
Design and Implementation
37
![Page 38: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/38.jpg)
Gestures and Gesture Recognition Supported gestures Recognition methods
38
![Page 39: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/39.jpg)
Click Gesture
A finger going down and forward, and then up and backward
39
![Page 40: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/40.jpg)
Pan/Scroll Gesture
Two fingers that are close together moving in similar directions
40
![Page 41: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/41.jpg)
Zoom Gesture
Two fingers moving in opposite directions with the distance between them increasing
41
![Page 42: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/42.jpg)
Rotate Gesture
Two fingers moving in opposite directions with the distance between them constant
42
![Page 43: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/43.jpg)
Circle Gesture
Hidden Markov Model Gesture
43
![Page 44: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/44.jpg)
Multitouch Gestures
Number of points used for each gesture has been linked to the intensity of the gesture
44
![Page 45: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/45.jpg)
Recognition
Movement – polling Simple gestures – Finite State Automata Complex Gestures – Hidden Markov
Models
45
![Page 46: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/46.jpg)
Design and Implementation
46
![Page 47: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/47.jpg)
User Interface
States:
47
![Page 48: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/48.jpg)
User Interface
Upon start-up, the Wii3D System attempts to connect to the Wii Remotes
48
![Page 49: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/49.jpg)
User Interface
Two possible errors – not 2 Wiimotes connected or no Wiimotes found
49
![Page 50: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/50.jpg)
User Interface
Search for devices
50
![Page 51: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/51.jpg)
User Interface
Found devices
51
![Page 52: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/52.jpg)
User Interface
Allow the devices to install
52
![Page 53: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/53.jpg)
User Interface
Connection success
53
![Page 54: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/54.jpg)
User Interface
Start polling
54
![Page 55: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/55.jpg)
User Interface
Currently polling
55
![Page 56: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/56.jpg)
User Interface
Events received
56
![Page 57: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/57.jpg)
User Study
Goals of the Experiment Design and Methodology
Tasks
Results
57
![Page 58: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/58.jpg)
User Study
Goals of the Experiment Design and Methodology
Tasks
Results
58
![Page 59: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/59.jpg)
Goals of the Experiment
To investigate whether the Wii3D System is a useful system
To investigate whether the Wii3D System could be used as an alternative to the mouse and keyboard
59
![Page 60: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/60.jpg)
User Study
60
![Page 61: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/61.jpg)
Design and Methodology
20 participants 15 minutes per user User consent required No individual data stored, only collated
results Supervised by researcher
61
![Page 62: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/62.jpg)
User Study
62
![Page 63: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/63.jpg)
Tasks
Introductory Questions Tasks Overview Questions
63
![Page 64: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/64.jpg)
Introductory Questions
How long have you been using a mouse and keyboard for?8 years
How often do you use a mouse and keyboard?3 hours/day
64
![Page 65: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/65.jpg)
Task 1 – Pointer Movement
65
Move pointers over targets
![Page 66: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/66.jpg)
Task 2 - Clicking
Move over targets Click gesture
66
![Page 67: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/67.jpg)
Task 3 – Panning/Scrolling Pan/Scroll and Image
67
![Page 68: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/68.jpg)
Task 4 – Zooming
Zoom into and out of an image
68
![Page 69: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/69.jpg)
Task 5 - Rotating
Rotate an image about the Z and X axes
69
![Page 70: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/70.jpg)
Task 6 – Complex Gesture Hidden Markov Models were used Circle gesture
70
![Page 71: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/71.jpg)
Overview Questions Would you use the Wii3D System as an
alternative to the mouse and keyboard? Why or why not?
If no, do you believe that the Wii3D System would be useful to someone else? Why?
Would you add/remove/change anything in the Wii3D System? Why?
You have undoubtedly had more experience using a mouse and keyboard than this type of system. What tasks would you find Wii3D more suitable for than a mouse and keyboard?
71
![Page 72: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/72.jpg)
User Study
72
![Page 73: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/73.jpg)
Results
Preliminary Observations Principal Results Participant Subjective Feedback Other Findings
73
![Page 74: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/74.jpg)
Preliminary Observations
Confusion between rotation and zoom gestures
People are more used to mouse and keyboard
Hidden Markov Models not performing efficiently
Hidden Markov Models only successfully recognizing a circle gesture 50% of the time
74
![Page 75: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/75.jpg)
Principal Results
None of the users would use Wii3D as a replacement for a mouse and Keyboard:Lack of typing supportGestures are not always recognizedAccuracy of the Wii3D System pointers was
not as good as a mouse
75
![Page 76: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/76.jpg)
Principal Results
The majority of the participants stated that they thought that the Wii3D System would be useful
76
![Page 77: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/77.jpg)
Movement
Mouse better for a single pointer
Wii3D better when there are more pointers
77
![Page 78: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/78.jpg)
Clicking
Mouse better for single pointer clicks
Wii3D slightly better for multiple pointer clicks
78
![Page 79: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/79.jpg)
Panning/Scrolling
Panning and scrolling is preferred with a mouse
Average and above ratings for Wii3D
79
![Page 80: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/80.jpg)
Zooming
Zooming is preferred with the mouse Best ratings out of all the gestures for
Wii3D
80
![Page 81: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/81.jpg)
Rotating
Preferred, again, is the mouse
Many users made zoom gestures instead
81
![Page 82: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/82.jpg)
Complex Gesture
Circle gestures were recognized correctly 50% of the time using Hidden Markov Models
This result is reflected in the ten participants who rated this task as “Very Unintuitive”
82
![Page 83: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/83.jpg)
Participant Subjective Feedback Users thought that the Wii3D System
would be useful for gaming and other three dimensional interactions
The users want typing functionality
83
![Page 84: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/84.jpg)
Other Findings
The longer people have used computers, the more time they spend on them daily
84
![Page 85: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/85.jpg)
Future Work
Improvements Additions
85
![Page 86: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/86.jpg)
Future Work
Improvements Additions
86
![Page 87: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/87.jpg)
Improvements
Multiple Wii Remotes Acceleration in predictive interpolation Dynamic Hidden Markov Models Gaussian Mixture Models in HMM
(continuous)
87
![Page 88: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/88.jpg)
Future Work
88
![Page 89: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/89.jpg)
Additions
GesturesDouble ClickFlickScaling an ObjectTyping
Artificial Neural Networks for Recognition
89
![Page 90: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/90.jpg)
Conclusion
There is a use for the Wii3D System The Wii3D System would not work as a
replacement for the traditional mouse and keyboard
90
![Page 91: Final Honours Presentation Principal Investigator: João Lourenço Supervisor: Dr Hannah Thinyane](https://reader036.vdocuments.net/reader036/viewer/2022062314/56649ebf5503460f94bca8f6/html5/thumbnails/91.jpg)
Questions/Comments
91