the use of wireless signals for sensing and interaction · the use of wireless signals for sensing...
TRANSCRIPT
![Page 1: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/1.jpg)
| Roland Meyer
Ubiquitous Computing Seminar FS2014 Roland Meyer 11.03.2014
The Use of Wireless Signals for Sensing and Interaction
![Page 2: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/2.jpg)
| Roland Meyer
§ Gesture Recognition § Classical Role of Electromagnetic Signals § Physical Properties of Electromagnetic Signals § Research Projects bridging wireless communication with
computer interaction § Wi-Vi § WiSee § WiTrack § AllSee
2
Overview
![Page 3: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/3.jpg)
| Roland Meyer
§ „In the 21st century the technology revolution will move into the everyday, the small and the invisible…“
Mark Weiser
3
Beyond Classic Interfaces
Image Source: Microsoft Wireless Laser Desktop 7000
![Page 4: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/4.jpg)
| Roland Meyer
§ Gestures as natural way of interaction § Vision based § Infrared based § Electric field sensing § Ultrasonic § Wearable sensors § Wireless signals
4
Gesture Recognition
Image Sources: Microsoft Kinect; CHI '95; GetMYO.com
![Page 5: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/5.jpg)
| Roland Meyer
§ Works without line-of-sight and through walls § Larger areas can be covered § Unseen gestures can be detected
§ Independent of light conditions § Works day and night, indoors and outdoors
§ Infrastructure already widely deployed § Wireless signals are all around us § Devices have wireless interfaces anyway § (Almost) no new hardware needed
§ Relatively low power consumption
5
Why Wireless Signals for Gesture Recognition?
![Page 6: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/6.jpg)
| Roland Meyer 6
Classical Role of Electromagnetic Signals
Maxwell predicts existence of electromagnetic waves
Hertz proves existence of electromagnetic waves
Wireless telegraph Television
AM Radio FM Radio
1880 1870 1890 1900 1910 1920 1930
1950 1940 1960 1970 1980 1990 2000
First mobile phone First hand-held phone, GPS RFID Wi-Fi
UMTS, Bluetooth
Radar
Microwave oven
![Page 7: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/7.jpg)
| Roland Meyer
§ Form of energy, emitted from a source § Propagating via photon wave particles through space at
the speed of light § Oscillating magnetic and electric components § Described by either
§ Wavelength λ § Frequency f § Energy E
7
Electromagnetic Signals
h = Planck’s constant c = speed of light
Image Source: Wikipedia
![Page 8: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/8.jpg)
| Roland Meyer 8
Electromagnetic Spectrum
Image Source: University of Oregon
![Page 9: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/9.jpg)
| Roland Meyer 9
Radio (and Microwave) Spectrum
penetrates dense objects
cannot penetrate objects
(line-of-sight)
travels only short distances
partly penetrates dense objects
Source: New America Foundation
Radio
Television GPS
Weather radar
Cell phones Toll tags Wi-Fi, Bluetooth
![Page 10: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/10.jpg)
| Roland Meyer
§ “Wi-Vi” § Detect number of humans in a (closed) room and their relative
movements § Communication through simple gestures
§ „WiSee“ § Recognize gestures in entire home, especially in non-line-of-sight
scenarios § „WiTrack“
§ 3D tracking of humans and body parts § „AllSee“
§ Recognize gestures with almost negligible power
§ “Wi-Vi” § Detect number of humans in a (closed) room and their relative
movements § Communication through simple gestures
§ „WiSee“ § Recognize gestures in entire home, especially in non-line-of-sight
scenarios § „WiTrack“
§ 3D tracking of humans and body parts § „AllSee“
§ Recognize gestures with almost negligible power
10
Research Projects
![Page 11: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/11.jpg)
| Roland Meyer
§ “Wi-Fi Vision” § Wi-Fi signals traverse wall and
reflect off human bodies back to receiver
§ 1 receive and 2 transmit directional antennas
§ 20 MHz-wide Wi-Fi channel in the 2.4 GHz band
11
Wi-Vi : „See Through Walls with Wi-Fi!”
[Adib2013]
![Page 12: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/12.jpg)
| Roland Meyer
§ Law enforcement § Intrusion detection § See through rubble in
emergency situations § Occupancy detection to control
heating/light § Entertainment
12
Applications for Wi-Vi
Image Source: Dartmouth College
![Page 13: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/13.jpg)
| Roland Meyer
§ Multiple antennas to improve throughput
§ Channels are estimated by sending known preamble from
each transmitter in sequence
13
MIMO (Multiple-Input Multiple-Output)
Tx1 Preamble x1 Data 1 Tx2 Preamble x2 Data 2
time
![Page 14: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/14.jpg)
| Roland Meyer
§ Each transmitter uses second antenna to null its transmission at the other receiver
14
MIMO: Interference Nulling
Instead of sending x1 send h22x1 and -‐h12x1
![Page 15: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/15.jpg)
| Roland Meyer
§ Direct signal and reflections off the wall itself (multipath) are much stronger than reflections of interest
§ Signals pass wall twice → much weaker
§ MIMO interference nulling to remove reflections from static objects 1. Estimate channels 2. Use estimates to null signal at receiver 3. Objects that moved between
step 1 and 2 can be detected 4. Repeat iteratively
15
Dealing with the Flash Effect
![Page 16: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/16.jpg)
| Roland Meyer
§ Inverse synthetic aperture radar (ISAR) to simulate antenna array § Cheaper, since less antennas needed § More compact § Assumptions on speed of motion
§ Estimate angle (relative movement) § Smoothed MUSIC algorithm to
separate multiple humans
16
Tracking Humans
![Page 17: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/17.jpg)
| Roland Meyer 17
Tracking Humans
1 human 2 humans
3 humans
[Adib2013]
§ Positive angle → moving towards device § Negative angle → moving away from device § Brightness (typically) indicates distance
§ Spatial variance with trained thresholds to automatically obtain number of humans
![Page 18: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/18.jpg)
| Roland Meyer
§ Special mode to send messages § Bits encoded by gestures
§ “0”: step forward, step backward § “1”: step backward, step forward
§ Requires knowledge about coarse location of device
18
Gesture Recognition
1 0
[Adib2013]
![Page 19: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/19.jpg)
| Roland Meyer
§ Two standard conference rooms (7×4 and 11×7 meters) § 15cm-wide hollow walls, supported by steel frames with
sheetrock on top § Wi-Vi placed one meter away from wall in neighboring room
§ 8 human subjects of different heights and builds § Subsets of up to 3 people for experiments on detecting humans § One human at a time for experiments on gesture recognition
19
Experimental Setup
![Page 20: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/20.jpg)
| Roland Meyer
§ One conference room for training, one for testing § Test subjects entered room, closed door and moved freely
20
Evaluation: Detecting Number of Humans
Detected
0 1 2 3
Act
ual
0 100% 0% 0% 0%
1 0% 100% 0% 0%
2 0% 0% 85% 15%
3 0% 0% 10% 90%
![Page 21: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/21.jpg)
| Roland Meyer 21
Evaluation: Decoding Gestures
§ No mismatched bits, only erasure errors § “0”-bits easier to detect than “1”-bits
§ Stepping forward, then backward is easier than the opposite § Subjects are closer to device on average when performing “0”-bits
[Adib2013]
4.5cm Solid Wood Door
15cm Hollow Wall
20cm Concrete
![Page 22: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/22.jpg)
| Roland Meyer
WiSee : „ Whole-Home Gesture Recognition Using Wireless Signals”
§ Leverage existing Wi-Fi infrastructure § 1 AP as multi-antenna receiver § Few devices as transmitters
§ Use Doppler shifts to measure movement speeds to identify gestures
22 [Pu2013]
![Page 23: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/23.jpg)
| Roland Meyer
§ Always-available control over household appliances § Adjust music volume § Adjust room temperature § Turn lights on/off § Change TV channels § Gaming
§ Secret gestures for user identification
23
Applications for WiSee
![Page 24: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/24.jpg)
| Roland Meyer 24
Doppler Shift
§ Static object § Emitted waves have same
frequency everywhere
§ Moving object § Frequency perceived higher
when approaching → positive shift
§ Lower when retreating → negative shift
Image Source: Wikipedia
![Page 25: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/25.jpg)
| Roland Meyer
§ Humans reflecting Wi-Fi signals act as virtual transmitters
§ Frequency shift depends on original frequency, speed and
direction of movement § Human motion results in very small shifts
§ A motion of 0.5 m/s within a 5 GHz transmission results in a maximum shift of 17 Hz → difficult to detect
25
Extracting Doppler Shifts from Wireless Signals
[Pu2013]
Positive shift Negative shift
![Page 26: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/26.jpg)
| Roland Meyer
§ Increase throughput by multiplexing a single wide channel into multiple orthogonal (non-interfering) subchannels
§ Widely used, e.g. in DVB-T, LTE, digital radio, …
26
OFDM (Orthogonal Frequency Division Multiplexing)
![Page 27: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/27.jpg)
| Roland Meyer 27
Extracting Doppler Shifts from Wireless Signals
§ Challenge: Detect frequency shifts many magnitudes smaller than the bandwidth
![Page 28: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/28.jpg)
| Roland Meyer
1. Decode received OFDM symbols using standard decoder
2. Use the decoded data to transform and re-encode all symbols into the first symbol, removing the data part and only leaving the “noise”
3. Perform FFT over N symbols to reduce bandwidth by factor of N
1. Decode received OFDM symbols using standard decoder
2. Use the decoded data to transform and re-encode all symbols into the first symbol, removing the data part and only leaving the “noise”
1. Decode received OFDM symbols using standard decoder
28
Extracting Doppler Shifts from Wireless Signals
Symbol #1 Symbol #2 Symbol #3 Symbol #4 …
00101101 01101001 11101001 01010110 …
00101101 00101101 00101101 00101101 …
00101101 00101101 00101101 00101101 …
![Page 29: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/29.jpg)
| Roland Meyer 29
Gestures
§ Multiple body parts move at different speeds → multiple Doppler shifts
[Pu2013]
![Page 30: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/30.jpg)
| Roland Meyer 30
Gestures
§ Use changes in energy to detect beginning and ending of gestures
§ If separated by less than one second, cluster two gestures into one
§ Pattern matching on number and order of positive and negative shifts § User independent § Speed independent
[Pu2013]
![Page 31: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/31.jpg)
| Roland Meyer
§ No standard MIMO channel estimation possible § No known preamble
§ User performs preamble gesture to gain control
§ Upon preamble detection iteratively use MIMO to estimate
optimal channel and lock onto the user
31
Dealing with Multiple Humans
[Pu2013]
×2 Double tap
![Page 32: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/32.jpg)
| Roland Meyer
§ Office building § 14.5cm-wide sheet-rock walls § Multiple other Wi-Fi devices
operating in the area § Two-bedroom apartment
§ 14cm-wide hollow walls § Wooden doors
§ 1 - 2 transmitting devices § 5-antenna receiver § 5 human subjects
32
Experimental Setup
[Pu2013]
![Page 33: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/33.jpg)
| Roland Meyer
§ 3 - 4 antennas is enough to detect gestures in all scenarios § User has to be in range of receiver
§ Can be increased by increasing number of transmitters or distance between transmitters and receivers
33
Evaluation: Gesture Detection
[Pu2013]
![Page 34: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/34.jpg)
| Roland Meyer
§ 900 gestures performed
§ 94% classified correctly § 4% classified incorrectly § 2% not detected
§ Accuracy of distinguishing between gestures is high even when transmitters are active only 3% of the time
34
Evaluation: Gesture Recognition
[Pu2013]
![Page 35: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/35.jpg)
| Roland Meyer
§ False detection rate decreases with number of preamble repetitions § < 0.13 per hour with 3
repetitions § None with 4 repetitions
§ 90% accuracy with 5 receiving antennas and 3 interfering users
35
Evaluation: Handling Multiple Humans
![Page 36: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/36.jpg)
| Roland Meyer
§ 3D tracking of humans § Coarse detection of moving body parts § Measure time-of-flight of reflections to estimate location
§ Localizes the center of a human body to within 10 to 13 cm horizontally and 21 cm vertically
36
WiTrack : “3D Tracking via Body Radio Reflections”
[Adib2014]
![Page 37: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/37.jpg)
| Roland Meyer
§ Augment virtual-reality and gaming systems to work in non-line-of-sight scenarios
§ Elderly fall detection § Possible because height and speed of movement is tracked
§ Control appliances by pointing at them § Possible because orientation of body parts is tracked
37
Applications for WiTrack
![Page 38: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/38.jpg)
| Roland Meyer
§ Extract gesture information from ambient background signals (e.g. TV broadcasting)
§ Signal amplitude is extracted using only analog hardware components § No need for power-hungry components
§ Leverage the fact that motion closer to the receiver causes more signal attenuation
§ Negligible power consumption § Can be used in batteryless devices
38
AllSee: “Bringing Gesture Recognition To All Devices”
[Bryce2014]
![Page 39: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/39.jpg)
| Roland Meyer
§ Wireless signals traditionally used for communication, but many more applications possible § Localization & motion tracking § Gesture recognition § Through-wall imaging and communication
§ Potential for the Internet of Things § (Re)use existing wireless infrastructure § No (body) instrumentation needed § No requirement for line-of-sight § Cover large areas with few devices § Low power
39
Summary
![Page 40: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/40.jpg)
| Roland Meyer
§ WiSee § AllSee
40
Application Demos
![Page 41: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/41.jpg)
| Roland Meyer 41
Thanks for Listening
![Page 42: The Use of Wireless Signals for Sensing and Interaction · The Use of Wireless Signals for Sensing and Interaction . Roland Meyer | ! Gesture Recognition ... WiSee : „ Whole-Home](https://reader033.vdocuments.net/reader033/viewer/2022041621/5e3f3dc4bee16d5b7a6f12d0/html5/thumbnails/42.jpg)
| Roland Meyer
§ [Adib2013] Fadel Adib, Dina Katabi See Through Walls with Wi-Fi! Proceedings of the ACM SIGCOMM 2013, Hong Kong, China, 2013.
§ [Pu2013] Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, Shwetak Patel Whole-Home Gesture Recognition Using Wireless Signals Proceedings of the 19th annual international conference on Mobile computing & networking Mobicom’13, Miami, USA, 2013
§ [Adib2014] Fadel Adib, Zachary Kabelac, Dina Katabi, Robert C. Miller. 3D Tracking via Body Radio Reflections Usenix NSDI'14, Seattle, USA, 2014
§ [Liu2013] Vincent Liu, Aaron Parks, Vamsi Tall, Shyamnath Gollakota, David Weatherall, Joshua Smith Ambient Backscatter: Wireless Communication out of Thin Air Proceedings of the ACM SIGCOMM 2013, Hong Kong, China, 2013.
§ [Bryce2014] Bryce Kellogg, Vamsi Tallat, Shyamnath Gollakota Bringing Gesture Recognition To All Devices Proceedings of the USENIX NSDI 2014, Seattle, USA, 2014.
42