apps with ears and eyes! build next generation apps with eyes and ears using google chrome
DESCRIPTION
Build next generation apps with eyes and ears using Google ChromeTRANSCRIPT
GoogleIO @ Java Meetup Ahmedabad
Build next generation apps with eyes and ears using Google Chrome
Treat your users as human!
l UX - 101
l Tools should fit human not the other way around!
Now we have books on UX!
l With computers, we lost 'human touch' in interaction
l Touch screens brought it back, but frankly its not the natural way to do 'things'
Let's get back to basics..
l I have to tell you something.. I will speak and you will listen.l So why it has to be different for computers?!
Enter the new era!
l Now browsers can speak to you.l And browsers can hear you too!
http://updates.html5rocks.com/2013/01/Voice-Driven-Web-Apps-Introduction-to-the-Web-Speech-API
Demo time!
https://www.google.com/intl/en/chrome/demos/speech.html
Do it yourself!
You talk too much...
l It's time to listen..
l Yes! That's all we need!
https://translate.google.co.in/#auto/hi/Welcome%20to%20Ishi%20Systems
Off-line mode too!
http://syl22-00.github.io/pocketsphinx.js/
This is how translation should work!
http://www.moreawesomeweb.com/demos/speech_translate.html
Command mode!
l I am married.... ammm.. Can I command my computer to do things?
https://www.talater.com/annyang/ https://github.com/TalAter/annyang
But can you see me?
http://wolframhempel.github.io/photobooth-js/
Ok but how its useful?
http://revealjs.herokuapp.com/
Time to demo!, again.! :-)
https://github.com/willy-vvu/reveal.js
What was that?
l Magic of 'Motion detection algorithms'l Over simplified How To:
Capture video [getUserMedia()] Draw frames [ html5 <canvas> ] Run Algorithm to detect change between frames [ .js]
l If you are deeply interested Read : http://labs.littlemissrobot.com/behind-the-mirror/
http://www.adobe.com/devnet/html5/articles/javascript-motion-detection.html
More!
l https://github.com/foo123/HAAR.js#live-examples Interactive Face Detection Many Faces Detection Interactive Mouth Detection
l l http://www.soundstep.com/blog/experiments/jstracking/
Motion tracking l http://www.soundstep.com/blog/experiments/jsdetection/
The Magical Xylophone
Its time to...
WebSpeech API fundametals
l Audio capturel Request authorizationl Audio processing pip line
Nodes (FFT , Gain, Filter...) http://chimera.labs.oreilly.com/books/1234000001552/
l Join to destination (Speakers)l + Visualizations
GetUserMedia API fundamentals
l Audio + Video capturel Request authorizationl Capturel Draw (Hidden)l Analyze + Processl Re-Draw
And finally...
लगता� हैं� बर्फ गिगर रहैं हैं�!
https://github.com/IonicaBizau/WebcamSnowhttp://ionicabizau.net/WebcamSnow/