obvious business potential” · 2017. 1. 6. · human variability => individualization –...

Lars Kai Hansen – [email protected] Technical University of Denmark

Quantified human behavior

“… obvious business potential”


Happy New Year!

Human behavior as a ressource – What are the signals? – .. and the challenges?

5 minute business bs

– AI = Augmented intelligence – Prepare for IQ=1000 – Why connected brains?

Mind reading internet

– Shift the focus from individual to social – Internet of brains – IoB v1.0: Connected hearing aids – Brain state monitoring - where are we?

How did you sleep last night?

More direct access to our state of mind will revolutionize the ways we understand and interact with ourselves, our collaborators and our computers

Mobile brain scanning can be used to read wishes and plans, to improve diagnosis, medication, and rehabilitation

At DTU Compute we have build the first truly mobile brain scanner. The scan is a 3D image of the instantaneous brain activity.

My aim is to give everybody realtime access to their brains.


Quick intro

Early work in machine learning introduced the ensemble method (IEEE PAMI 1990). Since mid-90s work on systems neuroscience /neuroimaging: first papers on mind

reading (PET, 1994) and (fMRI, 1997) More recent work in ML on ”Variance inflation” kPCA (JMLR, 2011) and SVMs (PRL, 2013) Recovering from undersampling biases for small samples in high-dimensional spaces AISTATS 2016: ”Dreaming more data… ” On deep learning with limited sample sizes Active in the community for ”mobile EEG”: The Smartphone Brain Scanner. New Scientist Nov 2011: “Now you can hold your brain in the palm of your hand”


Human behavior - what are the signals?

Single subject measures – Smartphones, watches: Mobility/GPS/Wifi triangulation, speech, eye-track,

face recognition – Quantified self devices: Fitbit, Jawbone, – Medical devices – hearables, Cure4You,

Oculus acquires eye-tracking startup The Eye Tribe

Digital & Social media

– Deep decoding: Emotional states – Media attention, shared attention in twitter – Social patterns: Sensible DTU / Copenhagen network study

“Oticon Tego is directed by the DecisionMaker system, driven by (AI) Artificial Intelligence that processes sound intelligently. This super advanced form of computer processing. Artificial Intelligence is the process of performing logical operations enthused by the human brain. The difference between AI-based and conventional instruments is distinct: AI-based instruments constantly adapt to particular situation where conventional instruments provide only a fixed response to selected types of sounds. AI-based, Oticon Tego evaluates the different sound processing options and selects the one guaranteed to give the clearest sound quality. “


Life-logging for evidence based living

Gordon Bell

MyLifeBits a Microsoft Research project. (ca 2001-05) Inspired by Vannevar Bush's hypothetical Memex computer system. http://www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/ The project included full-text search, text and audio annotations, and hyperlinks. The "experimental subject" of the project was computer scientist Gordon Bell, and the project aimed at collecting a lifetime of storage on and about Bell. Jim Gemmell of Microsoft Research and Roger Lueder were the architects and creators of the system and its software. http://research.microsoft.com/en-us/projects/mylifebits/default.aspx

http://research.microsoft.com/en-us/projects/mylifebits/default.aspx




Human behavior – modeling challenges learning curves for non-parametrics ~ log(N)/N

Human variability => Individualization – Power laws of human behavior (Song et al., 2010. Limits of predictability in human mobility, Science)

– Learning: The Power law of practise (Newell, A. and Rosenbloom, P.S., 1981. Cognitive skills and their acquisition, 1:1-55)

– Population measures have vanishing effect sizes.. “Replication crisis in psychology” -> Need a science of the individual based on the signals “Principia project”

Important information is in ”hidden variables” => neurotech

– Brain state: Motivation, vigilance, attention – History: Individual conceptual spaces, experiences, – Social dimensions - sensible DTU “It is a capital mistake to theorize before one has data”


William James, The Principles of Psychology (1890)

CHAPTER IV “Habit”

“When we look at living creatures from an outward point of view, one of the first things that strike us is that they are bundles of habits.”

“In wild animals, the usual round of daily behavior seems a necessity implanted at birth; in animals domesticated, and especially in man, it seems, to a great extent, to be the result of education. The habits to which there is an innate tendency are called instincts; some of those due to education would by most persons be called acts of reason.“

“It thus appears that habit covers a very large part of life, and that one engaged in studying the objective manifestations of mind is bound at the very outset to define clearly just what its limits are.”


Limits to predictability


Outline

Human behavior as a ressource – What are the signals? – What are the challenges?

5 minute business bs – AI = Augmented intelligence – Prepare for IQ=1000 – Why connected brains?

Mind reading internet

– Shift the focus from individual to social - Internet of brains – IoB v1.0: Connected hearing aids – Brain state monitoring - where are we?

AlphaGo - Lee Sedol 3 - 1


How big is AlphaGo?

“So far, machine learning is missing its separate condenser moment. So is AlphaGo a breakthrough on the path to emulating human intelligence? I think of it more as a trig point. It’s certainly an important intermediate goal, a chance to map the landscape and take the odd photo, but it is just a stage on the journey and one that we already knew we would reach. We have however got there quicker than expected, and that is a natural cause for celebration.” Neil Lawrence, Guardian Jan 28, 2016

#AlphaGo It is Lee vs 1,920 CPUs and 280 GPUs @ 3-4000 times the power consumed?... biology still rules http://www.economist.com/news/science-and-technology/21694540-win-or-

lose-best-five-battle-contest-another-milestone …

https://twitter.com/hashtag/Alphago?src=hash

https://t.co/dnXkrenHPQ




…Fan Hui once sat in much the same place. As we talk after the match, he clearly feels an enormous empathy for Lee Sedol, complaining about the online critics who have lambasted the Korean’s play. “Be gentle with Lee Sedol,” he says. “Be gentle.” But as hard as it was for Fan Hui to lose back in October and have the loss reported across the globe—and as hard as it has been to watch Lee Sedol’s struggles—his primary emotion isn’t sadness. As he played match after match with AlphaGo over the past five months, he watched the machine improve. But he also watched himself improve. The experience has, quite literally, changed the way he views the game. When he first played the Google machine, he was ranked 633rd in the world. Now, he is up into the 300s. In the months since October, AlphaGo has taught him, a human, to be a better player. He sees things he didn’t see before. And that makes him happy. “So beautiful,” he says. “So beautiful.”

Wired, March 2016

AI = Augmented Intelligence


Prepare for IQ AIQ=1000

IQ( woman + computer ) > IQ( computer )


Connected brains means business


Solutions for human progress and growth: - AI Augmented Intelligence - B2B direct communication - A vision for the effective society

Limiting factors to human progress and growth: - Intelligence: our capacity for deep specialization - Communication: our ability to share

Human progress and growth is driven by division of labour and specialization made possible by communication

Why?


the effective market society:

actionable access to any open information from all brains to all brains

Support productivity and well-being

Respect democratic living and privacy

the vision


”Obvious business potential”

Human senses & brains are not optimal …

list of cognitive biases in Wikipedia

http://en.wikipedia.org/wiki/List_of_cognitive_biases


DTU mobility projects

Social EEG- -Leaders and followers -Joint attention Mobile real-time EEG Imaging

-Neurofeedback -Digital media & emotion -Bhutan Epilepsy Project

Farrah J. Mateen, Massachusetts General Hospital

Camilla Falk

Ivana Konvalinka Simon Kamronn Andreas Trier Poulsen


Outline

Human behavior as a ressource – What are the signals? – What are the challenges?

5 minute business bs

– AI = Augmented intelligence – Prepare for IQ=1000 – Why connected brains?

Mind reading internet – Shift of focus from individual to social - Internet of brains – IoB v1.0: Connected hearing aids – Brain state monitoring - where are we?


https://www.youtube.com/watch?v=i_66KAOzXhU

Smartphone brain scanner

https://www.youtube.com/watch?v=Qkno9a0J9nM

Bhutan epilepsy project

https://www.youtube.com/watch?v=i_66KAOzXhU

https://www.youtube.com/watch?v=Qkno9a0J9nM


Smartphone Brain Scanner

Based on the Emotiv wireless transmission mechanism w/ the EPOC head set or modified EasyCaps (Stefan Debener, Oldenburg)

Version SBS2.0 for generic Android platforms (Tested in Galaxy Note, Nexus 7,...)

https://github.com/SmartphoneBrainScanner

A. Stopczynski, C. Stahlhut, M.K. Petersen, J.E. Larsen, C.F. Jensen, M.G. Ivanova, T.S. Andersen, L.K. Hansen. Smartphones as pocketable labs: Visions for mobile brain imaging and neurofeed-back. Int J. of Psychophysiology, (2014). A. Stopczynski, C. Stahlhut, J.E. Larsen, M.K. Petersen, L.K. Hansen. The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System. PloS one 9 (2), e86733, (2014)


Do we get meaningful 3D images?

Imagined finger tapping Left or right cued (at t=0) Signal collected from an AAL region (n=80)

Meier, Jeffrey D., Tyson N. Aflalo, Sabine Kastner, and Michael SA Graziano. Complex organization of human primary motor cortex: a high-resolution fMRI study.Journal of neurophysiology 100(4) :800-1812 (2008). A. Stopczynski, C. Stahlhut, M.K. Petersen, J.E. Larsen, C.F. Jensen, M.G. Ivanova, T.S. Andersen, L.K. Hansen. Smartphones as pocketable labs: Visions for mobile brain imaging and neurofeedback. International Journal of Psychophysiology, (2014). A. Stopczynski, C. Stahlhut, J.E. Larsen, M.K. Petersen, L.K. Hansen. The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System. PloS one 9 (2), e86733, (2014)


EEG in the classroom

JP. Dmochowski et al, "Correlated components of ongoing EEG point to emotionally laden attention a possible marker of engagement?" Frontiers of Human Neuroscience, 6:112, April 2012. JP. Dmochowski et al, ”Audience preferences are predicted by temporal reliability of neural processing”, Nature Communications 5: 4567, 2014. AP Poulsen et al. “EEG in the classroom: Synchronised neural recordings during a video presentation." arXiv:1604.03019 (2016).


24/7 Neurotechnology - with Aarhus Univ, Roskilde Sygehus, Hyposafe/Widex

Connect lab neuroscience and everyday life

Brain state representations connected by machine learning

Conventional EEG system

Wearable EEG system

Ear-EEG/Hyposafe device

High-performance research and clinical EEG system

Discreet, unobtrusive and user-friendly assistive devices for

everyday life

Smartphone data


Neurotech: Ear-EEG

Aim: A discreete, non-invasive solution for long time

recording in the wild Status EarEEG is a well-established technology Classical EEG reproduced: Sustained and event related responses to audio and visual stimulus High mutual information between ear and scalp EEG

Kidmose, P, et al. "Ear-EEG from generic earpieces: A feasibility study." Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. IEEE, 2013.


Hyposafe’s subcutaneous EEG

Permanent recording in the wild - build for decoding hypoglaemia risk Status Very stable subcutaneous electrode Magnetic coupling (signal <-> power) with outside ear piece Signal highly correlated with surface electrode in same location.

Duun-Henriksen, J, et al. "EEG Signal Quality of a Subcutaneous Recording System Compared to Standard Surface Electrodes." Journal of Sensors 2015 (2015).

seconds

Hz

http://www.hyposafe.com/index.php


Privacy… it’s human to share

Intuitive data Images, speech, economical, commercial, location, individual thoughts Non-intuitive data Health: diet, complete motion patterns Physiology: heart beat, skin resistance, gaze, brain data, your mind set Sandy Pentland calls for “a new deal on data” with three basic tenets: 1) you have the right to possess your data, 2) to control how it is used, 3) to destroy or distribute it as you see fit.


Lundbeck Foundation (CIMBI, CINS) Novo Nordisk Foundation (BASICS project)

Innovation Foundation Denmark (NeuroTech 24/7)

Thank you!

_i_ 8

obvious business potential” · 2017. 1. 6. · human variability => individualization –...

Documents