marco congedo, phd france telecom r&d

35
Marco Congedo, PhD France Telecom R&D Classification of Movement Classification of Movement Intention Intention by Spatially Filtered by Spatially Filtered Electromagnetic Inverse Solutions Electromagnetic Inverse Solutions [email protected] [email protected] Conjunct COST B27 and SAN Scientific Meeting, Swansea, UK, 16-18 September 2006

Upload: calida

Post on 15-Jan-2016

49 views

Category:

Documents


0 download

DESCRIPTION

Conjunct COST B27 and SAN Scientific Meeting, Swansea, UK, 16-18 September 2006. Classification of Movement Intention by Spatially Filtered Electromagnetic Inverse Solutions. Marco Congedo, PhD France Telecom R&D. [email protected]. Introduction. What is a BCI?. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Marco Congedo,  PhD France Telecom R&D

Marco Congedo, PhD France Telecom R&D

Classification of Movement Classification of Movement Intention Intention by Spatially Filtered Electromagnetic by Spatially Filtered Electromagnetic Inverse SolutionsInverse Solutions

[email protected]@Gmail.com

Conjunct COST B27 and SAN Scientific Meeting,Swansea, UK, 16-18 September 2006

Page 2: Marco Congedo,  PhD France Telecom R&D

2

Introduction

Page 3: Marco Congedo,  PhD France Telecom R&D

3

What is a BCI?A BCI is a system that allows humans

to transmit bits of information without making use of any motor activity.

This is achieved by detection and classification of discrete brain events.

Page 4: Marco Congedo,  PhD France Telecom R&D

4

Peer-Rewiewed Articles on "Brain-Computer Interface" (Source: PUBMED)

0

20

40

60

80

100

120

140

1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004

Year

Nu

mb

er o

f A

rtic

les

Page 5: Marco Congedo,  PhD France Telecom R&D

5

Domains of Applications• Motor Handicap

World Human

Input (Sensory)

Output (Motor)

Page 6: Marco Congedo,  PhD France Telecom R&D

6

"Aware Chair"(Georgia State University)

Text Editor(Helsinki University of Technology)

Examples of Current Applications for Motor Handicap

Page 7: Marco Congedo,  PhD France Telecom R&D

7

Domains of Applications• Motor Handicap

• Human-Machine Interface• New Interfaces• Detection of User's Intention (Video-Games, TeleInteraction)

Page 8: Marco Congedo,  PhD France Telecom R&D

8

Domains of Applications• Motor Handicap

• Human-Machine Interface

• Virtual Reality

• New Interfaces• Detection of User's Intention (Video-Games, TeleInteraction)

Page 9: Marco Congedo,  PhD France Telecom R&D

9

Navigation in a Virtual Environment via a Head Mounted Display and a BCI

(University of Graz)

Example of Application of BCI for Virtual Reality

Page 10: Marco Congedo,  PhD France Telecom R&D

10

Domains of Applications• Motor Handicap

• Human-Machine Interface

• Virtual reality• Robotics

• New Interfaces• Video-Games• Detection of User's Intention

Page 11: Marco Congedo,  PhD France Telecom R&D

11

Implantation of MicroElettrodes

Page 12: Marco Congedo,  PhD France Telecom R&D

12

Implantation of MicroElettrodes

Advantages:• Bypass the low-pass filter enforced by the cranial bones• Small Neuronal Population Recording (High Spatial Resolution)• 24h Data Availability

Disadvantages:• Invasive

Page 13: Marco Congedo,  PhD France Telecom R&D

13

Method

Page 14: Marco Congedo,  PhD France Telecom R&D

14

The Motor Cortex and the detection of Movement Intention

Page 15: Marco Congedo,  PhD France Telecom R&D

15

The Motor "Homunculus"

Page 16: Marco Congedo,  PhD France Telecom R&D

16

pyramidal cell

Section of aCortical Gyrus

Cerebral Cortex

Page 17: Marco Congedo,  PhD France Telecom R&D

17

Pyramical Cells of the Motor Cortex

Page 18: Marco Congedo,  PhD France Telecom R&D

18

Subjects and Procedures• Subject: one non-clinical subject during a self-paced key pressing task.

• Task: press with the index and little fingers keys using either the left or right hand, in a self-paced timing and self-chosen order.

• Protocol: three sessions of six minutes each, with a few minutes of break between sessions.

- Epochs of 500 ms were extracted ending 130 ms before the key press.

- The epochs were divided in a training set and a test set (316 and 100).

• EEG Data: BCI Competition 2003, Data-Set IV

(Blankertz et al, 2004)

- EEG was acquired at 28 leads (F3, F1, Fz, F2, F4, FC5, FC3, FC1, FCz, FC2, FC4, FC6, C5, C3, C1, Cz, C2, C4, C6, CP5, CP3, CP1, CPz, CP2, CP4, CP6, O1, O2) with a 1000 Hz sampling rate.

Page 19: Marco Congedo,  PhD France Telecom R&D

19

Examples of EEG trial related to Movement Intention(from -630 ms. to -130ms. before movement onset)

Left Finger Right Finger

-630 ms -130 ms Periodogram AutoCorrelation

Fron

tal

Site

sO

ccipita

l S

ites

Page 20: Marco Congedo,  PhD France Telecom R&D

20

Data Processing (Schematic Representation)

Band-Pass Filtering

Projection on the Beamspace(Spatial Filtering)

Source Power EstimationIn the Regions of Interest

(sLORETA)

Classification

Page 21: Marco Congedo,  PhD France Telecom R&D

21

Band-Pass Filtering

T-tests of Left vs. Right Finger Movement Intention(N= 159 Left Fingers trials + 157 Right Fingers trials.

Page 22: Marco Congedo,  PhD France Telecom R&D

22

Band-Pass Filtering

Threshold ofsignificance

minima

maxima

(maxima – minima)/2

Maximal and minimal absolute t-statistic across the volume for each frequency bin and their relation with the threshold of significance

Page 23: Marco Congedo,  PhD France Telecom R&D

23

Spatial Filtering (Common Spatial Pattern)

max ; maxT T

L RT T

R L

a b

a V a b V ba V a b Vb

Problem:

Solution:First and last d vectors of the Joint Diagonalizer ofLV and

RV

T

TL

TR

F V F I

F V F W

F V F I W

where I is the identity matrix, VΣ = VL+VR,W=diag(W1≥W2≥…≥WN-1) andI-W=diag(1-W1≤1-W2≤…≤1-WN-1).

satisfying:

Page 24: Marco Congedo,  PhD France Telecom R&D

24

sLORETA Source Power of the Filter Spatial Patterns

1

2

3

4

5

23

24

25

26

27

The 28 scalp coefficients are given as the 27 columns of T G F

Page 25: Marco Congedo,  PhD France Telecom R&D

25

Actual Filter Employed

27 26R F f f

where df is the unith norm dth column vector of F.

1 2L F f f Filter for Left Motor Cortex

Filter for Left Motor Cortex

Page 26: Marco Congedo,  PhD France Telecom R&D

26

sLORETA Source Power Estimation

TL L Ltr H VH T T T

L L L L L L Ltr H F F VF F H

T T TR R R R R R Rtr H F F VF F H

Unfiltered sLORETA Filtered sLORETA

LEFT

Moto

r C

orte

x

RIG

HT

Moto

r C

orte

x

TR R Rtr H VH

Page 27: Marco Congedo,  PhD France Telecom R&D

27

Filtered Source power of Left and Right finger movement intention grand average training trials

Legend: R=Right; L=Left; A=Anterior; P=Posterior; S=Superior; I=Inferior.

Left

trials

Rig

ht

trials

Page 28: Marco Congedo,  PhD France Telecom R&D

28

Classification

classify trial as finger movement intention if

classify trial as finger movement intention if

L R

L R

left

right

Page 29: Marco Congedo,  PhD France Telecom R&D

29

Right Finger Movement Intention Trials

Left Finger Movement Intention Trials

Training Set (N=316) Test Set (N=100)

Results

Ou

r M

eth

od

Un

filte

red

sLO

RE

TA

Page 30: Marco Congedo,  PhD France Telecom R&D

30

Discussion

Page 31: Marco Congedo,  PhD France Telecom R&D

31

• The Classifier is Untrained

Advantages of the Method

Page 32: Marco Congedo,  PhD France Telecom R&D

32

• The Classifier is Untrained

Advantages of the Method

• Adapt to Invividual Characteristics

Page 33: Marco Congedo,  PhD France Telecom R&D

33

• The Classifier is Untrained

Advantages of the Method

• Adapt to Invividual Characteristics• Processing Speed

Page 34: Marco Congedo,  PhD France Telecom R&D

34

• The Classifier is Untrained

Advantages of the Method

• Adapt to Invividual Characteristics• Processing Speed

• Non Invasiveness

Page 35: Marco Congedo,  PhD France Telecom R&D

35

End…

AcknowledgmentsThis Research has been partially funded by the French National Research Agency within the project Open-ViBE (Open Platform for Virtual Brain Environments), and by Nova Tech EEG, Inc., Knoxville, TN.

[email protected]

ReferenceCongedo M., Lotte, F, Lécuyer, A. (2006),

Classification of Movement Intention by Spatially Filtered Electromagnetic Inverse Solutions, Physics in Medicine and Biology, 51, 1971-1989.

Contacts