multivariate analyses with fmri data - tnu · multivariate analyses with fmri data sudhir shankar...

42
MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich

Upload: others

Post on 13-Mar-2020

18 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

MULTIVARIATE ANALYSES WITH fMRI DATA

Sudhir Shankar Raman Translational Neuromodeling Unit (TNU)

Institute for Biomedical Engineering University of Zurich & ETH Zurich

Page 2: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation

Modelling Concepts

Learning From Data

Multivariate Bayes in SPM

Generative Embedding

Page 3: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation • Local activations – Univariate approach

2

1

significant not significant

Page 4: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Univariate to Multivariate

2

1

1

2

not significant not significant

Page 5: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation

Learning from data

Multivariate Bayes in SPM

Generative Embedding

Modelling Terminology

Page 6: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Steps for analysis Feature

Extraction

Modelling

Classification

Clustering

Regression

Prediction

Model Selection

Cross validation

Performance

Inference

Page 7: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Feature Spaces Raw data

Model parameters

GLM – regression coefficients DCM – connection parameters

Voxel activity

F1 F2 . . . FP

S1

S2 Data Point or Feature Vector

.

.

SN

• High dimensionality • Class/Cluster distributions • Interpretation

Page 8: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Model Selection - Generalizability

Model Fit

Model Complexity

Bishop (2006), Pitt & Miyung (2002), TICS

Page 9: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Modelling goals • Prediction

• Model Selection

h X Y

Sparse Coding Distributed Coding

Predictive Density

Model Evidence

Page 10: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation

Learning From Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Concepts

Page 11: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Learning from Data

Supervised Learning

Unsupervised Learning

Reinforcement Learning

Semi-supervised Learning

Page 12: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Supervised Learning

Function - f

Independent variables X

dependent variable Y Categorical Continuous

Page 13: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

SVM

Classification

• Kernel Function – K 𝒙𝒊,𝒙𝒋 = 𝝓 𝒙𝒊 .𝝓 𝒙𝒋

𝝓

Function - f X Y

• Generative classifier • Discriminative classifier

Kernel Methods

Kernel methods for pattern analysis, Taylor , Cristianini, 2004

Page 14: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

K-fold Cross Validation

• Model Selection • Performance evaluation

Accuracy

1

2

3

87%

75%

89%

Training data

Test data

Page 15: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Performance – Single Subject

𝑝 = 𝑃 𝑋 ≥ 𝑘 𝐻0 = 1 − 𝐵 𝑘|𝑛,𝜋0

Brodersen et al. 2013, NeuroImage

Binomial Test

k=30

Page 16: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Performance – Multiple Subjects

Brodersen et al. 2013, NeuroImage

Fixed effects

Random effects

http://www.translationalneuromodeling.org/tapas/

Page 17: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Using classification for fMRI data

Pattern localization

Searchlight classifier

Nandy & Cordes (2003) MRM , Kriegeskorte et al. (2006) PNAS Mourao-Miranda et al. (2005) NeuroImage

Whole brain

Pereira et al. (2009) NeuroImage, Mitchell et al. (2004) Machine Learning

Word Category

Food Building People

Page 18: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Confounds – GLM vs MVPA

Todd et al. 2013, NeuroImage

Page 19: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Unsupervised Learning Building a representation of

data

Dimensionality Reduction Time series Clustering

K-means Mixture models

Page 20: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

K-means

Mixture of Gaussians

Bishop (2006)

Page 21: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Interpretation • Cluster parameters

• Purity Inferred Labels

External Labels

Subjects

Cluster 1 Cluster 2

Page 22: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation

Learning from Data

Multivariate Bayes in SPM

Generative Embedding Modelling

Page 23: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Encoding Vs Decoding Models

Page 24: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Encoding Vs Decoding

Friston et al. 2008 NeuroImage

Page 25: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Coding hypotheses

Spatial vectors Smooth vectors

Sparse vectors

Singular vectors of data Support vectors

Distributed vectors

𝑈 = 𝑅𝑌𝑇 𝑈𝑈𝑉𝑇 = 𝑅𝑌𝑇

Page 26: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Bayesian decoding of motion

Experimental factors: 1. Photic 2. Motion 3. Attention

Attention to motion dataset - Büchel & Friston 1999 Cerebral Cortex

Friston et al. 2008 NeuroImage

Page 27: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Multivariate Bayes in SPM

Page 28: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Results

Friston et al. 2008 NeuroImage

Page 29: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Results

Page 30: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Laminar activity related to novelty and episodic encoding

Maas et al. 2014 Nature Communications

Page 31: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Motivation

Learning from Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Principles

Page 32: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Subject 1

Subject 2

Subject N

Voxel activity

Subject 1

Subject 2

Subject N

Connectivity

Dynamic causal model (DCM)

Classification Clustering

Group 1 Group 2

. . . . . .

Page 33: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Generative Embedding - Classification

Brodersen et al. pLOS computation biology 2011.

Page 34: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

DCM - Speech processing

Brodersen et al. pLOS computation biology 2011.

Page 35: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Working memory - fMRI • 41 Schizophrenia patients (DCM IV,ICD 10), 42 controls

• Visual numeric n-back working memory task

Deserno, Lorenz et al 2012. The Journal of Neuroscience 32 (1). Society for Neuroscience: 12–20.

1 5 4 2 9 8 9

3 5 900ms

500ms

Page 36: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Model based clustering

Brodersen et al 2014 Neuroimage

Page 37: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Results – Healthy vs Schizophrenic

Brodersen et al 2014 Neuroimage

Page 38: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Brodersen et al 2014 Neuroimage

Results – Schizophrenia patients

Page 39: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Unified model for identifying subgroups

Page 40: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Summary

Learning from Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Principles

Page 41: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Practicals • Multivariate Bayes in SPM • Classification

• Clustering

Page 42: Multivariate Analyses with fMRI data - TNU · MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) ... Bayes in SPM Generative Embedding

Thank you