connectivity and synchronization: comparison of neural ... review1.pdf · connectivity and...

42
Ludovico Minati Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo Institute of Technology, Tokyo, Japan Institute of Nuclear Physics - Polish Academy of Sciences (IFJ-PAN), Kraków, Poland University of Trento, Trento, Italy

Upload: others

Post on 07-Jun-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Ludovico Minati

Connectivity and synchronization: comparison of neural observations and experiments with toy

networks

Tokyo Institute of Technology, Tokyo, JapanInstitute of Nuclear Physics - Polish Academy of Sciences (IFJ-PAN), Kraków, Poland

University of Trento, Trento, Italy

Page 2: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Two views on brain organization

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Functional specialisation: What regions respond to a particular

experimental input?

Image source: Sporns 2007, SPM Course

L. Minati

Page 3: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Two views on brain organization

Functional specialisation: What regions respond to a particular

experimental input?

??

Functional integration:How do regions influence each other? How does cognition emergefrom interacting regions?

Image source: Sporns 2007, SPM Course

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 4: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Topography to topology

Image source: Eileen Kraemer, 2005; Rosazza & Minati, 2011; © Authors and Springer Verlag

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 5: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Networks are everywhere

Image source: Eileen Kraemer, 2005

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 6: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Properties of self-organized networks

Image source: Jean Vaucher, 2005

Small-world-ness:

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 7: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Properties of self-organized networks

Scale-free-ness:

Image source: not known

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 8: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Importance of node centrality

Degree vs. betweenness centrality:

Image source: Minati et al., NeuroReport 2013

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 9: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Three aspects of brain connectivity

⚫ anatomical/structural connectivity

= presence of axonal connections

Image source: Sporns 2007, SPM Course

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 10: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Three aspects of brain connectivity

⚫ anatomical/structural connectivity

= presence of axonal connections

⚫ functional connectivity

= statistical dependencies between regional time series

Image source: Sporns 2007, SPM Course

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 11: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Three aspects of brain connectivity

⚫ anatomical/structural connectivity

= presence of axonal connections

⚫ functional connectivity

= statistical dependencies between regional time series

⚫ effective connectivity

= causal (directed) influences between neurons or neuronal

populations

Image source: Sporns 2007, SPM Course

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 12: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Brain connectivity and dynamics

Structural connectivity (i.e. physical links)

Functional connectivity (i.e. synchronization)

Dynamics

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 13: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Brain connectivity and dynamics

Structural connectivity (i.e. physical links)

Functional connectivity (i.e. synchronization)

Dynamics Plasticity

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 14: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Multiple scales

• Microscale (102-103 neurons)• Cortical (groups of) columns/microcircuits• Receptive field tiling, “building blocks” for larger circuits

• Mesoscale (105-107 neurons)• Gyral/sub-gyral circuits• Multi-sensory integration, associative functions

• Macroscale (109-1011 neurons)• Large-scale multi-gyral/bihemispheric circuits• Higher cognitive functions, consciousness

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 15: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Topological and dynamical properties

• Topology• Modularity• Scale-free-ness• Small-world-ness

• Dynamics • Non-linearity• Possible chaoticity• Criticality

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 16: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

The brain is totally unlike a digital computer

Design vs. Emergence J. Von Neumann

1903-1957

A. Turing

1912-1954

Image credit: Wikipedia, others

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 17: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

The brain is totally unlike a digital computer

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

→ Computation by design → (Epi)genetics only starting point

→ Architecture is fixed → Largely self-organized

→ Little or no redundancy → Huge redundancy

→ High reliability of each element → Low reliability of each element

→ Low noise/error rate → High noise/error rate

→ Parasitics/noise to be minimized → Parasitics/noise essential

→ Very high clock rate (GHz) → Very low clock rate (kHz)

Page 18: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

The brain is totally unlike a digital computer

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

① Effective connectivity ≡ Structural connectivity

→ Propagation of information is directly determined by connections

② Functional connectivity ≡ ∅

→ There is, usually, no spontaneous (intrinsic) activity

Page 19: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

The brain is totally unlike a digital computer

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

→ Simple lattice network

→ Relatively easy to train

→ Usually no spontaneous activity

→ Complex network topology

→ No robust tools to train, yet

→ Mostly spontaneous activity

Digital computer (GPU): Brain:100-200 W ~20 W

Page 20: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Is there anything physically unique about it?

Image credit: Wikipedia, DARPA, others

StochasticCartesian determinism Quantum

Seemingly, everywhere one looks, there is a paradox…

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 21: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Centrality and universality of emergence

Image credit: Wikipedia, others

Whole (collective behavior) >> Sum of parts (elemental dynamics)

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 22: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Why compare to other physical systems?

e.g. non-linear electronicsNumerical simulation

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 23: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Why compare to other physical systems?

In non-linear physical systems the emergence of globalproperties often fundamentally influenced by ''nuances'' suchas:

• Parametric mismatches between constituent elements,• Electrothermal noise in the oscillatory variables,• Noise in the dynamical parameters,• Non-ideal behaviours such as presence of ''parasitic''

elements,• Lack of discretization and so on.

Not at all trivial to capture numerically!

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 24: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Why would chaotic networks be interesting?

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

A classic example: the double-rod pendulum...

Image credit: Wikipedia

L. Minati

Page 25: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Why would chaotic networks be interesting?

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Rapid divergence… but it is not the main point…

Image credit: Chaosbook.org

L. Minati

Page 26: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Why would chaotic networks be interesting?

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Self-organization: paradigmatic case of the Belousov-Zhabotinsky reaction

Image credit: Wikipedia, others

L. Minati

Page 27: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Chaos synchronization

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Co

up

lin

g s

tre

ng

thL. Minati

Page 28: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Complexity in simple transistor circuits

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 29: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Complexity in simple transistor circuits

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Image source: Minati et al., CHAOS 2017. © AIP

Page 30: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Complexity in simple transistor circuits

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Image source: Minati et al., CHAOS 2014. © AIP

Page 31: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Complexity in simple transistor circuits

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Image source: cited article, © Elsevier

L. Minati

Page 32: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Emergence of community structure

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Image source: Besseling et al., © Elsevier

L. Minati

Page 33: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Emergence of community structure

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Ring structural connectivityas elementary substrate

L. Minati

Page 34: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Emergence of community structure

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Image source: Minati et al., CHAOS 2014. © AIP

Page 35: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Emergence of community structure

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 36: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Emergence of community structure

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Amplitude fluctuations loosely resemble EEG…

L. Minati

Image source: Minati et al., CHAOS 2014. © AIP

Page 37: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Dynamics within and outside hubs

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Image source: Minati et al., CHAOS 2015. © AIP

Page 38: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Dynamics within and outside hubs

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Cortical hubs seem to yield deterministic, non-linear dynamics

L. Minati

Image source: Minati et al., CHAOS 2015. © AIP

Page 39: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Dynamics within and outside hubs

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

A “toy model” of high-level brain connectivity

L. Minati

Image source: Minati et al., CHAOS 2015. © AIP

Page 40: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Dynamics within and outside hubs

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

Selective emergence of slow, high-amplitude fluctuations in hubs

L. Minati

Image source: Minati et al., CHAOS 2015. © AIP

Page 41: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Conclusions

1) Relationship between brain connectivity and dynamics

2) Parallels between emergence in the brain and other physical systems

3) Phase transitions in neurons and chaotic oscillators

4) Brain modularity and cluster synchronization

5) Hubs and dynamics

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati

Page 42: Connectivity and synchronization: comparison of neural ... Review1.pdf · Connectivity and synchronization: comparison of neural observations and experiments with toy networks Tokyo

Thank you for your attentionReferences:

1. Minati L. Experimental dynamical characterization of five autonomous chaotic oscillators with tunable series resistance. CHAOS 2014; 24(3):033110

2. Minati L. Experimental synchronization of chaos in a large ring of mutually coupled single-transistor oscillators: phase, amplitude, and clustering effects. CHAOS 2014; 24(4):043108

3. Minati L, Chiesa P, Tabarelli D, D'Incerti L, Jovicich J. Synchronization, non-linear dynamics and low-frequency fluctuations: analogy between spontaneous brain activity and networked single-transistor chaotic oscillators. CHAOS 2015; 25(3):033107

4. Minati L. Atypical transistor-based chaotic oscillators: Design, realization, and diversity. CHAOS 2017; 27(7):073113.

5. Minati L, Across Neurons and Silicon: Some Experiments Regarding the Pervasiveness of Nonlinear Phenomena. Acta Phys Pol B 2018; 49:2029.

[email protected] [email protected] [email protected] http://www.lminati.it

Connectivity and synchronization: comparison of neural observations and experiments with toy networks

L. Minati