the neuronal replicator hypothesis chrisantha fernando 1,2,3 eörs szathmary 1,4,5 1 collegium...
TRANSCRIPT
![Page 1: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/1.jpg)
The Neuronal Replicator Hypothesis
Chrisantha Fernando1,2,3
Eörs Szathmary1,4,5
1Collegium Budapest (Institute for Advanced Study), Budapest, Hungary2Centre for Computational Neuroscience and Robotics, Sussex University, UK
3MRC National Institute for Medical Research, Mill Hill, London, UK4Parmenides Foundation, Kardinal-Faulhaber-Strase 14a, D-80333 Munich,
Germany5Institute of Biology, Eötvös University, Pázmány Péter sétány 1/c, H-1117
Budapest, Hungary
![Page 2: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/2.jpg)
Origin of Life and the Origin of Mind
Wallace didn’t believe the mind could be explained by evolution. Darwin did.
Is there natural selection in the brain? Could it explain human generative
problem solving, curiosity, and creativity? Natural selection destroyed the
explanatory power of Divine creativity. Would natural selection in the brain
destroy the explanatory power of Self?
![Page 3: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/3.jpg)
What I don’t need to explain…
Performance on tasks where random variation with reward biased selection could work… Stroop Task WCST Tower of London
Instrumental tasks with
low dimensionality
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
![Page 4: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/4.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 5: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/5.jpg)
Instrumental Conditioning: Random exploration + stabilization of good
changes.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
![Page 6: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/6.jpg)
But SHC can’t explain generative creativity in insight problems
How do we solve insight problems?
What neural mechanisms underlie complex operant behaviour?
Why do we play, listen to music, do PhDs, and go to Rothko exhibitions?
QuickTime™ and a decompressor
are needed to see this picture.
![Page 7: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/7.jpg)
But we think that Natural Selection CAN explain generative creativityNatural selection happens when you’ve
got units that can Reproduce (replication with errors) Transmit heritable variations
For example The adaptive immune system works by natural
selection. (controlled) So do genetic algorithms for engineering airbus
wing shapes, etc… (artificial)
![Page 8: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/8.jpg)
Darwinism is not just Selectionism
A good solution can be copied and varied, i.e. parallel search resources can be appropriately distributed.
Offspring are mutated rather than oneself. Larger population sizes and elitism can a. increase the
sensitivity of selection to beneficial variants, b. prevent loss of good solutions.
Important when most changes are harmful. Variability can be structured by natural selection.
If there is variation in variability, i.e. non-trivial neutrality and lineage selection
X
A
B
A’
A’
B’
B’
If(F(A’) > F(B’) & F(A’) > F(X)) choose A
If(F(B’)> F(A’) & F(B’) > F(X)) choose B
Else(kill A & B and try again)(1 + 2 + 4) ES
![Page 9: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/9.jpg)
But how could replication happen in the brain? We propose at least two kinds of
mechanism. Copying of connectivity patterns (SLOW) Copying of activity patterns (FAST)
![Page 10: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/10.jpg)
Connectivity Copying
QuickTime™ and a decompressor
are needed to see this picture.
2. Causal Inference
1. Formation of 1->1 Mapping2. (Topographicity)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 11: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/11.jpg)
Parents killing children, and children killing parents
4. Fitness calculation
3. Activity gating
![Page 12: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/12.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
Stop activity spread
Error Correction Neurons
![Page 13: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/13.jpg)
I could evolve bigger networks with these extra mechanisms
![Page 14: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/14.jpg)
Activity Copying
1. Topograpicity
2. Bistability
3. Gating
![Page 15: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/15.jpg)
Minimal unit of activity replication = 2 bistable neurons
![Page 16: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/16.jpg)
Parents killing children, and children killing parents (again)
![Page 17: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/17.jpg)
Structuring Search of Activity Replicators
It is possible to combine Hebbian learning and natural selection to achieve structured variability.
Previously successful evolutionary solutions can be used to bias future evolutionary search.
Lamarckian inheritance in the brain.
![Page 18: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/18.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
Richard Watson’s HIFF
![Page 19: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/19.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 20: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/20.jpg)
![Page 21: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/21.jpg)
![Page 22: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/22.jpg)
![Page 23: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/23.jpg)
![Page 24: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/24.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 25: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/25.jpg)
![Page 26: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/26.jpg)
![Page 27: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/27.jpg)
- Search in biased towards the previous local optima
![Page 28: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/28.jpg)
![Page 29: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/29.jpg)
Recombination
![Page 30: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/30.jpg)
Further Work
How does the brain evolve representations of complex state-action spaces?
Neuronal chromosomes (chunking/hierarchical coupling) of state action pairs (options by synchrony).
Episodic memory may be a step in constructing such spaces (IAC algorithm).
assign value (fitness) to state-action pairs? Maximize first derivative of predictability Requires feed-forward emulators (Probabalistic robotics) Co-evolution of goals/solutions
Select actions to execute? Select actions that maximize intrinsic fitness.
![Page 31: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/31.jpg)
Further Work
Find behavioural evidence for neuronal replicators. Instrumental Learning: Find behaviours that
exhibit phenotypes consistent with multiple underlying neuronal replicators.
Entropic irreversibility (in the absence of memory/convergent evolution).
Behavioural pathologies in instrumental learning tasks best explainable by historical contingency.
QuickTime™ and a decompressor
are needed to see this picture.
![Page 32: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/32.jpg)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 33: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/33.jpg)
Further Work
Find neurophysiological evidence for neuronal replicators Topographic mapping, STDP, bistability, and
gating are known processes. Rapid synaptic remodelling has been observed Spontaneous neuronal activity (e.g. in sleep)
QuickTime™ and a decompressor
are needed to see this picture.
![Page 34: The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary](https://reader036.vdocuments.net/reader036/viewer/2022081506/56649d705503460f94a520a8/html5/thumbnails/34.jpg)
Thanks to
Richard GoldsteinRichard WatsonK.K. KarishmaPhil Husbands