universal laws and architectures: theory and lessons from nets, grids, brains, bugs,
DESCRIPTION
Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs, planes, docs, fire, fashion, art, turbulence, music, buildings, cities, earthquakes, bodies, running, throwing, S y n e s t h e s i a , spacecraft, statistical mechanics. fragile. slow. waste. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/1.jpg)
Universal laws and architectures:Theory and lessons from
nets, grids, brains, bugs, planes, docs, fire, fashion,
art, turbulence, music, buildings, cities, earthquakes, bodies, running, throwing,
Synesthesia, spacecraft, statistical mechanics
slow
inflexible
fragile
waste
![Page 2: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/2.jpg)
eye vision
Act
delay
Control
l noise
error ET j
N
P
+
noise
error
C
Understand this more deeply?
+ Neuroscience
Mechanics+Gravity +
Light +Control theory
exp ln
expT z p
pz pT
![Page 3: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/3.jpg)
eye vision
Act
delay
Control
l noise
error
Understand this more deeply?
+ Neuroscience
Vision
Motion
![Page 4: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/4.jpg)
Robust vision w/motion• Object motion• Self motion
Vision
Motion
eye vision
Act
delay
Control
noiseerror
![Page 5: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/5.jpg)
Fast
Slow
Flexible Inflexible
Vision
Explain this amazing system.
LayeringFeedback
![Page 6: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/6.jpg)
Experiment• Motion/vision control without blurring• Which is easier and faster?
Robust vision with• Hand motion• Head motion
![Page 7: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/7.jpg)
Fast
Slow
VOR
vision
Why?• Mechanism• Tradeoff
![Page 8: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/8.jpg)
Fast
Slow
Flexible Inflexible
VOR
vision
Vestibular Ocular Reflex (VOR)
Mechanism
Tradeoff
![Page 9: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/9.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
![Page 10: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/10.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
![Page 11: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/11.jpg)
Slow
Flexible
eye
Act
Fast
Inflexible
VOR
fast
Vestibular Ocular Reflex (VOR)
![Page 12: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/12.jpg)
Slow
Flexible
eye
Act
Fast
Inflexible
VOR
fast
It works in the dark or with your eyes closed, but
you can’t tell.
![Page 13: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/13.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
![Page 14: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/14.jpg)
vision
eye vision
Actslow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
Highly evolved (hidden)
architecture
LayeringFeedback
![Page 15: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/15.jpg)
eye vision
Act
VOR
Layering
AutomaticUnconscious
PartiallyConscious
![Page 16: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/16.jpg)
eye vision
Actslow
delay
VOR
fastLayeringFeedback
![Page 17: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/17.jpg)
vision
eye vision
Actslow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
fast
Architecturelayered/
distributed
![Page 18: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/18.jpg)
vision
eye vision
Actslow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
fast
Architecturelayered/
distributed
Robust or fine-tuned? BothModular or plastic? Both
![Page 19: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/19.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Error
+
Very rough cartoon
![Page 20: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/20.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
Error
+
ErrorTune gain
Slightly better
gainAOS
AOS = Accessory Optical system
![Page 21: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/21.jpg)
Cortex
eye vision
Actslow
delay
VOR
This fast “forward”
path
Object motion
Head motion
Cerebellum
Error
+
ErrorTune gain
Slightly better
gainAOS
AOS = Accessory Optical system
Needs “feedback”
tuning
Via AOS and cerebellum (not cortex)
![Page 22: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/22.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
Highly evolved (hidden)
architecture
![Page 23: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/23.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
slowest
![Page 24: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/24.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
Delays everywhere
Distributed control
slowest
![Page 25: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/25.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
noise
Act
slowestHeterogeneous
delays everywhere
![Page 26: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/26.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
3D + motion
See Marge Livingstone
Color?
![Page 27: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/27.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
See Marge Livingstone
3D + motion
colorvision
Slowest
![Page 28: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/28.jpg)
Stare at the intersection
![Page 29: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/29.jpg)
![Page 30: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/30.jpg)
Stare at the intersection.
![Page 31: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/31.jpg)
![Page 32: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/32.jpg)
![Page 33: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/33.jpg)
![Page 34: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/34.jpg)
Stare at the intersection.
![Page 35: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/35.jpg)
![Page 36: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/36.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
3D + motion
colorvision
Slowest
![Page 37: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/37.jpg)
Slow
Flexible
vision
Fast
Inflexible
VOR
colorvision
Seeing is dreaming• is simulation• requiring “internal model”
![Page 38: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/38.jpg)
gradient
Biased random walk
Ligand
SignalTransduction
Motion Motor
CheY
![Page 39: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/39.jpg)
+CH 3R
ATP ADPP
~
flagellarmotor
Z
Y
PY
~
PiB
B~P
Pi
CW-CH3
ATP
WA
MCPs
WA
+ATT
-ATT
MCPsSLOW
FAST
ligand binding
motor
Bacterial chemotaxis• Internal model necessary for robust chemotaxis• Reality is 3d, but…• Internal model virtual and 1d
![Page 40: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/40.jpg)
Slow
Flexible
vision
Fast
Inflexible
VOR
colorvision
LayeringDistributedFeedback
![Page 41: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/41.jpg)
Slow
Flexible
Fast
Inflexible
Impossible (law)
Architecture
Architecture (constraints that
deconstrain)
General Special
Universal laws and architectures (Turing)
ideal
![Page 42: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/42.jpg)
Slow
Flexible
Fast
Inflexible
General Special
NP(time)
P(time)
analytic
Npspace=Pspace
Decidable
Computation(on and off-line)
![Page 43: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/43.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
From toys to “real” systems
![Page 44: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/44.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
Improved algorithms
![Page 45: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/45.jpg)
Slow
Flexible
vision
Fast
Inflexible
VOR
colorvision
LayeringDistributedFeedback
![Page 46: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/46.jpg)
Cortex
eye vision
Actslow
delay
VOR
This fast “forward”
path
Object motion
Head motion
Cerebellum
Error
+
ErrorTune gain
Slightly better
gainAOS
AOS = Accessory Optical system
Needs “feedback”
tuning
Via AOS and cerebellum (not cortex)
![Page 47: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/47.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
![Page 48: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/48.jpg)
sup ( ) ?T
• Real (NP hard)• Complex = LTI (??)• Operator valued or
Noncomm (P)
Scale with dimension?
Uncertainty everywhere
![Page 49: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/49.jpg)
vision
eye vision
Actslow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
Highly evolved (hidden)
architecture
LayeringDistributedFeedback
![Page 50: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/50.jpg)
eye vision
delay .3s
Act
delay
Control
l
1p
l
noiseerror
![Page 51: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/51.jpg)
1x
2x
3x
Model?
• 1 dimension, 4 states?• Other 2 dimensions?• New issues arise
![Page 52: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/52.jpg)
eye vision
Act
delay
Control
noiseerror
ET j
N
1x
2x
3x
![Page 53: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/53.jpg)
eye vision
Act
delay
Control
noiseerror
ET j
N
1x
2x
3xeasy
easy
hard
![Page 54: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/54.jpg)
eye vision
Act
delay
Control
noiseerror
ET j
N
1x
2x
3xeasy
easy
hard
![Page 55: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/55.jpg)
eye vision
Act
delay
Control
noiseerror
ET j
N
Close one eye?
![Page 56: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/56.jpg)
10
100
Length, m
.1 1.5.22 k10
-110
010
1100
101
too fragile
complex
No tradeoff
expensive
fragile
exp lnexp
T z pp
z pT
Slow
Flexible
vision
eye vision
Act slowdelay
Fast
Inflexible
VOR
fastUniversal
laws?
![Page 57: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/57.jpg)
10
100
Length, m
.1 1.5.22
Slow
Flexible
vision
eye vision
Act slowdelay
Fast
Inflexible
VOR
fast
exp ln
expT z p
pz pT
How do these fit together?
![Page 58: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/58.jpg)
slow
flexible
fast
inflexible
How do these fit together?
“waste”“efficient”
fragile
robust
vision
VORdelay
![Page 59: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/59.jpg)
delaysec/m
.01
1
.1
area
.1 1 10diam(m)
.01 1 100
Retinal ganglion axons?
Other myelinated
Why such extreme diversity in axon size and delay?
![Page 60: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/60.jpg)
.01
1
delaysec/m
Aα
C
.1
Aβ
AγAδ
area
.1 1 10diam(m)
.01 1 100
Axon size and
speed
Fast
Small
Slow
Large
![Page 61: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/61.jpg)
delaysec/m
.01
1
.1
area
.1 1 10diam(m)
.01 1 100
Retinal ganglion axons?
Other myelinated
Why such extreme diversity in axon size and delay?
VORNo
diversity in VOR?
Resolution and bandwidth are cheap
speed costs
![Page 62: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/62.jpg)
axon
Same area= same “cost”
axonaxon
2 x resolution(less noise)
axon
x speed(less delay)
Double the area (and cost)?
speed costs Resolution and bandwidth are cheap
1delay
speed
![Page 63: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/63.jpg)
vision
Act
delay
10
100
Speed 1/
.1 1.5.22
.3s
exp p
Slower
axon axon
axon
2 x resolution(less noise)
axon
x
speed doubly expensive
but necessary
![Page 64: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/64.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
Delays everywhere
Distributed control
slowest
![Page 65: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/65.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
noise
Act
slowestHeterogeneous
delays everywhere
![Page 66: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/66.jpg)
expE p N
Fast
Slow
Flexible InflexibleReflex
SenseMotor
Prefrontal
Fast
Learn
Evolve
Apps
OS
HW
vision
Act
delay
axon axon
axon
2 x resolution(less noise)
axon
x
speed doubly expensive
but necessary
![Page 67: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/67.jpg)
slow
flexible
fast
inflexible
How do these fit together?
“waste”“efficient”
fragile
robust
vision
VORdelay
speed costs
![Page 68: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/68.jpg)
slow
flexible
fast
inflexible
In general?
wastefulefficient
fragile
robust
![Page 69: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/69.jpg)
slow
flexible
fast
inflexible
fragile
robust
wasteefficient
fragile
robust
![Page 70: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/70.jpg)
slow
flexible
fast
inflexible
fragile
robust
waste
efficient
fragile
robust
Cyber-physicalCyber only
![Page 71: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/71.jpg)
slow
flexible
fast
inflexible
waste
efficient
fragile
robust
Cyber-physical
![Page 72: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/72.jpg)
accessibleaccountableaccurateadaptableadministrableaffordableauditableautonomyavailablecompatiblecomposable configurablecorrectnesscustomizabledebugabledegradabledeterminabledemonstrable
dependabledeployablediscoverable distributabledurableeffective
evolvableextensiblefail
transparentfastfault-tolerantfidelityflexibleinspectableinstallableIntegrityinterchangeabl
einteroperable learnablemaintainable
manageablemobilemodifiablemodularnomadicoperableorthogonalit
yportableprecisionpredictableproducibleprovablerecoverablerelevantreliablerepeatablereproducibleresilientresponsivereusable
safety scalableseamlessself-sustainableserviceablesupportablesecurablesimplestablestandardssurvivable
tailorabletestabletimelytraceableubiquitousunderstandableupgradableusable
efficient
robust
sustainable
PCA Principal Concept Analysis
flexible
fast
efficient
robust
![Page 73: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/73.jpg)
slow
flexible
fast
inflexible
waste
efficient
![Page 74: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/74.jpg)
slow
flexible
fast
inflexible
waste
efficient
Slow
InflexibleFra
gile
Waste
slow
inflexible
fragile
wasteSame picture
![Page 75: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/75.jpg)
Control, OR
CommunicateCompute
Physics
Shannon
Bode
Turing
Gödel
EinsteinHeisenberg
Carnot
Boltzmann
Theory?Deep, but fragmented, incoherent, incomplete
Nash
Von Neumann
![Page 76: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/76.jpg)
Priorities
• Functionality (behavior, semantics)• Robustness
– Uncertain environment and components– Fast (sense, decide, act)– Flexible (adaptable, evolvable)
• Efficiency– Energy– Other resources (make and maintain)
![Page 77: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/77.jpg)
Control, OR
Compute
• Functionality (behavior, semantics)• Robustness
– Uncertain environment and components
– Fast (sense, decide, act)– Flexible (adaptable, evolvable)
• Efficiency– Energy– Other resources (make and maintain)
Function, delay,
robustness most
important
![Page 78: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/78.jpg)
• Functionality (behavior, semantics)• Robustness
– Uncertain environment and components– Fast (sense, decide, act)– Flexible (adaptable, evolvable)
• Efficiency– Energy– Other resources (make and maintain)
Communicate
Physics
Info theory
![Page 79: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/79.jpg)
• Functionality (behavior, semantics)• Robustness
– Uncertain environment and components– Fast (sense, decide, act)– Flexible (adaptable, evolvable)
• Efficiency– Energy– Other resources (make and maintain)
Communicate
Physics
Info theory
Noise, average, asymptotic
![Page 80: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/80.jpg)
Control, OR
Info theoryCompute
Physics
Function, delay,
robustness most
important
Function, delay,
robustness least
important
![Page 81: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/81.jpg)
Control, OR
Info theoryCompute
Physics
Shannon
Bode
Turing
Einstein
Heisenberg
Carnot
Boltzmann
Function, delay,
robustness most
important
Function, delay,
robustness least
important
Dominates “high impact
science” literature
![Page 82: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/82.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
From toys to “real” systems
![Page 83: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/83.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
Improved algorithms
![Page 84: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/84.jpg)
Control, OR
Info theoryCompute
Physics
Shannon
Bode
Turing
Einstein
Heisenberg
Carnot
Boltzmann
Function, delay,
robustness most
important
Function, delay,
robustness least
important
![Page 85: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/85.jpg)
Function, delay,
robustness most
important
Function, delay,
robustness least
important
Control, OR
CommunicateCompute
Physics
Shannon
Bode
Turing
New progress!
![Page 86: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/86.jpg)
Control, OR
Compute
Physics
Bode
Turing
New progress!
Coherent structures and turbulent drag
Function, delay,
robustness least
important
![Page 87: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/87.jpg)
Shear flow turbulence• Exhaustively studied
– Extensive experiments and big data– Detailed models and big simulations– Great! But all just deepen the mystery
• Perfectly illustrates robust/fragile• Without which? Bewilderment.
Physics of Fluids (2011)
![Page 88: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/88.jpg)
Physics of Fluids (2011)
wU
z x
y
uzx
yFlow
upflowhigh-speed
region
downflowlow speed
streak
Blunted turbulent velocity profile
Laminar
Turbulent
wU3D coupling
Coherent structures and turbulent drag
![Page 89: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/89.jpg)
wasteful
fragile Laminar
Turbulent
efficient
robust
Laminar
Turbulent
wU
?
Control?
Fundamentals!
![Page 90: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/90.jpg)
Control, OR
Compute
Bode
Turing
New progress!
Communications for control,
computing, biology
Function, delay,
robustness least
important
![Page 91: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/91.jpg)
Internal delays
SenseMotor
Prefrontal
Fast
Learn
Reflex
Evolve
vision
VOR
Communications for control,
computing, biology
![Page 92: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/92.jpg)
Internal delays
New theory: Distributed control with delays everywhere.
Sense/Act
Compute/communicate
Physical
![Page 93: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/93.jpg)
Info Thry
Control, OR
Compute
PhysicsOrthophysics (Eng/Bio/Math)
Optimization Statistics
Comms for Comp/Cntrl/Bio
Theory
![Page 94: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/94.jpg)
wasteful
fragile Laminar
Turbulent
efficient
robust ?
Control?
Info Thry
PhysicsOrthophysics (Eng/Bio/Math)
Laminar
Turbulent
uzx
yFlow
![Page 95: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/95.jpg)
Doyle, Csete, Proc Nat Acad Sci USA, JULY 25 2011
For more infoMost accessible
No mathReferences
![Page 96: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/96.jpg)
wasteful
fragile
efficient
robust
Impossible (law)
Architecture
Universal laws and architectures
Flexibly achieves what’s possible
![Page 97: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/97.jpg)
Efficiency/instability/layers/feedback
• Sustainable infrastructure? (e.g. smartgrids)• Money/finance/lobbyists/etc• Industrialization• Society/agriculture/weapons/etc• Bipedalism• Maternal care• Warm blood• Flight• Mitochondria• Oxygen• Translation (ribosomes)• Glycolysis (2011 Science)
Major transitions
Evolvability?
![Page 98: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/98.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
Accelerating evolution
Requires shared “OS”
![Page 99: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/99.jpg)
Horizontal Gene
Transfer
Sequence ~100 E Coli (not chosen randomly)• ~ 4K genes per cell• ~20K different genes in total (pangenome)• ~ 1K universally shared genes • ~ 300 essential (minimal) genes
![Page 100: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/100.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
What can go wrong?
![Page 101: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/101.jpg)
Horizontal Bad Gene Transfer
Horizontal Bad App Transfer
Horizontal Bad Meme
Transfer
Parasites &
Hijacking
Fragility?
Exploiting layered
architecture
Virus
Virus
Meme
![Page 102: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/102.jpg)
Horizontal Bad Meme
Transfer
Our greatest fragility?
Meme
Many human beliefs are:• False• Unhealthy
![Page 103: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/103.jpg)
Slow
Flexible
vision
Fast
Inflexible
VOR
![Page 104: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/104.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
![Page 105: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/105.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
Delays everywhere
Distributed control
slowest
![Page 106: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/106.jpg)
Slow
Flexible
vision
eye vision
Actslow
delay
Fast
Inflexible
VOR
fast
![Page 107: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/107.jpg)
Vision
-slow
VOR
fast
Fast
Slow
Flexible Inflexible
slower
Mixed
Redraw(not anatomical)
![Page 108: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/108.jpg)
Vision
-3d+motionB&W
slowVOR
fast
Fast
Slow
Flexible Inflexible
slower
Objects
Mixed
Redraw(not anatomical)
![Page 109: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/109.jpg)
3d+motionB&W
slow
Fast
Slow
Flexible Inflexible
slower
Objects
![Page 110: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/110.jpg)
![Page 111: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/111.jpg)
-3d+motionB&W
slowVOR
fast
Fast
Slow
Flexible Inflexible
Faces
slower
Objects
Mixed
Not sure how to draw this…
![Page 112: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/112.jpg)
Chess experts• can reconstruct entire chessboard with < ~ 5s inspection• can recognize 1e5 distinct patterns• can play multiple games blindfolded and simultaneous• are no better on random boards
(Simon and Gilmartin, de Groot)
www.psywww.com/intropsych/ch07_cognition/expertise_and_domain_specific_knowledge.html
![Page 113: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/113.jpg)
Specific brain lesions can cause “blindness” to• Faces• Fruit or Animals or Tools or ??• Left side of body• Movement• Nonmovement• ???
![Page 114: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/114.jpg)
Fast
Slow
Flexible Inflexible
Faces
slower
Objects
Not sure how to draw this…
Learning+evolution
![Page 115: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/115.jpg)
When needed, even wasps can do it.
![Page 116: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/116.jpg)
• Polistes fuscatus can differentiate among normal wasp face images more rapidly and accurately than nonface images or manipulated faces. • Polistes metricus is a close relative lacking facial recognition and specialized face learning. • Similar specializations for face learning are found in primates and other mammals, although P. fuscatus represents an independent evolution of specialization. • Convergence toward face specialization in distant taxa as well as divergence among closely related taxa with different recognition behavior suggests that specialized cognition is surprisingly labile and may be adaptively shaped by species-specific selective pressures such as face recognition.
![Page 117: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/117.jpg)
Fig. 1 Images used for training wasps.
M J Sheehan, E A Tibbetts Science 2011;334:1272-1275Published by AAAS
![Page 118: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/118.jpg)
vision
eye vision
Actslow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
Highly evolved (hidden)
architecture
Seeing is dreaming
![Page 119: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/119.jpg)
-3d+motionB&W
slowVOR
fast
Fast
Slow
Flexible Inflexible
Faces
slower
Objects
Mixed
Not sure how to draw this…
Learning+evolution
![Page 120: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/120.jpg)
Sense
Universal tradeoffs?
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
Learning can be very slow.
Evolution is even slower.
![Page 121: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/121.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
Accelerating evolution
Requires shared “OS”
![Page 122: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/122.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Gene Transfer
App Transfer
Meme Transfer
Some genes, apps, ideas
are “invented”
But most bacteria and
people get most of them from
others
![Page 123: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/123.jpg)
costly
fragile
efficient
robust
Learning
![Page 125: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/125.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
ErrorTune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
![Page 126: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/126.jpg)
Cortex
eye vision
Actslow
delay
VOR
fast
Object motion
Head motion
Cerebellum
+
Error
Tune gain
gain
AOS
AOS = Accessory Optical system
noise
Act
Reflex
![Page 127: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/127.jpg)
SensoryMotor
Prefrontal
Striatum
SlowFlexible
Learning
Ashby & Crossley
Slow
Reflex(Fastest,
LeastFlexible)
Extreme heterogeneity
![Page 128: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/128.jpg)
SensoryMotor
Prefrontal
Striatum
Fast
FastInflexible
SlowFlexible
Learning
Reflex(Fastest,
LeastFlexible)
Ashby & Crossley
Learning can be very slow.
![Page 129: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/129.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
HMTTeach
Horizontal Meme
Transfer
![Page 130: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/130.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
Horizontal Hardware Transfer
HHT
![Page 131: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/131.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
Apps
OS
HW
HMT
HHT
![Page 132: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/132.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
HMT
Soma
Reactive
Adaptive
Contextual
![Page 133: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/133.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
Apps
OS
HW
![Page 134: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/134.jpg)
FastCostly
SlowCheap
Flexible Inflexible
General Special
Layered Architecture
AppsOS
HW
Digital
Lumped
Distrib.
OSHW
Digital
Lumped
Distrib.
DigitalLumped
Distrib.
LumpedDistrib. Distrib.
Any layer needs all lower layers.
![Page 135: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/135.jpg)
Fast
Slow
Flexible Inflexible
Apps
OS
HW
AppsOS
HardwareDigital
LumpedDistributed
Tech implications/extensions
![Page 136: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/136.jpg)
Slow
Flexible
Fast
Inflexible
Impossible (law)
Architecture
Architecture (constraints that
deconstrain)
General Special
Universal laws and architectures (Turing)
ideal
![Page 137: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/137.jpg)
Slow
Flexible
Fast
Inflexible
General Special
NP(time)
P(time)
analytic
Npspace=Pspace
Decidable
Computation(on and off-line)
![Page 138: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/138.jpg)
Slow
Flexible
Fast
Inflexible
General Special
NP
P
analytic
Pspace
Decidable
Computation(on and off-line)
InsightAccessibleVerifiable
![Page 139: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/139.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
From toys to “real” systems
![Page 140: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/140.jpg)
Slow
Flexible
Fast
Inflexible
NPPanalytic
PspaceDecidable
Insight
Research progress
Control, OR
Compute
Improved algorithms
![Page 141: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/141.jpg)
P(time)(delay)
Pspace(memory, bandwidth)
Resource cost vs effectiveness
Cheap Costly
Strong
Weak
To make
In use
Talk
Energy
![Page 142: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/142.jpg)
Pspace(memory, bandwidth)
Cheap
Strong
To make
In use
1 TB < $100
$50
$??
1 TB = 1e12B
![Page 143: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/143.jpg)
P(time)
Pspace(memory, bandwidth)
What dominates tradeoffs
Cheap Costly
Strong
Weak
To make
In use
Talk
Energy
![Page 144: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/144.jpg)
time
What dominates tradeoffs
CostlyCheap
Fast
Slow
Energy
![Page 145: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/145.jpg)
time
What dominates tradeoffs
CostlyCheap
Fast
Slow
Energy
Flexible
Inflexible
![Page 146: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/146.jpg)
time
What dominates tradeoffs
Fast
Slow
Flexible
Inflexible
![Page 147: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/147.jpg)
Slow
Flexible
Fast
Inflexible
General Special
NP(time)
P(time)
analytic
Pspace
Decidable
Computation(on and off-line)
![Page 148: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/148.jpg)
Slow
Flexible
Fast
Inflexible
General Special
NP(time)
P(time)
analytic
Pspace
Decidable
Universal architecture
Universal TM
![Page 149: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/149.jpg)
10
100
Length, m
.1 1.5.22 k10
-110
010
1100
101
too fragile
complex
No tradeoff
expensive
fragile
exp lnexp
T z pp
z pT
Slow
Flexible
vision
eye vision
Act slowdelay
Fast
Inflexible
VOR
fastSlow
Flexible
Fast
Inflexible
General Special
NPPanalytic
Pspace
Decidable
![Page 150: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/150.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
Accelerating evolution
Requires shared “OS”
![Page 151: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/151.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
Apps
OS
HW
HMT
![Page 152: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/152.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Exploiting layered
architecture
![Page 153: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/153.jpg)
Core protocols
• OS seems to confuse• Replace with “core protocols”?• Examples different than OS or translation:
– Core metabolism– 2 component signal transduction
• Highly conserved/constrained core (knot)• Highly diverse/deconstrained edges
153
![Page 154: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/154.jpg)
slow
flexible
fast
inflexible
waste
efficient
fragile
robust
![Page 155: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/155.jpg)
slow
flexible
fast
inflexible
waste
efficient
body
brain
Combo
![Page 156: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/156.jpg)
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Learn
Reflex
Evolve
HMT
Soma
Reactive
Adaptive
Contextual
Combo
![Page 157: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/157.jpg)
Slow
Fast
Flexible InflexibleGeneral Special
AppsOSHWDig.Lump.Distrib.
OSHWDig.Lump.Distrib.
DigitalLump.Distrib.
LumpedDistrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation
Metabolism Signal
SenseMotor
Prefrontal
Fast
Learn
Reflex
Evolve
vision
VOR
![Page 158: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/158.jpg)
Slow
Fast
Flexible InflexibleGeneral Special
AppsOSHWDig.Lump.Distrib.
OSHWDig.Lump.Distrib.
DigitalLump.Distrib.
LumpedDistrib. Distrib.
Apps
OS
HW
![Page 159: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/159.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Horizontal App
Transfer
Horizontal Hardware Transfer
![Page 160: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/160.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
![Page 161: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/161.jpg)
OS
Horizontal App
Transfer
Horizontal Hardware Transfer
Constrained
Deconstrained
Deconstrained
![Page 162: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/162.jpg)
Horizontal Transfer
Horizontal Transfer
Constrained
Deconstrained
Deconstrained
![Page 163: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/163.jpg)
Con
stra
ined
Dec
onst
rain
ed
Dec
onst
rain
ed
![Page 164: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/164.jpg)
food
Glucose
Oxygen
OrgansTissuesCellsMolecules
Universal metabolic system
Blood
EfficientRobust
Evolvable
![Page 165: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/165.jpg)
food
Glucose
Oxygen
OrgansTissuesCellsMolecules
Blood
EfficientRobust
Evolvable
Constrained
DeconstrainedDeconstrained
![Page 166: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/166.jpg)
EfficientRobust
Evolvable
Constrained
DeconstrainedDeconstrained
DiverseDiverse
![Page 167: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/167.jpg)
EfficientRobust
Evolvable
Constrained
DeconstrainedDeconstrained
DiverseDiverse
OS
Deconstrained(Hardware)
Deconstrained(Applications)
Constrained
universal architectures
![Page 168: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/168.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Horizontal App
Transfer
Horizontal Hardware Transfer
![Page 169: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/169.jpg)
FastCostly
SlowCheap
Flexible Inflexible
HGT DNA repair
Mutation DNA replication
Transcription Translation
MetabolismSignal…
Layered Architecture
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
![Page 170: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/170.jpg)
FastCostly
SlowCheap
Flexible Inflexible
HGT DNA repair
Mutation DNA replication
Transcription Translation
MetabolismSignal…
Layered Architecture RNA
mRNA
RNApTranscription
Gene
AminoAcids
Proteins
RibosomesTranslation
Metabolism Products
Core Protocols
![Page 171: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/171.jpg)
FastCostly
SlowCheap
Flexible
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
Metabolism
![Page 172: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/172.jpg)
FastCostly
SlowCheap
Flexible
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
Metabolism
![Page 173: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/173.jpg)
FastCostly
SlowCheap
Flexible
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
Signal Transduction
![Page 174: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/174.jpg)
FastCostly
SlowCheap
Flexible
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
Signal Transduction
![Page 175: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/175.jpg)
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
Tra
nsm
itte
r
Rec
eive
r
Variety ofLigands &Receptors
Variety ofresponses
• 50 such “two component” systems in E. Coli• All use the same protocol
- Histidine autokinase transmitter- Aspartyl phospho-acceptor receiver
• Huge variety of receptors and responses• Also multistage (phosphorelay) versions
Signal transduction
![Page 176: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/176.jpg)
Tran
smit
ter
Rec
eive
r
Ligands &Receptors
Responses
Shared protocols
Flow of “signal”
Recognition,specificity
• “Name resolution” within signal transduction• Transmitter must locate “cognate” receiver and avoid non-cognate receivers• Global search by rapid, local diffusion• Limited to very small volumes
![Page 177: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/177.jpg)
Tran
smit
ter
Rec
eive
r
Ligands &Receptors
Responses
Tran
smit
ter
Rec
eive
r
Ligands &Receptors
Responses
Tran
smit
ter
Rec
eive
r
Ligands &Receptors
Responses
Shared protocols
Flow of “signal”
Recognition,specificity
![Page 178: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/178.jpg)
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofLigands &Receptors
Variety ofLigands &Receptors
Variety ofLigands &Receptors
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Variety ofLigands &Receptors
Variety ofresponses
Huge
variety
Huge variety
Tran
smit
ter
Rec
eive
rTran
smit
ter
Rec
eive
rTran
smit
ter
Rec
eive
r
Recognition,specificity
Huge variety• Combinatorial• Almost digital• Easily reprogrammed• Located by diffusion
![Page 179: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/179.jpg)
Tran
smit
ter
Rec
eive
rTr
ansm
itte
r
Rec
eive
rTr
ansm
itte
r
Rec
eive
r
Flow of “signal”
Limited variety• Fast, analog (via #)• Hard to change
Reusable in different pathways
![Page 180: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/180.jpg)
InternetsitesUsers
Tran
smit
ter
Rec
eive
r
Ligands &Receptors
Responses
Shared protocols
Flow of “signal”
Recognition,specificity
Note: Any wireless system and the Internet to which it is connected work the same way.
Lap
top
Ro
ute
r
Flow of packets
Recognition,Specificity (MAC)
![Page 181: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/181.jpg)
FastCostly
SlowCheap
Flexible Inflexible
HGT DNA repair
Mutation DNA replication
Transcription Translation
Metabolism Signaling
Layered Architecture
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
![Page 182: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/182.jpg)
gradient
Biased random walk
Ligand
SignalTransduction
Motion Motor
CheY
![Page 183: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/183.jpg)
+CH 3R
ATP ADPP
~
flagellarmotor
Z
Y
PY
~
PiB
B~P
Pi
CW-CH3
ATP
WA
MCPs
WA
+ATT
-ATT
MCPsSLOW
FAST
ligand binding
motor
More necessity and robustness
• Integral feedback and signal transduction (bacterial chemotaxis, G protein) (Yi, Huang, Simon)
• Example of “exploratory process”
![Page 184: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/184.jpg)
Random walk
Ligand Motion Motor
Bacterial chemotaxis
![Page 185: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/185.jpg)
gradient
Biased random walk
Ligand
SignalTransduction
Motion Motor
CheY
![Page 186: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/186.jpg)
Ligand
SignalTransduction
Motion Motor
CheY
![Page 187: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/187.jpg)
Ligand
SignalTransduction
Motion Motor
CheY
Component of feedback controller
![Page 188: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/188.jpg)
Ligand Motion Motor
CheY
Tra
nsm
itte
r
Rec
eive
r
Receptor Response
Component of feedback controller
![Page 189: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/189.jpg)
PMF
++
++
From Taylor, Zhulin, Johnson
Variety of receptors/
ligands Common cytoplasmic
domains
Common signal carrier
Common energy carrier
![Page 190: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/190.jpg)
Tra
nsm
itte
r R
ecei
ver
MotorVarietyof receptors& ligands
![Page 191: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/191.jpg)
Ligand Motion Motor
CheY
Tra
nsm
itte
r R
ecei
ver
MotorVarietyof receptors& ligands
![Page 192: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/192.jpg)
![Page 193: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/193.jpg)
CheY
Tra
nsm
itte
r
Rec
eive
r
Receptor Response
Integral feedback internal to signaling
network
![Page 194: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/194.jpg)
Ligand Motion Motor
CheY
Tra
nsm
itte
r
Rec
eive
r
Receptor Response
Integral feedback internal to signaling
network
Main feedback control loop
![Page 195: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/195.jpg)
Ligand
SignalTransduction
Motion Motor
CheY
![Page 196: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/196.jpg)
gradient
Biased random walk
Ligand
SignalTransduction
Motion Motor
CheY
![Page 197: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/197.jpg)
![Page 198: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/198.jpg)
Tumbling bias
pCheY
SignalTransduction
Motor
Perfect adaptation is necessary …
ligandpCheY
![Page 199: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/199.jpg)
Tumbling bias
ligand
Perfect adaptation is necessary …
…to keep CheYp in the responsive range of the motor.
pCheY pCheY
![Page 200: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/200.jpg)
Tumbling bias
![Page 201: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/201.jpg)
Ligand
F
y+
d
F ln(S)
1
1
yS
d F
ˆ ( ) ˆ( ) , (0) 0
(0)
(0) 0
F sF s F
s
F
S
Integral feedback
![Page 202: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/202.jpg)
Tran
smit
ter
Rec
eive
r
Variety ofLigands &Receptors
Response
![Page 203: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/203.jpg)
DiverseDeconstrained
(Hardware)
Deconstrained(Applications)
Diverse
Layered architectures
ConstrainedBut hidden
Apps
OS
HW
Core Protocols
![Page 204: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/204.jpg)
?
Deconstrained(Hardware)
Deconstrained(Applications)
Next layered architectures (SDN)
Constrained Optimize & control, share, virtualize, manage resources
CommsMemory, storageLatencyProcessingCyber-physical
Few global variables
Don’t cross layers
![Page 205: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/205.jpg)
The essence of layering
Physical resources
Optimize & control, share, virtualize, manage resources
Optimize & control, share, virtualize, manage resources
Optimize & control, share, virtualize, manage resources
Optimize & control, share, virtualize, manage resources
Applications
![Page 206: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/206.jpg)
The essence of networking
Physical
Control
Control
Apps
Control
Physical
Apps
Control
Physical
Apps
Virtual
![Page 207: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/207.jpg)
Prosen-cephalon
Telen-cephalon
Rhinencephalon, Amygdala,
Hippocampus, Neocortex, Basal ganglia, Lateral
ventricles
Dien-cephalon
Epithalamus, Thalamus,
Hypothalamus, Subthalamus, Pituitary
gland, Pineal gland, Third ventricle
Brain stem
Mesen-cephalon
Tectum, Cerebral peduncle, Pretectum, Mesencephalic duct
Rhomb-encephalon
Meten-cephalon
Pons, Cerebellum
Myelen-cephalon
Medulla oblongata
Spinal cord
CNS HW “stack”
?
Diverse?Deconstrained
(Hardware)
Deconstrained?(Applications)
Diverse
Layered architectures??
ConstrainedBrain
![Page 208: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/208.jpg)
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Horizontal App
Transfer
Horizontal Hardware Transfer
![Page 209: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/209.jpg)
FastCostly
SlowCheap
Flexible Inflexible
General Special
Layered Architecture
AppsOSHW
DigitalLumpedDistrib.
OSHW
DigitalLumpedDistrib.
DigitalLumpedDistrib.
LumpedDistrib. Distrib.
Any layer needs all lower layers.
![Page 210: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/210.jpg)
0. HGT1. DNA repair2. Mutation 3. DNA replication4. Transcription5. Translation6. Metabolism7. Signal transduction8. …
AppsOS
HardwareDigital
LumpedDistributed
Any layer needs all lower layers.
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
![Page 211: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/211.jpg)
Horizontal Gene
Transfer
Sequence ~100 E Coli (not chosen randomly)• ~ 4K genes per cell• ~20K different genes in total (pangenome)• ~ 1K universally shared genes • ~ 300 essential (minimal) genes
![Page 212: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/212.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
FastCostly
SlowCheap
Flexible Inflexible
General Special
HGT DNA repair
Mutation DNA replication
Transcription Translation
MetabolismSignal…
Layered Architecture
![Page 213: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/213.jpg)
Slow
Fast
Flexible InflexibleGeneral Special
AppsOSHWDig.Lump.Distrib.
OSHWDig.Lump.Distrib.
DigitalLump.Distrib.
LumpedDistrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation Metabolism
Signal
SenseMotor
Prefrontal
Fast
Learn
Reflex
Evolve
vision
VOR
![Page 214: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/214.jpg)
Slow
Fast
Flexible InflexibleGeneral Special
AppsOSHWDig.Lump.Distrib.
OSHWDig.Lump.Distrib.
DigitalLump.Distrib.
LumpedDistrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation
Metabolism Signal
SenseMotor
Prefrontal
Fast
Learn
Reflex
EvolveVOR
Many systems/organisms only use lower layers
![Page 215: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/215.jpg)
LumpedDistrib. Distrib.
Metabolism
Signal
SenseMotor Fast
Reflex
EvolveVOR
Many systems/organisms only use lower layers
Analog
Red blood cellsNormocephalic anucleosis
Most metazoans
![Page 216: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/216.jpg)
SenseMotor Fast
Reflex
Evolve
Analog?
Most metazoans
![Page 217: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/217.jpg)
LumpedDistrib. Distrib.
Metabolism
Signal
SenseMotor Fast
Reflex
Evolve
Many systems/organisms only use lower layers
Analog
Red blood cellsNormocephalic anucleosis
Most metazoans
![Page 218: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/218.jpg)
200 microns
Denucleated neurons
Megaphragma mymaripenne
5 day lifespan7,400 neurons vshousefly 340,000 honeybee 850,000.
Normocephalic anucleosis
![Page 219: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/219.jpg)
Slow
Fast
Flexible InflexibleGeneral Special
AppsOSHWDig.Lump.Distrib.
OSHWDig.Lump.Distrib.
DigitalLump.Distrib.
LumpedDistrib. Distrib.
HGT DNA repair Mutation DNA replication Transcription
Translation Metabolism
Signal
SenseMotor
Prefrontal
Fast
Learn
Reflex
Evolve
vision
VOR
![Page 220: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/220.jpg)
10
100
Length, m
.1 1.5.22 k10
-110
010
1100
101
too fragile
complex
No tradeoff
expensive
fragile
exp lnexp
T z pp
z pT
Slow
Flexible
vision
eye vision
Act slowdelay
Fast
Inflexible
VOR
fastSlow
Flexible
Fast
InflexibleGeneral Special
NPPanalytic
PspaceDecidable
![Page 221: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/221.jpg)
control feedback
RNA
mRNA
RNApTranscription
Other Control
Gene
AminoAcids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transductionATP
DNA
New gene
SensoryMotor
Prefrontal
Striatum
Reflex
LearningSoftware
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
What can go wrong?
Before exploring
mechanisms
![Page 222: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/222.jpg)
Horizontal Bad Gene Transfer
Horizontal Bad App Transfer
Horizontal Bad Meme
Transfer
Parasites &
Hijacking
Fragility?
Exploiting layered
architecture
Virus
Virus
Meme
![Page 223: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/223.jpg)
Horizontal Bad Meme
Transfer
Our greatest fragility?
Meme
Many human beliefs are:• False• Unhealthy
![Page 224: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/224.jpg)
Horizontal Bad Meme
Transfer
Our greatest fragility?
Meme
Many human beliefs are:• False• Unhealthy
• Masculinity• Compassion
![Page 225: Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs,](https://reader037.vdocuments.net/reader037/viewer/2022110101/568130ad550346895d96bab8/html5/thumbnails/225.jpg)
Horizontal Transfer
Horizontal Transfer
Constrained
Deconstrained
Deconstrained
Universal architectures
Universal laws
Fast
Slow
Flexible InflexibleGeneral Special
SW Apps
OS
HW