![Page 1: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/1.jpg)
Synthesis and Processing of Materials
U.S. Army Research, Development and Engineering Command
Cognition, Computers and Cooperation
Presented at
TRADOC
MAD SCIENTIST SPEAKER SERIESSeptember 7, 2015
Bruce J. West
ST- Chief Scientist Mathematics
Army Research Office
919-549-4257
![Page 2: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/2.jpg)
Synthesis and Processing of Materials
2
Cognition, Computers & Cooperation
• Forecasting technology for the Army
• Pitfalls of futurology
• A little about the human brain
• Machine-driven thoughts
• Thought-driven machines
• Brain to brain communication
![Page 3: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/3.jpg)
Synthesis and Processing of Materials
3
Cognition, Computers & Cooperation
• The failure modes of futurology:
− Scientific discoveries are unpredictable.
− Technology breakthroughs are no better.
• significance
• omission
• alternatives
2012
![Page 4: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/4.jpg)
Synthesis and Processing of Materials
4
Cognition, Computers & Cooperation
• What makes this prediction different?
• It does not start with the desired outcome.
• It is based on reasonable extrapolation from existing sciences.
• It synthesizes the results from three fields.
• This is only one of many potential outcomes.
Brain-computer interface (BCI)
Network Science (NS)
Synthetic telethaphy
50 years
15 years
Brain-brain interface (BBI) 15 years
![Page 5: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/5.jpg)
Synthesis and Processing of Materials
5
Cognition, Computers & Cooperation
Let us start with the experimental evidence that:
1. machines can directly influence the brain;
2. the brain can directly influence machines.
![Page 6: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/6.jpg)
Synthesis and Processing of Materials
6
Cognition, Computers & Cooperation
• Brain-computer Interface (BCI) experiments gained notoriety in the spring of 1965, when the Yale neuroscientist Jose Delgado stopped a charging bull by transmitting a radio signal to an implant in the caudate nucleus of the animal’s brain.
The New York Times (1965):Matador with a radio stopswired bull; J. Osmundsen
![Page 7: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/7.jpg)
Synthesis and Processing of Materials
7
Cognition, Computers & Cooperation
• Five hundred years of experiments studying the human brain.
![Page 8: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/8.jpg)
Synthesis and Processing of Materials
8
Cognition, Computers & Cooperation
![Page 9: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/9.jpg)
Synthesis and Processing of Materials
9
Cognition, Computers & Cooperation
• Brain-computer Interface (BCI)
• Thought-driven systems Carmena, JM; Lebedev, MA; Crist, RE; O'Doherty, JE; Santucci, DM; Dimitrov, DF; Patil, PG; Henriquez, CS; Nicolelis, MA (2003PLoS Biology 1 (2): E42
DUKE MIT
![Page 10: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/10.jpg)
Synthesis and Processing of Materials
10
Cognition, Computers & Cooperation
• Brain-machine Interface (BMI) applications.
• Present-day research
• Carmena, JM; Lebedev, MA; Crist, RE; O'Doherty, JE; Santucci, DM; Dimitrov, DF; Patil, PG; Henriquez, CS; Nicolelis, MA (2003PLoS Biology 1 (2): E42
![Page 11: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/11.jpg)
Synthesis and Processing of Materials
11
Cognition, Computers & Cooperation
BCI HELICOPTER
BCI ROBOT
BCI SATISFACTION
BCI QUADRIPLEGIA
![Page 12: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/12.jpg)
Synthesis and Processing of Materials
12
Cognition, Computers & Cooperation
2011
• The science fiction version of the BBI goal
![Page 13: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/13.jpg)
Synthesis and Processing of Materials
13
Cognition, Computers & Cooperation
2003
• First brain-to-brain Interface (BBI) experiments involved two rats.
• Encoder is the sender and decoder is the receiver
• Encoder learns empirically
• Decoder learns by having information funneled into his brain directly
M. Pais-Vieira, M. Lebedev, C. Kunicki, J. Wang & M.A.L. Nicolelis, “A Brain-to-Brain Interface for Real-Time Sharing of Sensorimotor Information”, Scientific Reports 3, 1319 (2013).
A. Ramakrishnan, P.J. Ifft, M. Pais-Vieira, Y.W. Byun, K.Z. Zhauang, M.A. Lebedev & M.A.L. Nicolellis, “Computing Arm Movements with a Monkey Brainet”, Scientific Reports 5, 10767 (2015).
![Page 14: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/14.jpg)
Synthesis and Processing of Materials
14
Cognition, Computers & Cooperation
R.P.N. Rao & A. Stucco, “When two brains connect”, Scientific American, special issue (2014).
• Experimental realization of the Vulcan mind meld.
• Use one person’s brain data to produce a specific pattern of neural
activity in another person’s brain.
![Page 15: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/15.jpg)
Synthesis and Processing of Materials
15
Cognition, Computers & Cooperation
![Page 16: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/16.jpg)
Synthesis and Processing of Materials
16
Cognition, Computers & Cooperation
![Page 17: Synthesis and Processing of Materials U.S. Army Research, Development and Engineering Command Cognition, Computers and Cooperation Presented at TRADOC](https://reader036.vdocuments.net/reader036/viewer/2022070401/56649f175503460f94c2d70c/html5/thumbnails/17.jpg)
Synthesis and Processing of Materials
17
Cognition, Computers & Cooperation