korea day2 tutorial 20161014 v6

05/03/2023 Understanding Cognitive Systems 1

Cognition as a Service (CaaS)Jim Spohrer (IBM)

Seoul, South Korea; October 14, 2016Consulting Conference

http://www.slideshare.net/spohrer/korea-day2-tutorial-20161014-v6


AI Magazine: Cognition as a Service


CSIG = Cognitive Systems Institute Grouphttp://cognitive-science.info/community/weekly-update/


Today’s Talk• Abstract: Cognition as a Service (CaaS)

• Introduction to the cognitive era of computing, in which cognitive capabilities from natural language and video understanding, machine learning, and decision support with explanations and levels of confidence become broadly available as part of cognitive solutions in the cloud and on personal devices such as smartphones. Building cognitive systems is still too hard, but will be getting easier over next ten years.

• Bio:• Jim Spohrer, IBM, Director Understanding Cognitive Systems• Former Director, University; Service Research; CTO IBM VC Group• Jim is developing a next generation curriculum to help learners build,

understand, and work with cognitive systems. Education: Yale Computer Science (AI&CogSci) PhD, MIT Physics BS.

Jim SpohrerIBM

05/03/2023 7

Today’s Talk• Four Cool Tech Topics

• Today: CaaS• If time others

• Getting Started• Universities• Watson Developers• Cloud Developers

• Servitization:• Industry 4.0• IoT• CaaS

• Definitions• Why this is still too hard

© IBM UPWard 2016

Cognition as a Service (CaaS): AI building blocks for IA solutions

Servitization of Industry 4.0 and IoT


Getting Started: Three Doors

Universities Watson Developers Cloud Developers

Onthehub.com/IBM IBM.com/watson/developercloud Bluemix.net/catalog

HICSS.org World of Watson IBM INTERACT


Getting Started: IBM on the hubhttp://onthehub.com/ibm


Getting Started: Watson Developer Cloudhttp://www.ibm.com/watson/developercloud/


Getting Started: Watson APIs on Bluemixhttps://console.ng.bluemix.net/catalog/


Learn more about a service offering


Learn more…


Try the service…

05/03/2023 18

IBM Cloud Bluemix: Watson APIs are growing…

© IBM UPWard 2016

So far (June 2016), 100,000 faculty and students globally given access


Starter Kits


Starter Kits: Social Customer Care


Starter Kit...

05/03/2023 22

What is Industry 4.0?

© IBM UPWard 2016

05/03/2023 23

History of the idea: Mirror Worlds

© IBM UPWard 2016

05/03/2023 24© IBM UPWard 2016

Why is this relevant?

05/03/2023 25

I am still very skeptical… but tell me more….

© IBM UPWard 2016

05/03/2023 26© IBM UPWard 2016

05/03/2023 27

Managers: Courage Required….

© IBM UPWard 2016

05/03/2023 28

Talent required, but…

© IBM UPWard 2016

05/03/2023 29

Industry 4.0

© IBM UPWard 2016

05/03/2023 30

CyberPhysical Systems?

© IBM UPWard 2016

05/03/2023 31

Industry 4.0

© IBM UPWard 2016

05/03/2023 32© IBM UPWard 2016

05/03/2023 33© IBM UPWard 2016

Yesterday: Servitization• Rolls Royce: “Power By The Hour”

Tomorrow: Servitization• Start with any traditional product that is sold to customers• Make the product part of a smart/wise service system

• Instrument it (sensors) – Internet of Things/Everything• Set-up an intelligent operation center to monitor all products’ performance across their

life-cycles• Use big data analytics to determine how to improve product performance, efficiency,

maintenance, etc.• Offer customer the “product-performance-as-a-service” with financing/Internet of Service• Customer benefits from cost-savings, predictability• Provider benefits margin-improvements, predictability

• Every product becomes a platform technology (a vehicle for service innovation) for innovative university startups

Vision: MMaaRRSS• Modular Manufacturing as a Regional Recirculation Service System• “I am the stuff that will be made into product X for customer Y.”• Stuff = Material, Energy, and Information Flows • Minimize transport costs (for products and waste)

• The Vision: Circular Economy (~4 minutes)


Circular Economy: Product to Service Thinking

“The best way to predict the future is to inspire the next generation of students to build it better”

Digital Natives Transportation Water Manufacturing

Energy Construction ICT Retail

Finance Healthcare Education Government

05/03/2023 © IBM 2015, IBM Upward University Programs Worldwide accelerating regional development

39

I have…

Have you noticed how the building blocks just keep getting better?


40

Learning to program:My first program

Early Computer Science Class:Watson Center at Columbia 1945

Jim Spohrer’s First Program 1972

05/03/2023 41© IBM UPWard 2016

Fast Forward 2016: Consider this…

05/03/2023 42

Microsoft CaptionBot June 19, 2016

© IBM UPWard 2016

05/03/2023 43

Microsoft CaptionBot June 20, 2016

© IBM UPWard 2016

05/03/2023 44

IBM Image Tagging

© IBM UPWard 2016


45

Brief History of AI

• 1956 – Dartmouth Conference• 1956 – 1981 Micro-Worlds• 1981 – Japanese 5th Generation• 1988 – Expert Systems Peak• 1990 – AI Winter• 1997 – Deep Blue• 1997 – 2011 Real-World• 2011 – Jeopardy! & SIRI• 2013 – Cognitive Systems Institute• 2014 – Watson Business Unit &• True North Brain Chip• 2015 – “Cognition as a Service”

on IBM Bluemix

05/03/2023 46

1955 1975 1995 2015 2035 2055

Can better service help us be wiser?

Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach

47

Computing: Then, Now, Projected

05/03/2023

2035

2055


48


49

05/03/2023 50© IBM UPWard 2016

05/03/2023 51© IBM UPWard 2016

What might Reality 2.0 look like?


52

What exists in 2016?

360,000 100,000 120,000 60,000 150,000

05/03/2023 53

How fast is Artificial Intelligence approaching?

What might it look like?

05/03/2023 54

Definition: Intelligence• Intelligence has been defined in many

different ways including as one's capacity for logic, understanding, self-awareness, learning, emotional knowledge, planning, creativity and problem solving. It can be more generally described as the ability to perceive information, and retain it as knowledge to be applied towards adaptive behaviors within an environment or context.

© IBM UPWard 2016

https://en.wikipedia.org/wiki/Logic

https://en.wikipedia.org/wiki/Understanding

https://en.wikipedia.org/wiki/Self-awareness

https://en.wikipedia.org/wiki/Learning

https://en.wikipedia.org/wiki/Emotional_knowledge

https://en.wikipedia.org/wiki/Plan

https://en.wikipedia.org/wiki/Creativity

https://en.wikipedia.org/wiki/Problem_solving

https://en.wikipedia.org/wiki/Perception

https://en.wikipedia.org/wiki/Knowledge

05/03/2023 55

Definitions: AI vs IA

© IBM UPWard 2016

AI is Artificial Intelligence, orintelligence in machines (smart machines)

IA is Intelligence Augmentation, orpeople thinking and working together with smart machines.

IA is what IBM calls “Cognitive Computing” andthe smart machines are called “Watson Solutions” or

more generally “Digital Cognitive Systems (Cogs)”

Cognition as a Service (CaaS): AI building blocks for IA solutions


Augmenting Workers


How to augment workers? Very hard still


Human Nature: Sometimes people are lazy or in a hurry

Courtesy Jean Paul JacobIBM Research Emeritus


Definitions: Types of Cognitive System Entities(symbol and pattern processing systems)• Socio-Technical (Organization-based)

• Businesses• Cities• Nations

• Biological (Brain-based)• People• Animals

• Technological (Computation-based)• Embodied (Robot, Car, Device)• Virtual (Local, Cloud)


Boosting Creativity and Productivity


What types of digital cognitive systems? • Cognitive Build: Outthink Challenge (250K people)

• Imagine a digital cognitive system to help you do something important in your personal or professional lives

• Team to design it and advocate for it, and then everyone votes

• Winners: reduce waste and human suffering, screen for health issues and safety threats, learn life skills and make better choices, find what you are looking for, move around more effectively, provide emotional support, provide IT support, learn about important public policy goals and make better choices

• Types: Tool, Assistant, Collaborator, Coach, Mediator


Types• Tool• Assistant• Collaborator• Coach• Mediator


Types: Progression of models and capabilities

Task & World Model/Planning & Decisions

Self Model/Capacity & Limits

User Model/Episodic Memory

Institutions Model/Trust & Social Acts

Tool + - - -

Assistant ++ + - -

Collaborator +++ ++ + -

Coach ++++ +++ ++ +

Mediator +++++ ++++ +++ ++

tool assistant collaborator coach mediator


Build: 10 million minutes of experience


Build: 2 million minutes of experience


Build: Hardware < Software < Data < Experience < Transformation


Understand them…


Work with…


Next generation cognitive curriculum

05/03/2023 71

IBM Cloud Bluemix: Watson APIs are growing…

© IBM UPWard 2016

So far (June 2016), 100,000 faculty and students globally given access


72

Wise Service System:All entities’ in networkuse cognitive mediatorsto enhance value co-creation interactions

Cognitive Mediators:Cognitive systems with deep knowledge of both customer (user) and provider (expert)as co-creators of win-win value

Entity augmentation boosts both creativity and productivity of interactions


73

Cognitive Mediatorsfor all people in all roles


74

Occupations = Many Tasks


75

Watson Discovery Advisor

Simonite, T. 2014. Software Mines Science Papers to Make New Discoveries. MIT. November 25, 2014.URL: http://m.technologyreview.com/news/520461/software-mines-science-papers-to-make-new-discoveries/


76

User Models

05/03/2023 77

Courses• 2015

• “How to build a cognitive system for Q&A task.”• 9 months to 40% question answering accuracy• 1-2 years for 90% accuracy, which questions to reject

• 2025• “How to use a cognitive system to be a better professional X.”• Tools to build a student level Q&A from textbook in 1 week

• 2035• “How to use your cognitive mediator to build a startup.”• Tools to build faculty level Q&A for textbook in one day• Cognitive mediator knows a person better than they know themselves

• 2055• “How to manage your workforce of digital workers.”• Most people have 100 digital workers.


78

In Summary

“A service scienceperspective considersthe evolving ecology of service system entities, their value co-creation andcapability co-elevationinteractions, and their capabilities, constraints,rights, and responsibilities.”

Cognitive SystemsEntities

Service SystemsEntities With

CognitiveMediators

Add Rights &Responsibilities


81

Explain external phenomena


82

Explain internal phenomena


83

Explainvalue co-creationphenomena


84

Physics Chemistry Biology

Neuroscience Psychology ArtificialIntelligence

Engineering Management PublicPolicy

Education Design Humanities

Natural Systems

Cognitive Systems

Service Systems


Jim Spohrer (IBM)Seoul, South Korea; October 14, 2016

Consulting Conferencehttp://www.slideshare.net/spohrer/korea-day2-tutorial-20161014-v6