Can we teach morals to A.I.?Rosa M. Gil

Universitat de Lleida

Webminars

1st. Option

We can make programs

https://www.theverge.com/2016/10/5/13160546/i-robot-folio-society-edition-illustrations-art-isaac-asimov

alicedmedia.blogspot.com

Japan’s “Ten Principles of Robot Law”

1. Robots must serve mankind.2. Robots shall never kill or injure humans.3. Robots shall call the human that creates them “father.”4. Robots can make anything, except money.5. Robots shall never go abroad without permission.6. Male and female robots shall never change roles.7. Robots shall never change thier appearance or assume anotheridentity without permission.8. Robots created as adults shall never act as children.9. Robots shall not assemble other robots that have been scrappedby humans.10. Robots shall never damage human homes or tools.

htt

ps:

//ak

iko

k01

2u

m1

.wo

rdp

ress

.co

m/j

apan

s-te

n-p

rin

cip

les-

of-

rob

ot-

law

/

1988

Judeo-Christian monotheism also

adheres to the doctrine that only God can

give life

…any human who breathes life into an

inanimate object is assuming the role of

God and thereby becoming a false idol.

Such a blasphemer deserves

punishment, and in the conventions of

science fiction, this usually comes in theform of betrayal by the robots.https://www.technologyreview.com/s/421187/why-japanese-love-robots-and-americans-fear-them/

“In Japan… they’re culturally open to robots, on account of

animism. They don’t make a distinction between inanimate objects

and humans.”

Animism is a component of the Shinto

faith, the religion that preceded the

introduction of Buddhism to Japan and

remains an influential part of the

country’s culture. Animism is the notion

that all objects have a spirit - even man-

made objectshttps://www.technologyreview.com/s/421187/why-japanese-love-robots-and-americans-fear-them/

It is very hard to specify directly values! because there are infinitely manyundesirable outcomes in an open

world.

Consequences

They mimic us (some examples)

• Eugene Goostman a chatbot passed the Turing Test

• 7 June 2014. Portrayed as being a 13-year-old boy from Odessa, Ukraine, who has a pet guinea pig and a father who is a gynaecologist.

• Chat bots in human beings social networks• Simulated a person on Tinder.

• Alphabet chairman says Google Duplex passes Turing test in one specific way (2018)

• Cleverbot in 2011 …

Learning

Facebook and Stanford researchers design a chatbot thatlearns from its mistakes (January

17, 2019)

Learning

Can neural network computers learn fromexperience, and if so, could they ever become

what we would call 'smart'? And could twodifferent neural networks teach each other

what they know, thereby making each other a better network?

October 2019

https://www.scientificamerican.com/article/can-neural-network-comput/

Some answers …

• Neural network computers can learn from eachother

• Its 'smartness' is confined to a single task, which isnot what 'smart' typically implies

• While the network may be capable of assimilatingthe old and the new knowledge, this would in alllikelihood require that the network re-learn boththe old and the new concepts.

Has Skynet been born?• KAIROS, short for Knowledge-directed Artificial

Intelligence Reasoning Over Schemas

“Aladdin has an effect on the management of around ten per cent of theworld’s financial assets, or around $20 trillion. Over 25 years, it has growninto a system that is directly or indirectly responsible for more than fourtimes the value of all the money in the world.”

It is an electronic system by BlackRock Solutions, the risk

management division of the largest investment

management corporation, BlackRock, Inc. In 2013, it

handled about $11 trillion in assets (including BlackRock's

$4.1 trillion assets), which was about 7% of the world's

financial assets, and kept track of about 30,000 investmentportfolios.

Can we make artificial intelligence ethical?

“The sooner we come to an understanding of AI thatensures its powerful capabilities are a net positive forpeople and workers, the more wisely we can developand deploy it. And the more talented young peoplefrom all disciplines we train to think critically aboutAI, the more we can guarantee our leadership in thisvital area for the long term”

WEDNESDAY, JANUARY 23, 2019Stephen A. Schwarzman

Blackstone Chairman, CEO and Co-Founder$300M MIT150M Oxford

Intelligent Nudges in AI

Unique InsightsHumu’s insights combine thousands of employee data inputs to focus teams on the actions that matter most.Nudge Engine®Humu's Nudge Engine® delivers personal, achievablesuggestions that make every employee a change agent.

Rooting in emotions …

Emospark is an emotionally-aware AI console for thehome

EmoSPARK is an artificial intelligence

console created in London, United

Kingdom by Patrick Levy-Rosenthal.

The device uses facial recognition and

language analysis to evaluate human

emotion and convey responsive content

according to the emotion

2007

Emotional Intelligence

•Affectiva develops software thatunderstands people’s emotionaland cognitive states by analyzingtheir facial expression.

http

s://med

ium

.com

/@m

ark_riedl/

hu

man

-centered

-artificial-in

telligence-7

0b

01

9f9

56

d1

Understanding humansCommonsense

and corrupted reward)

AI Systems Helping HumansUnderstand Them

• AI Rationalization (It is our hypothesis that AI rationalization will promote feelings of trust, rapport, and comfort in non-experts operatingautonomous systems and robots)

A Neural Machine Translation Approach to GeneratingNatural Language Explanationshttps://arxiv.org/abs/1702.07826

Computational Creativity

https://www.nvidia.com/en-us/research/ai-playground/

We can teach morals to robots bytelling them stories?

Commonsense

and

corrupted reward)

Using stories to generate a value-alignedreward signal for reinforcement learningagents that prevents psychotic-appearing

behavior

https://www.cc.gatech.edu/~riedl/pubs/aaai-ethics16.pdf

Stories encode many types of sociocultural knowledge: commonlyshared knowledge, social protocols, examples of proper and improper

behavior, and strategies for copingwith adversity

Humans learn sociocultural values bybeing immersed within a society and a culture. While not all humans act

morally all the time, humans seem to adhere to social and cultural norms

more often than not withoutreceiving an explicitly written down

set of moral codes

An intelligent entity must learn to align its values with that of humans

Storytelling is a strategy forcommunicating tacit knowledge

How can it be implemented?

Use of reinforcement learning to control agent behavior, and

computational reasoning aboutnarratives.

Reinforcement learning (RL) is theproblem of learning how to act in a world so as to maximize a reward

signal.

Many believe RL, especially whencombined with deep neural

networks to predict the long-termvalue of actions, may be part of a framework for artificial general

intelligence

Deep reinforcement learning

Computational NarrativeIntelligence

Narrative intelligence is the the ability to craft, tell, and understand stories

https://arxiv.org/pdf/1806.06877.pdf

Automated Story Generator

A process of finding a sequence of eventsthat are consistent with the model thentranslating abstract events into natural

language

Scheherazade system from a valuealignment perspective because of the ability to learn a procedural

understanding of how a story abouta particular topic can unfold without

a priori hand-coded knowledge

Value alignment in a reinforcement learning agent

theoretically can be achieved byproviding the agent with a rewardsignal that encourages it to solvea given problem and discourages

it from performing any actionsthat would be considered

harmful to humans

Quixote

Automated Measures

To test that automated measurescorrelate with human judgments wecompare the scores our algorithms

produce to the scores from thehuman-subject study

Evaluation of story generationsystems

• Grammaticality

• Narrative Productivity (“interesting language” and “avoiding repetition”)

• Local Contextuality (capture differences in contextbetween adjacent sentences). Ex: Sent2Vec measure

• Temporal Ordering (temporal ordering Bayesianestimate and“temporal ordering” results)

https://www.cc.gatech.edu/~riedl/pubs/purdy-aiide18.pdf

Rosa M. Gil Iranzo

Thank youvery much

https://www.linkedin.com/in/rosa-gil197206/https://www.researchgate.net/profile/Rosa_Gil

Can creativity be automated?• Google’s technology, known as NSynth, is even able to

merge the characteristics of different instruments to create new sounds.

• there is a great deal of artistic input that goes in beforethe AI can start to put together the pieces. In someways, this could be described as artistic optimizationrather than creation, using machine learning to essentially carry out focus groups at a greater scale and speed than would be possible using traditionaltechniques. Creatives have put together the pieces of the campaign and the different ideas, while themachine learning helps to choose the combinationsthat work best.

https://www.sentient.ai/blog/ai-power-become-creative/

Van Gogh: Loving Vincent (2017)

• https://www.imdb.com/title/tt3262342/videoplayer/vi1862449433?ref_=tt_ov_vi

https://deepdreamgenerator.com/#gallery