introduction to artificial intelligence
DESCRIPTION
INTRODUCTION TO ARTIFICIAL INTELLIGENCE. Massimo Poesio LECTURE 1: Intro to the course, History of AI. ARTIFICIAL INTELLIGENCE: A DEFINITION. The branch of Computer Science whose aim is to develop machines able to display intelligent behavior - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/1.jpg)
INTRODUCTION TO ARTIFICIAL INTELLIGENCE
Massimo Poesio
LECTURE 1: Intro to the course, History of AI
![Page 2: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/2.jpg)
ARTIFICIAL INTELLIGENCE: A DEFINITION
• The branch of Computer Science whose aim is to develop machines able to display intelligent behavior
• Strong AI: developing machines all but undistinguishable from human beings
• Weak AI: developing SIMULATIONS of human intelligence
![Page 3: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/3.jpg)
AI BY EXAMPLE: GAMES
![Page 4: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/4.jpg)
AI BY EXAMPLE: ROBOCUP
![Page 5: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/5.jpg)
AI BY EXAMPLE: LANGUAGE
![Page 6: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/6.jpg)
AI BY EXAMPLE: LANGUAGE
![Page 7: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/7.jpg)
A BRIEF HISTORY OF AI
• Forerunners, I: logic and ontologies• Forerunners, II: mechanical machines / robots• The beginning of AI: Turing, Dartmouth,
Games, Search• The role of Knowledge in Human Intelligence• The role of Learning• Modern AI
![Page 8: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/8.jpg)
ARISTOTLE
• Aristotle developed the first theory of knowledge and reasoning – his ideas eventually developed into modern– LOGIC– ONTOLOGIES
![Page 9: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/9.jpg)
ARISTOTLE: SYLLOGISM(Prior Analytics)
BARBARA:A: All animals are mortalA: All men are animals.A: Therefore, all men are mortal.
The first attempt to develop a precise method for reasoning about knowledge: identify VALID REASONING PATTERNS, or SYLLOGISMS
DARII:A: All students in Fil., Logica & Informatica take Intro to AII: Some students in Filosofia take Fil., Logica & Informatica.I: Therefore, some student in Filosofia takes Intro to AI.
![Page 10: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/10.jpg)
FIRST ONTOLOGIES
![Page 11: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/11.jpg)
LOGIC: BEYOND ARISTOTLE
• Ramon Lull (13th Century): first mechanical devices for automatic reasoning (Lull’s disks)
• Leibniz (17th Century): Encoding for syllogisms• Boole (19th Century): Boolean Algebra• Frege (1879): Predicate calculus
![Page 12: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/12.jpg)
BOOLEAN ALGEBRA
![Page 13: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/13.jpg)
FORERUNNERS, 2
![Page 14: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/14.jpg)
TURING
• Alan Turing is the father of AI• He was the first to imagine machines able of
intelligent behavior• And devised an intelligence test, the TURING
TEST: replace the question “Can a machine be endowed with intelligence” with the question:– Can a machine display such human-like behavior to
convince a human observer that it is a human being?
![Page 15: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/15.jpg)
DARTMOUTH
• In 1956 a group of researchers including J. McCarthy, M. Minsky, C. Shannon, N. Rochester organized a workshop at Dartmouth to study the possibility of developing machine intelligence
![Page 16: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/16.jpg)
THE BEGINNINGS OF AI (1956-1966)
• Early AI researchers identified intelligence with the kind of behavior that would be considered intelligent when displayed by a human, and tried to develop programs that reproduced that behavior
• Examples:– Chess– Theorem proving
![Page 17: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/17.jpg)
HEURISTIC SEARCH
• This early research focused on the development of SEARCH ALGORITHMS (A*) that would allow computers to explore a huge number of alternatives very efficiently
![Page 18: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/18.jpg)
THE SUCCESS OF EARLY AI
In 1997, the chess-playing program DEEP BLUE developed by IBM researchers led by Feng-hsiung Hsu, beat the chess world champion Gary Kasparov over six games
![Page 19: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/19.jpg)
EARLY AI RUNS INTO TROUBLE (1966-1973)
• Soon however researchers realized that these methods could not be applied to all problems requiring intelligence, and that there were a number of ‘simple’ problems that could not be handled with these methods at all– Example of the first: machine translation (the
ALPAC report)– Example of the second: natural language, vision
![Page 20: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/20.jpg)
COMMONSENSE KNOWLEDGE IN LANGUAGE UNDERSTANDING
• Winograd (1974):– The city council refused the women a
permit because they feared violence.– The city council refused the women a
permit because they advocated violence
![Page 21: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/21.jpg)
AI KEY DISCOVERIES, 1
• Performing even apparently simple tasks like understanding natural language requires lots of knowledge and reasoning
![Page 22: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/22.jpg)
THE ‘KNOWLEDGE YEARS’ (1969-1985)
• Development of knowledge representation techniques
• Development of EXPERT SYSTEMS• Development of knowledge-based techniques
for – Natural Language Understanding– Vision
![Page 23: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/23.jpg)
KNOWLEDGE REPRESENTATION METHODS
• Logic is the older formalization of reasoning• It was natural to think of logic as providing the
tools to develop theories of knowledge and its use in natural language comprehension and other tasks
• Great success in developing theorem provers• But AI researchers quickly realized that the
form of logic required was not valid deduction
![Page 24: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/24.jpg)
FROM LOGIC TO AUTOMATED REASONING
• Starting from the ‘50s AI researchers developed techniques for automatic theorem proving
• These techniques are still being developed and have been used to prove non-trivial theorems
![Page 25: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/25.jpg)
RESOLUTION THEOREM PROVING
All Cretans are islanders. All islanders are liars. Therefore all Cretans are liars.
∀X C(X) implies I(X) ∀X I(X) implies L(X) Therefore, X C(X) implies L(X) ∀¬C(X) ∨ I(X) ¬I(Y) L(Y) ∨¬C(X) L(Y) ∨
![Page 26: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/26.jpg)
HIGH PERFORMANCE THEOREM PROVING
• There are now a number of very efficient theorem provers that can be used to demonstrate sophisticated mathematical theorems– Otter– Donner & Blitzen
![Page 27: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/27.jpg)
THE FOUR-COLOR PROBLEM
• Conjecture: given a plane divided in regions, it is possible to color the regiones in such a way that two adjacent regions are always of different colors using no more than 4 colors
• This conjecture was demonstrated by an automatic theorem prover in 1997
![Page 28: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/28.jpg)
AI KEY DISCOVERIES, 2
• Neither commonsense nor ‘expert’ reasoning involve only valid inferences from certain premisses:– Commonsense reasoning often involves jumping
to plausible conclusions– Expert reasoning involves making decisions with
uncertainty
![Page 29: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/29.jpg)
COMMONSENSE KNOWLEDGE IN LANGUAGE UNDERSTANDING
• Winograd (1974):– The city council refused the women a
permit because they feared violence.– The city council refused the women a
permit because they advocated violence
![Page 30: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/30.jpg)
DIAGNOSTIC REASONING IN EXPERT SYSTEMS
IF patient has loss of weight AND anorexia AND spleen is palpable AND feverTHEN patient MAY have Hodgkin’s disease
![Page 31: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/31.jpg)
BEYOND VALID INFERENCE
• As a result of discovery number 2, AI researchers quickly got involved with developing better theories of commonsense reasoning and uncertain reasoning– Drawing inspiration from psychology (work on
semantic networks, scripts)– Developing new inference formalisms
![Page 32: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/32.jpg)
SOME RESULTS FROM COGNITIVE PSYCHOLOGY: SEMANTIC NETWORKS
• Collins & Quillian, 1969: knowledge appears to be organized around objects and in a taxonomic way– A canary is yellow– A canary has feathers– A canary eats food
• Haviland & Clark 1974, Sanford & Garrod 1979: ‘associated’ knowledge available when concepts are mentioned– I looked around the house.– The lounge was very spacious.
![Page 33: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/33.jpg)
AN EXAMPLE OF SEMANTIC NETWORK
![Page 34: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/34.jpg)
COMMONSENSE REASONING: SCRIPTS (SCHANK & ABELSON, 1977)
John entered the restaurant.
The menu had changed, so he ordered one of the new dishes.
The bill was very steep.
![Page 35: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/35.jpg)
AN EXAMPLE OF SCRIPT
![Page 36: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/36.jpg)
‘KNOWLEDGE-BASED’ SYSTEMS FOR LANGUAGE UNDERSTANDING: SHRDLU
Winograd, 1974
![Page 37: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/37.jpg)
A DIALOGUE WITH SHRDLU
Person: PICK UP A BIG RED BLOCK.Computer: OK.Person: GRASP THE PYRAMID.Computer: I DON'T UNDERSTAND WHICH PYRAMID YOU MEAN.Person (changing their mind): FIND A BLOCK WHICH IS TALLER THAN THE ONE YOU ARE HOLDING AND PUT IT INTO THE BOX.Computer: BY "IT", I ASSUME YOU MEAN THE BLOCK WHICH IS TALLER THAN THE ONE I AM HOLDING.Computer: OK.Person: WHAT DOES THE BOX CONTAIN?Computer: THE BLUE PYRAMID AND THE BLUE BLOCK.Person: WHAT IS THE PYRAMID SUPPORTED BY?Computer: THE BOX.Person: HOW MANY BLOCKS ARE NOT IN THE BOX?Computer: FOUR OF THEM.Person: IS AT LEAST ONE OF THEM NARROWER THAN THE ONE WHICH I TOLD YOU TO PICK UP?Computer: YES, THE RED CUBE.
![Page 38: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/38.jpg)
EXPERT SYSTEMS
• Beginning with the ’70s, AI researchers developed systems that could be used to diagnose – Illnesses (MYCIN, DXPLAIN)– Mechanical problems• DELTA-CATS1, General Electric, Bonissone et al 1984• IDEA, Centro Ricerche Fiat, ~1993
– etc
![Page 39: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/39.jpg)
EXPERT SYSTEMS
![Page 40: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/40.jpg)
A COMMONSENSE ENCYCLOPEDIA: CYC
• A project initiated in 1984 by Doug Lenat. The goal: to encode all of commonsense knowledge
• Changed the underlying formalism several times. – These days: a logic-based representation
• Two versions available:– OpenCyc (http://www.opencyc.org/)
• 50 000 concepts, 300 000 facts• Can be downloaded / on the Web
– ResearchCyc (http://research.cyc.com/)• 300 000 concepts, 3 million facts
![Page 41: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/41.jpg)
KNOWLEDGE IN CYC
"Bill Clinton belongs to the class of US Presidents“
(#$isa #$BillClinton #$UnitedStatesPresident)
“All trees are plants”
(#$genls #$Tree-ThePlant #$Plant)
“Paris is the capital of France".
(#$capitalCity #$France #$Paris)
![Page 42: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/42.jpg)
COMMONSENSE REASONING
• Modelling commonsense inference required the development of entirely new paradigms for inference beyond classical logic
• Non-monotonic reasoning• Probabilistic models
![Page 43: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/43.jpg)
AI RUNS INTO TROUBLE, AGAIN
• The CYC project started in 1984, and by common opinion is nowhere near finished– Hand-coding of commonsense FACTS is unfeasible – (We will get back to this point later when talking
about socially constructed knowledge)• Work on lower-level tasks such as speech
perception revealed the impossibility of hand-coding commonsense RULES and assigning them priorities
![Page 44: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/44.jpg)
SPEECH
![Page 45: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/45.jpg)
KEY AI DISCOVERIES, 3
• A theory of intelligence requires a theory of how commonsense knowledge and cognitive abilities are LEARNED
![Page 46: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/46.jpg)
THE MACHINE LEARNING YEARS (1985-PRESENT)
• The development of methods for learning from evidence started even before Dartmouth
• But machine learning has now taken center stage in AI
![Page 47: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/47.jpg)
CYBERNETICS
• McCulloch, Pitts (1943): first artificial neurons model (based on studies of real neurons)
![Page 48: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/48.jpg)
KNOWLEDGE REPRESENTATION IN THE BRAIN
![Page 49: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/49.jpg)
MODELS OF LEARNING BASED ON THE BRAIN: THE PERCEPTRON
![Page 50: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/50.jpg)
LEARNING TO CLASSIFY OBJECTS
![Page 51: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/51.jpg)
ARTIFICIAL INTELLIGENCE TODAY
• Artificial intelligence as a science:– Artificial intelligence vs. Cognitive Science
• Artificial Intelligence as a technology
![Page 52: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/52.jpg)
AI INDUSTRY: GOOGLE
![Page 53: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/53.jpg)
AI INDUSTRY: ROBOTICS
![Page 54: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/54.jpg)
CONTENTS OF THE COURSE• Knowledge Representation– A reminder about logic– Ontologies– Semantic networks
• Machine Learning– A reminder about statistics– Supervised learning– Unsupervised learning
• Putting it all together: Natural Language– A task that requires to use both knowledge
representation and machine learning
![Page 55: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/55.jpg)
PRACTICAL INFORMATION• 60 hours / 12 credits• Timetable: – Mondays, 10-12 and 16-18 (lectures)– Tuesdays, 12-14 (labs / tutorials)
• Prerequisites– The ideal student would have the background provided by
the three-year course in Filosofia and Informatica (some background in linguistic, logic, and statistics; some experience with programming)
• Evaluation– A project to be presented at the exam
• Web site: http://clic.cimec.unitn.it/massimo/Teach/AI
![Page 56: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/56.jpg)
READING MATERIAL• Required:
– The course slides, available from the Web Site– Other material downloadable from the Website
• Recommended readings:– Russel and Norvig, Artificial Intelligence: A Modern Approach (2nd ed), Prentice-Hall– Bianchini, Gliozzo, Matteuzzi, Instrumentum vocale: intelligenza artificiale e linguaggio,
Bononia
• Supplementary on specific sub-areas of AI:– KR:
• John F. Sowa, Knowledge Representation, Brooks / Cole• Blackburn, Bos, Representation and Inference for Natural language, CSLI
– ML:• Mitchell – Machine Learning – Prentice-Hall
![Page 57: INTRODUCTION TO ARTIFICIAL INTELLIGENCE](https://reader038.vdocuments.net/reader038/viewer/2022103008/56816864550346895ddeb764/html5/thumbnails/57.jpg)
READINGS• This lecture:
– http://en.wikipedia.org/wiki/Timeline_of_artificial_intelligence– John F. Sowa, Knowledge Representation, Brooks / Cole, ch. 1