lawrence snyder university of washington, seattle
TRANSCRIPT
LawrenceSnyderUniversityofWashington,Seattle
© Lawrence Snyder 2004
Progress has been tremendous
PizzapartyTuesdayinAllenHall(CSEbuilding) Labsthisweekaredevotedtopairprogramming;itisaperfecttimetowork,butofcourse,youmayalsoneedtoworkoutsideofthosetimes
2/14/11 © 2011 Larry Snyder, CSE 2
Lasttime,weemphasizedakeyfactofalgorithmdesign…
Youmustbeabletoexplainwhyanalgorithmworks It’sdifferentforeveryalgorithm Youneedtoknow,butoftenyoumayalsohavetoexplainittosomeoneelse
Ourillustrationwasexplainingwhytwosortingalgorithmsworked
2/14/11 © 2011 Larry Snyder, CSE 3
4
TheinventorsofENIAC,1stcomputer,saidit“thinkswithelectricity”▪ Docalculators“think”?▪ Doesperformingarithmetic,whichisentirelyalgorithmic,requirethinking?▪ Once,performingarithmetic,wasthoughttobedivinelyormagicallyconferredability
5
TheinventorsofENIAC,1stcomputer,saidit“thinkswithelectricity”▪ Docalculators“think”?▪ Doesperformingarithmetic,whichisentirelyalgorithmic,requirethinking?▪ Once,performingarithmetic,wasthoughttobedivinelyormagicallyconferredability
The Problem: Many human activities look like thinking until they are understood (to be algorithmic)
6
A.M.Turing,computerpioneer,worriedaboutintelligenceinhumans&machines;proposedatest(1950)▪ Awarethatitisintelligenceuntilit’sunderstood,Turingdevisedatestwiththisexperimentalsetup:Acomputer(A)andaperson(B)areconnectedtoanexaminer,whocanaskquestionsusingtexttodeterminewhichiswhich
7
Formulatequestionsapersoncananswerbutacomputercan’t
InterrogatorInthefirstlineofyoursonnetwhichreads'ShallIcomparetheetoasummer'sday',wouldnot'aspringday'doaswellorbetter?
ComputerItwouldn'tscan.InterrogatorHowabout'awinter'sday'?Thatwouldscanallright.ComputerYes,butnobodywantstobecomparedtoawinter'sday.InterrogatorWouldyousayMr.PickwickremindedyouofChristmas?ComputerInaway.InterrogatorYetChristmasisawinter'sday,andIdonotthinkMr
PickwickwouldmindthecomparisonComputerIdon'tthinkyou'reserious.Byawinter'sdayonemeansa
typicalwinter'sday,ratherthanaspecialonelikeChristmas.
2/14/11 © 2011 Larry Snyder, CSE 8
CompletelyAutomatedPublicTuringTestToTellComputersandHumansApart DevelopedatCMUbyLuisVanAhnandhisteam
2/14/11 © 2011 Larry Snyder, CSE 9
10
JoelWeizenbaum’s“Doctor”[a\k\a“Eliza”]wasaprogramthatappearedintelligent
User:I’mdepressed.Doctor:Whyareyoudepressed?User:Mymotherisnotspeakingtome.Doctor:Tellmeaboutyourmother.User:Shedoesn’twantmetomajorinCS.Doctor:No?User:No,shewantsmetogointomedicine.
Doctor was basically scripted
11
Thestudyofmakingcomputersactintelligently▪ Theyalreadyactintelligent…e.g.theycancorrectyourspellingmistakes▪ Isthisintelligentbehavior?MostAIresearcherswouldsay“no”…algorithmic▪ PlayinggrandmasterlevelchessinatournamentbecameanAIgoal(1952) ‐Minimizesrealworldknowledge ‐Cleargoal,formalsystem
12
Chessisagame,soitusesagametree▪ Ateachnodeisa‘board’‐‐easilydigitized▪ Belowitareallboardscreatedin1move;belowthose,allboardsneedinganothermove
Anobjectivefunctionevaluates“goodness”oftheposition:goforhighest…opponentgoesforlowest
13
AnIBMsystem,DeepBlue,playedworldchampionGaryKasparov▪ In1996Kasparovwon,butDeepBlueplayed1gamewell!!!Thiswasafirst.▪ InMay11,1997DeepBluewon3.5‐2.5
Deep Blue is a 32 processor parallel computer with 256 “chess processors” that can consider 200,000,000 chess positions per second + opens + ends
14
DoesDeepBlue’sperformanceshowthatacomputercanbeintelligent?▪ No‐‐itrepeat’sitsdesignersintelligence(weakrebuttal)▪ Yes‐‐it’sbetterthananyoneintheworldatsomethingpeoplefindinterestingandfun▪ Maybe‐‐itshowsintelligenceinchess,butcanitapplyitsintelligenceelsewhere?
What do you think?
2/14/11 © 2011 Larry Snyder, CSE 15
ComparedtoDeepBlue,Watsonismuchmoresophisticatedindesign,organization runson~2,500parallelCPUs,eachcapableofupto33billionoperationsasecond;sizeofsmallRV
crawledandorganized200millionpagesofdata “expert”analyzers—morethan100differenttechniquesrunningconcurrentlytoanalyzenaturallanguage,appraisesources,proposehypotheses,mergeresultsandranktopguesses.
2/14/11 © 2011 Larry Snyder, CSE 16
Itmaybeanticlimacticforthepublic,buttheCScommunityisalla‐buzzbecausethisisREALLYdifficulttechnically
It’stoughto“get”apun!
2/14/11 © 2011 Larry Snyder, CSE 17
Chessseemsharder,butit’snot Chesshasfixedrules,littlerealworlddataneeded Jeopardy,morefreeformusingonlyrealdata
Otherdifferences Inchessthe“problem”isknownbeforehand,butinJeopardy,someoneelsesetsuptheproblem
Inchess,decisionsarebasedonaformula,butinJeopardymanyformsofevaluationareneeded(aproblemsolvedbyprobabilities)
Inchessthereisverylittlepre‐planning,butinJeopardy,organizingthedataisthekey
2/14/11 © 2011 Larry Snyder, CSE 18
19
Computersdothingsdeemedcreativeinpast▪ CreatedesignsinthestyleofPietMondrian,JacksonPollackorJosefAlbers…
Is it Art? Is it Creative?
20
Creativityhastwoforms:“flashoutoftheblue”and“incrementalrevision”▪ “Flash,”i.e.inspiration,israre;isitjustluck?▪ “Revision”,i.e.hardwork,iscommonandtoalargedegreealgorithmic
Advertising agencies are famous for creativity, but in a recent study, 89% of all award-winning ads were an application of one of six templates -- design algorithm
AnexperimentattheU.ofOregon…composemusicinthestyleofBach
Threeparticipants:Bach,UofOProfessor,EPIprogram
Andthewinneris…
AudienceThought:Bach’s Professor’s EPI’s workwasworkwasworkwas ProfessorEPIprogramBach
2/14/11 © 2011 Larry Snyder, CSE 21
WatsonlookstobeamajoradvanceinAIandabigsteptowardsansweringTuring’sTest
WhatisWatson?
2/14/11 © 2011 Larry Snyder, CSE 22