-- tutorial on machine learning and hand-on coding training

10
2019 CTPL Workshop on Machine Learning 1 Gate of Industry 4.0, Embracing Artificial Intelligence -- Tutorial on Machine Learning and Hand-on Coding Training The CTPL group (Computational Transport Phenomena Laboratory, KAUST) is pleased to announce a workshop themed “Gate of Industry 4.0, Embracing Artificial Intelligence -- Tutorial on Machine Learning and Hand-on Coding Training” to gather our guests from Xi’an Jiaotong University, Virginia Polytechnic Institute and State University, King Fahd University of Petroleum and Minerals, China University of Petroleum, Taif University and Xiamen University, together with our CTPL members to step into the area of machine learning, especially deep learning. A distinguished young scholar, Yu Li, from Computational Bioscience Research Centre (CBRC) will give us a tutorial talk on the basic structure and procedure as well as instructions on the coding using Tensorflow and Matlab. Tao, Yiteng and Jingfa from CTPL will discuss on our current application of deep learning on optimizing engineering computations. Location: Room 4214, Building 1, KAUST, Saudi Arabia Time: 12:00pm – 16:00pm, 4 th , March, 2019 Workshop Chair: Shuyu Sun Workshop Secretary: Tao Zhang

Upload: others

Post on 21-May-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

1

GateofIndustry4.0,EmbracingArtificialIntelligence

--TutorialonMachineLearningandHand-onCodingTraining

TheCTPLgroup(ComputationalTransportPhenomenaLaboratory,KAUST)

is pleased to announce a workshop themed “Gate of Industry 4.0, EmbracingArtificialIntelligence--TutorialonMachineLearningandHand-onCodingTraining”togatherourguestsfromXi’anJiaotongUniversity,VirginiaPolytechnicInstituteand State University, King Fahd University of Petroleum and Minerals, ChinaUniversityofPetroleum,TaifUniversityandXiamenUniversity,togetherwithourCTPLmemberstostepintotheareaofmachinelearning,especiallydeeplearning.A distinguished young scholar, Yu Li, from Computational Bioscience ResearchCentre(CBRC)willgiveusatutorialtalkonthebasicstructureandprocedureaswellas instructionsonthecodingusingTensorflowandMatlab.Tao,YitengandJingfa from CTPL will discuss on our current application of deep learning onoptimizingengineeringcomputations.

Location:Room4214,Building1,KAUST,SaudiArabiaTime:12:00pm–16:00pm,4th,March,2019WorkshopChair:ShuyuSunWorkshopSecretary:TaoZhang

Page 2: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

2

Agenda

Time Speaker Topic

12:00pm—12:30pm Grouplunchandfree

discussion12:30pm—12:40pm ShuyuSun Openingandwelcome

12:40pm—13:10pm YuLiIntroductionontheMachineLearningandDeepLearning

13:10pm—13:40pm TaoZhangApplicationofDeepLearning

onacceleratingflashcalculations

13:40pm—14:10pm YitengLiFurtherapplicationofdeeplearningonmorecomplexphaseequilibriumproblems

14:10pm—14:30pm Coffeebreakandfree

discussion

14:30pm—15:00pm JingfaLi

Areviewonmachinelearningapproachforefficientuncertaintyquantificationusingmultiscalemethods

15:00pm—15:15pm HaiyiWuPredictingEffectiveDiffusioninPorousMediafromTheirimagesbyDeepLearning

15:15pm—16:00pm YuLi Hand-ontrainingoncoding

Page 3: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

3

*AllpresentationswillincludeashortQ&Aattheend.**Lunchwillbeservedat12:00pm,andjuice,coffeeandwaterwillbeprovidedallthetime.***Ashortintroductiontoeachspeakerandabstractofeachtalkareattachedinthefollowingpages.****ThemapofKAUSTInnandDiscoverySquare,aswellasofCampus,areillustratedonthelastpagetoguideyoutotheworkshopmeetingroomandtouraroundouruniversity.*****ItishighlysuggestedthattheattendeescouldsetupTensorflowandMatlabinadvance.******ItisrecommendedthattheattendeescouldfinishtheMatlabOnrampCourseathttps://www.mathworks.com/learn/tutorials/matlab-onramp.html*******ThetimeisshowninSaudiArabiatimezone(GMT+3)

Page 4: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

4

GuestAttendees

Name Affiliation

Prof.RuiQiaoVirginiaPolytechnicInstituteandStateUniversity,theUSA

Prof.BoYuBeijingInstituteof

PetrochemicalTechnology,China

Prof.JieChenXi’anJiaotongUniversity,

China

Prof.LiangGongChinaUniversityof

Petroleum,Qingdao,ChinaProf.HuangxinChen XiamenUniversity,China

Prof.ManalAlotibi TaifUniversity,SaudiArabia

Prof.XianbinLuo GuizhouUniversity,China

Dr.GangLeiKingFahdUniversityofPetroleumandMinerals,

SaudiArabia

Page 5: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

5

IntroductionontheMachineLearningandDeepLearning

Name:YuLiAffiliation: King Abdullah University of Science andTechnology,KAUST,SaudiArabiaBiography:Mr.LiisnowaPhDstudentatKAUST,majoringinComputer Science. He is a member of Structural andFunctionalBioinformatics(SFB)Group,whichisledbyDr.XinGao.HegotMasterdegreeinComputerScienceatKAUSTinDecember 2016. Before that, he got Bachelor degree inBiosciencesatUniversityofScienceandTechnologyofChina(USTC)in2015.HisresearchinterestsareDeepLearning,BioinformaticsandMachineLearning.Abstract:Machine learningalgorithms,especiallydeep learning,haveachievegreatsuccesses inrecentyearsacrossdifferentfields.Inthistalk,Iwillgiveabriefintroductiononmachinelearninganddeep learning. Because of the impressive potential of artificial intelligence, the relatedterminologies,suchas‘artificialintelligence(AI)’,‘machinelearning(ML)’,‘deeplearning(DL)’,have been abused in media, which can inevitably cause incorrect usages and people’smisunderstanding,whoarenotinthefield.So,Iwillstartfromclarifyingthebasicconceptsof‘AI’, ‘ML’ and ‘DL’. After that, I will introduce themain tasks ofmachine learning, includingclassification, regression, clustering and dimensionality reduction. Then, I will give a briefintroduction to neural networks, touching some interesting models, including convolutionalneuralnetworks(CNN),recurrentneuralnetworks(RNN),graphconvolutionalneuralnetworks(GCN)andgenerativemodels,suchasgenerativeadversarialnetworks(GAN).

Page 6: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

6

ApplicationofDeepLearningonacceleratingflashcalculations

Name:TaoZhangAffiliation:KingAbdullahUniversityofScienceandTechnology,KAUST,SaudiArabiaBiography:Mr.ZhangisnowaPhDstudentinthedepartmentof Earth Science and Engineering, joining our group sinceAugust 2016. In 2013, he got his Bachelor degree in ChinaUniversity of Petroleum, Beijing with the major Oil & GasStorage and Transportation. In June 2016, he obtained hismaster degree in the same major and university. Currently his research areaincludesmultiphaseflowsimulationindifferentcontinuumscales.Abstract:In the past two decades, researchers have made remarkable progress in accelerating flashcalculation,whichisveryusefulinavarietyofengineeringprocesses.Inthistalk,generalphasesplittingproblemstatementsandflashcalculationproceduresusingtheSuccessiveSubstitutionMethodare reviewed,while themain shortagesarepointedout. Twoaccelerationmethods,Newton'smethodandtheSparseGridsMethodarepresentedafterwardsasacomparisonwiththedeep learningmodelproposed in thispresentation.Adetailed introduction fromartificialneural networks to deep learningmethods is provided herewith the authors' own remarks.Factors inthedeep learningmodelare investigatedtoshowtheireffectonthefinalresult.Aselectedmodelbasedonthathasbeenusedinaflashcalculationpredictorwithcomparisonwithothermethodsmentioned above. It is shown that results from the optimized deep learningmodelmeet the experimental datawell with the shortest CPU time.More comparisonwithexperimentaldatahasbeenconductedtoshowtherobustnessofourmodel.

Page 7: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

7

Isothermal-isochoric phase equilibrium calculation inconventionalandunconventionalreservoirsbyadynamicmodel

Name:YitengLiAffiliation:KingAbdullahUniversityofScienceandTechnology,KAUST,SaudiArabiaBiography:Mr.Li isnowaPhDstudent inthedepartmentofEarthScienceandEngineering,joiningourgroupsinceJanuary2016.In2012,hegothisBachelordegreeinOceanUniversityofChina,QingdaowiththemajorMaterialChemistry.InMay2014,heobtainedhismasterdegreeinpetroleumengineeringinUniversityofSouthernCalifornia,LosAngeles.Currentlyhisresearch area includes phase equilibrium calculation and multiphase flow insubsurfacereservoirs.Abstract: Phase equilibrium calculation has various applications in petroleumengineering,notonlyasastandalonecalculationforseparationprocessbutalsoanintegral component of the compositional reservoir simulation. Previously, amajority of studies focus on the safety rather than the efficiency. It has beenreportedthattheequation-of-statebasedflashcalculationconsumesanenormousamountofcomputationaltime,upto70%,incompositionalsimulation,makingitthebottleneckfortheextensiveapplicationofcompositionalsimulators.Asaresult,the acceleration of flash calculations without much compromise in accuracybecomes an active research topic in the last two decades. In today’s topic, thephaseequilibriaproblemismodeledbasedontheNVTflashformulation.BasedonthelawsofthermodynamicsandOnsager’sreciprocalprinciple,moleandvolumeevolutionaryequationsareconstructedtodescribethedynamicprocessfromanynon-equilibriumstatetotheequilibriumstate.Benefitingfromitsgreatcapacity,weincorporatestabilitytestandphasesplittingcalculationtogether,bothofwhichconstitutethephaseequilibriumcalculation,andaccomplishthembyasingledeeplearningmodel. Itdiffers fromtheconventional flash frameworkwherestabilitytesting precedes phase splitting calculation, as most of the researches in flashspeedupbymachinelearningfollow.Anumberofsimulationresultsarepresentedtoshowtheaccuracyandefficiencyoftheproposeddeepneuralnetworkmodel.

Page 8: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

8

Areviewonmachinelearningapproachforefficientuncertaintyquantificationusingmultiscalemethods

Name:JingfaLiAffiliation:KingAbdullahUniversityofScienceandTechnology,KAUST,SaudiArabiaBiography:JingfaLicurrentlyworksasapostdoctoralfellowatComputational Transport Phenomena Laboratory (CTPL) atKAUST. He received the Bachelor degree from SouthwestPetroleumUniversityin2012andthePhDdegreefromChinaUniversity of Petroleum (Beijing) in 2017 both in PetroleumStorage& Transportation Engineering.His research interestsfocusonFVM,modelreductionmethod,anduncertaintyqualification.Abstract:Inthistalk,Iwillreviewamachinelearningapproachfortheestimationofcoarsescalebasisfunctionsinmultiscalefinitevolumemethod.Inthisapproach,a neural network predictor fitted using a set of solution samples fromwhich itlearnstogeneratesubsequentbasisfunctionsatalowercomputationalcostthansolving the local problems is developed. The computational advantage of thisapproachisrealizedforuncertaintyquantificationtaskswherealargenumberofrealizationshas tobeevaluated.Theproposedapproach isevaluatedonellipticproblemsyieldingverypromisingresults.

Page 9: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

9

PredictingEffectiveDiffusioninPorousMediafromTheir

imagesbyDeepLearning

Name:HaiyiWuAffiliation:VirginiaPolytechnicInstituteandstateUniversity,theUSABiography:Mr.Wu is now a PhD student at Virginia Tech,majoring in Mechanical Engineering. He is a member inLaboratory of Transport Phenomena for AdvancedTechnology,whichis ledbyProf.RuiQiao.HegotBachelordegree inModernMechanics at University of Science andTechnologyofChinain2015.Hisresearchinterestsaremultiscaleandmultiphasetransportphenomenainporousmedia.Abstract:Thisworkaimstotesttheapplicationofmachinelearningforpredictingthe effective diffusion of a porous medium from its geometry and to improvemachine learningperformanceby combing itwith field knowledge. The generalframework includes two parts. In the first part, a dataset for the diffusioncoefficient inporousmediaisgeneratedusingtheLatticeBoltzmannmethod.Inthe second part, machine learning method is used to process the datasetsgeneratedinthefirststepandtopredictthediffusioncoefficientofgivenporousstructure.Theconvolutionalneuralnetworks (CNN) isusedto train thedataset.ComparisonwiththegroundtruthsindicatestheexcellentpredictiveperformancebyCNNinawidevarietyofporousstructureswithacomputationalcostofseveralorders of magnitude smaller. The CNN results improves the prediction byconventionalBruggemanequationbyalmost2ordersofmagnitude,especiallyforthosesampleswithsmallporositiesandstrongheterogeneity.

Page 10: -- Tutorial on Machine Learning and Hand-on Coding Training

2019CTPLWorkshoponMachineLearning

10

KaustInn&DiscoverySquare

Campus