Upload File

ai deep learning - cf machine learning

27
DEEP LEARNING Breakthrough In Machine Learning Intro & Tour

Upload: karl-seiler

Post on 17-Jan-2017

148 views

Category:

Software


0 download

Report

TRANSCRIPT

Page 1: AI Deep Learning - CF Machine Learning

DEEP LEARNINGBreakthrough In Machine Learning

Intro & Tour

Page 2: AI Deep Learning - CF Machine Learning

Central Florida Machine Learning, Predictive Analytics and Automated Reasoning

“Smart tech is here, now, and integral to your engineering.”

Page 3: AI Deep Learning - CF Machine Learning

INTROS

Page 4: AI Deep Learning - CF Machine Learning

Exploring and sharing

How to…

What’s new / hot

Engineering Resources

Page 5: AI Deep Learning - CF Machine Learning

Data Science

Big Data

Machine Learning

Semantics

Predictive Analytics

Internet of Things

Artificial Intelligence

Language Processing

Page 6: AI Deep Learning - CF Machine Learning

DEEP LEARNINGBreakthrough In Machine Learning

Intro & Tour

Page 7: AI Deep Learning - CF Machine Learning

Bill Gates, then Chairman, Microsoft

“A breakthrough in machine learning would

be worth ten Microsofts.”

Page 8: AI Deep Learning - CF Machine Learning
Page 9: AI Deep Learning - CF Machine Learning
Page 10: AI Deep Learning - CF Machine Learning
Page 11: AI Deep Learning - CF Machine Learning

Deep Learning Algos

• Deep Boltzmann Machine (DBM)

• Deep Belief Networks (DBN)

• Convolutional Neural Network (CNN)

• Stacked Auto-Encoders

Page 12: AI Deep Learning - CF Machine Learning

HISTORY• Neural nets - big in the late 80’s -

Despite a commonly-held belief, there have been numerous successful applications

• Out of fashion in the 90’s

• 2003 renewed interest in the problem of learning representations (as opposed to just learning simple classifiers) - LeChun

• 2006-2007 traction via unsupervised training - Ng

• Now “Deep Learning” has come to designate any learning method that can train a system with more than 2 or 3 non-linear hidden layers.

Page 13: AI Deep Learning - CF Machine Learning

WHY NOW?• More and diverse data

• More processing power

• Algorithm advances and discoveries

• GPUs

Page 14: AI Deep Learning - CF Machine Learning

Andrew Ng Yann

LeCun

Page 15: AI Deep Learning - CF Machine Learning

EXAMPLES

Page 16: AI Deep Learning - CF Machine Learning

Image Recognition

Page 17: AI Deep Learning - CF Machine Learning

Image Recognition

Page 18: AI Deep Learning - CF Machine Learning

Speech Recognition

Page 19: AI Deep Learning - CF Machine Learning

Natural Language

• Constituency parsing

• Sentiment analysis

• Information retrieval

• Machine translation

• Contextual entity linking

Page 20: AI Deep Learning - CF Machine Learning

VIDEO

Page 21: AI Deep Learning - CF Machine Learning

Andrew Ng: Deep Learning…

https://www.youtube.com/watch?v=n1ViNeWhC24

https://www.youtube.com/watch?v=n1ViNeWhC24
Page 22: AI Deep Learning - CF Machine Learning

Introduction to Deep Learning with Python

https://www.youtube.com/watch?v=S75EdAcXHKk

https://www.youtube.com/watch?v=S75EdAcXHKk
https://www.youtube.com/watch?v=S75EdAcXHKk
Page 23: AI Deep Learning - CF Machine Learning

TOOLS

Page 24: AI Deep Learning - CF Machine Learning

TensorFlow™ is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API.

Page 25: AI Deep Learning - CF Machine Learning

The goal of Torch is to have maximum flexibility and speed in building your scientific algorithms while making the process extremely simple. Torch comes with a large ecosystem of community-driven packages in machine learning, computer vision, signal processing, parallel processing, image, video, audio and networking among others, and builds on top of the Lua community.

At the heart of Torch are the popular neural network and optimization libraries which are simple to use, while having maximum flexibility in implementing complex neural network topologies. You can build arbitrary graphs of neural networks, and parallelize them over CPUs and GPUs in an efficient manner.

Page 26: AI Deep Learning - CF Machine Learning

• Pylearn2 is a machine learning library. Most of its functionality is built on top of Theano. It provides parallelization with CPUs and GPUs.

• Theano — An open source machine learning library for Python.• Deeplearning4j — An open source deep learning library written for Java. It provides parallelization with

CPUs and GPUs.• OpenNN — An open source C++ library which implements deep neural networks and provides

parallelization with CPUs.• NVIDIA cuDNN — A GPU-accelerated library of primitives for deep neural networks.• DeepLearnToolbox — A Matlab/Octave toolbox for deep learning.• convnetjs — A Javascript library for training deep learning models. It contains online demos.• Gensim — A toolkit for natural language processing implemented in the Python programming language.• Caffe — A deep learning framework.• Apache SINGA — A deep learning platform developed for scalability, usability and extensibility.• RNNLM — RNN language model open source.• RNNLMPara — Parallel RNN language model trainer open source.

Other Tools

Page 27: AI Deep Learning - CF Machine Learning

Karl Seiler | [email protected]@pivitguruSMARTER CHANGE


Learning Deep Learning

Deep Learning for Generic Object Detection: A Survey · deep learning, probabilistic models, autoencoders, manifold learning, and deep networks 17 Deep learning LeCun et al. (2015)

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1

Deep learning / representation learning

Deep Learning for Depth Learning CS 229 Course Project ...cs229.stanford.edu/...DepthLearning_FinalReport.pdf · Deep Learning for Depth Learning CS 229 Course Project, ... Deep Learning

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning

Einführung ins Deep Learning · Einführung ins Deep Learning deep space computing AG 6. Dezember 2019 deep-space.ch

Introducing Deep Learning with MATLAB - MathWorks · Introducing Deep Learning with MATLAB7 How A Deep Neural Network ... relevant features of an image. With deep learning, ... Deep

Deep Learning in real world @Deep Learning Tokyo

Introducing Deep Learning with MATLAB - Systematics · Introducing Deep Learning with MATLAB6 Inside a Deep Neural Network ... Deep learning is a subtype of machine learning. With

Deep Learning for Laser Based Odometry Estimation - …juxi.net/workshop/deep-learning-rss-2016/papers/Nicolai - Deep... · Deep Learning for Laser Based Odometry Estimation ... deep

Deep learning

Deep Learning I - Korea Universitydsba.korea.ac.kr/wp/wp-content/seminar/Deep learning/Deep Learning... · Deep Learning I Deep learning is research on learning models with multilayer

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine

Introduction to Deep Learning - Computer Graphics€¦ · Introduction to Deep Learning CS468 Spring 2017 Charles Qi. What is Deep Learning? Deep learning allows computational models

Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

Deep Learning

Hangzhou Deep Learning Meetup-Deep Reinforcement Learning

Language Processing and Learning Models for Community ...disi.unitn.it/moschitti/since2013/2017_!PMJ_Romeo_Arabic.pdf · 115 deep learning features (cf. Section 4). 116 Extensive

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artificial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

Deploying Enterprise Deep Learning Masterclass Preview - Enterprise Deep Learning

Deep materials informatics: Applications of deep learning in … · deep learning: † Deep learning requires big data: In many cases, the biggest limiting factor for applying deep

Lecture 1: Introduction to Deep Learning · uva deep learning course –efstratios gavves introduction to deep learning - 1

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

NPDL Global Report - New Pedagogies for Deep Learning · Deep Learning 7 The 6Cs 7 Deep Learning Progressions 9 Impact 16 Key Findings: Deep Learning 18 New Pedagogies 19 Learning