applications of deep learning 25-04-2019...deep learning methods employ multiple processing layers...

Deep Learning: Theory and Practice 25-04-2019 Applications of Deep Learning

Upload: others

Post on 17-Jul-2020

1 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Deep Learning: Theory and Practice

25-04-2019Applications of Deep Learning

Page 2: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Natural Language Processing

https://arxiv.org/abs/1708.02709#

Page 3: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Natural Language Processing

Page 4: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Word Embeddings

Learn a vector representation for each word

Page 5: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Language Modeling

Page 6: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Sentiment Analysis/Summarization

Page 7: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Machine Translation

Page 8: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Architectures

Recurrent Neural Networks

Attention Based Models

Page 9: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Speech Processing

https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/HintonDengYuEtAl-SPM2012.pdf

Page 10: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Speech Recognition

2018

5.3%

Claims of human parity !!!

Page 11: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Speaker Recognition Embedding

Embeddings used for verificationtask.

Page 12: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Speech Enhancement

Removing Noise Using a Supervised Training Mechanism

Page 13: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Architectures

Deep neural networks

Bidirectional LSTM Networks

Page 14: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Image Processing

Page 15: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Object Identification

Page 16: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Object Segmentation

Page 17: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Face Detection

Page 18: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Architectures Commonly Used

Convolutional networks

Resnet Architectures

Page 19: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Future DirectionsUnsupervised and Semi-supervised learning

• How little of labelled data is good enough ? • Transfer Learning Principles

Understanding And Insights Into Deep Networks • Understanding parameters and representations.

Deep Generative Models • Using deep learning for generative modeling

Page 20: Applications of Deep Learning 25-04-2019...Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art

Software ToolsTheano

http://deeplearning.net/software/theano/

PyTorch https://pytorch.org/

TensorFlow https://www.tensorflow.org/

Kaldi http://kaldi-asr.org/

https://pytorch.org/

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

CS 678 – Deep Learning1 Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks

Electro · 2019-01-17 · including carrier networks, internet data centres, high performance computing and deep learning applications. These products will employ Rockley Photonics’

Seeing Deeply and Bidirectionally: A Deep Learning Approach for … · 2018. 8. 28. · Deep learning based methods Some recent works start to employ learning based methods in reﬂection

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning

Deep materials informatics: Applications of deep learning in … · deep learning: † Deep learning requires big data: In many cases, the biggest limiting factor for applying deep

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning

BUILDING GENERALIZATION USING DEEP LEARNING · employ deep learning for cartographic generalizations tasks, es-pecially for the task of building generalization. Most Deep Learn-ing

Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

Deep learning / representation learning

Deep Learning I - Korea Universitydsba.korea.ac.kr/wp/wp-content/seminar/Deep learning/Deep Learning... · Deep Learning I Deep learning is research on learning models with multilayer

Deep Learning for Physical-Layer 5G Wireless …lead to ultra-high power consumption and limited link gains in correlated channels [13]. Here, we employ deep learning in an mmWave

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artiﬁcial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

Deep learning

Deep Learning with H2O - University of Idahostevel/504/Deep Learning with...Deep Learning with H2O. . 4Deep Learning Overview Unlike the neural networks of the past, modern Deep Learning

Introducing Deep Learning with MATLAB - Systematics · Introducing Deep Learning with MATLAB6 Inside a Deep Neural Network ... Deep learning is a subtype of machine learning. With

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

fast.ai - Learning Deep Learning

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

An Introduction to Deep Learning · Deep Learning An Introduction to ... •Deep Learning •Feed Forward Network •Problems of Deep Learning •AutoEncoders •Restricted Boltzmann

Intro to Deep Learning - bpTT Bright Minds … · 17/08/2020 · Intro to Deep Learning Deep Sequence Modeling Deep Computer Vision Deep Generative Modeling Deep Learning Applications

Neural Network for Nanoscience: Scanning Electron ... · Employ deep learning to classify scientific images Integrate a SEM image classifier to provide additional metadata Produce

Hangzhou Deep Learning Meetup-Deep Reinforcement Learning

Deep Learning in real world @Deep Learning Tokyo

Learning Deep Learning

Einführung ins Deep Learning · Einführung ins Deep Learning deep space computing AG 6. Dezember 2019 deep-space.ch

Deep Learning for Generic Object Detection: A Survey · deep learning, probabilistic models, autoencoders, manifold learning, and deep networks 17 Deep learning LeCun et al. (2015)

Deep Metric Learning via Adaptive Learnable Assessmentopenaccess.thecvf.com/content_CVPR_2020/papers/... · ity. To achieve this, we employ an episode-based training scheme [42],

Introducing Deep Learning with MATLAB - MathWorks · Introducing Deep Learning with MATLAB7 How A Deep Neural Network ... relevant features of an image. With deep learning, ... Deep

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Deep Learning for Laser Based Odometry Estimation - …juxi.net/workshop/deep-learning-rss-2016/papers/Nicolai - Deep... · Deep Learning for Laser Based Odometry Estimation ... deep

Lecture 1: Introduction to Deep Learning · uva deep learning course –efstratios gavves introduction to deep learning - 1

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine