Upload File

fast.ai - learning deep learning

17
Learning Deep Learning fast.ai course Teemu Kurppa - www.teemukurppa.net Head of Cloud , ŌURA - ouraring.com Twitter - @teemu

Upload: teemu-kurppa

Post on 18-Mar-2018

771 views

Category:

Data & Analytics


5 download

Report

TRANSCRIPT

Page 1: fast.ai - Learning Deep Learning

Learning Deep Learningfast.ai course

Teemu Kurppa - www.teemukurppa.net Head of Cloud , ŌURA - ouraring.com Twitter - @teemu

http://www.teemukurppa.net
http://ouraring.com
Page 2: fast.ai - Learning Deep Learning

[email protected]

www.ouraring.com

the world's first wellness ring

Head of Cloud

I work at

mailto:[email protected]?subject=
http://www.ouraring.com
Page 3: fast.ai - Learning Deep Learning

Hype is strongwith this one

Page 4: fast.ai - Learning Deep Learning

A

AI Winters60s70s80s90s

This time it’s different?

Page 5: fast.ai - Learning Deep Learning
Page 6: fast.ai - Learning Deep Learning

Jeremy HowardEntrepreneur & Data Scientist

FastMailfamous email service

Kaggledata science competitions

Enlitic using deep learning for medical imaging

fast.aimaking deep learning accessible to all

Page 7: fast.ai - Learning Deep Learning

fast.ai course - the method

Learn to apply first - learn theory after

7 lessons: - video lectures, 1-2h/each - assignments & reading, +10h/lesson - Kaggle competitions

Page 8: fast.ai - Learning Deep Learning

fast.ai course - Part 1 contentImage Recognition Collaborative Filtering Natural Language Processing

Underfitting Overfitting

Semi-supervised learning CNNs, RNNs, Embeddings

Page 9: fast.ai - Learning Deep Learning

Transfer Learning

Page 10: fast.ai - Learning Deep Learning
Page 11: fast.ai - Learning Deep Learning
Page 12: fast.ai - Learning Deep Learning
Page 13: fast.ai - Learning Deep Learning

Transfer Learning

Finetune this

Reuse this

Page 14: fast.ai - Learning Deep Learning

from vgg16 import Vgg16vgg = Vgg16()

batch_size=64

batches = vgg.get_batches(path+'train', batch_size=batch_size) val_batches = vgg.get_batches(path+’valid’, batch_size=batch_size*2)

vgg.finetune(batches) vgg.fit(batches, val_batches, nb_epoch=1)

vgg.test(path+’test’)

Lesson 1: Code

Gives 97% accuracy (State of the Art 3 years ago 80%)

Page 15: fast.ai - Learning Deep Learning

State of the Art Techniques

2011 Xavier Initialisation2013 VGG2014 Pseudo-labeling2014 Dropout 2015 Batch Normalisation2015 ResNet2016 VGG with Batch Norm (by Jeremy)

Page 16: fast.ai - Learning Deep Learning

AI Garage Helsinki

regular monthly meet-up for programmers learning by doing

Interested?

Page 17: fast.ai - Learning Deep Learning

Thanks!Q&A

Teemu Kurppa - www.teemukurppa.net Head of Cloud , ŌURA - ouraring.com Twitter - @teemu

http://www.teemukurppa.net
http://ouraring.com

Deep Learning for Reinforcement Learning in Pacman · Deep Learning for Reinforcement Learning in Pacman Deep Learning für Reinforcement Learning in Pacman Vorgelegte Bachelor-Thesis

Lecture 1: Introduction to Deep Learning - uvadlc.github.io · Lecture 1: Introduction to Deep Learning Efstratios Gavves. UVA DEEP LEARNING COURSE UVA DEEP LEARNING COURSE –EFSTRATIOS

Introduction to Deep Learning - Computer Graphics€¦ · Introduction to Deep Learning CS468 Spring 2017 Charles Qi. What is Deep Learning? Deep learning allows computational models

arXiv:1801.06146v5 [cs.CL] 23 May 2018 · Universal Language Model Fine-tuning for Text Classification Jeremy Howard fast.ai University of San Francisco [email protected] Sebastian Ruder

Executing Deep Learning Strategies Masterclass Preview - Enterprise Deep Learning

NPDL Global Report - New Pedagogies for Deep Learning · Deep Learning 7 The 6Cs 7 Deep Learning Progressions 9 Impact 16 Key Findings: Deep Learning 18 New Pedagogies 19 Learning

fast.ai - Deep Learning Part 2 (v2) - GitHub...fast.ai: Deep Learning Part 2 (v2) (2018) Lesson 8: Object Detection Outline Welcome to Cutting Edge Deep Learning for Coders, part 2

Deep Learning for Reinforcement Learning in · PDF fileDeep Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning für ... Während

Introduction to Deep Learning - Joyce Hojoyceho.github.io/cs534_s17/slide/25-deep-learning.pdf · Deep Learning: Overview ... Review: Backpropogation https: ... • Deep Learning

Binary Deep Learning - TAUweb.eng.tau.ac.il/.../wp-content/uploads/2017/03/Binary-Deep-Learning.pdf · Binary Deep Learning Deep Learning Seminar, School of Electrical Engineering,

Deep Learning for Laser Based Odometry Estimation - …juxi.net/workshop/deep-learning-rss-2016/papers/Nicolai - Deep... · Deep Learning for Laser Based Odometry Estimation ... deep

Tutorial: Deep Reinforcement Learning - Machine Learning ...hunch.net/~beygel/deep_rl_tutorial.pdfTutorial: Deep Reinforcement Learning - Machine Learning

Deep Learning Lab Course 2017 (Deep Learning …ais.informatik.uni-freiburg.de/teaching/ws17/deep...Deep Learning Lab Course 2017 (Deep Learning Practical) Labs: (Computer Vision)

THE DEEP LEARNING REVOLUTION - Nvidia...THE DEEP LEARNING REVOLUTION Superhuman Breakthroughs in Modern Artificial Intelligence Powered by GPUs JOIN THE DEEP LEARNING ERA DEEP LEARNING

20151216 Computer Vision Meetup Deep Learning Deep Learning - Rene...Deep Learning . René Donner Deep Learning Overview 2 ... coursera ... 20151216 Computer Vision Meetup Deep Learning

From Reinforcement Learning to Deep Reinforcement …fagostin/assets/files/...Keywords: Machine learning · Reinforcement learning Deep learning · Deep reinforcement learning 1 Introduction

An Introduction to Deep Learning · Deep Learning An Introduction to ... •Deep Learning •Feed Forward Network •Problems of Deep Learning •AutoEncoders •Restricted Boltzmann

Tutorial: Deep Reinforcement Learning · Outline Introduction to Deep Learning Introduction to Reinforcement Learning Value-Based Deep RL Policy-Based Deep RL Model-Based Deep RL

Introducing Deep Learning with MATLAB - MathWorks · Introducing Deep Learning with MATLAB7 How A Deep Neural Network ... relevant features of an image. With deep learning, ... Deep

Einführung ins Deep Learning · Einführung ins Deep Learning deep space computing AG 6. Dezember 2019 deep-space.ch

Lecture 3: Deep Learning Optimizations - GitHub Pagesuvadlc.github.io/lectures/nov2019/lecture3.pdf · Lecture 3: Deep Learning Optimizations Deep Learning @ UvA. UVA DEEP LEARNING

Deep Learning for Depth Learning CS 229 Course Project ...cs229.stanford.edu/...DepthLearning_FinalReport.pdf · Deep Learning for Depth Learning CS 229 Course Project, ... Deep Learning

UNSUPERVISED DEEP LEARNING - TAUweb.eng.tau.ac.il/.../uploads/2016/12/Unsupervised-Deep-Learning.pdf · UNSUPERVISED DEEP LEARNING Erez Aharonov Noam Eilon Deep Learning Seminar School

Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks CS 678 – Deep Learning1

Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer

Deep Learning I - Korea Universitydsba.korea.ac.kr/wp/wp-content/seminar/Deep learning/Deep Learning... · Deep Learning I Deep learning is research on learning models with multilayer

Deep Learning - Oxford Statisticspalamara/teaching/SML19/HT19_lecture15.pdf · SB2b/SM4 - Deep Learning Deep Learning Infrastructure! Computational Infrastructure critical to deep

Deep materials informatics: Applications of deep learning in … · deep learning: † Deep learning requires big data: In many cases, the biggest limiting factor for applying deep

Deep Learning: An Introduction from the NLP Perspective Deep Learning - An...Deep Learning Approach 1 Deep Learning Approach 2 Disclaimer I am not (yet) an expert in Deep Learning

Deep Learning for Generic Object Detection: A Survey · deep learning, probabilistic models, autoencoders, manifold learning, and deep networks 17 Deep learning LeCun et al. (2015)

Deep Learning - South Dakota State UniversityDeep Learning Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a branch of machine

Mapping land use and land cover changes faster and at ...€¦ · the cloud. On the deep learning model training side, we’re using Dynamic UNetfrom Fast.ai. Fast.aiis a deep learning

Learning Deep Learning

Intro to Deep Learning - bpTT Bright Minds … · 17/08/2020  · Intro to Deep Learning Deep Sequence Modeling Deep Computer Vision Deep Generative Modeling Deep Learning Applications

CS 678 – Deep Learning1 Deep Learning Early Work Why Deep Learning Stacked Auto Encoders Deep Belief Networks