Upload File

imagenet classification using binary convolutional neural...

  • Home
  • Documents
  • ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks
13
XNOR-Net ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari Vicente Ordonez Joseph Redmon Ali Farhadi Presentation by Naveen

Upload: others

Post on 16-Aug-2020

18 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

XNOR-NetImageNet Classification Using Binary

Convolutional Neural Networks

Mohammad Rastegari Vicente OrdonezJoseph Redmon

Ali Farhadi

Presentation by Naveen

Page 2: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Deep Neural Networks are Complicated(And Huge!)

Remember HW2 - Size of AlexNet?

Page 3: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

CPU vs GPU

SmallWeak

Scrawny

BigStrong

Powerful

Page 4: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Possible ApproachesShallow Approximation Compression

Page 5: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Binary-Weights Network

Basic Idea: Too much information in each convolutional layer. Can we store less?

Page 6: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

I * W ~ (I W) a~

I = Input TensorW = Weightsa = scaling factor

Binary-Weights Network

Page 7: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Training

Binarize weights in forward pass and backward

propagation

Use real valued weights in gradient descent (Why?)

Also, if we are using real valued weights somewhere, what’s the

point?!

Page 8: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

XNOR-Net

Page 9: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Training

BinActivComputes the K and sign(I)

BinConvPerform earlier Binary

Convolution

Page 10: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Experiments

Efficiency

58x CPU Speedups

Page 11: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

ExperimentsAccuracy

Cifar-10

Binary-Weight Network: 9.88% Error XNOR-Net: 10.17% Error

Page 12: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

ExperimentsAccuracy

Page 13: ImageNet Classification Using Binary Convolutional Neural ...vicente/recognition/2016/presentations/xnornet.pdfImageNet Classification Using Binary Convolutional Neural Networks

Questions?


Interpreting Adversarially Trained Convolutional Neural ...Interpreting Adversarially Trained Convolutional Neural Networks shuffled images, then evaluate the classification accuracy

TEX-Nets: Binary Patterns Encoded Convolutional Neural ...€¦ · TEX-Nets: Binary Pa‡erns Encoded Convolutional Neural Networks for Texture RecognitionICMR ’17, , June 6–9,

A Convolutional Transformation Network for Malware ...convert binary executables into color images that convey the semantics of the binary data. We develop a Convolutional Transformation

Advancements in Image Classification using Convolutional

Syndrome decoding of binary convolutional codes · Syndrome decoding of binary convolutional codes Citation for published version (APA): ... ity of a Viterbi like syndrome decoder

ImageNet Classification with Deep Convolutional Neural ...usman/courses/cs675_summer20/...ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky University

ImageNet Classification with Deep Convolutional Neural …hinton/absps/imagenet.pdf · ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky ... and 17.0%

Complex Network Classification with Convolutional Neural Network · 2019. 4. 25. · Complex Network Classification with Convolutional Neural Network Ruyue Xin1, Jiang Zhang1,*,

Convolutional Neural Networks for Fashion Classification

Implementation of Binary and Ternary Convolutional Codes

Deep Convolutional Neural Networks for the Classification ...users.ics.forth.gr/tsakalid/PAPERS/CNFRS/2017-EI1-Kfot.pdf · Deep Convolutional Neural Networks for the Classification

Traffic sign classification with deep convolutional neural ...publications.lib.chalmers.se/records/fulltext/238914/238914.pdf · Traffic sign classification with deep convolutional

Local Binary Convolutional Neural Networksopenaccess.thecvf.com/content_cvpr_2017/papers/Juefei-Xu... · 2017-05-31 · Local Binary Convolutional Neural Networks Felix Juefei-Xu

Bi-GCN: Binary Graph Convolutional Network

Convolutional Neural Networks for Font Classification

Steel Defect Classification with Max-Pooling Convolutional

3D model classification using convolutional neural networkcs229.stanford.edu/proj2015/146_report.pdf · 2017-09-23 · 3D model classification using convolutional neural network

Binary Convolutional Codes with Application to Magnetic - NativeI

Age and Gender Classification Using Convolutional …openaccess.thecvf.com/content_cvpr_workshops_2015/W08/...Age and Gender Classification using Convolutional Neural Networks Gil

ImageNet Classification with Deep Convolutional Neural Networks

ImageNet Classification with Deep Convolutional Neural ...fritz/absps/imagenet.pdf · ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky University of

Object Classification using 3D Convolutional Neural Networkspublications.lib.chalmers.se/records/fulltext/249371/... · 2017-05-17 · Object Classification using 3D Convolutional

ImageNet Classification with Deep Convolutional Neural ... · ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky University of Toronto [email protected]

Convolutional Generative Adversarial Networks with Binary

Convolutional Neural Networks arXiv:1603.05279v1 … · XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari y, Vicente Ordonez , Joseph

Tiny ImageNet Classification with Convolutional …cs231n.stanford.edu/reports/2015/pdfs/leonyao_final.pdfTiny ImageNet Classification with Convolutional Neural Networks Leon Yao,

Skin Lesions Classification Using Convolutional Neural ... · Skin Lesions Classification Using Convolutional Neural Networks in Clinical Images Danilo Barros Mendes * ... scale,

Local Binary Convolutional Neural Networks - arXiv · PDF filemotivated by local binary patterns (LBP). ... local binary convolutional neural networks (LBCNN)1, have much lower model

DeepSentiBank: Visual Sentiment Concept Classification with ... · DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks Tao Chen1, Damian

Circulant Binary Convolutional Networks: Enhancing …openaccess.thecvf.com/content_CVPR_2019/papers/Liu...Circulant Binary Convolutional Networks: Enhancing the Performance of 1-bit

Breast Cancer Histopathological Image Classification using ... · Breast Cancer Histopathological Image Classification using Convolutional Neural Networks Fabio A. Spanhol, Luiz

Behavioral Malware Classification using …spiros/papers/malcon2018a.pdfBehavioral Malware Classification using Convolutional Recurrent Neural Networks Bander Alsulami Drexel University

XNOR-Net: ImageNet Classification Using Binary ...ai2-website.s3.amazonaws.com/publications/XNOR-Net.pdf · XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

Food Image Classification with Convolutional Neural Networks

ImageNet Classification with Deep Convolutional Neural …kriz/imagenet_classification_with_deep_convolutional.pdfImageNet Classification with Deep Convolutional Neural Networks