Upload File

what convnets look at when they look at nudity

  • Home
  • Science
  • What convnets look at when they look at nudity
65
What convnets look at when they look at nudity Ryan Compton [email protected]

Upload: ryan-compton

Post on 25-Jan-2017

287 views

Category:

Science


0 download

Report

TRANSCRIPT

Page 1: What convnets look at when they look at nudity

What convnets look at when they look at nudity

Ryan [email protected]

Page 2: What convnets look at when they look at nudity

Disclaimer

Please be advised that this presentation may contain content which some viewers may find offensive.

Page 3: What convnets look at when they look at nudity

Disclaimer

Please be advised that this presentation may contain content which some viewers may find offensive.

Page 4: What convnets look at when they look at nudity

API Demo

Page 5: What convnets look at when they look at nudity

1996

Page 6: What convnets look at when they look at nudity
Page 7: What convnets look at when they look at nudity
Page 8: What convnets look at when they look at nudity
Page 9: What convnets look at when they look at nudity
Page 10: What convnets look at when they look at nudity
Page 11: What convnets look at when they look at nudity
Page 12: What convnets look at when they look at nudity

Eventually someone will get real good at feature engineering and the problem will be solved, right?

Page 13: What convnets look at when they look at nudity

Fast-forward: CNNs

Page 14: What convnets look at when they look at nudity

SFW training data

Page 15: What convnets look at when they look at nudity

SFW training data

Learned low-dimensional representations are rich in semantic information

Page 16: What convnets look at when they look at nudity
Page 17: What convnets look at when they look at nudity

But How?

Page 18: What convnets look at when they look at nudity

SFW training data

Page 19: What convnets look at when they look at nudity

NSFW training data

Page 20: What convnets look at when they look at nudity

convnet

Demo network for this talk (modified ZF net):

5 convolutional layers3 fully-connected layers2 softmax outputs (‘sfw’ and ‘nsfw’)

Page 21: What convnets look at when they look at nudity

Train Test

Page 22: What convnets look at when they look at nudity

Train Test

Publish

Page 23: What convnets look at when they look at nudity

Train TestDeploy to prodand everything breaks

Page 24: What convnets look at when they look at nudity

And how does it do that?

Page 25: What convnets look at when they look at nudity

Occlusion Experiment

Page 26: What convnets look at when they look at nudity

Occlusion Experiment

Page 27: What convnets look at when they look at nudity
Page 28: What convnets look at when they look at nudity

Deconvolutional Networks

• Provides way to map activations at high layers back to the input

• Same operations as Convnet, but in reverse:– Unpool feature maps– Convolve unpooled maps

• Filters copied from Convnet

– Used here purely as a probe– Originally proposed as unsupervised learning

method– No inference, no learning Input Image

Convolution (learned)

Unpooling

Feature maps

Non-linearity

[Zeiler et al. CVPR’10, ICCV’11]

Page 29: What convnets look at when they look at nudity
Page 30: What convnets look at when they look at nudity

Wavelets, curvelets, framelets, shapelets, shearlets...

Page 31: What convnets look at when they look at nudity

Reversible Max Pooling

Pooled Feature Maps

MaxLocations“Switches”

Pooling Unpooling

Feature MapReconstructed Feature Map

Page 32: What convnets look at when they look at nudity

Reuse Feedforward Switches

Page 33: What convnets look at when they look at nudity

2014

Page 34: What convnets look at when they look at nudity

First Layer

Image from Zeiler, Matthew D., and Rob Fergus. "Visualizing and understanding convolutional networks." European Conference on Computer Vision. Springer International Publishing, 2014.

Page 35: What convnets look at when they look at nudity

Second Layer

Page 36: What convnets look at when they look at nudity

Third Layer

Page 37: What convnets look at when they look at nudity

Fourth Layer

Page 38: What convnets look at when they look at nudity

Fifth Layer

Page 39: What convnets look at when they look at nudity

conv1

Page 40: What convnets look at when they look at nudity

conv2

Page 41: What convnets look at when they look at nudity

conv3

Page 42: What convnets look at when they look at nudity

conv4

Page 43: What convnets look at when they look at nudity

conv5

Page 44: What convnets look at when they look at nudity

fc8

Page 45: What convnets look at when they look at nudity

https://en.wikipedia.org/wiki/Lenna

Lenna or Lena is the name given to a standard test image widely used in the field of image processing since 1973.[1] It is a picture of Lena Söderberg, shot by photographer Dwight Hooker, cropped from the centerfold of the November 1972 issue of Playboy magazine.

https://en.wikipedia.org/wiki/Lenna
https://en.wikipedia.org/wiki/Lenna
Page 46: What convnets look at when they look at nudity

fc8

Page 47: What convnets look at when they look at nudity

fc8

Page 48: What convnets look at when they look at nudity

fc8

Page 49: What convnets look at when they look at nudity

fc8

Page 50: What convnets look at when they look at nudity

fc8

Page 51: What convnets look at when they look at nudity
Page 52: What convnets look at when they look at nudity

Oh and safe stuff too...

Page 53: What convnets look at when they look at nudity
Page 54: What convnets look at when they look at nudity

The Future...

Page 55: What convnets look at when they look at nudity

Context matters

Page 56: What convnets look at when they look at nudity

Context matters

Page 57: What convnets look at when they look at nudity

Context matters

Page 58: What convnets look at when they look at nudity

Context matters

Page 59: What convnets look at when they look at nudity

Customization matters (demo)

Page 60: What convnets look at when they look at nudity

Clarifai Research

Research

Page 61: What convnets look at when they look at nudity

Data and Research

Data Science● Collect data● Improve

Models

Research● Solve problems

we don’t have solutions for today

Page 62: What convnets look at when they look at nudity

What about data?

Datasets● 100+ datasets● Almost every

vertical where there are images and videos

Data● 1B+ labelled

images● 1M+ labelled

videos

Page 63: What convnets look at when they look at nudity

The Data / Research Team

You

clarifai.com/jobs

Page 64: What convnets look at when they look at nudity

Some common questions:

What about publishing?

Can I work remotely?

Page 65: What convnets look at when they look at nudity

Research Collaborations: How to Apply?

Where: [email protected]: ● Name● School● Year in Program● Professor● Current Focus + Future Interests● ResumeWhen: Accepting Applications Now!


Looks – About The Nudity In Black, White And Color 01

Lecture 6: Convnets for object detection and segmentation · uva deep learning course –efstratios gavves convnets for object detection, segmentation and structured outputs - 6 o

Deep Fried Convnets

1965 Mar. - Fashion Evolution in Guam: From Nudity to Jeans

Fast ConvNets with fbfft...Fast ConvNets with fbfft A GPU Performance Evaluation Facebook AI Research Nicolas Vasilache, Jeff Johnson, Michael Mathieu, Soumith Chintala, Serkan Piantino,

Lecture 5: Modern ConvNets - GitHub PagesPicture credit: Bharath Raj UVA DEEP LEARNING COURSE –EFSTRATIOS GAVVES MODERN CONVNETS - 15 o Multiple kernel filters of different sizes

Lecture 37: ConvNets (Cont’d) and Training...ConvNets (e.g. [Krizhevsky 2012]) overfit the data. E.g. 224x224 patches extracted from 256x256 images Randomly reflect horizontally

Deformation Modeling in ConvNets - Objects365 · •Regular ConvNets can model geometric variations to some extent. •By introducing deformable convolution & deformable RoI pooling,

Do Convnets Learn Correspondence?papers.nips.cc/paper/5420-do-convnets-learn-correspondence.pdf · Do Convnets Learn Correspondence? ... combine a weak spatial model with deep learning

Cultural Event Recognition with Visual ConvNets and ... · Cultural Event Recognition with Visual ConvNets and Temporal Models Amaia Salvador*, Matthias Zeppelzauer**, Daniel Manchon-Vizuete´

ELEC 576: Understanding and Visualizing Convnets ......ELEC 576: Understanding and Visualizing Convnets & Introduction to Recurrent Neural Networks Ankit B. Patel Baylor College of

Lecture 5: Understanding Convnets and Knowledge Transfer · right make the convnet see a “BMW i6 ... COURSE –EFSTRATIOS GAVVES UNDERSTANDING CONVNETS AND KNOWLEDGE TRANSFER -

Expose : Nudity

4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networksopenaccess.thecvf.com/content_CVPR_2019/papers/Choy_4D... · 2019-06-10 · 4D Spatio-Temporal ConvNets: Minkowski

How ConvNets See + Applicationsguerzhoy/321/lec/W07/HowConvNetsSee.pdfUnderstanding How ConvNets See CSC321: Intro to Machine Learning and Neural Networks, Winter 2016 Michael Guerzhoy

XX - Surreal Images - some nudity

Predicting Weather Uncertainty with Deep Convnets · Predicting Weather Uncertainty with Deep Convnets Peter Grönquist ETH Zürich [email protected] Tal Ben-Nun ETH Zürich

4D Spatio-Temporal ConvNets: Minkowski Convolutional ......S′′ ′′ ′ ′

WHEN THE LOIN CLOTH DROPPED Nudity among the · PDF fileWHEN THE LOIN CLOTH DROPPED Nudity among the Greeks ... nudity, as in this shard ... Is it a boy or a man, one might ask

Observer Localization using ConvNets - Stanford Universitykipnisal/Papers/CS231n_project.pdf · approach that is not based on ConvNets. We note that a ge-olocalization problem is

Cultural Event Recognition with Visual ConvNets and Temporal Models

Convolutional Neural Networks (CNNs / ConvNets)web.stanford.edu/class/cs379c/archive/2018/class...Convolutional Neural Networks (CNNs / ConvNets) Convolutional Neu ral Networks are

Wes Mills and Nudity

Deformable ConvNets V2: More Deformable, Better Results

ConvNets and ImageNet Beyond Accuracy: Understanding ...€¦ · ConvNets and ImageNet have driven the recent success of deep learn-ing for image classification. However, the marked

[Warning - This film contains nudity and references to drugs]

Looks – About The Nudity In Black, White Ande Color 02

Very Deep ConvNets for Large-Scale Image Recognitionkaren/pdf/ILSVRC_2014.pdf · Very Deep ConvNets for Large-Scale Image Recognition Karen Simonyan, Andrew Zisserman Visual Geometry

ConvNets for NLP

Nudity in Greek Roman Art - Discuss Education on the OCR ...social.ocr.org.uk/files/ocr/Carrie_Vout_Session_4_presentation.pdf · Nudity in Greek & Roman Art Dr Caroline Vout, Faculty

Automatic Detection of Images Containing Nudity

Robo-Nanny: ConvNets for Intelligent Baby Monitoringcs231n.stanford.edu/reports/2017/pdfs/13.pdf · Robo-Nanny: ConvNets for Intelligent Baby Monitoring Lily Cheng - June 2017 Stanford

Ama - The Pearl Diving Mermaids of Japan (Warning: Nudity) - Gakuranman

COVID-19 Diagnosis from Cough Acoustics using ConvNets and

The Pioneer Plaque (*WARNING - features drawings of nudity*)