Upload File

neural network convolutional with recognition face · 2015-06-03 · using convolutional neural...

  • Home
  • Documents
  • Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition
13
Face recognition with Convolutional Neural Network Martin Vels

Upload: others

Post on 17-Jul-2020

24 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

Face recognition

with Convolutional

Neural NetworkMartin Vels

Page 2: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● Labeled Faces in the Wild (LFW) dataset with 13,233 images, 5749 persons (classes)

● Only using classes with 5 or more samples: 423 classes

● Using Convolutional Neural Network (CNN) to recognize person on the image

Face recognition with CNN

Page 3: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● Face recognition and in general pattern recognition are interesting topic

● My research is related to analyzing video data to find certain patterns

● Video is a sequence of images● Get to know the topic of CNN and use the

knowledge in my research

Motivation

Page 4: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● CNN can achieve really good results on image data

● Sample CIFAR-10 dataset with 60k images and 10 classes achieves <2% error rates

● With LFW dataset, achieving 30% error rate would be reasonable

Goal

Page 5: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● 423 classes, 5985 images, ● median number of images per class: 8,

50% of classes with 5 images, ● most images per class: 530● image size 250x250px● cropping 128x128 from center, resizing to

64x64px● some experiments with grayscale images

LFW Dataset

Page 6: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

LFW Dataset - resizing

Page 7: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● Similar to regular neural network● Basic building block is neuron● Neurons are organized into layers● Various types of layers● Idea is to gradually reduce high

dimensional input and classify the image

Convolutional Neural Network

Page 8: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

http://cs231n.github.io/neural-networks-1/

Neuron - the main building block

Page 9: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

Various types of layers to reduce dimensions

http://cs231n.github.io/convolutional-networks/

ConvNet architecture

Page 10: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● MATLAB toolbox● Implements Convolutional Neural

Networks for computer vision applications● CNN building blocks available as functions● Available freely: http://www.vlfeat.

org/matconvnet/

MatConvNet

http://www.vlfeat.org/matconvnet/
http://www.vlfeat.org/matconvnet/
http://www.vlfeat.org/matconvnet/
Page 11: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

Results

10 classes with at least 50 images per class

32x32 RGB 64x64 grayscale

Page 12: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

Results

423 classes with mostly less than 8 images per class

32x32 RGB 64x64 grayscale

Page 13: Neural Network Convolutional with recognition Face · 2015-06-03 · Using Convolutional Neural Network (CNN) to recognize person on the image Face recognition with CNN Face recognition

● CNN is an interesting and promising tool● Works well with large dataset ● Disappointing results with my dataset

Future ideas:● Use horizontal flipping and cropping from

corners to generate more data● Experiment with different configurations

and parameters

Conclusion


Deep Convolutional Neural Networks (preliminary experiments) · 1. Scanning window + CNN CNN - Outstanding recognition accuracy of holistic image recognition accuracy [Krizhevsky

Face Recognition through Deep Neural Networkweb.eecs.utk.edu/~hqi/deeplearning/lecture07-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song Face Recognition,

Face recognition accuracy of forensic examiners, superrecognizers, and face ... · face recognition. Multiple laboratory-based face recognition tests of these individuals indicate

Face Recognition & Biometric Systems, 2005/2006 Face recognition process

Face detection and recognition - Computer Sciencecs.unc.edu/~lazebnik/spring09/lec22_eigenfaces.pdf · Face detection and recognition Detection Recognition “Sally ... Face Recognition

Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

Emotion Recognition in the Wild via Convolutional Neural ...in machine face recognition have been due to deep Con-volutional Neural Networks (CNN) which require massive amounts of

P-CNN: Pose-based CNN Features for Action Recognition · 2015-09-24 · P-CNN: Pose-based CNN Features for Action Recognition Guilhem Cheron´ y Ivan Laptev Cordelia Schmidy INRIA

Face recognition Face Identification

Deep Face Recognition - csuohio.educis.csuohio.edu/~sschung/CIS660/DeepFaceRecognition_parkhi15.pdfrecent works on face recognition have proposed numerous variants of CNN architectures

FACE RECOGNITION

Face Recognition by Independent Component Analysis … Recognition by Independent... · Face Recognition by Independent Component Analysis ... FACE RECOGNITION BY INDEPENDENT COMPONENT

Face Recognition

Face Recognition CPSC 601 Biometric Course. Topics Challenges in face recognition Face detection Face recognition Advantages and disadvantages

Face Recognition Using PCA and Eigen Face Approachethesis.nitrkl.ac.in/3814/1/Thesis.pdf · Face Recognition Using PCA and Eigen Face ... Face Recognition Using PCA and Eigen Face

Boosting Face in Video Recognition via CNN based Key Frame

A Face Emotion Recognition Method Using Convolutional ... · recognition, a face expression recognition method based on a convolutional neural network (CNN) and an image edge detection

Optimized CNN Based Image Recognition Through Target

Face Recognition CPSC 4600/5600 @ UTC/CSE. 2 Face Recognition Introduction Introduction Face recognition algorithms Face recognition algorithms Comparison

Face and Eye Detection by CNN Algorithmsmpfluege/cs152-FinalProject/Face and Eye... · Face and Eye Detection by CNN Algorithms 499 ... Face recognition as a complex activity can

Gradient-Orientation-Based PCA Subspace for Novel Face Recognition · INDEX TERMS Face recognition, object recognition, pattern recognition. I. INTRODUCTION Face recognition, which

Facial Recognition with Deep Learning...However, the same face recognition system using simple CNN fails significantly when it comes to differentiating Facial Recognition with Deep

Deep Face Recognition - NVIDIA · HERTA Deep Face Recognition GPU-powered face recognition Offices in Barcelona, Madrid, London, Los Angeles Crowds, unconstrained Deep Face Recognition

Gesture Recognition with CNN · 2020-01-28 · Ahmed Abdelghany 20 January 2020 Gesture Recognition with CNN. Outline Motivation for Gesture Recognition Taxonomy of GR ... (2016)