Multimodal Deep Learning - Max-Planck-Institut fr ... Deep Learning Zeynep Akata Zero-Shot Learning Latent Embeddings for Zero-Shot Image Classication Xian et.al., CVPR16 CVPR17
Post on 06-May-2018
Multimodal Deep LearningZeynep AkataZero-Shot LearningLatent Embeddings for Zero-Shot Image ClassificationXian et.al., CVPR16 & CVPR17WLarge errorWWLinear compatibility function: large errors (left).Piecewise-linear: significantly improves results (right).Multi-Cue Zero-Shot Learning with Strong SupervisionAkata et.al., CVPR16ClassEmbeddingFImageEmbeddingBlue Jay Albatrossblacklong tailbluecone beakAttributes: costly but good, W2V: cheap but weak.Strong visual supervision: to compensate weak W2V.Learning Deep Representations of Fine-Grained VisualDescriptions Reed et.al., CVPR162 4 6 8 10# of train sentences per image30354045505560Top-1 Acc. (in %)Zero-Shot in CUBOurs (word)Ours (char)LSTMTCNNAttributesCNN-RNN: fast + models sequence of words or charactersWith >4 sentences: outperforms SoA with attributesGaze Embeddings for Zero-Shot Image ClassificationKaressli et.al., CVPR17Original image Gaze pointsGaze Features with Grid (GFG)Gaze histogram (GH)00000021322Raw gaze data02200130020Gaze Features without Grid (GFS)GH Embedding per classGFS Embedding per classGaze heatmapOutlierremovalGaze data collectionGFG Embedding per class+xy123d...x 9+xyd...x 3123Generating: Vision + LanguageGenerarive Adversarial Text to Image SynthesisReed et.al. ICML16GAN conditioned on sentences: real/fake, matching/nota tiny bird, with a tiny beak, tarsus and feet, a blue crown, blue coverts, and black cheek patchthis small bird has a yellow breast, brown crown, and black superciliaryan all black bird with a distinct thick, rounded bill.this bird is different shades of brown all over with white and black spots on its head and backGAN - CLSGAN - INTGANGAN - INT- CLSthe gray bird has a light grey head and grey webbed feetGTGenerates pixels from characters: intuitiveLanguage compensates lack of large # training imagesLearning What and Where to Draw Reed et.al. NIPS16This bird has a yellow head, black eyes, a gray pointy beak and orange lines on its breast.This water bird has a long white neck, black body, yellow beak and black head.This bird is large, completely black, with a long pointy beak and black eyes.This bird is completely red with a red and cone-shaped beak, black face and a red nape.This white bird has gray wings, red webbed feet and a long, curved and yellow beak.This small bird has a blue and gray head, pointy beak and a white belly.GTGTGTGTGTGTGenerating Visual Explanations Hendricks et.al. ECCV16D: this bird has a white breast black wings and a red spot on its head.E: this is a white bird with a black wing and a black and white striped head.D: this bird has a white breast black wings and a red spot on its head.E: this is a black and white bird with a red spot on its crown.This is a Downy Woodpecker because... This is a Downy Woodpecker because...Class + image conditional LSTM & Reinforcement LossLearns to mention class-specific and visible properties
View more >
Max-Margin Zero-Shot Learning for Multi-class Classi tud51700/pdfs/aistats15a.pdf Max-Margin Zero-Shot
Deep Learning in Remote Sensing Image Classication ? Deep Learning in Remote Sensing Image Classication
Multimodal Deep Learning - Ml Deep Learning ... learning sound representation from videos. ... joint learning of images and tags Image captioning: ...
Deep Multiple Instance Learning for Image Classification Multiple Instance Learning for Image Classication and Auto-Annotation ... tasks like classication and detection. However, ... recognition , image
Calorimetry with Deep Learning: Particle Classication ... ? Calorimetry with Deep Learning: Particle
Deep Learning for Reinforcement Learning in Learning for Reinforcement Learning in ... Deep Learning for Reinforcement Learning in Pacman Deep Learning fr ... Whrend Q-learning enttuschende ...
Deep Learning I - Korea learning/Deep Learning...Deep Learning I Deep learning is research on learning models with multilayer ... Application for Baduk Figure 6. Image Identification ... Deep Learning I
DEEP LEARNING FOR IMAGE CLASSIFICATION - LEARNING FOR IMAGE CLASSIFICATION ... Deep Image: Scaling up Image Recognition ... Image Classification, ...
Active Transfer Learning With Zero-Shot Priors: Reusing ... Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks E. Gavves QUVA Lab, University of Amsterdam T. Mensink University ...