1. NIPS2013@, 2014-01-23DeViSE:A Deep Visual-Semantic Embedding Model Preferred Infrastructure

2. l l @beam2d Preferred Infrastructure Jubatus l l: @: : (2)2 3. DeViSE: A Deep Visual-Semantic Embedding Model Andrea Frome*, Greg S. Corrado*, Jonathon Shlens*, Samy Bengio, Jeffrey Dean, MarcAurelio Ranzato, Tomas Mikolov. (Google, Inc.) *These authors contributed equally. l l lCurrent affiliation: Facebook, Inc.Zero-shot learning Deep Convolutional Neural Netword2vec Deep CNN 3 4. Zero-shot learning l l l l llx y (x, y) Ytrain Ytest YtrainYtest = ; 4 5. Zero-shot learning l l l semantic knowledge Wikipedia lCf.) R. Socher+, Zero-Shot Learning Through Cross-Modal Transfer, ICLR2013 lzero-shot learning2008 (e.g. H. Larochelle+, Zero-data Learning of New Tasks, AAAI2008) 5 6. Supervision lILSVRC2012Supervision l5CNN+2+softmax 1SupervisionDeViSESupervision DistBelief6 7. word2vec lGoogle SkipGram: MLPlNIPS: T. Mikolov+, Distributed Representations of Words and Phrases and their Compositionality, NIPS2013l Cf.) https://plus.google.com/107334123935896432800/posts/JvXrjzmLVW4 7 8. DeViSE Deep CNN (Supervision) 8Softmax layer 9. DeViSE Deep CNN (Supervision)SkipGram (word2vec)9 10. DeViSE Deep CNN (Supervision) SkipGram (word2vec)1.Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, T. Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013. 10 11. DeViSE Deep CNN (Supervision)Hinge rank lossSkipGram (word2vec)1.Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, T. Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013. 11 12. DeViSE Deep CNN (Supervision) word2vec 12 13. 1.Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, T. Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013. 13 14. 1.Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, T. Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013. 14 15. : convex combination of semantic embeddings (ConSE) lM. Norouzi+, Zero-Shot Learning by Convex Combination of Semantic Embeddings, ArXiv 1312.5650v2 ICLR2014 (open review)Supervisiontop-k zero-shot label lDeViSE 15 16. ll l lZero-shot learning(semantic knowledge) DeViSE: Deep CNNword2veczero-shot learning ConSE semantic knowledge16 17. 1.Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, T. Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013.2.A. Krizhevsky, I. Sutskever, G. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. NIPS 2012.3.H. Larochelle, D. Erhan, Y. Bengio. Zero-data Learning of New Tasks. AAAI 2008.4.M. Norouzi, T. Mikolov, S. Bengio, Y. Singer, J. Shlens, A. Frome, G. S. Corrado, J. Dean. Zero-Shot Learning by Convex Combination of Semantic Embeddings. ArXiv 1312.5650.5.R. Socher, M. Ganjoo, H. Sridhar, O. Bastani, C. D. Manning, A. Y. Ng. Zero-Shot Learning Through Cross-Modal Transfer. ICLR 2013.17