multimedia retrieval (dcu 2016)
TRANSCRIPT
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Multimedia Retrieval
Lecturer Xavi Giroacute i Nieto
Version 20161
DocXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Index
1 Motivation
2 Search
3 Navigation
4 Recommendation
5Evaluation
6Adaptation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThe ideal user experience when consuming multimedia contents should ideally fulfill
1 What the user wants
2 When the user wants it
3 How the user wants it
4 Where the user wants it
And the broadcasting architecture poses several limitations in this regard
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation1 What the user wants
TV broadcasters used to choose content
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2 When the user wants it
TV broadcasters and regulators used to choose schedule
Motivation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Index
1 Motivation
2 Search
3 Navigation
4 Recommendation
5Evaluation
6Adaptation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThe ideal user experience when consuming multimedia contents should ideally fulfill
1 What the user wants
2 When the user wants it
3 How the user wants it
4 Where the user wants it
And the broadcasting architecture poses several limitations in this regard
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation1 What the user wants
TV broadcasters used to choose content
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2 When the user wants it
TV broadcasters and regulators used to choose schedule
Motivation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThe ideal user experience when consuming multimedia contents should ideally fulfill
1 What the user wants
2 When the user wants it
3 How the user wants it
4 Where the user wants it
And the broadcasting architecture poses several limitations in this regard
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation1 What the user wants
TV broadcasters used to choose content
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2 When the user wants it
TV broadcasters and regulators used to choose schedule
Motivation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation1 What the user wants
TV broadcasters used to choose content
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2 When the user wants it
TV broadcasters and regulators used to choose schedule
Motivation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2 When the user wants it
TV broadcasters and regulators used to choose schedule
Motivation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation3 How the user wants it
Cellular networks and mobile devices can transport video streams at scalable qualities
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Motivation4 Where the user wants it
The business model based on a diferent television market of each country makes little sense in a globalized world
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationConsumers are replacing audiovisual broadcasting networks for telematic networks based on IP protocols
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
MotivationThere are different techniques to find what the user wants from the metadata of the contents
Search Navigation Recommendation
User Knows
User does not know
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Usuari
Search
Database
bull If the user knows what he wants he has an idea of the desired results
bull Search engines try to answer a user query with the minimum possible interaction
Metadatas
- text- numbers
+info httpenwikipediaorgwikiSemantic_gap
Semantic gap
User query
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search1 Context-based search (eg keyword geolocation date)
Textual query is matched with semantic metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
+info httpwwwshazamcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
E Mohedano Salvador A McGuinness K Giroacute-i-Nieto X OConnor N and Marqueacutes F ldquoBags of Local Convolutional Features for Scalable Instance Searchrdquo in ACM International Conference on Multimedia Retrieval (ICMR) New York City NY USA In Press
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
2Content-based search (visual audio sketch )
Search
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Google Goggles
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Plant retrieval
+info httpleafsnapcom
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
Clothes retrieval
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoScan a beer get a Glooprdquo (2014)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Search2 Content-based search (visual audio sketch )
ldquoShopping with Image Recognitionrdquo (2015)
[+info]
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
PFC Alexander Schmidth amp Laurens de Voos httpbitsearchblogspotcomVideo a httpbitsearchblogspotcom200903event-handlinghtml
bull Example During navigation users follow a path through a data structure built from the content metadata
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Browsing
Web httpupseekupcedugos
+infohttpbitsearchblogspotcomes201201video-browser-showdown-at-multimediahtml
bull Example Tree-based structure based on visual similarity
GOS (Graphical Object Searcher)Winners of Video Browser Showdown 2012
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
RecommendationPersonal Crowd
Automatic (learning)Promotion
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Recommendationbull Online social networks provide training data for learning
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Retrievalrdquo Dublin City University (04042016)
Outline
1 Motivation
2 Search
3 Browsing
4 Recommendation
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi
Im
age
Proc
essi
ng G
roup
s
Uni
vers
itat P
olitegrave
cnic
a de
Cat
alun
ya (U
PC)
Xavier Giro-i-Nieto ldquoMultimedia Annotationrdquo Dublin City University (04042016) 28
Thanks a lot Slides available at
httpsimatgeupceduwebpeoplexavier-giro
DocXavi
ProfessorXavi