presenting knowledge on the semantic weblynda/talks/2006/microsoftjun06.pdfsemantic graph to...

10

1 Presenting Knowledge on the Semantic Web Lynda Hardman Semantic Media Interfaces Jacco van Ossenbruggen Frank Nack http://media.cwi.nl

Upload: others

Post on 26-Sep-2020

2 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

1

Presenting Knowledgeon the Semantic Web

Lynda HardmanSemantic Media Interfaces

Jacco van OssenbruggenFrank Nack

http://media.cwi.nl

Page 2: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

2

Long-term goal• Develop knowledge-intensive models and document

processing technologies that are able to:

generate coherent multimedia presentations tailored to an individual user

taking into account their preferences, abilities, device capabilities and environment.

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Page 3: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

3

Semantic graph to presentation

Semantic graph to presentation

• DISC• Rijksmuseum repository of media items• Semantic graph is not enoughRembrandt married-to Saskiaalso need discourse structuresfor deriving grouping, ordering and priorities

• Biography template createdpainter is-a profession

• Stefano Bocconi, Joost GeurtsISWC 2003

Page 4: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

4

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s

Argument generation in video

Page 5: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

5

Argument generation in video• Vox Populi• Database of video clips• Annotated with topic and agree/disagree• Argumentation model (Toulmin)• User specifies query and video sequence

generated

• Stefano Bocconi,ICME 2005

AmsterdamHypermedia

Model

Cuypers

Topia,DISC

Vox Populi

From syntax to semantics

TimeSyn

tax

Sem

antic

s /facet

Page 6: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

6

MultimediaN Eculture

• Collection of vocabularies in RDF:– AAT, ULAN, TGN

• Artchive images• Interface for searching and browsing

http://eculture.multimedian.nl

Partners:– Guus Schreiber, VU; Bob Wielinga & Jan Wielemaker, UvA– Jos Baeten, DEN (Digitale Erfgoed Nederland)

Eculture advanced search interface

Page 7: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

7

Eculture search result – monet

Eculture facet browsing –post-impressionist artist

Page 8: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

8

Eculture single artist

Eculture single styled artist

Page 9: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

9

Challenges

• Making (multimedia) discourse and design knowledge explicit

• Expressing re-usable semantics of media assets

• Designing architectures for multimedia presentation generation

W3C Multimedia Semantics XG• Use Semantic Web technologies to integrate existing

multimedia metadata standards• Demonstrate the added value of formal semantics• Provide best practices for annotating and using multimedia

content on the Web

http://www.w3.org/2005/Incubator/mmsem/

Public mailing list:http://lists.w3.org/Archives/Public/public-xg-mmsem/

Page 10: Presenting Knowledge on the Semantic Weblynda/talks/2006/MicrosoftJun06.pdfSemantic graph to presentation Semantic graph to presentation •DISC • Rijksmuseum repository of media

10

This research is supported by

• NWO I2RPIntelligent Information Retrieval and Presentation

• NWO NASHNetworked Adaptive Structured Hypermedia

• MultimediaN Eculture

• Images courtesy of Rijksmuseum, Amsterdam

Dual Graph Convolutional Network for Semantic Segmentation ... · Dual Graph Convolutional Network for Semantic Segmentation Li Zhang* 1 [email protected] Xiangtai Li*2 [email protected]

Visual-Semantic Graph Attention Networks for Human-Object

Semantic Data Management in Graph Databases

Learning Semantic Entity Representations with Knowledge Graph … · 2018-01-04 · Learning Semantic Entity Representations with Knowledge Graph and Deep Neural Networks and its

Semantic Mining based on graph theory and ontologies. Case ... · Semantic Mining based on graph theory and ontologies. Case Study: Cell Signaling Pathways ... using knowledge bases

Semantic Object Parsing with Graph LSTM · 2017. 8. 25. · Semantic Object Parsing with Graph LSTM 127 Fig.2. The proposed Graph LSTM structure. (1) The top row shows the traditional

Weakly Supervised Graph Based Semantic Segmentation by Learning Communities … · · 2015-10-24Weakly supervised graph based semantic segmentation by learning communities of image-parts

Towards Semantic Network Models via Graph …chesteve/ppt/EWSDN15-Semantic...Towards Semantic Network Models via Graph Databases for SDN Applications 1-Oct 2015, Bilbao, Spain Agenda

Community Detection Using Graph Structure and Semantic ...kartiks2/community_detection.pdf · Community Detection Using Graph Structure and Semantic Understanding of Text Kartik Sawhney

Multimedia for the Semantic Weblynda/talks/2000/SemWeb00.pdfSMIL in 3 mins (part of) media item Content Spatial layout Links source and destination Alternative content bandwidth task

Towards Multi-Semantic Image Annotation with Graph ...research.lenovo.com/~yongrui/ps/mm2011.pdf · Towards Multi-Semantic Image Annotation with Graph Regularized Exclusive Group

BioGrakn: A Knowledge Graph-Based Semantic Database for ...klarman.me/academic-work/resources/MesEtAlCISIS17.pdf · BioGrakn: A Knowledge Graph-based Semantic Database for Biomedical

Graph-RISE: Graph-Regularized Image Semantic Embedding · Graph-RISE: Graph-Regularized Image Semantic Embedding Da-Cheng Juan, Chun-Ta Lu, Zhen Li, Futang Peng, Aleksei Timofeev,

Graph-Based Semantic Web Service Composition …downloads.hindawi.com/journals/jhe/2017/4271273.pdfResearch Article Graph-Based Semantic Web Service Composition for Healthcare Data

Oracle® Spatial and Graph RDF Semantic Graph Developer’s Guide 12c … · 2016-02-19 · Oracle® Spatial and Graph RDF Semantic Graph Developer’s Guide 12c Release 1 – Graph

Spatial Pyramid Based Graph Reasoning for Semantic Segmentation · 2020. 6. 29. · Spatial Pyramid Based Graph Reasoning for Semantic Segmentation Xia Li1,2,4,* Yibo Yang3,4,* Qijie

The Enterprise Semantic Graph - MicroStrategy

Semantic Object Parsing with Graph LSTMusers.eecs.northwestern.edu/~xsh835/assets/eccv2016... · 2016-08-22 · Semantic Object Parsing with Graph LSTM 3 RowLSTM Diagonal BiLSTM Local-Global

A semantic dependency-graph-based approach …worldcomp-proceedings.com/proc/p2013/SWW2807.pdfA semantic dependency-graph-based approach combining platforms hosting data and applications

node2hash: Graph Aware Deep Semantic Text Hashing

3D Graph Neural Networks for RGBD Semantic Segmentationurtasun/publications/qi_etal_iccv17.pdf · 3D Graph Neural Networks for RGBD Semantic Segmentation Xiaojuan Qi yRenjie Liaoz;x

Community detection in semantic graph

3D Graph Neural Networks for RGBD Semantic Segmentationopenaccess.thecvf.com/content_ICCV_2017/papers/Qi_3D_Graph_Neu… · 3D Graph Neural Networks for RGBD Semantic Segmentation

Complexity and Scalability in Semantic Graph Analysis...Semantic Graph Databases • Designed for irregular data –Graph based, not table based • Ontologies are used instead of

Spatial Pyramid Based Graph Reasoning for Semantic ...openaccess.thecvf.com/.../Li_Spatial_Pyramid_Based_Graph_Reasoni… · Spatial Pyramid Based Graph Reasoning for Semantic Segmentation

Semantic Graph Databases: The Evolution of Relational Databases

Semantic Web, Knowledge Graph, and Other Changes to SERPS – A Google Semantic Timeline

Semantic web and information graph

Graph Mining: Applications - stuba.sk · •Semantic information from Google Knowledge Graph •Structural (network) features from Related Places Graph •places connected according

Presenting Knowledge on the Semantic Weblynda/talks/2006/BTJan06.pdfSemantic graph to presentation •DISC • Rijksmuseum repository of media items • Semantic graph is not enough

Graph-RISE: Graph-Regularized Image Semantic Embedding · 2019-03-01 · Graph-RISE: Graph-Regularized Image Semantic Embedding Woodstock ’18, June 03–05, 2018, Woodstock, NY

GHashing: Semantic Graph Hashing for Approximate

SelfSAGCN: Self-Supervised Semantic Alignment for Graph ......SelfSAGCN: Self-Supervised Semantic Alignment for Graph Convolution Network Xu Yang1, Cheng Deng1∗, Zhiyuan Dang1, Kun

Graph Databases and the Semantic Web

RDF Semantic Graph Developer's Guide - Oracle · Oracle® Spatial and Graph RDF Semantic Graph Developer's Guide 18c E84309-02 June 2018