marklogic user group - best of mlw and search + semantics

59
<presentation/> <presenter>Matt Turner</presenter> <title>Chief Technologist, Media Solutions</title>

Upload: matt-turner

Post on 12-May-2015

1.045 views

Category:

Technology


1 download

DESCRIPTION

Live on stage at the MarkLogic User Group London, Matt Turner, MarkLogic's Chief Technologist for Media Solutions, will attempt to channel the groundbreaking, innovative and amazing topics from the recent MarkLogic World conference. Hear the mission impossible project stories, see the great customer apps and (if all goes well) get a first hand look at some of the new MarkLogic features.

TRANSCRIPT

Page 1: MarkLogic User Group - Best of MLW and Search + Semantics

<presentation/>

<presenter>Matt Turner</presenter><title>Chief Technologist, Media Solutions</title>

Page 2: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 2 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

<MLUGL><intro/><talk>

<bit>Mission Impossible</bit><story>Wiley</story><story>Springer</story><story>Mitchell1</story>

<bit>Search and Semantics<bit><demo>Old Skool</demo>

</talk></MLUGL>

Page 3: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 3 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Mission(s) Impossible

Page 4: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 4 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

<story>http://www.marklogic.com/resources/slides-gearing-up-for-the-content-factory-to-quickly-create-innovate-and-monetize/</story>

Page 5: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 5 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 6: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 6 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 7: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 7 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 8: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 8 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 9: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 9 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 10: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 10 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 11: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 11 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

<story>http://www.marklogic.com/resources/betting-the-company-how-springer-successfully-insourced-its-flagship-content-platform/</story>

Page 12: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 12 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 13: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 13 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 14: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 14 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 15: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 15 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 16: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 16 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 17: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 17 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 18: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 18 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 19: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 19 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 20: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 20 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 21: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 21 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 22: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 22 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 23: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 23 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 24: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 24 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 25: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 25 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 26: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 26 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 27: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 27 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 28: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 28 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 29: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 29 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 30: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 30 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 31: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 31 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

<story>http://www.marklogic.com/resources/the-journey-from-print-to-online/</story>

Page 32: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 32 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 33: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 33 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

65 OEM Auto and Part Manufacturers

Data on every modern car sold in US Repair Diagnostics Maintenance Technical Service Bulletins

(TSBs) Wiring Estimator

Mitchell1: Data

Page 34: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 34 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 35: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 35 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 36: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 36 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Mitchell1: Data Then, Data Now

Page 37: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 37 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Mitchell1: Data Then, Data Now

Page 38: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 38 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Mitchell1: Data Then, Data Now

Page 39: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 39 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Mitchell1: Market Reactionhttps://www.youtube.com/watch?v=IfM8v-8NY_4&list=UUIOYnh6LBFooV_YxlPVPLvA&index=36

Page 40: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 40 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Search . . . and Semantics

Page 41: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 41 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

One Question . . .

Page 42: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 42 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Who’s Smarter?

VS

Page 43: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 43 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Do domestic dogs interpret pointing as a command? Animal Cognition (2012): 1-12 , November 09, 2012By  Scheider, Linda; Kaminski, Juliane; Call, Josep; Tomasello, Michael

Page 44: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 44 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

What if . . .

Page 45: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 45 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

HOW?

SEMANTICS!

Page 46: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 46 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

The Basic Idea

Get some triples . . . if you haven’t already

• Grabbed DBPedia• Dumped in Linked Data Consortium• Loaded Lehigh• and NYT’s open data

You are behind!

But what if you could add in documents?

Page 47: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 47 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Rich MarkLogic Applications .. Made Richer

Page 48: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 48 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Rich MarkLogic Applications .. Made Richer

Name: John SmithAffiliation: IBMTimezone: PSTCommitter: Hadoop

Page 49: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 49 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Semantics Architecture

TRIPLE

XQY XSLT SQL SPARQL

GRAPHSPARQL

Page 50: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 50 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Triple Index

• 3 triple orders• Cached for performance• Works seamlessly with other indexes• Security• 350 bytes per triple on disk• 1 billion+ triples per host

TRIPLE

Page 51: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 51 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

SPARQL

• Executed using the triple index• SPARQL 1.0• Cost-based optimization• Join ordering and algorithms• More in the lightning talks

select * where { ?person :birth-place ?place; :first-name “John”}

SPARQL

Page 52: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 52 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Demo

Page 53: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 53 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Page 54: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 54 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Old Skool

- Quickie Framework- Circa 2006ish- HTML tables -> 1997 style- ‘action’ controller- <query/> state -> from the query string

- No sessions- No CSS- No Javascript- No Adaptive Design- No Facets?

Page 55: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 55 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Search

Page 56: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 56 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Facets!

Page 57: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 57 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Semantics

Page 58: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 58 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Just Semantics?

Page 59: MarkLogic User Group - Best of MLW and Search + Semantics

Slide 59 Copyright © 2013 MarkLogic® Corporation. All rights reserved.

Thank You!