Exploring search driven applications with SharePoint 2013Joris PoelmansSharePoint ArchitectRealDolmen

About meWork at RealDolmen

Technical lead and product manager

SharePoint Server MVP since 2005

Active in Belux Information Worker User Group –

www.biwug.be

Blog: http://jopx.blogspot.com

Twitter: @jopxtwits

3

Session Objectives• Describe what’s new in Search for SP2013

• Provide a high level overview of the new search architecture

• Describe what Search Driven Applications are

• Show how the new customization allows you to build Search Driven Applications

• Level 300 session

Session Objectives and Takeaways

4

Challenges with search – Data ComplexityWhat we give to search engines

What most search engines see

1 2 3 4awaycomecontrastivecustomizeforfs14howoptimizingourrelevance (3)

shouldsimplesomess14techniquesview (2)whatwhenwithyou

Author: victor poznanskiTitle: conf relevancy sharepoint Date: 9.4.9Type: pptAuthority: 6Anchor: SPC presentation …

5

Challenges with search - Intent

Understanding the underlying user question

What is a good search result?

6

All relevant documents (precision)

Complete answer (recall)

Sweet spotBalance between recall, precision and relevance

7

Microsoft’s goals for SP2013 search

Find Answer ExtendFind what you’re looking for with intelligent results tailored to you

Get answers and take action with an experience that’s always a step ahead

Build smarter/no-code applications that can scale for any need or business requirement

Drive relevant and actionable results with good recall

SP2013 Search New user interfaceNew clean user interface with focus on providing actionable search results

DemoThe new search experience

10

Demo recap• Dynamic, clean new search

experience•Rich results, hover panel, refinders, counts, actionable results, HTML/JS Templates

• Search from everywhere•Pervasive search box, search verticals

• Find the needle in the haystack•Word/Excel/PPT/site previews (Office Web Apps), deep links, query rules, expertise search

SP2013 Search New user interfaceNew clean user interface with focus on providing actionable search results

New search architecture

One unified search architecture supported by strong analytics. Consolidation of FAST and Enterprise Search components

Search architecture

12

HTTPFile sharesSharePointUser profilesLotus Notes DocumentumExchange foldersCustom - BCS

SharePointSP AppsDevicesNon-SP UX

SearchAdmin

Content UXCrawl

ContentProcessing Index

QueryProcessing WFE

API

AnalyticsProcessing

FAST Search Index

Public API

Unit of scale/role boundary

13

Crawl ComponentOOB connectorsExtensible through BCSOOTB PDF supportLocal disk cacheCrawled items tracked

in Crawl databaseConfigurations stored in

Admin databaseContinuous crawling

Crawl

ContentProcessing Index

Crawl

FAST Search Index

HTTP

File Shares

SharePoint

User Profiles

Exchange

Lotus Notes

Documentum

Custom (BCS)

...SearchAdmin

Admin

mssearch.exe

Content Processing Component• Stateless node

• Analyzes content for indexing

• Processing flow

• Dictionaries

• Schema mapping

• Stores links and anchors in Link database (analytics)

• Extensible through web service call-outs

• Configurations stored in admin database

Crawl

ContentProcessing Index

Crawl

FAST Search Index

SearchAdmin

Admin

AnalyticsProcessing

Link

ContentEnrichmentWeb Service

15

Index Core

Index

FAST Search Index

Use partitions and replicas – no more rows and columns

Index schema extendedEnhanced functionality with managed property:• Data type• Queryable• Searchable• Retrievable• Refinable• Sortable• Safe for anonymous

access

16

Analytics Processing Component

Crawl

ContentProcessing Index

QueryProcessing WFE

API

AnalyticsProcessing

FAST Search Index

Link

Analytics Reporting

• Map-reduce• Learns by usage• Search Analytics• Usage Analytics• Enriches index by

updating index items

• Usage reports in Analytics database

Event Stream

17

SharePointSP AppsDevicesNon-SP UX

Query Processing Component

SearchAdmin

UXQueryProcessing WFE

API

Index

FAST Search Index

Public API

Unit of scale/role boundary

• Stateless node• Processing flows• Query analyzer• Linguistics• Dictionaries• Result sources• Schema mapping• Query rules• Query federation • Configurations

stored in admin database

Admin

DemoExploring Search Service Application

SP2013 Search New user interfaceNew clean user interface with focus on providing actionable search results

New search architecture

One unified search architecture supported by strong analytics. Consolidation of FAST and Enterprise Search components

Personalized and more relevant search resultsSearch results based on search history. Full control over ranking, sorting, etc … using query rules

20

Query rules drive relevance

Captures Search IntentReplaces search keywords in 2010Create query rules at Farm, Site Collection, and Site levels

Composed of 3 top level elementsQuery Conditions

What queries should be handled?

Query Actions

What happens when a rule matches?

PublishingOptions

Is the rule active and for how long?

21

Query rules – some examples

DemoExploring query rules

SP2013 Search New user interfaceNew clean user interface with focus on providing actionable search results

New search architecture

One unified search architecture supported by strong analytics. Consolidation of FAST and Enterprise Search components

Personalized and more relevant search resultsSearch results based on search history. Full control over ranking, sorting, etc … using query rules

New customization model for searchEasier to extend and configure the search user experience. Rich contextual previews. Deliver on the promise of search driven applications

24

Search driven applications“How do I support

theunique search needs of teams and work

that impact our business?”

To do so, you need a search platform that has• A deep understanding of your

information• Flexible relevance to meet diverse

needs• A customizable UX to increase user

efficiency

Sales: 360o Customer Insight

Services: Knowledge Browser

Marketing: Competitive Intelligence

Research & Development:Innovation Portal

Support:Call Center Advisor

Operations:Systems/Logistics Portal

Legal, HR, IT, Finance, ……

Defining personas and scenarios is critical

25

Meet Julian IslaDevelopment EngineerWorking on the Green Initiative, finding ways to create more environmentally friendly oil production equipment

Julian and his team are developing a new pump

Natural Gas (and Oil) production release significant amounts of Methane, which is a potent greenhouse gas, into the atmosphere. Pumps are one source of release.  

Julian needs to dive deep into what’s known and what’s not, walking through the pump design part by part

Find existing technologies and sources of components

Explore areas where Consolidated Energy might patent an approach

Connect search results to collaborative efforts

Customizations for Search driven applicationsConfigure

• Query rules• Result sources• UI Look&Feel with

display templates• Metadata

extraction using Managed Metadata

Extend Build

• BCS models• Search Center

extensions• Content By Search

webpart• Use Analytics and

recommendations• Content processing

extensibility

• Windows 8 search apps

• Mobile search experiences

• SharePoint search apps

26

27

Easier to build search driven apps Why?

More configuration – less development More granularity in configuration CSOM – Microsoft.SharePoint.Client.Search.Query and REST

API Content By Search Web part XSLT is replaced with Display Templates

The search UI is driven by Query rules Display templates Result types Result sources

28

Customizing search – Query Rules Control over query results

Defined via a Condition and Action

Query rules: Result Blocks Promoted Results Ranked Results

29

Customizing search – Display Templates HTML templates that define how a search result looks

SharePoint auto-generates the JS version and the HTML Stored in the master page gallery

Support full debugging

30

Customizing search – Result types Define what Display Templates will display a search result based upon a condition Search service Site Collection Site Owners

31

Customizing search – Result Sources Replace Scopes and Federated Locations Extended federation options

Remote SharePoint farms Exchange OpenSearch

Definable at Search Service – search administrator – globally

available Site collection level – site collection admin –

available to all sites in site collection Site – site owners – this site only

32

Content By Search Web Part Similar to Content by Query Web Part

– but based on indexed content Show content cross site collections

Show content cross multiple site collections

New presentation template model for easy content presentation fine tuning Content rendered in client side Provides full control on rendering

capabilities using html templates Easy editors as web part editors for

defining planned query

DemoExploring the Content By Search Web Part

34

OnlineOn Premises

SharePoint 2013 Features & Licensing OnlineOn Premises

P Kiosk Plan 1 Plan 2Foundatio

nStandard EnterpriseFeature Set Capability

Apps

Collaboration

Search

Content Management

Business Intelligence

Business Solutions

App Catalog & Marketplace

Team Sites

Work Management

Social

External sharing

Basic Search

Standard Search*

Enterprise Search*

Content Management

Records Management

E-discovery, ACM, ComplianceExcel Services, PowerPivot, PowerViewScorecards & Dashboards

Access Services

Visio Services

Form Based Applications*

SharePoint 2013 Workflow

Business Connectivity Services**

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●*

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●

●: Existing ●: New BOLD: EnhancedNote* : Some of the features may not be available (or have limited capability) in equivalent Online SKUsNote* * : Some of the features may not be available in Foundation and Standard SKUsNote : Please refer to Microsoft volume licensing website for the latest Product Use Rights document

34

35

Search quality is even better in this release

Improved ranking that builds on SS and FS + new featuresImproved linguistics: stemming and thesaurusDictionary support

Manage intent diversityHandle different intents with query rules

Easier to build search driven applications

Do more with less developmentFocus on specific personas and business scenarios

Summary

36

Call to action Call to action:Sign up for Office 365 Developer PreviewWatch developer videos around building SharePoint 2013 appsWatch IT Pro videos to explore SharePoint 2013 appsRegister on www.biwug.be as a member to stay up to date for local SharePoint 2013 sessions

For more information or questionsSharePoint 2013 start pageSharePoint 2013 Developer documentationSharePoint 2013 IT Pro documentationSharePoint 2013 Delicious linksYammer – https://www.yammer.com/spyam

Thank You

Q & A