Spark the future.

May 4 – 8, 2015Chicago, IL

Everything

O-365 Hybrid Search

Kathrine Hammervold, Manas Biswas

BRK3134

Comin

g by

end of

2015!

Introductions

Manas BiswasEscalation engineer, O-365India

Kathrine HammervoldProgram managerFAST, Norway

The new Office 365 hybrid search is a joint effort between engineers in the SharePoint and the FAST team, with close collaboration from services, support, partners and customers.

Presenters

Is this session for you?

Hybrid search sounds awesome!

Ready to simplify search?

Will Delve work for my fileshare content?

Topics we will cover in this session

What is Office 365 hybrid search?

How does it benefit my organization?

How does hybrid search work?

Customization

How do I start? When can I get it?

Session take-aways

Office 365 keeps search running and up-to-date, while I reduce on-premises investments

My organization will get more value from Office 365 faster, even during migration

I can use search and Delve to find and discover content in Office 365 and on-premises

What is Office 365 hybrid search?

What is hybrid search?

A company has a hybrid environment if their content and applications are spread across on-premises and Office 365.

Hybrid search makes finding content easy, wherever the content lives.

In SharePoint Server 2013 we introduced hybrid search using query federation.

Search results came as separate results sets.

This solution required hosting all search components on-premises.

The existing hybrid search solution from 2013

Demo of Office 365 hybrid search

Kathrine Hammervold

The Office 365 hybrid search experience

Search from anywhere, even on-premises sites

Office 365 enterprise search and Delve for your on-premises content

Preview and access the content when connected to your corporate network

Relevancy and deep refiners across the entire result set

How does it benefit my organization?

Support forum

SupportSales &

Marketing

Knowledge Articles

Contoso has 2 SharePoint Server deployments (2013 and 2010), plus content in fileshares.

Hardware requirements:

14 application servers4 content + 10 search

Fileshares SP 2013 content SP 2010 content

On-premises

SP 2013 SSA

SPO contentFileshares SP 2013 content SP 2010 content

They roll out OneDrive for Business to their users, and start migrating sites to Office 365.

Hardware required after migration:

13 application servers3 content + 10 search

site migration

On-premises

Office 365

SupportSales & Marketing

Knowledge Articles

NEW!OneDrive

Support forum

SPOSearch Farm

SP 2013 SSA

Contoso learned that they can index their on-premises sites in the search index in Office 365, without upgrading their existing deployments.

Current hardware requirements:

5 application servers3 content + 2 search

SupportSales & Marketing

Knowledge Articles

Fileshares

SP 2013 Cloud SSA

OneDrive

Support forum

SPOSearch Farm

SP 2013 content SP 2010 content

New

On-premises

Office 365

SPO content

SP 2013 SSA

Reduced on-premises infrastructure cost by hosting most search components in the cloud

The Office 365 team keeps search running and up-to-date for you, 24/7

Brings together on-premises and cloud collaboration like never before with Delve

Smoother search experience, even during migration

Contoso did not have to upgrade their existing deployments to get started with Office 365 hybrid search

Summary

DLP Sensitive Data Search works with hybridSearch for sensitive data across on-premises and SharePoint Online

All Built-in sensitive types

Identification and export

Extends to data in OneDrive

Sensitive Information type detection through KQL searches

Get instant statistics

Preview & export results

How does hybrid search work?

Prerequisites The Cloud Search service application Logical architecture: crawling Security and Identity Combining the old and the new hybrid

search Logical architecture: query

Prerequisites for using Office 365 hybrid search

Directory Synchronization of AD users and groups

Supported content sourcesSharePoint Server 2007, 2010 or 2013

Fileshares, BCS connectors*

SharePoint Server withCloud Search service

application2013 or 2016

Office 365 subscription that includes SharePoint +

Activated Users

Hybrid environment with Office 365

Basic hybrid search requirements

Comin

g by

end of

2015

Additional requirements for search previews

Reverse proxy back to on-premises WAC server

Demo of Cloud Search service applicationManas Biswas

AD

AAD

DirSync

SP 2013 SP 2010 SP 2007 Fileshares BCS

Cloud SSA

Content processing SPO

Search IndexItem queue

Parsed content

ACL mapping

1

2

34

5

6 7

Logical architecture: crawling

Corporate

network

Office 365

Crawling and parsing

Demo of crawler

Manas Biswas

Security and identity

Directory Synchronization

• Security principals can be managed on-premises and synched to the cloud by using the DirSync tool.

• The object in the cloud (AAD) directory now mirrors the object in the on-premises (AD) directory.

AD AAD

AccountName

CORP\jaden

SID S-1-5-21-1212121212-1212121212-1212

AccountName

jaden@corp.hybridsearch.com

msOnline-OnPremiseSecurityIdentifier

S-1-5-21-1212121212-1212121212-1212

PUID PUID-XXXX-XXXXXXXXXX

Mapping of Access Control ListsAs items are indexed in Office 365, the access control entries are looked up in the cloud directory service.

Allow: S-1-5-21-1212121212-1212121212-1212

Allow: PUID-XXXX-XXXXXXXXXX

• User SIDs are mapped to PUIDs• Group SIDs are mapped to Object IDs• «Everyone» and «Authenticated users» are mapped to «Everyone except

external users»

Summary

• Who you are determines what documents you can search for

• If you get a document in the search result online, it is because you have access to the document on-premises

• You must be signed into on-premises to open/access the actual document.

SP 2013

Cloud SSA

SPOSearch Index

Logical architecture: query

Corporate network

SP 2010

1

2a

Jaden issues a query from Office 365.Her user token contains her online identity and group memberships.

1

Jaden isues a query from a site on-premises. This sends over her on-premises claims to SPOHer user token gets rehydrated with her online claims as she is authenticated against Office 365.

2a

2b

2b

Office 365

Combining hybrid search approaches• Litware are also considering hybrid search, but

they have some business sensitive content that they need to keep indexed on-premises for legal reasons.

• Litware can combine the two hybrid search approaches

• They implement query federation from the site that has the high-business impact content on-premises

SP 2013

Cloud SSA

SPOSearch Index

Logical architecture w/ query federation

Corporate network

SP 2010

1

2a

2b

Office 365

SP 2013 search

3

Paul issues a query from the site with sensitive content.He gets back search results from on-premises and online as separate result sets

3

Customization

Hybrid search and customizationWith the new hybrid search solution all index and query related settings are managed in SharePoint Online

Crawling and parsing are still managed on-premises.

Supported and unsupported customizations

SUPPORTED Custom IFilter BCS connectors Partner connectors (on

SharePoint Server 2013 Cloud SSA)

SUPPORTED Tenant level schema mapping Query rules Result sources ...

On-premises In the cloud

NOT SUPPORTED Content that requires custom

security trimming

NOT SUPPORTED Site collection level schema

mapping Custom security trimming Custom entity extraction Content enrichment web service

Managed property for hybrid search resultsThe IsExternalContent managed property is set to «1» for content that is crawled on-premises.

The property can be used to restrict a query for online/on-premises results, as a refiner or in a result source

Example search verticals (1)

SharePoint Online

Everything Support Search

Custom result source using Local SharePoint results plus a filter which excludes results from on-premises

TIP: Can be used during validation of hybrid search in the production tenant.

Result source query:{searchTerms} NOT(IsExternalContent:1)

Example search verticals (2)

This is the default result source using Local SharePoint results but it has been renamed to «Everything» in the Search Navigation configuration.

SharePoint Online EverythingSupport Search

Example search verticals (3)

The Support Search vertical only searches sites that are relevant to the Support team.

It uses Local SharePoint results plus a filter on which sites to include in the search results

Result source query:{searchTerms} (Path:»http://sp2010» OR Path:»file://fileshare» ORPath:»http://demohybrid.../../supportforum»)

SharePoint Online Everything Support Search

Demo of custom result sources

Kathrine Hammervold

How do I start?When can I get it?

MSIT are rolling out hybrid search

Ongoing high-touch TAP program with a handful of ISVs and customers

2015: ship as SharePoint Server 2013 PU2016: ship as SharePoint Server 2016

Timeline for Office 365 hybrid search w/Delve

Thank You!

Can hybrid search bring value to your organization?

Keep the questions coming on Yammer.

Stay tuned for an update to SharePoint Server 2013.

Visit Myignite at http://myignite.microsoft.com or download and use the Ignite Mobile App with the QR code above.

Please evaluate this sessionYour feedback is important to us!

© 2015 Microsoft Corporation. All rights reserved.