SharePoint at Microsoft

Scott St. JeanMicrosoft IT

IT Organizational Structure

Team Membership (Dogfood)

• Service Management (1)• Program/Project Management (4)

• Lead PM and 1 vendor PM• Dedicated Search and People PMs

• Engineering and Technologists (2)• 1 Engineer and 1 Technologist

• Server Operations Support (10)• 2 Leads• 8 Operation Analysts

• Client Support (3)• 1 Lead• 2 Support Analysts

Team Membership (Sustained and Service Growth)

• Service Management (1.5)• Program/Project Management (4.5)

• Lead PM, ½ PM head, and 1 vendor PM• Dedicated Search and People PMs

• Engineering and Technologists• 1 Engineer and 2 Technologists

• Server Operations Support (10)• 2 Leads• 8 Operations Analysts

• Client Support (3)• 1 Lead• 2 Support Analysts

Services We (MACS) Own

Asia Pacific (Singapore)• Asia Pacific Web Sites• Asia Pacific Personal Sites• Asia Pacific Services• Asia Pacific Extranet

Americas (Redmond)• Americas Web Sites• Americas Personal Sites• Americas Services• Americas Extranet• Americas Project Server• Enterprise Search• LOB Profile Import

Europe, Middle East, Africa (Dublin)• EMEA Web Sites• EMEA Personal Sites• EMEA Services• EMEA Extranet

Global SharePoint Service Deployment

Minimum Performance Level

File Size MPL User Compliance

1 MB 10 sec 80%

5 MB 35 sec 96%

Weighted Average Percentage of users who meet MPL

File Size Average DL Time Weighted Average DL Time

1 MB 11.64 sec10.4 sec

5 MB 39.04 sec33.19 sec

* New MPL still under negotiation. Next steps to examine what we can do to improve performance. We are considering ½ of proposed numbers.

Data Current as of 11/2006

Minimum Performance Level(regional breakdown)

Region DL Time 1MB

DL Time 5MB

North America 8.3 34.8

South America 18.3 78.4

Europe 17.6 35.0

Africa 23.9 76.1

Middle East 15.2 37.7

South Pacific 8.4 23.0

Far East 8.9 21.0

Download time (seconds) by regionSharePoint users by region

Clients in: AmericaFarm

Asia Farm

EMEA Farm

America 94.53% 4.90% 0.57%Asia 32.51% 66.75% 0.74%EMEA 23.03% 0.09% 76.88%

Bandwidth usage breakdown by users to each farm

Data Current as of 11/2006

Microsoft IT Hosted Services

• Regional SSP• Only MACs has access

• MOSS Child farms• Shared Hosting in each

region• Personal site host• Team site host• Offered at no cost

• Gold/Platinum child farms• Paid hosting farms• Support some

customization• Project Server

• Service in limbo• Still 2003 solution• Examining alternative

hosting options

• Extranet• Externally accessible sites• Designed for partner

collaboration• Product Showcase

• Host Header• Deprecated Service• Still WSS 2.0

• Shared Hosted Portal Farms• Deprecated Service• Many still SPS 2003

• WSS Child Farms• Deprecated Service• SKU to SKU upgrade

planned• Negotiating with WSS team

about no hosted WSS farms at Microsoft

SSP Farm Relationships

Profile Profile ChangeChange

ReplicationReplication

All regions have an SSP Farm

Regions crawl local content Redmond crawls all regional

content as well Profile changes made locally Profile changes replicated to

other SSP farms All LOB data imported into

profiles done in Redmond

Dedicated Shared Services Farm

AA PP

• Hosted services consumed by child farms• One per region• In Redmond we have a dedicated SQL

cluster, in regions this is shared SQL storage• All SharePoint 2007 sites consume from

shared services• Local farms can have a local SSP for Excel

services.

Child Farms• Several different configurations

• Multiple Web Front End Servers• Dedicated Search Target and dedicated

Application (Excel and Index) Servers• Combined Search Target/Application

Server• Load balanced and engineered to provide

redundant hosting• Child farms can have local shared service

providers for Excel• Hardware

• WFE (min 2 WFEs)• 32-bit or 64-bit• 1 or 2 Proc (Dual Core)• 4 to 16 GB RAM

• Excel (Application Servers)• 64-bit• 2 Proc (Dual Core)• 8 GB RAM

WNLB

Optional(reconsidering)

Optional

Searc

h

Targ

et

Searc

h

Targ

et

Child/SSP Farm Relationship

• All SharePoint 2007 properties consume from regional shared services.

• Communication between a child farm and the SSP farm is via data connections and web service calls

• The child farm will render even if the SSP farm is down but services like search, audiences, profile, and BDC will not work

• Child farms are within the same data center. Federation across the WAN is not supported. Latency must be less then 80 ms.

Service Tier Offerings• Platinum (In Progress)

• Dedicated Hardware• High value web properties• Has highest startup and monthly chargeback• Support most server side customizations

• Gold (Pilot in Feb)• Shared Hardware (up to 10 / farm)• Med – High value web properties• Has startup and monthly chargeback• Support server side customizations that permit

coexistance• Silver (Current service)

• Shared Hardware (1000’s / farm)• Any web site• No cost to users• Next to no server side customizations supported

Service Level Agreement

• IT Help technical support 24x7

• Normal priority (3) tickets resolved within 72 hours• Pri. 1 – 50+ user impact (4 hr)• Pri. 2 – 2+ user impact (24 hr)• Pri. 3 – Normal scheduled work

(3 d)• Pri. 4 – Low priority work (8 d)

• Availability 99.9% Goal• Maintain blocked file list• Business critical level of

service not mission critical• Broken customizations not

fixed by IT

• Databases are backed up once every 24 hours and retained for 14 days

• Site restores require GM Approval

• Maintenance window• Daily: 6 pm to 6 am local

server• Weekend: Fri 10 pm to Mon 6

am

• Quotas• Start (Default) – 500 MB• Grow to 1 GB• Grow up to 5 GB in 1 GB

increments

MSIT SharePoint Service Offering (December)

Data Current as of 12/2006

* Just over 12 TB total content stored in SharePoint at Microsoft

SharePoint 2007 Worldwide Server Inventory *

Data Current as of 12/2006

* Projected numbers based on current commitments, does not include pre-production environments

SQL Infrastructure

AA AA

AA PP

pp

Infrastructure• 64-bit, SQL 2005 infrastructure• Multiple Active, Single Passive, Single backup node

Hardware SKUs• HP D585 – 8-way machines with 8 GB RAM• Shared storage (SAN)

Backup• SQL backup to disk groups for drop drives• Pivot disk groups to backup node (p) for backup to tape or

near disk storage• Disk groups pivot back before SQL backups begin

Monitoring• Outsourced monitoring to another IT team within Microsoft

Search and Crawl

• Once upgrades complete, goal is to incrementally crawl min of once every 24 hours (regionally dependant, specifically SharePoint)

• Single MOSS index in each region

• Dedicated query servers on SSP farm process requests

• Average query performance is 2 seconds/query. Faster for simpler queries and slower for complex queries.

• We’re looking to add more RAM to our query servers to help with performance

• We use search via BDC to crawl some Siebel data

• Local farm help requires WSS search service

• To date we’ve indexed 20M in Redmond

• We take a tiered approach to crawl frequency

• Highest priority content crawled each day or more.

• Medium priority a few times a week.

• Lower priority content once a week.

• Performance goal is an average of 20 docs/second for SharePoint content over multiple crawls

• On average (month):• 575K Queries /month for Redmond

SSP

Excel Services

• Trusted Location “http://” setup for each silver farm

• Uses published low perms account to do data refresh

• 100 MB maximum file size• Uses both data connection libraries and

embedded connections• We have not yet implemented a request

process for new trusted locations• Warnings turned on and shown when

refreshing connections

InfoPath Forms Services

• Not an SSP feature but rather a farm feature

• Enabled on all 2007 child farms• We don’t currently support forms with

code on silver service• We will support this for platinum and

gold customers.• Required for workflow features• Uses the session state component of the

SSP

Profile Import

• Different Imports run in different regions• In all regions we

import AD data• In Redmond we

use BDC to import LOB data

• Incremental run every 24 hours

• Fulls run once a week

• Process 130K AD records

Profile Synchronization/My Sites

• 3 regional MySite hosts

• Users modify their own data (non-AD or BDC source) in local region

• Profile data used in local farm people search

• Indexed regularly by local SSP host

• Almost 55,000 personal sites world wide

• Custom code added to replication user supplied changes to other regions and BDC changes from Redmond

• Uses change log to push incrementally

• Change replicated world wide within seconds of user save.

• Reflected in search after next crawl

Other Services

• SSO – Not currently used• Document Conversion – Not currently used• Project Server – new service being defined,

not currently offered by Microsoft IT• ISA 2006 – used to access some properties

from Internet• Performance Point Server – working with

PG to determine how to offer Service• BDC – used sparingly, will make available

to Gold/Platinum customers

Monitoring

• Monitor environment with MOM v2 today

• Three teams:• DCOPs (Data Center)

• Monitors OS, Hardware, and Web Sites and Services MOM Pack

• 30 min response time on Web Sites and Services Issues (Service outage)

• 24/7/365 coverage

• MACS• Monitors with SharePoint 2007,

SharePoint 2003, WSS 2.0, WSS 3.0, IIS, MSCS, and DFS MOM Packs

• Pager system for critical alerts• Looking to outsource monitoring

and initial response

• PSIT SQL• SQL, DFS, and MSCS

monitoring of SQL servers• Backup/Restores of data

• We are in a transition phase• Migrating to System Center• Application monitoring is being

transitioned as we restructure monitoring teams

© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

04/13/23 26