System Architecture Design Strategies

Student Edition

Copyright © 2015 EsriAll rights reserved.

Course version 3.0. Version release date July 2015.

Printed in the United States of America.

The information contained in this document is the exclusive property of Esri. This work is protected under United Statescopyright law and other international copyright treaties and conventions. No part of this work may be reproduced ortransmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or by anyinformation storage or retrieval system, except as expressly permitted in writing by Esri. All requests should be sent toAttention: Contracts and Legal Services Manager, Esri, 380 New York Street, Redlands, CA 92373-8100 USA.

EXPORT NOTICE: Use of these Materials is subject to U.S. export control laws and regulations including the U.S. Departmentof Commerce Export Administration Regulations (EAR). Diversion of these Materials contrary to U.S. law is prohibited.

The information contained in this document is subject to change without notice.

US Government Restricted/Limited Rights

Any software, documentation, and/or data delivered hereunder is subject to the terms of the License Agreement.The commercial license rights in the License Agreement strictly govern Licensee's use, reproduction, or disclosure ofthe software, data, and documentation. In no event shall the US Government acquire greater than RESTRICTED/LIMITED RIGHTS. At a minimum, use, duplication, or disclosure by the US Government is subject to restrictions asset forth in FAR §52.227-14 Alternates I, II, and III (DEC 2007); FAR §52.227-19(b) (DEC 2007) and/or FAR §12.211/12.212 (Commercial Technical Data/Computer Software); and DFARS §252.227-7015 (DEC 2011) (Technical Data -Commercial Items) and/or DFARS §227.7202 (Commercial Computer Software and Commercial Computer SoftwareDocumentation), as applicable. Contractor/Manufacturer is Esri, 380 New York Street, Redlands, CA 92373-8100,USA.

@esri.com, 3D Analyst, ACORN, Address Coder, ADF, AML, ArcAtlas, ArcCAD, ArcCatalog, ArcCOGO, ArcData, ArcDoc,ArcEdit, ArcEditor, ArcEurope, ArcExplorer, ArcExpress, ArcGIS, ArcGlobe, ArcGrid, ArcIMS, ARC/INFO, ArcInfo, ArcInfoLibrarian, ArcLessons, ArcLocation, ArcLogistics, ArcMap, ArcNetwork, ArcNews, ArcObjects, ArcOpen, ArcPad, ArcPlot,ArcPress, ArcPy, ArcReader, ArcScan, ArcScene, ArcSchool, ArcScripts, ArcSDE, ArcSdl, ArcSketch, ArcStorm, ArcSurvey,ArcTIN, ArcToolbox, ArcTools, ArcUSA, ArcUser, ArcView, ArcVoyager, ArcWatch, ArcWeb, ArcWorld, ArcXML, Atlas GIS,AtlasWare, Avenue, BAO, Business Analyst, Business Analyst Online, BusinessMAP, CityEngine, CommunityInfo, DatabaseIntegrator, DBI Kit, EDN, Esri, Esri—Team GIS, Esri—The GIS Company, Esri—The GIS People, Esri—The GIS SoftwareLeader, FormEdit, GeoCollector, Geographic Design System, Geography Matters, Geography Network, GIS by Esri, GIS Day,GIS for Everyone, GISData Server, JTX, MapIt, Maplex, MapObjects, MapStudio, ModelBuilder, MOLE, MPS—Atlas, PLTS,Rent-a-Tech, SDE, SML, Sourcebook·America, SpatiaLABS, Spatial Database Engine, StreetMap, Tapestry, the ARC/INFOlogo, the ArcGIS logo, the ArcGIS Explorer logo, the ArcPad logo, the Esri globe logo, the Esri Press logo, the GIS Day logo,the MapIt logo, The Geographic Advantage, The Geographic Approach, The World's Leading Desktop GIS, Water Writes,www.arcgis.com, www.esri.com, www.geographynetwork.com, www.gis.com, www.gisday.com, and Your PersonalGeographic Information System are trademarks, service marks, or registered marks in the United States, the EuropeanCommunity, or certain other jurisdictions. CityEngine is a registered trademark of Procedural AG and is distributed underlicense by Esri.

Other companies and products or services mentioned herein may be trademarks, service marks or registered marks of theirrespective mark owners.

Course introduction

IntroductionCourse goalsAdditional resourcesInstalling the course dataIcons used in this workbookUnderstanding the ArcGIS Platform

1 System design process

Lesson introductionWhat is system architecture design?Why is system architecture design important?Why should you plan?What questions are you trying to answer?What demands does GIS place on the computing infrastructure?Cost of a changeIntegrated business needs assessmentBuilding a GIS: Implementation strategySystem design strategies overviewSDSwiki demo: System Design Strategies wiki siteSystem architecture design terminologyGIS business planningPre-design effortsEnterprise visionCPT demo: Pre-design efforts.System design processTechnical architecture strategyCPT demo: System architecture designMonitor performance complianceCPT demo: Performance validationCPT demo: Platform Capacity CalculatorExercise 1: Use the Platform Capacity Calculator to identify the best platform selection

Estimate current web service display complexityFind the throughput capacity (TPH) of the Esri hardware bundlesDetermine how many concurrent users the hardware candidates can supportHow does user productivity impact concurrent user capacity?What is your optimum deployment strategy if you choose to use virtual servers?

Lesson review

2 GIS software technology

Lesson introductionGIS software evolutionWhat is ArcGIS?Emerging technology trends

i

ArcGIS for Server GeoEvent extensionBig dataSelecting the correct computing architectureEnterprise deployment strategiesFederated deployment strategiesCommunity deployment strategiesService (REST)-oriented architectureGIS in a service-oriented architectureCloud deployment patternsCloud service modelsCloud deployment strategiesArcGIS platformDesktop operationsCPT demo: ArcGIS desktop workflowsWeb operationsMobile operationsArcGIS OnlinePortal for ArcGISCPT demo: ArcGIS server workflowsArcGIS for Server licensingSoftware technology selectionSoftware technology cycleExercise 2: Use the CPT to explore GIS software technology

What are your business requirements?Select your project workflow performance targetsComplete your system architecture design

Lesson review

3 Software performance

Lesson introductionStandard workflowsCustom workflow loadsCPT Calculator workflow recipeArcGIS imagery access patternsGraphics (2D/3D) performanceDisplay density performance impactsRegistered Portal servicesCPT demo: Calculator recipe configurationDisplay complexity trade-offsActivityGIS user performance expectationsMap display complexityMeasuring display complexity (MXDperfstat)Defining display complexityMap publishing demo: Display complexity

ii

CPT demo: Calculator display complexityParallel processing performance impactsTake advantage of caching (%DataCache)Display resolution performance impactsSelecting the best output formatSelecting the best vector storage formatSelecting the best imagery storage formatCPT demo: Cache, Resolution, Output, and Data sourceCustom workflow loads analysisExercise 3: Use the CPT to explore software performance

Use the CPT Calculator to help select the appropriate software performance targetsEvaluate display performance when changing output to Feature service.What are the advantages of mixing feature service with cached basemap?Add custom FSvcEdit workflow to project workflows

Lesson review

4 Server software performance

Lesson introductionArcGIS for Server software componentsArcGIS for Server terminologyPooled service instance configurationMap service process configurationCached map serviceBatch process loadsWeb mapping service loadsMap publishing demo: Service Editor map service configurationCPT demo: Optimum service instance configurationsGenerating the map cacheCache processing profileManaged Services demo: Caching configurationsPlatform memory recommendationsGreek citizen declaration case studyGreek network architectureTechnical architecture alternativesCPT Calculator design case studyCaching advantage summaryExercise 4: Use the CPT to evaluate server software performance

Demonstrate batch process service instance loads on the CPT Design tabDemonstrate web mapping service instance loads on the CPT Design tab

Lesson review

5 GIS data administration

Lesson introductionGIS feature data architecture

iii

What is versioning?Geodatabase versioning exampleArcSDE explicit state modelArcSDE version state tuningVersioned geodatabase viewVersioning managed by ArcSDE schemaGeodatabase replication use casesDistributed enterprise architecture strategiesMobile operationsProduction/publication operationsExtract/transform/load operationsDistributed geodatabase operationsHierarchical operationsArcGIS for Desktop DBMS connectionsCPT demo: Platform Capacity Calculator custom web map servicesGIS imagery data architectureWhat is a mosaic dataset?ArcGIS image access patternsRecommended image deployment workflowGIS enterprise data architectureStorage architecture options: Advent of the storage area networkStorage architecture options: Advent of network-attached storageWays to protect spatial data: RAID (Redundant array of independent disks)SSD technology is hereSolid-state drive technologyHierarchical storage managementWays to move GIS data: Traditional backup/transfer/loadWays to move GIS data: Database replicationWays to move GIS data: Disk-level replicationProtect your GIS data resourcesCPT demo: Platform Capacity Calculator custom imagery servicesCPT demo: Configure CPT Calculator and Design tabs for imagery workflowsExercise 5: Use the CPT to determine platform capacities and workflows

How does data source selection impact web mapping platform capacity?How does data source selection impact web image service platform capacity?Use the CPT Calculator to generate custom imagery workflow performance targetsAdd the custom imagery workflow to Project Workflows on the CPT Workflow tab

Lesson review

6 Network communications

Lesson introductionWhy is GIS traffic-intensive?Types of networksWhat is network capacity?What is data?

iv

What is client/server communication?What are network transport protocols?GIS client/server protocolsWhat is network transport time?Network transport time examplesWhat is network latency?Network latency exampleCPT demo: Network latencyShared network performanceNetwork design planning factorsNetwork traffic adjustments: Output formatNetwork traffic adjustments: Data source formatEnterprise network architectureNetwork suitability analysis: Network utilizationNetwork traffic queuingNetwork suitability analysis: User productivityUser productivity adjustmentCPT demo: Excel enable iterative calculations settingCPT Calculator demo: Workflow network performanceCPT Design demo: Enterprise network capacityCPT Design demo: Network suitability analysisWeb performanceExercise 6: Use the CPT to explore network communications

Use the CPT Calculator to evaluate web mapping display performance for remote shared low-bandwidth sitesWhat are the performance advantages of using an optimized web service?Add custom WebLite workflow to project workflowsHow does network bandwidth contention impact user productivity?Configure the design to represent business requirements for local and remote site users

Lesson review

7 GIS product architecture

Lesson introductionArcGIS system technical architectureArcGIS product architecture: Software componentsVirtualization deployment optionsArcGIS for Desktop: Software component architectureArcGIS for Desktop: Workstation clientsArcGIS for Desktop: Application/desktop virtualizationCPT demo: ArcGIS for Desktop CPT Calculator configurationsCPT demo: ArcGIS for Desktop Standard WorkflowsCPT demo: ArcGIS for Desktop CPT Design configurationsArcGIS for Server: Software component architectureArcGIS for Server: Key site component functionsWeb services platform tier structure

v

Single-tier platform configuration (single GIS server tier)Two-tier platform configuration (separate data servers)Three-tier platform configuration (separate web and data servers)ArcGIS for Server multiple site deployment patternsArcGIS for Server multiple site integrationEnterprise development, staging, and production operationsActive-passive ArcGIS for Server failover configurationsArcGIS for Server multiple data center failoverArcGIS for Server high capacity linear scalabilityCPT demo: ArcGIS for Server CPT Calculator configurationsCPT demo: ArcGIS for Server single-tier CPT Design configurationCPT demo: ArcGIS for Server two-tier CPT Design configurationCPT demo: ArcGIS for Server three-tier CPT Design and Calculator configurationsCPT demo: CPT Design platform tier component overviewArcGIS platform deployment patternsPortal for ArcGIS platform configurationExercise 7: Use the CPT to explore GIS product architecture

Use the CPT Calculator to identify the optimum ArcGIS for Server platform configurationAdjust the CPT Design to show an enterprise design solution with a three-tier ArcGIS for ServerarchitectureAdjust the CPT Design to show an enterprise design solution with a two-tier ArcGIS for ServerarchitectureReduce ArcGIS for Server license cost by using a virtual server environment

Lesson review

8 Platform performance

Lesson introductionPlatform performance baselineBaseline history compared with Moore's lawFaster platforms serve more with less hardwareHow relative performance is measuredTime to produce a mapCPT demo: Platform performance resources2015 technology changesPlatform identificationVendor platform performanceProcessing time drives throughput2015 Intel processor performanceArcGIS 2015 platform best buyCPT demo: What is the best buy?Workstation platform recommendationsWindows terminal configurationsWindows Terminal Server platform capacitySDE geodatabase configurations for GIS vector data managementSDE geodatabase platform capacity

vi

ArcGIS for Server configurationsArcGIS for Server platform capacityCPT demo: Windows Terminal Server platform sizingCPT demo: SDE geodatabase platform sizingCPT demo: ArcGIS for Server platform sizingDPT demo: Platform Capacity Calculator sizingHardware vendor platform selectionExercise 8: Use the CPT to evaluate platform performance

Use the CPT Calculator to identify how upgrading to current technology can reduce overalloperating costUse the CPT Calculator to evaluate performance and cost of available 2015 serverconfigurationsUse the CPT Design tab to identify how upgrading to current technology can reduce overallenterprise GIS operating cost

Lesson review

9 Information security

Lesson introductionWhat is information security?Four types of security threatsCIA security triadLevels of securityEnterprise security strategyChoose a security standardEsri's security strategy evolutionArcGIS for Server security authorizationGIS portal information modelWeb GIS access and privilegesArcGIS Online security authorizationPortal for ArcGIS security authorizationGIS portal architecture in ArcGIS OnlinePortal for ArcGIS relationship to ServerSecurity in the cloudCloud implementation optionsArcGIS cloud hybrid capabilitiesEsri informal pattern selectionBasic security needsStandard security needsAdvanced security needsWeb firewall best practicesWeb services with proxy serverWeb service components in DMZSecurity strategy overviewLesson review

vii

10 Performance management

Lesson introductionSystem performance factorsHow to manage performanceUser workflow terminologyWhat is service time?System performance terminologyWhat is queue time?What is response time?What is workflow productivity?What is cycle time?What is a valid user workflow?User productivity adjustmentWhat is a batch process?CPT demo: User productivity adjustmentCPT demo: Batch process productivityPlatform throughput and service timePlatform performance and response timePlatform queue timeCPT demo: Multi-core server performanceHow to size the networkWhat is system performance?Manage performance complianceCPT demo: Test validationExercise 10: Use the CPT to manage performance

Convert measured test results to generate a custom project workflowUse the CPT Throughput/Utilization Test tool to generate workflow service timesMove the test workflow results to the Project Workflows listValidate the new test workflow on the CPT Design tabUse the validated test workflow to generate capacity of new 2015 servers

Lesson review

11 City of Rome

Lesson introductionCity of Rome case studyPre-design effortsUser requirements analysis: User locations and connectivityUser requirements analysis: Workflow performance targetsCPT demo: City of Rome: User requirements analysisUser requirements summaryCPT demo: Workflow performance targetsSystem design processTechnical architecture strategy: Year 1

viii

Workflow loads analysis: User needs summary (Year 1)CPT demo: Workflow configuration: Year 1Network recommendations: Year 1Platform architecture selection: Year 1Hardware price listCPT demo: Physical platform configurations: Year 1Physical platform solutions: Year 1CPT demo: HA virtual configuration: Year 1HA virtual platform solution: Year 1Technical architecture strategy: Year 2Workflow loads analysis: User needs summary (Year 2)DPT demo: Workflow configuration: Year 2Network recommendations: Year 2Platform architecture selection: Year 2CPT demo: HA virtual configuration: Year 2HA virtual platform solution: Year 2CPT Demo: Data center configuration without web public services: Year 2Data center solution without web public services: Year 2Amazon pricingCPT demo: Amazon Cloud web public services configurationAmazon-hosted public web servicesRome City Hall business case summaryWorkflow loads analysis: User needs summary (Police)DPT demo: Workflow configuration: Police networkPolice HA virtual platform solution

12 System implementation

Lesson introductionIntegrated system design processEnterprise visionExisting business architecture: Governance and political landscapeExisting business architecture: Use the correct languageExecutive management committeeGIS planning team leadershipGIS implementation team leadershipKey GIS staff functionsGIS enterprise management structureExisting business architecture: Platform and network environmentsExisting business architecture: Operational constraints and prioritiesExisting business architecture: Funding constraintsUser requirements analysis: Business discovery processUser requirements analysis: GIS business planning processUser requirements analysis: User locations and connectivityUser requirements analysis: Workflow performance targetsSystem architecture design

ix

Maintain a current planPhased system deploymentVirtual server deploymentsSoftware technology life cycleSystem testingDemo: Performance testingHave a scheduleMonitor performance complianceSystem performance tuningManaging technology changeExercise 12: Use the CPT to design a system for the City of Portland

Determine CPT workflows to complete the City of Portland designDetermine projected network traffic for Portland (Year 1)Evaluate the Portland (Year 1) network bandwidth requirementsConfigure the Portland hardware architectureConfigure the Portland (Year 1) workflow softwareIdentify the system architecture design solution for Year 1Evaluate the projected network traffic for the Portlandl (Year 2) designDetermine the hardware requirements for Portland (Year 2)

Appendixes

Appendix A: Esri data license agreementAppendix B: Answers to lesson review questions

Lesson 1: System design processLesson 2: GIS software technologyLesson 3: Software performanceLesson 4: Server software performanceLesson 5: GIS data administrationLesson 6: Network communicationsLesson 7: GIS product architectureLesson 8: Platform performanceLesson 9: Information securityLesson 10: Performance management

x