Brendan Sylvander

GIS Coordinator

206-860-3252

brendan.sylvander@noaa.gov

Counting Fish, Tracking Dollars, Making Maps, and Collaborating

on the Web with Reverse Proxy Server

NOAA WebShop 2004July 27, 2004

Issues, Concerns and Issues, Concerns and OpportunitiesOpportunities

- Where is the data Where is the data (tabular and spatial), metadata, documents, (tabular and spatial), metadata, documents, analysis tools, discussions, links, project information and analysis tools, discussions, links, project information and contacts needed for BIOP, M&E and Salmon Recovery activitiescontacts needed for BIOP, M&E and Salmon Recovery activities

- How do researchers, project managers, and the public better How do researchers, project managers, and the public better interface with the Web interface with the Web as a “working system” to store, find, as a “working system” to store, find, analyze, collaborate, and share data and documents in a analyze, collaborate, and share data and documents in a distributed environmentdistributed environment

- How can we get access to salmon and environmental data How can we get access to salmon and environmental data in a in a way easy for users to use and update? Example: Salmon way easy for users to use and update? Example: Salmon Abundance, Genetics, Telemetry, Streamnet, OWEB, PRISM, Abundance, Genetics, Telemetry, Streamnet, OWEB, PRISM, CALFISH, SSHIAP, DART, EMAP, NRIS, hatcheries data, data not CALFISH, SSHIAP, DART, EMAP, NRIS, hatcheries data, data not on the internet such as spreadsheets, ASCII files, paper, etc.on the internet such as spreadsheets, ASCII files, paper, etc.

-- How can we better utilize current software/hardware How can we better utilize current software/hardware advancements advancements with dedicated application development teams with dedicated application development teams and analysts to support BIOP, M&E, CBCIS, and Pacific Coast and analysts to support BIOP, M&E, CBCIS, and Pacific Coast Salmon Recovery Fund effortsSalmon Recovery Fund efforts

SDM Mission StatementSDM Mission Statement

The Salmon Data Management team will, for NWFSC The Salmon Data Management team will, for NWFSC scientists and external customers:scientists and external customers:

• Promote collaboration, communication, and Promote collaboration, communication, and coordination using e-Gov principles and enterprise-coordination using e-Gov principles and enterprise-wide architecture framework to share and access wide architecture framework to share and access internal and external information and data;internal and external information and data;

• Provide and maintain “corporate” data, metadata, Provide and maintain “corporate” data, metadata, and applications;and applications;

• Support analysis and project management services, Support analysis and project management services, andand

• Respond in a timely and effective manner.Respond in a timely and effective manner.

SDM MethodologySDM Methodology

• AwarenessAwareness

• AssessmentAssessment

• Design/Development/TestingDesign/Development/Testing

• Transition/TrainingTransition/Training

• DeploymentDeployment

• MaintenanceMaintenance

• Project PlanningProject Planning

• DocumentationDocumentation

• Independent Validation and VerificationIndependent Validation and Verification

SDM Development SDM Development EnvironmentEnvironment• Setup and Baseline SDM Development Environment Setup and Baseline SDM Development Environment

using “Corporate” Software and Hardware – Winter using “Corporate” Software and Hardware – Winter 2002/032002/03

- Oracle 8.1.7 DBMS w/ 440 Gigs- Oracle 8.1.7 DBMS w/ 440 Gigs

- Oracle9iAS, Oracle Designer 6i, Oracle Developer- Oracle9iAS, Oracle Designer 6i, Oracle Developer

- ESRI SDE and IMS Web Server- ESRI SDE and IMS Web Server

- ESRI/ERDAS License Key Manager - ESRI/ERDAS License Key Manager

- SDM Staff Fileserver 340 Gigs at Raid 5- SDM Staff Fileserver 340 Gigs at Raid 5

- 5 Dual P4 1.7 GHz 1 Gig Workstations/Servers- 5 Dual P4 1.7 GHz 1 Gig Workstations/Servers

- Network upgrades to 100 MB LAN and 1 Gig Fiber- Network upgrades to 100 MB LAN and 1 Gig Fiber

SDM Production SDM Production EnvironmentEnvironment• Setup and Baseline SDM Production Environment Setup and Baseline SDM Production Environment

using “Corporate” Software and Hardware – Spring using “Corporate” Software and Hardware – Spring 20032003

- Oracle 8.1.7 and 9i DBMS Servers- Oracle 8.1.7 and 9i DBMS Servers

- Oracle9iAS, Oracle Forms and Reports - Oracle9iAS, Oracle Forms and Reports ServersServers

- ESRI SDE and IMS Web Servers- ESRI SDE and IMS Web Servers

- 7 Dual P4 2.4 GHz 2 Gig Servers w/ 330 - 7 Dual P4 2.4 GHz 2 Gig Servers w/ 330 Gigs RaidGigs Raid

- Network upgrades to 1 Gig Fiber- Network upgrades to 1 Gig Fiber

NWFSC Salmonid DatabaseNWFSC Salmonid Databasehttp://webapps.nwfsc.noaa.gov/nsdhttp://webapps.nwfsc.noaa.gov/nsd

Pacific Coastal Salmon Recovery Fund Pacific Coastal Salmon Recovery Fund DatabaseDatabase

http://webapps.nwfsc.noaa.gov/pcsrfhttp://webapps.nwfsc.noaa.gov/pcsrf

NWFSC Collaboration WebsiteNWFSC Collaboration Websitehttp://webapps.nwfsc.noaa.govhttp://webapps.nwfsc.noaa.gov

Live Demonstration of…Live Demonstration of…

• NWFSC Salmonid Database NWFSC Salmonid Database Pilot V.1.4Pilot V.1.4

• PCSRF Public Database V.1.0PCSRF Public Database V.1.0

• SDM SDM WebWeb Pilot V.1.3 Pilot V.1.3

Lesson LearnedLesson Learned

• Hardware is cheap – capability doubles every 18 months at same cost Hardware is cheap – capability doubles every 18 months at same cost • MS Windows 2000 Server is easy to manage compared to UnixMS Windows 2000 Server is easy to manage compared to Unix• NMFS Oracle support license has been great but now charge as usedNMFS Oracle support license has been great but now charge as used• ESRI GSA support license is expensive - $36K/yr for NWFSCESRI GSA support license is expensive - $36K/yr for NWFSC• Reverse Proxy Server was difficult to setup with Oracle AS but now Reverse Proxy Server was difficult to setup with Oracle AS but now

stablestable• Disaster recovery and backup for Development servers with Ghost at Disaster recovery and backup for Development servers with Ghost at

$54/server compared to typical $750/server is absolutely essential$54/server compared to typical $750/server is absolutely essential• Reusing Oracle Web Forms and Portals templatesReusing Oracle Web Forms and Portals templates• Oracle Designer 6i Metadata Repository is invaluableOracle Designer 6i Metadata Repository is invaluable• Documentation, documentation, documentation for DQADocumentation, documentation, documentation for DQA• 508 is a continuous improvement process and tradeoffs are involved508 is a continuous improvement process and tradeoffs are involved• People and/or development costs are the most expensive componentPeople and/or development costs are the most expensive component• Moving toward Mercury TestDirector automated testing, MS Visual Moving toward Mercury TestDirector automated testing, MS Visual

Sourcesafe, and increased project managementSourcesafe, and increased project management• Data quality issues for both primary and secondary data continue to Data quality issues for both primary and secondary data continue to

pose the most difficult challenges in time and laborpose the most difficult challenges in time and labor• Managing “change” for all of the above will be even more difficult Managing “change” for all of the above will be even more difficult

over the life cycleover the life cycle

AQ&Q U E S T I O N SQ U E S T I O N SA N S W E R SA N S W E R S