Near Real-Time Near Real-Time Ocean Data Ocean Data

ManagementManagementAn Implementation of Open An Implementation of Open

Source Technologies and OGC Source Technologies and OGC ProtocolsProtocols

Charlton Purvis, University of South Carolina, a Charlton Purvis, University of South Carolina, a SEACOOS partnerSEACOOS partner

Near Real-Time Ocean Data Management

SEACOOS was initiated in 2002 with ONR funding

to develop a coastal ocean information system

for FL, GA, SC and NC.

SEACOOS Over-Arching Goal: To significantly increase the quantity and quality of environmental information from the coastal ocean of the SE U.S. and facilitate its use in a wide range of societal, scientific, and educational applications.

Near Real-Time Ocean Data Management

Observational platforms contributed by SEACOOSpartners

Observational platforms contributed by SEACOOSpartners

Near Real-Time Ocean Data Management

SEACOOS modeling Coordinating model

simulations forthe entire region

Near Real-Time Ocean Data Management

The (tiny) data The (tiny) data management management

big picturebig picture

Near Real-Time Ocean Data Management

Near Real-Time Ocean Data Management

Laundry list of core Laundry list of core technologiestechnologies

Base environmentBase environment LinuxLinux ApacheApache Perl & PHPPerl & PHP

Mapping & imagingMapping & imaging University of Minnesota’s University of Minnesota’s

MapServerMapServer ImageMagickImageMagick AniS & GifsicleAniS & Gifsicle GnuplotGnuplot

Data storageData storage PostgreSQLPostgreSQL PostGISPostGIS FilesystemFilesystem

Near Real-Time Ocean Data Management

Data aggregation & Data aggregation & storagestorage

Aggregation format Aggregation format flavorsflavors netCDF (in situ and netCDF (in situ and

remotely-sensed remotely-sensed data)data)

PNG (RS imagery)PNG (RS imagery)

StorageStorage Relational Relational

database (in situ, database (in situ, model output, model output, some RS)some RS)

Files (RS imagery)Files (RS imagery) TechnologyTechnology

PerlPerl PostgreSQLPostgreSQL

& PostGIS& PostGIS

Near Real-Time Ocean Data Management

NormalizationNormalization

Reporting time Reporting time variesvaries In-situ dataIn-situ data

E.g. daily, hourly, E.g. daily, hourly, half-hourly, every 10 half-hourly, every 10 minutesminutes

Remotely-sensed Remotely-sensed datadata

E.g. twice dailyE.g. twice daily TechnologyTechnology

PostgreSQL & PostgreSQL & PostGISPostGIS

Near Real-Time Ocean Data Management

Visualization : interactive Visualization : interactive mappingmapping

Production siteProduction sitehttp://www.seacoos.orghttp://www.seacoos.org

DevelopmentsiteDevelopmentsite

TechnologyTechnology MapServerMapServer ImageMagickImageMagick Perl & PHPPerl & PHP

Near Real-Time Ocean Data Management

Visualization : graphs & Visualization : graphs & animationsanimations

Ad-hoc time-series Ad-hoc time-series graphsgraphs

Ad-hoc animationsAd-hoc animations

Technology : MapServer | ImageMagickTechnology : MapServer | ImageMagickGnuplot | Gifsicle |AniSGnuplot | Gifsicle |AniS

Near Real-Time Ocean Data Management

Dissemination (it Dissemination (it isis the the technology)technology)

OPeNDAP (DODS) data accessOPeNDAP (DODS) data access OGC-friendly: WMS, WFSOGC-friendly: WMS, WFS

pick a layer, any layer pick a layer, any layer http://nautilus.baruch.sc.edu/http://nautilus.baruch.sc.edu/seacoos_misc/show_sea_coos_obs_time_ranges.phpseacoos_misc/show_sea_coos_obs_time_ranges.php

Near Real-Time Ocean Data Management

Dissemination : example Dissemination : example 11

IntegratedOceanObservingSystemhuIntegratedOceanObservingSystemhurricanedemo rricanedemo

http://www.openioos.orghttp://www.openioos.org

Near Real-Time Ocean Data Management

Dissemination : example Dissemination : example 22

NC NC OneMapOneMapViewer Viewer http://gisdata.usgs.net/http://gisdata.usgs.net/website/NC_OneMap/website/NC_OneMap/viewer.aspviewer.asp

Near Real-Time Ocean Data Management

Open source : obstacles & Open source : obstacles & sustenancesustenance

ObstaclesObstacles DocumentationDocumentation Stereotypes in a commercialized worldStereotypes in a commercialized world

SustenanceSustenance CommunicationCommunication

Listservs and twikisListservs and twikis Information sharing protocol standardsInformation sharing protocol standards

OGCOGC

Near Real-Time Ocean Data Management

OGC sustenance? Prove OGC sustenance? Prove it!it!

Log layer usageLog layer usage Example layer : Example layer :

MODIS RGB MODIS RGB compositecomposite

Available viaAvailable viaSEACOOSSEACOOSinteractive mapsinteractive mapsand WMSand WMS

Near Real-Time Ocean Data Management

Layer usage loggingLayer usage logging MODIS RGB MODIS RGB

compositecompositetotal hits = 652total hits = 652

Interactive mapInteractive maphits = 105hits = 105

WMS hits = 547WMS hits = 547

Near Real-Time Ocean Data Management

An open source attitudeAn open source attitude

SEACOOS data managementSEACOOS data management Direct result of combined effort from academia, Direct result of combined effort from academia,

government, and the private sectorgovernment, and the private sector Providing the foundation for other ocean Providing the foundation for other ocean

observing systems to adapt and build uponobserving systems to adapt and build upon Plenty of miles to go with more room to grow!Plenty of miles to go with more room to grow!

Who am I?Who am I? Charlton Purvis, University of South Carolina, Charlton Purvis, University of South Carolina,

SEACOOSSEACOOS cpurvis@sc.educpurvis@sc.edu Happy to help and share.Happy to help and share.