Data Standards Workflow

Raw data Scripts Database

Store raw data in subversion to

keep track of history

Stored files (netcdf)

accessible through the web

Extract Transform Load

Charts & Maps

Tools and websites

Provide

Add meta information

Script to convert raw data into

netcdf

OpenEarthRawData

OpenEarth

OPeNDAP

OpenEarthTools

Data Standards Workflow

Raw data Scripts Database

Store raw data in subversion to

keep track of history

Stored files (netcdf)

accessible through the web

Extract Transform Load

Charts & Maps

Tools and websites

Provide

Add meta information

Script to convert raw data into

netcdf

OpenEarthRawData

OpenEarth

OPeNDAP

OpenEarthTools

Extract

• subversion• storing raw data

Subversion• Remote file server• Work on local copy• Track changes

Subversion server

Local copy

checkout update commit

Delete

Add

Copy

Extract

Procedure

Subversion server

Local copy

checkout updatecommit

Delete

Add

Copy

Procedure: check outExtract – storing raw data

• Checkout the directory (i.e. create local copy) • https://repos.deltares.nl/repos/OpenEarthRawData/course

• Right mouse click (RMC) for Tortoise menu

D:\data\micore

https://repos.deltares.nl/repos/OpenEarthRawData/course

Extract – storing raw data

Procedure: check out

Subversion server

Local copy

checkout updatecommit

Delete

Add

Copy

Procedure: addExtract – storing raw data

Add a directory for your data

• branches/• tags/• trunk/

• organization/• datasetname

• cache/• raw/• scripts/• inspire_description.xml

• course• Pc number/

• cache/• raw/

• transect.txt• scripts/• inspire_description.xml

Allows for use of authorization

We’re working under course today. Add your pc directory

You can store your data here, after the course

We’ll make this file later

Get this file from:OpenEarthRawData\course\example\raw

Extract – storing raw data

• Add the pcname directory to your local subversion copy

Extract – storing raw data

Procedure: add

Subversion server

Local copy

checkout updatecommit

Delete

Add

Copy

Procedure: commitExtract – storing raw data

• RMC for Tortoise menu• Commit your local changes. Changes will be sent

to server.Some useful message here

Extract – storing raw data

Procedure: commit

Subversion• Remote file server• Work on local copy• Track changes

Subversion server

Local copy

checkout update commit

Delete

Add

Copy

Extract - summary

Procedure