openearth: a 4th paradigm workflow for marine and coastal science
TRANSCRIPT
![Page 1: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/1.jpg)
`
Dutch Data Award for beta sciences 2012
Feb 28th 2013, SRIE 2013
![Page 2: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/2.jpg)
Need for marine and coastal science/engineering http://nupedailynews.com/wp-content/uploads/2013/01/telescope..jpg
http://chromblog.thermoscientific.com/Portals/49739/images/ lims for biobanking1.png
http://www.eiroforum.org/media/photo_galleries/cern/cern-02l.jpg
http://oeatech.net/wp-content/uploads/2011/03/RADARSAT2-satellite.jpg
suspended mud particle
64 μm
6400 km: North Atlantic Oscillation (NAO)
gap 10-6 > 10+6
Water scarcity Flood protection Water pollution
http://upload.wikimedia.org/wikipedia/commons/2/22/ Da_Vinci_Vitruve_Luc_Viatour.jpg
Marine/coastal scales
![Page 3: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/3.jpg)
OpenEarth is a workflow
philosophy technology
community
![Page 4: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/4.jpg)
OpenEarth philosophy
Open up & collaborate
philosophy Non-zero sum game: 1 + 1 = 3 Tragedy of the Commons OpenEarth wants to keep sharing going
![Page 5: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/5.jpg)
OpenEarth philosophy
Open up & collaborate
community
![Page 6: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/6.jpg)
OpenEarth philosophy
Open up & collaborate
• all collaborating is not enough • chaos • coordination needed • but no overall boss • we need smooth workflow • like wikipedia
![Page 7: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/7.jpg)
OpenEarth philosophy
technology
Open up & collaborate
check this out
![Page 8: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/8.jpg)
OpenEarth community: social media & hands-on
philosophy technology
community
![Page 9: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/9.jpg)
LinkedIn group 269 members
![Page 10: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/10.jpg)
Sprint sessions: hands-on outreach & feed-back every year prior to Netherlands Centrum voor Kustonderzoek (NCK) days
![Page 11: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/11.jpg)
OpenEarth philosophy: universal principles
philosophy Technology principles
community
![Page 12: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/12.jpg)
1) data & tools are one: database alone is useless
raw data: volts counts
+ software
data product =
https://earth.esa.int/handbooks/meris/aux-files/image047.jpg http://logfurniturehowto.com/wp-content/uploads/2012/07/ Types-Of-Screwdrivers-And-Their-Uses.jpg
ESA/NASA raw satellite volts
ESA/NASA useful product physical units
![Page 13: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/13.jpg)
2) good enough to share, if good enough to publish transparency to combat sloppiness, mistakes & fraud. No standardization yet.
http://adaywithsfe.files.wordpress.com/2012/09/eazie5.jpg
http://static.nl.groupon-content.net/25/05/1333050000525.jpg
http://cdn.chud.com/a/af/afdcafa0_2601_vegetable_lo_mein.jpeg
http://farm4.static.flickr.com/3330/3599399622_839ec0cc66.jpg http://blog.gjvanbussel.nl/wp-content/uploads/2011/09/Stapel.jpg
![Page 14: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/14.jpg)
3) Quality is a version control process
• Sharing will generate feed-back: version control becomes inevitable • update your own work • allow altered copies to proliferate
• Version control is common practice for • ISO 9001: doc, xls, pdf • Toyota Kaizen: keep on improving • Software engineering: windows update • … science is lacking behind anyway
http://www.knups.nl/leuk_plaatje/56/Helaas_pindakaas.html http://www.food-info.net/nl/national/ww-pindakaas_clip_image001.jpg
![Page 15: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/15.jpg)
OpenEarth technology: a pragmatic choice
philosophy Technology: an open software stack
community
![Page 16: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/16.jpg)
Off-The-Shelf (OTS) vs off-the-drawing board
http://www.bnr.nl/incoming/621827-1301/fyra-578.jpg/ALTERNATES/i/Fyra-578.jpg
http://1.bp.blogspot.com/-Z8vfA9SmoOg/T84rGCE_XaI/AAAAAAAABLM/Wp2nXaTvrEc/s1600/Amsterdam+086.jpg
We seek an open source software stack that can serve our needs today. We do embrace new technology, but will not allow it to delay us from proper data management now.
![Page 17: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/17.jpg)
Cloud technology: operational de facto web-standards
tailored data > OGC WxS …
> ISO SQL- PostGIS > OGC netCDF- CF OPeNDAP
SubVersion …
> OGC KML …
… graphics of data
standard data
raw data
catalogue of data
work done on server
work done on client
what where when who why how … data URLs
smart phone & tablet users scientists professionals
![Page 18: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/18.jpg)
Subversion: version control on data and tools
![Page 19: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/19.jpg)
Subversion: version control on data and tools
# commits
Time in quarters
![Page 20: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/20.jpg)
Web services to data subsets: linking with DOI
![Page 21: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/21.jpg)
All data in Google Earth: DataTube weather models
10 km resolution
satellite data
1km resolution
Dutch digital elevation maps
100 m resolution
scale of interest: km/yr
coastal bathymetry
10 m resolution
dune profiles
1m resolution
Pro
ces
scal
e: k
m/y
r
scale of interest: km/yr
![Page 22: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/22.jpg)
Data scarcity > data abundance: data scientist most sexy job 21st century 1. 1000’s yrs: Empirical Archimedes ea. 2. 100’s yrs: Theoretical Newton ea. 3. 10’s yrs: Computational Neumann ea. 4. Now 4th paradigm by Microsoft Research
Portal to filter: deal with complaints overwhelmed users
![Page 23: OpenEarth: a 4th paradigm workflow for marine and coastal science](https://reader030.vdocuments.net/reader030/viewer/2022032422/55a96d101a28ab8b358b46c5/html5/thumbnails/23.jpg)
Questions