1 ornl daac data products and tools robert cook environmental sciences division oak ridge national...

27
1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting Washington, DC October 14, 2010

Upload: doreen-anthony

Post on 31-Dec-2015

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

1

ORNL DAAC Data Products and Tools

Robert CookEnvironmental Sciences DivisionOak Ridge National Laboratory

Oak Ridge, TN

NSIDC User Working Group MeetingWashington, DC

October 14, 2010

Page 2: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

2

ORNL DAAC

Archive data products produced by projects within NASA’s Terrestrial Ecology Program

Mission: assemble, distribute, and provide data services for a

comprehensive archive of terrestrial biogeochemistry and ecological dynamics observations and models to facilitate research, education, and decision-making in support of NASA’s Earth science.

ORNL DAAC’s Web Site www.daac.ornl.gov

Page 3: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

3

ORNL DAAC by the numbers

Staff: 12 Full time equivalents Environmental scientists, computer scientists, and GIS

specialists Data Holdings

877 data sets; ~1 Tb volume Data set volume: Median = 500 KB; Mean = 500 MB Files per data set: Median = 2; Mean 263 files; Max =

92,000 files Data orders: 620,000 products ordered by 8,200 users in

FY 2009 ~50% have numeric IP Remaining user domains are foreign, commercial,

educational, and government User Working Group: 15 Scientists and NASA Program

Manager

Page 4: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

4

ORNL DAAC: Data CollectionsORNL DAAC: Data Collections

3. Regional and3. Regional and Global Global Studies Studies

(176) (176)• Climate• Soils• Vegetation• Hydroclimatology

2. Validation of Land Products (21)2. Validation of Land Products (21)

Total Data Sets = 877

1. Field Campaigns (670)1. Field Campaigns (670)• FIFE• OTTER• SNF• BOREAS• LBA• SAFARI 2000

BOREASLBA

LBA

S2KS2K

In-situObservations

?

Remote Sensing

LAI/fPAR NPP

• Land Validation• MODIS Subsets• FLUXNET• NPP• BigFoot

LAI/fPARNPP

4. Model Products (9)4. Model Products (9)• Benchmark Models

•IBIS, BIOME-BGC, LSM• Manuscript Models

•PNeT, Century, Biome-BGC

Page 5: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

5

MODIS Land Product Subsetting Tools In a scale and format (text, GeoTIFF) useful for field researchers

Three methods to obtain subsets1. Tool for 1,147 selected sites2. Tool for any user selected location on demand

• User selects product, time period, location, and area (1 x 1 km up to 200 x 200 km) worldwide and for user-selected time periods

3. WebService• Programmatically obtain MODIS subsets for any land location,

time period and area (from 1 pixel up to 201 x 201 km) using a standards based SOAP Web Service

1,147 field sites for MODIS Collection 5

Center Pixel

Mean Value of Pixels

Percent of Pixels that meet QC Criteria

EVI in Southern California

MODIS Land Products (C5) at ORNL DAAC

Surface Reflectance (MOD09A1)

Surface Temperature (MOD11A2)

Land Cover (MOD12Q1)

Vegetation Phenology (MOD12Q2)

NDVI / EVI (MOD/MYD13Q1)

LAI / fPAR (MOD / MYD15A2)

Net Photosynthesis (MOD17A2)

Annual NPP (MOD17A3)

Albedo (calc) (from MCD43A1,2)

Reflectance – BRDF Adjusted (MCD43A2,4)

December 2003 fire

Page 6: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

6

First tool: MODIS Land Product Subsets

Key Features:

Data is available for 12 MODIS land products (Collection 5)

Time resolution is 8-day, 16-day, or annual Spatial resolution is 250 m, 500 m or 1000 m Subsets are available for the entire period of MODIS record

(2000-Present) Provides direct input into text editor or MS Excel User can filter data by QC flags Small file size

Page 7: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

7

LTER site in Minnesota: Cedar Creek Natural Resources Area

Google Earth, Google Map and LandSat views of site

MODIS Article in LTER Newsletter

http://intranet.lternet.edu/modules.php?name=UpDownload&req=getit&lid=700

Page 8: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

8

LTER site in Minnesota: Cedar Creek Natural Resources Area

Center Pixel

Mean Value of Pixels

Percent of Pixels that meet QC Criteria

Page 9: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

9

What we offer: MODIS land product subsets of any size

(Maximum: 201- x 201-km) MODIS land product subsets for any period for a

product Subsets are in ASCII and GeoTIFF format MODIS Collection 5 data

How it works: User inputs the coordinates for the site or selects

from a picklist of sites User chooses the areal extent and the time

period Processing of subsetted product (selection of

tiles, mosaicing, generating time series data file and graphs) takes 10 to 60 minutes for most products (depends on area, time period, and product)

The tool will send an email message containing a URL where the output can be accessed

MODIS Products offered through the subsetting tool for Globe

Surface ReflectanceSurface Temperature

Land CoverVegetation Phenology

NDVI / EVILAI / fPAR

Net PhotosynthesisAnnual NPP Albedo (calc)

Reflectance – BRDF Adjusted

Second Tool: Global Tool for any Location on Earth

Page 10: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

10

Second Tool: Global Tool for any Location on Earth

Example Site in Rondonia-10.185, -63.67

Page 11: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

11

Can select GeoTIFF, in

addition to text (ASCII)

Page 12: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

12

MODIS Land Cover for the Site

Page 13: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

13

Stackable time series

Center Pixel

Mean Value of Pixels

Percent of Pixels that meet QC Criteria

Page 14: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

14

Grid Visualization for Nov 1-16, 2001

White: Filtered pixels

Black: Center pixel

Page 15: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

15

NDVI / Phenology

NDVI for site near Richmond, VA

Page 16: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

16

Land Cover Dynamics (Phenology) (MOD12Q2)

Site near Richmond

Day of the Year

Page 17: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

Demonstration of Global Tool

17

http://daac.ornl.gov/glb_viz_2/12Oct2010_14:01:46_460165200L55.88L-98.48S3L3_MOD15A2_CA-NS1/index.html

Page 18: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

Third Tool: MODIS Web Service

Get MODIS Subsets through machine to machine interaction

SOAP (Simple Object Access Protocol) based

Retrieve Subsets using:

• Command line ( Perl)• Workflows (Kepler)• JAVA desktop software

Page 19: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

19

MODIS Next Steps

Offer next re-processing (Collection 6) in 2011 Offer both C5 and C6 at the same time

Offer subsets of 1-day products LST and Reflectance

Offer subsets up to 1000 km x 1000 km

Page 20: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

20

What is the Scientific Impact of the ORNL DAAC?

Question from Charlie Vorosmarty, UWG Member

Metric: Evaluate how many DAAC data sets have been used in papers.

Page 21: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

21

We encourage users to cite data sets and send us reprints

Page 22: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

Scientific Impact of the ORNL DAAC

Metric: Evaluate how many DAAC data sets have been used in papers, dissertations, or policy reports

Citations to published / archived DAAC data Chambers, J.Q., E.S. Tribuzy, L.C. Toledo, B.F. Crispim, N. Higuchi, J. dos Santos,

A.C. Araujo, B. Kruijt, A.D. Nobre, and S.E. Trumbore. 2009. LBA-ECO CD-08 Tropical Forest Ecosystem Respiration, Manaus, Brazil. Data set. Available on-line [http://daac.ornl.gov] from Oak Ridge National Laboratory Distributed Active Archive Center, Oak Ridge, Tennessee, U.S.A. doi:10.3334/ORNLDAAC/912.

Notify data providers of data publication and ask them to add citation to CV Sponsors, P&T Committees can evaluate data publication productivity

Page 23: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

Metadata contains a suggested citation

23

Page 24: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

24

Example of paper that cites DAAC data

Strack, J.E., G.E. Liston, and R.A. Pielke. 2004. Modeling snow depth for improved simulation of snow-vegetation-atmosphere Interactions. Hydrometeorology 5:723 - 734.

Page 25: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

25

Estimating Scientific Impact: Steps Taken

Ask users for reprints of publications based on data sets obtained from the ORNL DAAC When they order the data and one year after they

ordered data

Review on-line services (e.g., Web of Science, Elsevier’s Science Direct) to see if ORNL DAAC or DAAC Projects are mentioned or if data have been cited in papers full text search, citation indices

Added Digital Object Identifiers (DOI) for each data product to facilitate tracking use of ORNL DAAC data in the literature

Page 26: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

ORNL DAAChttp://daac.ornl.gov/

MODIS Toolshttp://daac.ornl.gov/MODIS/modis.shtml

Bob [email protected]`

26

Page 27: 1 ORNL DAAC Data Products and Tools Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN NSIDC User Working Group Meeting

27

Provide tutorial on “Best Practices for Preparing Ecological Data to Share”

Cook et al. 2001 Bulletin ESA 82: 138 – 141 Best Practices include:

1. Assign Descriptive File Names 2. Use Consistent and Stable File Formats 3. Define the Parameters 4. Use Consistent Data Organization 5. Perform Basic Quality Assurance 6. Assign Descriptive Data Set Titles 7. Provide Documentation Update on-line:http://daac.ornl.gov/PI/pi_info.html

Best Practices for Preparing Ecological

and Ground-Based Data Sets

to Share and Archive

Robert B. Cook, Richard J. Olson,

Paul Kanciruk, and Leslie A. Hook

Environmental Sciences Division

Oak Ridge National Laboratory