john campbell - · pdf filejohn campbell . quantifying uncertainty in ecosystem studies lter...

63
JOHN CAMPBELL

Upload: vuthien

Post on 06-Feb-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

JOHN CAMPBELL

Page 2: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Quantifying Uncertainty in

Ecosystem Studies

LTER All Scientists Meeting

Estes Park, Colorado

Sept. 10-13, 2012

Page 3: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Agenda Introductions (what's your biggest source of uncertainty?) 5 minute presentations (5 minutes questions/discussion) • Mark Harmon: Introduction to sources of uncertainty • Adam Skibbe: Precipitation interpolation • Xuesong Zhang: Precipitation • John Battles: Biomass • Mark Green: Streams • Ruth Yanai: Soils • Jeff Taylor: NEON

Overarching topics: Introduction followed by group discussion • Craig See: Gaps • Carrie Rose Levine: Monitoring

A plea for your involvement

Page 4: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Bormann et al. 1977. Science.

Page 5: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

What is QUEST?

QUEST is a research network interested in improving

understanding and facilitating use of uncertainty analyses in

ecosystem research

• Funding through LNO, NSF

• Working group meetings (Boston, Oregon, New York, NH)

• Held educational workshops (e.g., ESA)

• Several publications

www.quantifyinguncertainty.org [email protected]

Page 6: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Introduction

• Name

• Affiliation

• Site

• What’s your biggest source of

uncertainty?

Page 7: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Discussion Questions

Overarching topics: Intro followed by group discussion Craig See: Gaps Carrie Rose Levine: Monitoring Should we use consistent approaches to estimating uncertainty for every observation? How does one derive an optimal sampling strategy for minimizing uncertainty? Is it always possible to estimate uncertainty?

Page 8: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

MARK HARMON

Page 9: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Sources of Uncertainty

• Measurement error-technique and technology

• Sampling error-natural variability in space and time

• Regression/conversion (parameter) error- models used to convert one set of numbers to another

• Model selection error (structural error)-uncertainty of knowledge/representation

Page 10: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Uncertainty

Natural variability

Knowledge uncertainty

“Random” variability

Systematic Error-bias

Page 11: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Uncertainty

Natural variability

Knowledge uncertainty

“Random” variability

Systematic Error-bias

Page 12: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Judging progress objectively

Current system

Ideal system

timeline

Page 13: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

ADAM SKIBBE

Page 14: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

CWT Precip Models

Page 15: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Spline High 190 Low 111 Radial Basis High 192 Low 114 Kriging High 183 Low 135

Kernel High 182 Low 134 IDW High 183 Low 135 Global Polynomial High 196 Low 119

IDW Comparisons

Model Comparisons

Page 16: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

AND Comparisons

Page 17: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 18: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 19: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 20: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 21: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

XEUSONG ZHANG

Page 22: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Enhancing Spatial Precipitation Interpolation using Auxiliary Data

Xuesong Zhang

Joint Global Change Research Institute

Pacific Northwest National Laboratory and University of Maryland

Great Lakes Bioenergy Research Center Thrust 4 - Sustainability

Michigan State University

Page 23: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Universal Spatial Variation Model

• Materon (1969) proposed a general representation of spatial variables:

– 𝑍 𝒙 = 𝑚 𝒙 + 𝜀′ 𝒙 + 𝜀′′(𝒙)

– where 𝒙 is a spatial location, 𝑚 is deterministic component, 𝜀′ represents a stochastic component driven by unknown factors, 𝜀′′ denotes measurement error.

• Basic form of Kriging

– 𝑍 𝒙 = 𝑚 𝒙 + 𝜀 𝒙

– where 𝑚 is global or locally varying mean, and 𝜀 is residual that is spatially correlated.

Page 24: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Simple Kriging • Best Linear Unbiased Estimator (BLUE)

• Estimate residual at an unsampled point by a linear combination of the observed residuals at surrounding points.

– 𝑍 𝒖 − 𝑚 𝒖 = 𝜆𝑖𝑛𝑖=1 ∙ [𝑍 𝒙 − 𝑚 𝒙 ]

• Allow for flexible 𝑚 𝒖

– 𝑚 =1

𝑛 𝑍(𝒙)𝑛

𝑖=1

– 𝑚 𝒙 = 𝛽0 + 𝛽1 ∙ 𝑌1(𝒙) + 𝛽2 ∙ 𝑌2(𝒙)

– where Yi is external variable, such as

– elevation, spatial coordinate, NEXRAD

Page 25: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

An example in Little River Experimental Watershed

Page 26: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

• Spatial precipitation estimated by different methods on October 3, 2002

• 𝑚 =1

𝑛 𝑍(𝒙)𝑛

𝑖=1 𝑚 𝒙 = 𝛽0 + 𝛽1 ∙

𝑁𝐸𝑋𝑅𝐴𝐷(𝒙)

Precipitation maps

High : 115.7

1

Low : 32.59

116 mm 32 mm

62 mm 65 mm 96 mm

Page 27: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Evaluation statistics

• Estimation Efficiency

𝐸𝐸 = 1.0 − [𝑍 𝒙 − 𝑍 𝒙 ]𝑛

𝑖=1

[𝑍 𝒙 − 𝑍 (𝒙)𝑛𝑖=1 ]

– where 𝑍 𝒙 estimated precipitation values at 𝒙, and 𝑍 (𝒙) is mean value of the 𝑛 rain-gauge observed precipitation values.

Methods

Evaluation coefficients

SK NEXRAD SKlm

Oct. 13,

2002

Mean 63.7 73.43 60.95

SDV 5.84 19.14 16.52

EE 0.10 -0.26 0.65

Page 28: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Water Yield

Map

s in A

ugu

st, 20

03

32 mm

48 mm 26 mm

52 mm

79 mm 68 mm

99 mm 111 mm

6.5

4.4

6.3

7.4

0

2

4

6

8

SK NEXRAD Bias SKlm

August, 2003

Str

eam

flo

w (

cm

s)

Monthly Streamflow in August, 2003

Page 29: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

xzhang.pbworks.com

Page 30: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 31: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 32: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Thank you for your attention!

Page 33: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

JOHN BATTLES

Page 34: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Estimating uncertainty in forest biomass: What exactly should we be reporting?

QUEST Workshop –LTER ASM 2012 John Battles Hubbard Brook

Fig. 2 in Zapata-Cuartas et al. 2012.

Page 35: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Year

20072002199719921987198219771965

Tota

l B

iom

ass (

Mg h

a-1

)

136

150

165

180

195

210

225

233

Tota

l B

iom

ass (

Mg h

a-1

)

6

10

15

20

25

29

W6: Hubbard Brook Reference Watershed with uncertainty estimates

Live trees Dead trees Live saplings

Page 36: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Sources of uncertainty in forest carbon estimates

Measurement e.g., diameter and height measurements (tree) species (tree) density (plot) Biomass transfer functions (tree level) e.g., allometric equations, volume equations, wood density estimates Sampling error (class level) error when plots in a class are aggregated to get central tendencies (e.g., average to get mean value) Model selection (tree level) related to transfer function

Page 37: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

3.0 3.5 4.0 4.5 5.0 5.5 6.0

3.5

4.0

4.5

5.0

5.5

log10(PIRU$PV)

log

10

(PIR

U$

AB

OV

E)

Attention has focused on two aspects: 1. The statistics around the transfer function where tree measurements are used to calculate mass.

2. Propagating uncertainty as we scale up from trees to plots to stands to forests.

Page 38: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Zapata-Cuartas et al. 2012. Forest Ecology and Management 277:173–179

Many ideas on how to best develop transfer functions.

3.0 3.5 4.0 4.5 5.0 5.5 6.0

3.5

4.0

4.5

5.0

5.5

log10(PIRU$PV)

log

10

(PIR

U$

AB

OV

E)

0e+00 2e+05 4e+05 6e+05 8e+05

0e

+0

03

e+

05

PIRU$PV

pA

BO

VE

Whittaker et al. 1974.

Page 39: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Methods for uncertainty assessment

Analytical error propagation e.g., Taylor expansions Monte Carlo simulation Hierarchical analysis e.g., Bayesian state space model Nested likelihood functions Ad hoc approaches e.g., various forest offset/carbon accounting protocols None

Page 40: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Back to the question: What should we be reporting? 1. Science Leave to peer review process with expectation uncertainty will be addressed. 2. What about resource managers? e.g., National Forest and National Parks now required to monitor forest carbon pools. 3. What about carbon/GHG accounting protocols in states/regions? National standards and international standards 4. What about remote sensing approaches calibrated with biometric results?

Page 41: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

MARK GREEN

Page 42: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Fluxfrom

a point

ConcentrationDischarge

Time Step/

Sampling Schem

e

Stage

Rating Curve

Grab Samples

Accuracy

Precision

quality of Q measurem

ents

n of Q measurem

ents

Representative

Sampling

Lab stuff

sampling

protocolsmodel

selection

serial autcorrelation

Discharge

Measurem

ents

Interpolation model

other

variables

Page 43: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis
Page 44: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

RUTH YANAI

Page 45: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Sources of Uncertainty in Soil Nutrient Contents

Sampling Uncertainty Analytical Uncertainty

Page 46: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Nitrogen in the Forest Floor Hubbard Brook Experimental Forest

The change is insignificant (P = 0.84). The uncertainty is 22 kg/ha/yr.

Page 47: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

We can’t detect a difference of 1000 kg N/ha in the mineral soil…

How should we estimate the uncertainty in change over time in soil N?

Page 48: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

JEFF TAYLOR

Page 49: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

A National Observatory: 20 Eco-Climatic Domains

49 [email protected]

Page 50: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Terrestrial Measurements

[email protected] 50

Page 51: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

NEON Data Products

[email protected] 51

584 level 1 data products

117 level 4 data products

Page 52: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

52 [email protected]

Challenges

• Coordinating Standardized Approaches

(Observer Bias)

• Combining Uncertainties Across Scales

• Metadata

• Reprocessing

Page 53: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

The National Ecological Observatory Network is a project sponsored by the National Science Foundation and managed under cooperative agreement by NEON Inc.

[email protected] 53

www.neoninc.org

[email protected]

Page 54: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

CRAIG SEE

Page 55: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Why gap filling?

Credit: Odonfiction.wordpress.com

Credit: Don Buso

Page 56: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

What do you do?

• Sometimes its not important (finding mean)

• Sometimes we need a continuous records (calculating pools, fluxes)

• Often a reasonable estimate can be made based on other available data

Page 57: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Gap filling (imputation) methods

• Use of historical averages

• Bayesian Bootstrapping

• Expectation-maximization algorithm

• Use neighboring values

– Direct substitution

– Regression

All gap filling methods introduce new error into the final total!

Page 58: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Streamflow gaps at Wakayama

weir12

weir16

weir17

weir20

0

100

200

300

0 100 200 300

0

50

100

150

0 50 100 150

0

50

100

150

0 50 100 150

0

50

100

0 50 100

Eiji Matsuzaki

Page 59: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Precipitation gaps at Sevilleta Volume and chemistry measurements taken from 20 collectors across SEV from 1989-1995.

How do we incorporate “gap uncertainty” into annual nitrate deposition estimates?

Page 60: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Statistics

• Stepwise regressions using neighboring gauges as predictor variables

• 68.2% PI

• Relative errors add

0

20

40

60

80

100

120N

itra

te (

mg/

m2)

Gauge 2E Annual Nitrate Deposition

1989 1990 1991 1992 1993 1994 1995

Page 61: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

CARRIE ROSE LEVINE

Page 62: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Statistical Approaches

We used certain data analysis methods depending on the available data (pg. 7).

Model Type Time Series Multiple Sites

Repeated measures mixed

effects model X X

Detectable difference

analysis X

Mann Kendall trends test

and General Linear Model X

Repeated measures mixed effects model: a generalized linear model that can include

random as well as fixed effects. Time series within each site treated as a repeated

measure, and random subsamples of sites were selected to generate hypothetical

sampling schemes.

Detectable difference analysis: describes the ability to detect significant changes in a

future survey. The input variables include the sample size and standard deviation of the

original survey and an alpha and power level.

Mann Kendall trends test and General Linear Model: Mann Kendall test was used to

assess trends in time series based on the Kendall rank correlation. When sampling took

place throughout the year and seasonal trends were present, we used a Seasonal Mann

Kendall trend test. General linear regression and the standard error of the were used to

assess slope and the uncertainty in trends

Page 63: JOHN CAMPBELL - · PDF fileJOHN CAMPBELL . Quantifying Uncertainty in Ecosystem Studies LTER All Scientists Meeting ... Taylor expansions Monte Carlo simulation Hierarchical analysis

Model estimate and model

standard error of long-

term average

concentrations of SO4 (mg

L-1) based on a repeated-

measures mixed-effects

model using 50 random

iterations for each

simulated subsample size.

Open symbols show

models that reduced the

number of lakes sampled,

and red symbols show

models that reduce the

number of months

sampled per year for all

lakes.