how long should a long-term river study be?

14
This article was downloaded by: [McMaster University] On: 05 November 2014, At: 09:04 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK Journal of Freshwater Ecology Publication details, including instructions for authors and subscription information: http://www.tandfonline.com/loi/tjfe20 How Long Should a Long-Term River Study Be? Jill F. Thomas a a National Council for Air and Stream Improvement , P.O. Box 1259, Anacortes, Washington, 98221, USA Published online: 11 Jan 2011. To cite this article: Jill F. Thomas (2005) How Long Should a Long-Term River Study Be?, Journal of Freshwater Ecology, 20:2, 367-379, DOI: 10.1080/02705060.2005.9664977 To link to this article: http://dx.doi.org/10.1080/02705060.2005.9664977 PLEASE SCROLL DOWN FOR ARTICLE Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and should be independently verified with primary sources of information. Taylor and Francis shall not be liable for any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of the Content. This article may be used for research, teaching, and private study purposes. Any substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://www.tandfonline.com/page/terms- and-conditions

Upload: jill-f

Post on 11-Mar-2017

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How Long Should a Long-Term River Study Be?

This article was downloaded by: [McMaster University]On: 05 November 2014, At: 09:04Publisher: Taylor & FrancisInforma Ltd Registered in England and Wales Registered Number: 1072954 Registeredoffice: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK

Journal of Freshwater EcologyPublication details, including instructions for authors andsubscription information:http://www.tandfonline.com/loi/tjfe20

How Long Should a Long-Term RiverStudy Be?Jill F. Thomas aa National Council for Air and Stream Improvement , P.O. Box 1259,Anacortes, Washington, 98221, USAPublished online: 11 Jan 2011.

To cite this article: Jill F. Thomas (2005) How Long Should a Long-Term River Study Be?, Journal ofFreshwater Ecology, 20:2, 367-379, DOI: 10.1080/02705060.2005.9664977

To link to this article: http://dx.doi.org/10.1080/02705060.2005.9664977

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all the information (the“Content”) contained in the publications on our platform. However, Taylor & Francis,our agents, and our licensors make no representations or warranties whatsoever as tothe accuracy, completeness, or suitability for any purpose of the Content. Any opinionsand views expressed in this publication are the opinions and views of the authors,and are not the views of or endorsed by Taylor & Francis. The accuracy of the Contentshould not be relied upon and should be independently verified with primary sourcesof information. Taylor and Francis shall not be liable for any losses, actions, claims,proceedings, demands, costs, expenses, damages, and other liabilities whatsoever orhowsoever caused arising directly or indirectly in connection with, in relation to or arisingout of the use of the Content.

This article may be used for research, teaching, and private study purposes. Anysubstantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &Conditions of access and use can be found at http://www.tandfonline.com/page/terms-and-conditions

Page 2: How Long Should a Long-Term River Study Be?

How Long Should a Long-Term River Study Be? Jill F. Thomasa

National Council for Air and Stream Improvement P.O. Box 1259

Anacortes, Washington 98221 USA

ABSTRACT I developed a quantitative method to determine appropriate time lengths for long-

term river studies. A literature review identified three critical components for evaluating length of long-term studies - the length of relevant time spans, sufficient statistical power to see an effect, and the variability of the system. The first component (relevant time spans) does not require data and, therefore, can provide an a p r i o r i estimation of the required study length. The remaining components can be used with historical data or with preliminary data to provide a detailed characterization of study length requirements. The method was tested using fish community and water quality data from a long-term multi-river study and successfully characterized the unique time requirements for each river.

INTRODUCTION Temporal ecological studies can range in time from less than a year to open-ended

programs with no set endpoints. In today's world of accountability and limited resources, researchers need to answer the question, "How long is long enough?" in order to balance data requirements with economic and time resources. At what point has the study accumulated adequate observations to answer the relevant questions with sufficient power?

I developed a "weight of evidence" method to determine the minimum time requirement for a long-term river study within the framework of the study question, components, and preliminary data analysis. The method was developed from the results of a literature review that revealed three critical components - relevant time spans, sufficient experimental power, and background variability. The literature review is here summarized and the method is applied to an experimental design and tested with data from an on-going long-term receiving water study.

The parameters for the literature review were that studies had to be specific to rivers, more than one year in length, and cover biotic andlor abiotic components. The search produced 28 papers and included studies of persistence/stability/variability, temporal recovery, cumulative effects, environmental drivers, long-term monitoring programs, and concept papers. The biological parameters included one or more of the following: periphyton, macrophytes, benthic macroinvertebrates, and fish.

Two thirds of the studies (14 of 21) used historical data sources as a determining factor in setting the study length (Bryant 1985, Poff and Ward 1989, Bradt et al. 1999, Onorato et al. 2000, Lowell et al. 2000, Schubauer-Berigan et al. 2000, Haag and Westrich 2002, Jennings and Jamagin 2002, Kovacs et al. 2002, Lowell and Culp 2002, Metzling et al. 2002, Sosiak 2002, Woodward et al. 2002, Papanicolaou et al. 2003). Additionally, nearly half of the studies related the time of the study to specific changes in the watershed or river conditions from point sources, non-point sources, or events (Bryant 1985, Sullivan 1985, Onorato et al. 2000, Klug and Cottingham 2001, Minshall et al. 2001a, Minshall et al. 2001b, Minshall et al. 2001c, Kovacs et al. 2002, Jennings and Jarnagin 2002, Sosiak 2002); in some cases these were before and after designs that essentially covered many years. There were few studies not using historical data and not

'Current address: Weyerhaeuser, Mail Stop WTC 2G2,32901 Weyerhaeuser Way S, Federal Way, WA 98001 USA; Email: [email protected]

Journal of Freshwater Ecology, Volume 20. Number 2 -June 2005

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 3: How Long Should a Long-Term River Study Be?

correlated to specific changes (Gilliom et al. 1995, Fmget et a]. 2001, Scarsbrook 2002). However, the use of available data and correlation to watershed or river events were not the only considerations cited in the literature as relevant. Several authors discussed the importance of identifying relevant time spans (e.g., life spans of biological endpoints or time spans for recovery of drought effects) and including these when considering the study length (Minshall 1988, Cooper et al. 1998, Philippi et al. 1998, Scarsbrook 2002). Three papers discussed the necessity of designing the study so that there was sufficient experimental power for detecting effects should effects be present (Philippi et. al. 1998, Urquhart et al. 1998, USEPA 2002). Five of the papers addressed the aspect of the dynamic nature of these systems and therefore the need to include the effects of natural or background variability (Poff and Ward 1989, Scarsbrook 2002, USEPA 2002, Kratz et al. 2003, Papanicolaou et al. 2003).

Of the five identified components, relevant time spans, sufficient statistical power, and background variability are broadly important to all classes of long-term studies. Additionally, historical data or pilot study information is needed to calculate effect size and sample size. Thus, these components were incorporated into a "weight of evidence" approach to determine how long a study should continue (Table 1). Analysis of each of these components would provide a minimum required time in which to see an effect if an effect existed for each endpoint, resulting in a range of times within which the study length should fall. Determination of the final time frame would rely on investigators interpreting the time ranges in terms of their study question, experimental design, and practical issues.

Table 1. Critical components for determining study length with steps for calculations.

Critical component Element(s) Method for determination

I. Relevant time spans Time spans for 1. List study components and their relevant biotic relevant time spans (e.g., study and abiotic component = large-bodied fish; time components of span = average lifespan for the large- the study bodied fish).

2. Determine length of all relevant time spans (from reference or literature search).

11. Statistical power Power, a, 1. Preset power and a to levels effect size, and acceptable for the study. sample size 2. Calculate effect size from historic or

pilot study data. 3. Use power, a and effect size to

determine necessary sample sizelsite.

4. Sample sizelsampling schedule determines minimum required time.

111. Background variability River 1. Calculate signa1:noise ratio discharge as a

a. Signal = mean change in surrogate for variability discharge

b. Noise = standard deviation.

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 4: How Long Should a Long-Term River Study Be?

METHODS AND MATERIALS In 1998, a 10 to 20 year long-term receiving water study was begun at four

effluent receiving waters in the United States - Codorus Creek in Pennsylvania, the Leaf River in Mississippi, the McKenzie River in Oregon and the Willamette River in Oregon (Hall et al. 1999). Codorus Creek is a wadeable stream flowing northeast through a heavily agricultural and urban area in the Northern Piedmont ecoregion in south central Pennsylvania. There are six sites sampled in the study area covering 44.4 km along the West Branch and mainstem of Codorus Creek. The Leaf River is a moderate size, unregulated fast flowing river that is located on a broad undeveloped flat plain in the Southeastern Plains ecoregion of southern Mississippi. There are six sampling sites covering 5 1.2 km of the lower Leaf River. The McKenzie River is a large, fast flowing river moving in the forested valleys of the western Cascades and the Willarnette Valley ecoregions in west central Oregon. There are five sampling locations in the study area covering 25.6 km along the lower McKenzie River. The Willamette River is a large, fast river flowing north through a wide agricultural valley in the Willamette Valley ecoregion of western Oregon. There are six sampling locations covering 42.4 krn extending along the upper Willamette River. Complete descriptions of the rivers and their individual sampling locations are in Thomas and Hall (2004).

Fish samples were collected quarterly from September 1998 to June 2001 and semi-annually from September 2001 through September 2003 at Codorus Creek, the McKenzie River, and the Willamette River. The Leaf River was sampled annually in October from 1999 through 2003. Fish in Codorus Creek were captured using backpack electrofishing with three runs of approximately 600 s in riffle, run and pool areas. The McKenzie River and the Willamette River were sampled using nearshore boat electrofishing, with two runs of approximately 250 m in length, and nearshore backpack electrofishing of three runs of approximately 600 s each. The Leaf River was sampled using nearshore boat electrofishing of one run of approximately 30 min and nearshore backpack electrofishing of three runs of approximately 600 s each. All captured fish were identified to the lowest practicable taxonomic level (Table 2). Runs were normalized to CPUE (catch per unit effort) (600 s average for the backpack, 500 m total for the Oregon boat electrofishing, and 30 min for the Leaf boat electrofishing).

Grab water samples were collected monthly from 1997 to 2003 for Codorus Creek, the McKenzie River, and the Willamette River, and from 1999 through 2003 for the Leaf River. Analysis included temperature and pH (recorded in the field) and color (Pt-Co, determined on unpreserved samples by HACH Method 10068). Water quality data is summarized in Table 3.

Component I : Relevant tinre spans. Time spans were chosen to reflect the biotic endpoints of the study and the abiotic regional factors that occurred within the 10 to 20 year temporal framework of the study question. The biotic endpoints were fish community and condition; the relevant time spans chosen were the lifespans of representative species of large-bodied and small-bodied fish for each river (www.fishbase.org, Ross 2001, Steiner 2000). The abiotic factors included flow cycles, drought, and flood; the time spans for these were cycle time or recovery time. Potential human disturbances (e.g., newly permitted discharges or accidental events or disturbances) were not considered sufficiently predictable to be included.

Component 2: Sufficient statisticalpower. To determine the length of study based on sufficient statistical power, four components were needed: power, a (type I error), effect size, and sample size. Two of the components, acceptable power and a levels, were preset for this study at 80% and 0.10, respectively. These levels were chosen as

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 5: How Long Should a Long-Term River Study Be?

Tab

le 2

. Sum

mar

y of

fis

h ca

tch

data

fro

m C

odor

us C

reek

(C),

Lea

f Riv

er (

L),

McK

enzi

e R

iver

(M

), a

nd W

illam

ette

Riv

er (

W).

C

aptu

re m

etho

ds w

ere

back

pack

ele

ctro

fish

ing

(1) a

nd b

oat e

lect

rofi

shin

g (2

).

Tax

on

Com

mon

nam

e R

iver

M

etho

d T

axon

C

omm

on n

ame

Riv

er

Met

hod

Aci

pens

er t

rans

mon

tanu

s w

hite

stu

rgeo

n W

2

C. g

ulos

us

riff

le s

culp

in

M, W

I

Acr

oche

ilus

alu

tace

us

chis

elm

outh

W

1,

2

C. p

erpl

exus

re

ticul

ate

scul

pin

M, W

1

,2

Alo

sa a

laba

mae

al

abam

a sh

ad

L 2

C. r

hoth

eus

torr

ent

scul

pin

M, W

1

,2

A.

chry

soch

lori

s sk

ipja

ck h

erri

ng

L 2

Cyc

lept

us e

long

atus

bl

ue s

ucke

r L

2 A

mbl

opli

tes

ario

mm

us

shad

ow b

ass

L 2

Cyp

rine

lla

anal

osta

na

satin

fin

shin

er

C

1 A

. ru

pest

ris

rock

bas

s C

1

C. s

pilo

pter

a sp

otfi

n sh

iner

C

1

Am

eiur

us n

atal

is

yello

w b

ullh

ead

c, w

1

,2

C. v

enus

ta

blac

ktai

l sh

iner

L

1,2

A

mia

cal

va

bow

fin

L 2

Cyp

rini

dae

unid

entif

ied

min

now

C

, L, M

, 1

,2

W

Am

moc

rypt

a be

ani

nake

d sa

nd d

arte

r L

1 C

ypri

nida

e un

iden

tifie

d da

ce

M, W

1

,2

Ang

uill

a ro

stra

ta

amer

ican

eel

L

2 C

ypri

nus

carp

io

com

mon

car

p c

, w

1,2

A

phre

dode

rus

saya

nus

pira

te p

erch

L

2 D

oros

oma

cepe

dian

um

gizz

ard

shad

L

2 0

A

plod

inot

us g

runn

iens

fr

eshw

ater

dru

m

0

L 2

Eri

cym

ba b

lrcc

a~a

silv

erja

w m

inno

w

L 1

Cam

post

oma

anom

alum

ce

ntra

l st

oner

olle

r C

1

Eso

x ni

ger

chai

n pi

cker

el

L 2

Car

piod

es c

ypri

nus

quill

back

car

psuc

ker

L 2

Eth

eost

oma

blen

nioi

des

gree

nsid

e da

rter

C

1

C. v

elif

er

high

fin

carp

suck

er

L 1,

2

E. h

istr

io

harl

equi

n da

rter

L

1 C

atos

tom

us c

omm

erso

ni

whi

te s

ucke

r C

1

E. o

lmst

edi

tess

ella

ted

dart

er

C

1 C

. mac

roch

eilu

s la

rges

cale

suc

ker

M, W

1,

2

E. s

tigm

aeum

sp

eckl

ed d

arte

r L

2 C

. pla

tyrh

ynch

us

mou

ntai

n su

cker

M

, W

1, 2

E

. zon

ale

band

ed d

arte

r C

1

Cen

trar

chid

ae

unid

entif

ied

sunf

ish

c, L

1, 2

E

xogl

ossu

m m

axil

ling

ua

cutl

ips

min

now

C

I

Cli

nost

omus

fund

uloi

des

rosy

side

dac

e C

1

Fun

dulu

s di

apha

nus

band

ed k

illif

ish

C

1 C

otti

dae

unid

entif

ied

scul

pin

M, W

1

,2

F. o

liva

ceus

bl

acks

potte

d L

1 to

pmin

now

C

ottu

s as

per

pric

kly

scul

pin

W

1, 2

G

ambu

sia

afi

nis

m

osqu

itofi

sh

L 1

C. b

aird

i m

ottle

d sc

ulpi

n M

, W

1, 2

G

aste

rost

eus

acul

eatu

s th

rees

pine

stic

kleb

ack

M

1 C

. bel

ding

i pa

iute

scu

lpin

M

, W

1,2

H

iodo

n te

rgis

us

moo

neye

L

2 C

. cog

natu

s sl

imy

scul

pin

M, W

1

,2

Hyb

ogna

thus

nuc

hali

s si

lver

y m

inno

w

L 1

,2

C. c

onfu

sus

shor

thea

d sc

ulpi

n M

, W

1 H

ypen

teli

um n

igri

cans

no

rthe

rn h

og s

ucke

r L

2

(con

tinue

d)

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 6: How Long Should a Long-Term River Study Be?

Tab

le 2

(co

ntin

ued)

Ic

talu

rus f

urca

tus

blue

cat

fish

L

2 N

. vol

ucel

lus

mim

ic s

hine

r L

1,2

I.

pun

ctat

us

chan

nel

catf

ish

L 1,

2

N.

win

chel

li

clea

r ch

ub

L 2

Icti

obus

bub

alus

sm

allm

outh

buf

falo

L

2 O

ncor

hync

hus

clar

ki

cutth

roat

trou

t M, W

2

Lam

petr

a ri

char

dson

i w

este

rn b

rook

lam

prey

M

, W

1,2

0

. kis

utch

co

ho s

alm

on

M, W

2

Lep

isos

teus

ocu

latu

s sp

otte

d ga

r L

2

0. m

ykis

s ra

inbo

w tr

out

M, W

1

,2

L. o

sseu

s lo

ngno

se g

ar

L

2 0

. myk

iss

stee

lhea

d W

2

Lep

omis

aur

itus

re

dbre

ast

sunf

ish

C

1 0

. tsh

awyt

scha

ch

inoo

k sa

lmon

M

, W

1,2

L

. cya

nell

us

gree

n su

nfis

h C

1

Per

cina

len

ticu

la

frec

kled

dar

ter

L 2

L. g

ibbo

sus

pum

pkin

seed

c,

w

1,2

P

. ni

grof

asci

ata

blac

kban

ded

dart

er

L 1

,2

L. g

ulos

us

war

mou

th

L 2

P. p

elta

ta

shie

ld d

arte

r C

1

L, m

acro

chir

us

blue

gill

c, L

, w

1, 2

P

. sci

era

dusk

y da

rter

L

1,2

L.

meg

alot

is

long

ear

sunf

ish

L 1,

2

P.

vigi

l sa

ddle

back

dar

ter

L

2 L

. mic

rolo

phus

re

dear

sun

fish

c

, L

1, 2

P

erco

psis

tra

nsm

onta

na

sand

rol

ler

M, W

2

Lux

ilus

cor

nutu

s co

mm

on s

hine

r C

1

Petr

omyz

ontid

ae

unid

entif

ied

lam

prey

M

, W

l,2

o

Mac

rhyb

opsi

s st

orer

iana

si

lver

chu

b -4

L 2

Pim

epha

les

nota

tus

blun

tnos

e m

inno

w

C

1 M

icro

pter

us d

olom

ieu

smal

lmou

th b

ass

c, w

1,

2

P.

vigi

lax

bullh

ead

min

now

L

1,2

M

. pun

ctul

atus

sp

otte

d ba

ss

L

1, 2

P

omox

is a

nnul

aris

w

hite

cra

ppie

L,

w

2 M

. sal

moi

des

larg

emou

th b

ass

c, L

, w

1, 2

P

. ni

grom

acul

atus

bl

ack

crap

pie

L, w

2

Min

ytre

ma

mel

anop

s sp

otte

d su

cker

L

2 P

roso

pium

wil

liam

soni

m

ount

ain

whi

tefi

sh

M, W

2

Mor

one

saxa

tili

s st

ripe

d ba

ss

L 2

Pty

choc

heil

us

nort

hern

pik

e m

inno

w

M, W

1

,2

oreg

onen

sis

Mox

osto

ma

cari

natu

m

rive

r re

dhor

se

L 2

Pyl

odic

tis

oliv

aris

fl

athe

ad c

atfi

sh

L 2

M. p

oeci

luru

m

blac

ktai

l re

dhor

se

L 2

Rhi

nich

thys

atr

atul

us

blac

knos

e da

ce

C, M

, W

1 M

ugil

cep

halu

s st

ripe

d m

ulle

t L

2 R

. cat

arac

tae

long

nose

dac

e C

,M,W

1

,2

Myl

oche

ilus

cau

rinu

s pe

amou

th

M, W

1

,2

R. f

alca

tus

leop

ard

dace

M

, W

l,2

N

otem

igon

us c

tyso

leuc

as

gold

en s

hine

r C

1

R. o

scul

us

spec

kled

dac

e M

, W

1,2

N

otro

pis

athe

rino

ides

em

eral

d sh

iner

L

2 R

icha

rdso

nius

bal

teat

us

reds

ide

shin

er

M, W

1

,2

N.

huds

oniu

s sp

otta

il sh

iner

C

1

Salm

o tr

utta

br

own

trou

t C

1

N. l

ongi

rost

ris

long

nose

shi

ner

L 2

Salm

onid

ae

unid

entif

i ed

salm

onid

M

1

,2

N. p

rocn

e sw

allo

wta

il sh

iner

C

1

Sem

otil

us a

trom

acul

atus

cr

eek

chub

C

1

N. t

exan

us

wee

d Sh

iner

L

1

,2

Tri

nect

es m

acul

atus

ho

gcho

ker

L 1

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 7: How Long Should a Long-Term River Study Be?

sufficient to allow reasonable detection with an acceptable error rate at an economically supportable level of sampling; other studies may find different levels of power and a more appropriate. The two other components needed to be calculated from existing data. This study had data available from the first five years; however, should this not be the case, historic data could be used or pilot studies can be conducted. Effect size is a method to quantify the potential differences between control and experimental conditions; this was calculated for each river for both the fish and water quality parameters. Small effect sizes, although detectable, may not be ecologically relevant. In addition, they require extremely large sample sizes, which are not usually feasible in field studies. Therefore, for the purposes of this study, small effect sizes were defined to be "no detectable differences." Using the calculated effect sizes, the required sample sizes were then determined (a priori ANOVA with six groups, GPOWER, Bonn, Germany). As the sampling schedule was preset in the experimental design phase of this study, the length of study time was then determined by dividing the required sample size by the number of samples scheduled per year.

The relative effect size for the multivariate fish community data was calculated as the maximum difference between the average rank dissimilarities between groups (Philippi et al. 1998), using the ANOSIM R-statistic (Primer, Plymouth, UK). The R- statistic has values between 0 and 1 and is a comparative measure of the degree of separation of groups (Clarke and Wanvick 2001). Effect size categories (small, medium, and large) were then determined using K-means clustering with three groups. To test this method of calculating effect size, the dataset was split into a training set and a test set, with the original calculations for determining required sample sizes performed on the training set and then tested using the test set. Results between the training and test set were compared with an acceptable success rate defined as 2 80% match between the training set and the test set.

The univariate water quality effect sizes were calculated with a formula for effect size [(mean of experimental) - (mean of control)] / standard deviation (Cohen 1988) using the mean and standard deviation for three water quality variables (temperature, pH, and color) that met the assumptions of normality and homogeneity of variance. They were then classified into small (5 0.2), medium (> 0.2 to < OX), and large (2 0.8) effect sizes (Cohen 1988). The study design does not include reference (control) streams but is based on multiple sampling locations in an upstream to downstream gradient. Therefore, two effect sizes were calculated for each water quality parameter to give a range of effects seen between sites. The first represented the sn~allest effect seen between two sites (sites with small or no differences in their means), and the other was for the largest difference between two sites.

Component 3: Background variability. River discharge was chosen to represent the stability of background environmental conditions in order to assess the temporal variability of the system. Discharge is correlated with rainfall and so will account for drought or wet seasons. It is also correlated with some water quality variables (e.g., suspended solids and turbidity) and has been shown to be correlated with aquatic

Table 3. Summary of the river water quality data used in this analysis. Temperature pH Color N Mean OC N Mean N Mean

Codorus Creek 359 13.5 359 7.7 348 57.4 Leaf River 240 22.0 238 6.5 235 72.6 McKenzie River 302 10.7 302 6.7 295 13.2 Willamette River 299 11.4 300 6.7 291 21.6

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 8: How Long Should a Long-Term River Study Be?

community composition (Koel and Peterka 2003). Background variability was calculated as the signal to noise ratio - the mean change in discharge per year (signal) to the standard deviation (noise) for the nearest USGS gauging station in each river. A higher signal to noise ratio represents a system with smaller background variability; a lower signal to noise ratio indicates a system with more background variability.

Uncertainties. Contributing to the uncertainty of the outcome for each of these criteria were the assumptions that were made as part of this method. The relevant time span assessment assumed that the contribution of the longer (e.g., > 20 years) abiotic time spans, such as the North Atlantic Oscillation, did not interfere with the interpretation of the results at a less than decadal level. This may not be true, particularly if a cycle is in a period of rapid alteration during the relevant time period. The biotic time spans also assumed that relevant effects would show up within one life cycle. The time span used for drought was from a different ecosystem and may not reflect the outcome at these rivers. Additionally, flood frequency was used for flood recovery time, as the recovery after flood disturbances is typically rapid (Lake 2000); however, if the flood event is severe or out of season, the recovery time may be much longer. Additionally, the flood recovery time used was a national average for flood frequency; specific areas may have much higher or lower flood frequencies. Effect size included the assumption that the calculated effect size was not significantly impacted by the dynamic state of a river or by expected changes between sites due to river continuum changes (Vannote et al. 1980). It also assumed that the effect size was constant over the period of the study. This particular assumption can be evaluated periodically during the study and modified as necessary. Sample collection was also assumed to occur at a rate that represents a reasonable long-term experimental design (e.g., if 30 samples were required they were not collected during 30 consecutive days). The preset type I and type I1 error rates were also assumed to be sufficient to allow reasonable detection of effect with minimal risk of finding an effect where none exists and at an economically supportable level of sampling. Additionally, the use of river flow to represent background variability may not fully represent the level of variability experienced by the aquatic communities or the variable nature of the different aquatic community's responses to flow changes.

RESULTS Contponent results. The relevant time spans found large-bodied fish had the longest life spans, ranging from 12 years (Codorus Creek) to 16 years (Leaf River), and the small- bodied fish had two (Leaf River, McKenzie River and Willamette River) to three year life spans (Codorus Creek). The abiotic component time spans were the same for all rivers, with one year for seasonal flow cycle, supra-seasonal drought recovery time of 10 years for fish (Lake 2003) and one year average for bankfull (flood) stage (Leopold et al. 1964).

The effect size for the fish communities ranged from a low of 0.188 with a required sample size of 280 (McKenzie River boat electrofishing captured population) to a high of 0.836 with a required sample size of 24 (Codorus Creek) (Table 4). The Leaf River had insufficient sample size for this component to be calculated. Testing of the multivariate effect size method was done for Codorus Creek only, which had a success rate of 86.7%, well above the required 80%. There were insufficient sample sizes for the McKenzie River and the Willamette River to test the effect size. The time required to see an effect ran from two years (Codorus Creek) to 8.5 years (Willamette River).

The water quality effect sizes ranged from small (0.1) to large (2.9) (Table 5). The small effect sizes were discarded and samples required determined for the medium to large effect size parameters. The required sample sizes ranged from 21 for large effect

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 9: How Long Should a Long-Term River Study Be?

sizes to 133 for medium effect sizes. The time required for sampling ranged from less than one year to 4.5 years.

Background variability signal to noise ratio ranged from a low of 0.69 to 1.72. The Leaf River had the lowest ratio (0.69) indicating substantial background variability. The two rivers with the lowest background variability were the McKenzie River (1.72) and the Willamette River (1.24). Codorus Creek had a moderate ratio of 0.84.

River study length assessments. Analysis of the four rivers provided a unique combination of time lengths for each. Results are summarized in Table 6.

The Willamette River required study time lengths ranging from less than one year to 15 years. The longest biotic component was the relevant temporal scale for the large- bodied fish (15 years). The longest abiotic component, 10 years for drought, was relevant for this river, which had experienced drought conditions during the study period. Power components for the biotic communities required 8.5 years, while the water quality variables required from one to four years. The background variability indicated a relatively minor influence, suggesting that the shorter ranges should be adequate to detect effects. These results indicate a study length of 8.5 years should be sufficient to detect biotic and abiotic influences. However, caution should be used if selecting a shorter time for the study as effects on large-bodied fishes may be missed and confounding effects from drought recovery may make interpretation of the results misleading. If large-bodied fishes were an endpoint of concern, then their relevant time span should supersede the shorter time rages, and the study length should be set at 15 years. Given that the power calculation is based on a minimum sample size to achieve sufficient power, larger sample sizes will only enhance the power.

The McKenzie River had similar results to the Willamette River, with required lengths of time ranging from less than one year to 15 years. The longest biotic component was the relevant temporal scale for the large-bodied fishes. The longest abiotic component, 10 years for drought, was relevant for this river, which had experienced record drought conditions during the study period. Power components for the biotic communities were seven years, while the water quality variables required from one to 4.5 years. The background variability indicated a minor influence, suggesting that the shorter ranges should be adequate to detect effects. These results indicate a minimum study length of seven years would be sufficient to detect effects in the biotic and abiotic communities, although there is a risk of confounding effects from the drought not being isolated. As with the Willamette River, if large-bodied fish were of concern, then their relevant time spans should become the deciding factor over the shorter power calculation, resulting in a minimum study length of 15 years.

The Leaf River had required time lengths ranging from less than one year to non- determined. The Leaf River had a less frequent sampling schedule than the other rivers

Table 4. Summary of the fish community effect determinations for each river.

River Effect size Effect size Required

(R-statistic) category sample size Success rate ("A)

Codorus 0.836 Large 24 86.7 McKenzie (backpack 0.394 Medium 70 Not tested

population) McKenzie (boat population) 0.188 Small 280 Not tested

Willamette (backpack 0.259 Small 162 Not tested population)

Willamette (boat population) 0.328 Medium 102 Not tested

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 10: How Long Should a Long-Term River Study Be?

and did not have the necessary sample size to calculate the biotic community power component. The longest relevant biotic temporal scale was 16 years, for the large-bodied fish. The longest abiotic component, 10 years for drought, was relevant for this river, which had experienced drought conditions during the study period. Power requirements for the water quality components indicate that a study of two years would be sufficient to detect effects in the medium effect size category. However, the background variability was the highest for this river, reflecting the drought and flooding that had occurred during the study period, suggesting that extreme caution be used when determining minimum study length for this river. Using the relevant time span information for this river, a minimum study length to assess biotic components would be estimated to be 10 to 16 years. This would allow for small and large-bodied fish effects to be detected and for effects from drought conditions to be determined.

Codorus Creek had the shortest range of required times ranging from less than one year to 12 years. The longest biotic component was the relevant temporal scale for the large-bodied fish. The longest abiotic component, 10 years for drought, was relevant for this river, which had experienced drought conditions during the study period. Power components for the biotic communities required two years, while the water quality variables required from one year to 4.5 years. The background variability indicated a moderate impact, suggesting that caution be used with the shorter study lengths. These results indicate that a study of two years would be sufficient to assess most water quality issues and small-bodied fish effects. It should be noted that this short time span will not adequately represent effects in the large-bodied fish with their 12 year relevant time span, whereas, a longer study length (e.g., 12 years) would ensure that both large and small- bodied fish effects would be seen, that drought impact would be detected and that long- term variability would be addressed.

Table 5. Summary of the water quality effect sizes for each river. Variable Codorus Creek Leaf River McKenzie Willamette

River River Temperature Medium (0.3) Medium (0.3) Small (0.1) to Small (0.2) to

to large (2.9) to large (2.4) large (2.4) large ( 1.9)

PH Small (0.2) to None (0) to Small (0.2) to Small (0.1) to large (2.4) large (2.2) large (2.3) large (2.6)

Color Small (0.1) to Small (0. I) to None (0) to Small (0.1) to large (2.1) large (2.0) large (2.3) large (2.4)

DISCUSSION Long-term ecological studies increase our understanding of ecosystem dynamics

and recovery (Adams et al. 2002, Kratz et al. 2003). It has been suggested that one of the main purposes of long-term studies is to provide the ability to detect cause and effect relationships through assessment of trends (Kratz et al. 2003). However, how long a long-term study runs is dependent on a number of factors, including the availability of monetary resources (Niemi et al. 1993) as well as physical and time constraints (Oswood and Barber 1982). These factors can potentially result in studies not being able to collect sufficient data. Additionally, analysis of subsets of early data may result in misleading results. The method developed and presented in this study has two points of major significance. It can ensure that the results of long-term studies (whether assessed with complete or truncated datasets) are supported as ecologically and statistically valid; and, it can provide a means of optimizing the use of experimental resources.

Field studies have the advantage over laboratory studies of being more ecologically relevant. The disadvantages are the multiple confounding factors and

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 11: How Long Should a Long-Term River Study Be?

minimal ability to control or manipulate events to show cause and effect, although many studies do attempt to suggest relationships through weight of evidence and correlation between components (Adams 2003). Nonetheless, without demonstrating that the study covered sufficient time for organisms to respond or to account for confounding factors, detected trends may not truly represent the status of the system. Additionally, without substantiating that sufficient data were collected to show effects should effects be present, a finding of "no effects" cannot be considered significant. Results and conclusions from field studies would have added weight if information confirming the relevance of the time length studied, the statistical validity of the sample size, and the relationship of the results to the background variability was provided.

The optimum use of resources is another beneficial outcome of the use of this method. Field studies are labor intensive and time consuming to undertake. Efficient use of resources can be accomplished by early use of this analysis to design studies that include adequate samples to accommodate sufficient power and background variability. Additionally, use of this method will enable early conclusion of a study if the study goals are achieved early or discontinuing a study if the goals are not achievable within the time frame, and resources can then be directed to new study locations.

An additional conclusion from the analysis of the four rivers in this study was the need for river specific study length assessments. This was demonstrated by the differences in the effects sizes for the biotic endpoints. Rivers with large effect sizes in the biotic communities could be assessed in much less time than those with smaller effect sizes. Additionally, this method indicated that sampling the aquatic community of a river or a site once does not provide sufficient information to assess the community status. In fact, assessment of the effect size with two samples was insufficient for all four rivers in this study, and the river with the largest effect size still required a study length of two years for the biotic component. This provides evidence to support the concept that long- term studies provide more accurate analysis of ecosystem structure than short-term studies (Bradt et al. 1999, Kratz et al. 2003). The results also indicated that, for rivers with moderate to low background variability, the coarse estimate made by the first step (identification of relevant time spans) will provide a reasonable short-term assessment of time length with the more detailed analysis following initial data collection. However, for more variable rivers, the coarse estimate of time length may of necessity be the only available option to predict study length, with final study length perhaps not determined until nearing the end of the study. This is supported by the findings of Urquhart et al. (1998) in which they predicted that large variance components could overwhelm other study components.

Table 6. Summary of the analysis of the temporal components for each river.

Component Codorus Leaf McKenzie Willamette Creek River River River

Longest relevant time span 12 years 16 years 15 years 15 years Sufficient power: biotic 2.0 years 7.0 years 8.5 years Sufficient power: abiotic 4.5 years 2.0 years 4.5 years 4.0 years Variability Moderate High Low Low

ACKNOWLEDGEMENTS Thanks to the members of the Long-Term Receiving Water Study Scientific

Advisory Panel for their project oversight and discussion: Thomas Deardorff, Barry Firth, Wayne Landis, Wayne Minshall, Tibor Kovacs, and John Rodgers. Thanks also to the many people who contributed to the research presented in this paper: Joan Ikoma, Bill Arthurs, Dan McGarvey, Renee Ragsdale, and Rick Haley for their field and lab contributions; Tim Hall, Reid Miner, Robert Fisher, and Judy Dudley for their work on originating the experimental design.

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 12: How Long Should a Long-Term River Study Be?

LITERATURE CITED Adams, S. M. 2003. Establishing causality between environmental stressors and effects

on aquatic ecosystems. Human and Ecological Risk Assessment 9: 17-35. Adams, S. M., W. R. Hill, M. J. Peterson, M. G. Ryon, J. G. Smith, and A. J. Stewart.

2002. Assessing recovery in a stream ecosystem: Applying multiple chemical and biological endpoints. Ecological Applications 12: 15 10-1 527.

Bradt, P., M. Urban, N. Goodman, S. Bissell, and I. Speigel. 1999. Stability and resilience in benthic macroinvertebrate assemblages, impact of physical disturbance over twenty-five year. Hydrobiologia 403: 123-133.

Bryant, M. D. 1985. Changes 30 years after logging in large woody debris and its use by salmonids. Proceedings, Riparian Ecosystems and Their Management, Tucson, Arizona, USA, April 16-1 8, USDA Forest Service General Technical Report RM- 120.

Clarke, R. M. and R. M. Wanvick. 2001. Change in marine communities: an approach to statistical analysis and interpretation, 2nd edition. PRIMER-E, Plymouth, UK.

Cohen, J. 1988. Statistical power analysis for the behavioral sciences, 2nd edition. Lawrence Earlbaum Associates, Hillsdale, New Jersey, USA.

Cooper, S. D., S. Diehl, K. Kratz, and 0. Sarnell. 1998. Implications of scale for patterns and processes in stream ecology. Australian Journal of Ecology 23:27-40.

Fmget, J.-F., M. Centofanti, J. Dessaix, J.-M. Olivier, J.-C. Druart, and P.-J. Martinez. 2001. Temporal and spatial dynamics in large rivers: example of a long-term monitoring of the middle RhGne River. Annales de Limnologie 37:237-25 1.

Gilliom, R. J., W. M. Alley, and M. E. Gurtz. 1995. Design of the National Water- Quality Assessment Program: occurrence and distribution of water-quality conditions. U.S. Geological Survey Circular 11 12,33 p.

Haag, I. and B. Westrich. 2002. Processes governing river water quality identified by principal component analysis. Hydrological Processes 16:3 1 13-3 130.

Hall, T. J., J. L. Dudley, R. P. Fisher, and D. L. Borton, 1999. Integrated long-term receiving water studies: site selection process and a description of the selected study sites. Proceedings, TAPPI 99 International Environmental Conference, Atlanta, Georgia, USA.

Jennings, D. B. and S. T. Jarnagin. 2002. Changes in anthropogenic impervious surfaces, precipitation and daily streamflow discharges: a historical perspective in a mid- Atlantic subwatershed. Landscape Ecology 17:471-489.

Koel, T. M. and J. J. Peterka. 2003. Stream fish communities and environmental correlates in the Red River of the North, Minnesota and North Dakota. Environmental Biology of Fishes 67: 137-55.

Kovacs, T. G., P. H. Martel, J. S. Gibbons, B. I. O'Connor, and R. H. Voss. 2002. Tracking the benefits of mill environmental investments aimed at protecting aquatic organisms. TAPPI Journal 1 :9-15.

Klug, J. L. and K. L. Cottingham. 2001. Interactions among environmental drivers: community responses to changing nutrients and dissolved organic carbon. Ecology 82:3390-3403.

Kratz, T. K., L. A. Deegan, M. E. Harmon, and W. K. Lauenroth. 2003. Ecological variability in space and time: insights gained from the US LTER program. Bioscience 5357-66.

Lake, P. S. 2000. Disturbance, patchiness, and diversity in streams. Journal of the North American Benthological Society 19573-592.

Lake, P. S. 2003. Ecological effects of perturbation by drought in flowing waters. Freshwater Biology 48: 1 16 1-1 172.

Leopold, L. B., M. G. Wolman, and J. P. Miller. 1964. Fluvian processes in geomorphology. Dover Publications, Inc., New York, New York, USA.

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 13: How Long Should a Long-Term River Study Be?

Lowell, R. B. and J. M. Culp. 2002. Implications of sampling frequency for detecting temporal patterns during environmental effects monitoring. Water Quality Research Journal of Canada 37: 1 19-132.

Lowell, R. B., J. M. Culp, and M. G. DubC. 2000. A weight-of-evidence approach for northern river risk assessment: integrating the effects of multiple stressors. Environmental Toxicology and Chemistry 19: 1 182-1 190.

Metzeling, L., D. Robinson, S. Perriss, and R. Marchant. 2002. Temporal persistence of benthic invertebrate communities in south-eastern Australian streams: taxonomic resolution and implications for the use of predictive models. Marine and Freshwater Research 53: 1223-1234.

Minshall, G. W. 1988. Stream ecosystem theory: a global perspective. Journal of the North American Benthological Society 7:263-288.

Minshall, G. W., J. T. Brock, D. A. Andrews, and C. T. Robinson. 2001a. Water quality, substratum and biotic responses of five central Idaho (USA) streams during the first year following the Mortar Creek fire. International Journal of Wildland Fire 10: 185- 199.

Minshall, G. W., C. T. Robinson, D. E. Lawrence, D. A. Andrews, and J. T. Brock. 2001b. Benthic macroinvertebrate assemblages in five central Idaho (USA) streams over a 10 year period following disturbance by wildfire. International Journal of Wildland Fire 10:201-213.

Minshall, G. W., T. V. Royer, and C. T. Robinson. 2001c. Response of the Cache Creek macroinvertebrates during the first 10 year following disturbance by the 1988 Yellowstone wildfires. Canadian Journal of Fisheries and Aquatic Sciences 58: 1077- 1088.

Niemi, G. J., N. E. Detenbeck, and J. A. Perry. 1993. Comparative analysis of variables to measure recovery rates in streams. Environmental Toxicology and Chemistry 12:1541-1547.

Onorato, D., R. A. Angus, and K. R. Marion. 2000. Historical changes in the ichthyofaunal assemblages of the upper Cahaba River in Alabama associated with extensive urban development in the watershed. Journal of Freshwater Ecology 15:47-63.

Oswood, M. E. and W. E. Barber. 1982. Assessment of fish habitat in streams: goals, constraints, and a new technique. Fisheries 73-1 1.

Papanicolaou, A. N., A. Bdour, N. Evangelopoulos, and N. Tallebeydokhti. 2003. Watershed and instream impacts on the fish population in the south fork of the Clearwater River, Idaho. Journal of the American Water Resources Association 39:191-203.

Philippi, T. E., P. M. Dixon, and B. E. Taylor. 1998. Detecting trends in species composition. Ecological Applications 8:300-308.

Poff, N. L and J. V. Ward. 1989. Implications of streamflow variability and predictability for lotic community structure: a regional analysis of streamflow patterns. Canadian Journal of Fisheries and Aquatic Sciences 46: 1805-1 8 18.

Ross, S. T. 2001. Inland fishes of Mississippi. University Press of Mississippi, Mississippi, USA.

Scarsbrook, M. R. 2002. Persistence and stability of lotic invertebrate communities in New Zealand. Freshwater Biology 47:417-43 1.

Schubauer-Berigan, M. K., M. Smith, J. Hopkins, and S. M. Cornier. 2000. Using historical biological data to evaluate status and trends in the Big Darby Creek Watershed (Ohio, USA). Environmental Toxicology and Chemistry 19: 1097-1 105.

Sosiak, A. 2002. Long-term response of periphyton and macrophytes to reduced municipal nutrient loading to the Bow River (Alberta, Canada). Canadian Journal of Fisheries and Aquatic Sciences 59:987- 1001.

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014

Page 14: How Long Should a Long-Term River Study Be?

Steiner, L. 2000. Pennsylvania Fishes. Pennsylvania Fish and Boat Commission, Harrisburg, Pennsylvania, USA.

Sullivan, K. 1985. Long-term patterns of water quality in a managed watershed in Oregon: 1. suspended sediment. Water Resources Bulletin 21:977-87.

Thomas, J. F. and T. J. Hall. 2004. Pattern analysis of fish communities upstream/downstream of pulp and paper mill discharges on four U.S. receiving waters. Pages 195-207 in D. L. Borton, T. J. Hall, R. P. Fisher and J. F. Thomas (editors). Pulp & paper mill effluent environmental fate & effects. DEStech Publications, Inc., Lancaster, Pennsylvania, USA.

Urquhart, N. S., S. G. Paulsen, and D. P. Larsen. 1998. Monitoring for policy-relevant regional trends over time. Ecological Applications 8:246-257.

U.S. Environmental Protection Agency (USEPA). 2002. Research strategy, Environmental Monitoring and Assessment Program. EPA 6201R-02/002. Office of Research and Development, Research Triangle Park, North Carolina, USA.

Vannote, R. L., G. W. Minshall, K. W. Cummins, J. R. Sedell, and C. E. Cushing. 1980. The river continuum concept. Canadian Journal of Fisheries and Aquatic Science 37~130-137.

Woodward, G., J. I. Jones, and A. G. Hildrew. 2002. Community persistence in Broadstone Stream (U.K.) over three decades. Freshwater Biology 47:1419-1435.

Received: 13 September 2004 Accepted: 27 December 2004

Dow

nloa

ded

by [

McM

aste

r U

nive

rsity

] at

09:

04 0

5 N

ovem

ber

2014