t11 types of tests

13
Parametric versus Nonparametric Statistics – When to use them and which is more powerful? By Rama Krishna Kompella

Upload: kompellark

Post on 13-May-2015

898 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: T11 types of tests

Parametric versus Nonparametric Statistics – When to use them and

which is more powerful?

By Rama Krishna Kompella

Page 2: T11 types of tests

Parametric Assumptions

• The observations must be independent• The observations must be drawn from

normally distributed populations• These populations must have the same

variances• Observations are independent• Variable under study has underlying

continuity

Page 3: T11 types of tests

3

Nonparametric Alternative

• The parametric assumptions cannot be justified: normal distribution, equal variances, etc.

• The data as gathered are measured on nominal or ordinal data

• Sample size is small.

Page 4: T11 types of tests

Nonparametric Methods

• There is at least one nonparametric test equivalent to a parametric test

• These tests fall into several categories1. Tests of differences between groups

(independent samples)2. Tests of differences between variables

(dependent samples)3. Tests of relationships between variables

Page 5: T11 types of tests

Differences between independent groups

• Two samples – compare mean value for some variable of interest

Parametric Nonparametrict-test for independent samples

Wald-Wolfowitz runs test

Mann-Whitney U test

Kolmogorov-Smirnov two sample test

Page 6: T11 types of tests

Differences between independent groups

• Multiple groupsParametric NonparametricAnalysis of variance (ANOVA/ MANOVA)

Kruskal-Wallis analysis of ranks

Median test

Page 7: T11 types of tests

Differences between dependent groups

• Compare two variables measured in the same sample

• If more than two variables are measured in same sample

Parametric Nonparametrict-test for dependent samples

Sign test

Wilcoxon’s matched pairs test

Repeated measures ANOVA

Friedman’s two way analysis of varianceCochran Q

Page 8: T11 types of tests

Relationships between variables

• Two variables of interest are categorical

Parametric Nonparametric

Correlation coefficient

Spearman R

Kendall Tau

Coefficient Gamma

Chi squarePhi coefficient

Fisher exact test

Kendall coefficient of concordance

Page 9: T11 types of tests

Summary Table of Statistical TestsLevel of

MeasurementSample Characteristics Correlation

1 Sample

2 Sample K Sample (i.e., >2)

Independent Dependent

Independent Dependent

Categorical or Nominal

Χ2 or bi-

nomial

Χ2 Macnarmar’s Χ2

Χ2 Cochran’s Q  

Rank or Ordinal

  Mann Whitney U

Wilcoxin Matched

Pairs Signed Ranks

Kruskal Wallis H

Friendman’s ANOVA

Spearman’s rho

Parametric (Interval &

Ratio)

z test or t test

t test between groups

t test within groups

1 way ANOVA between groups

1 way ANOVA (within or repeated measure)

Pearson’s r

Factorial (2 way) ANOVA  

 (Plonskey, 2001)

Page 10: T11 types of tests

Advantages of Nonparametric Tests

• Probability statements obtained from most nonparametric statistics are exact probabilities, regardless of the shape of the population distribution from which the random sample was drawn

• If sample sizes as small as N=6 are used, there is no alternative to using a nonparametric test

Siegel, 1956

Page 11: T11 types of tests

Advantages of Nonparametric Tests

• Treat samples made up of observations from several different populations.

• Can treat data which are inherently in ranks as well as data whose seemingly numerical scores have the strength in ranks

• They are available to treat data which are classificatory

• Easier to learn and apply than parametric tests

Siegel, 1956

Page 12: T11 types of tests

Criticisms of Nonparametric Procedures

• Losing precision/wasteful of data• Low power• False sense of security• Lack of software• Testing distributions only• Higher-ordered interactions not dealt with

Page 13: T11 types of tests

Questions?