chap. 9: nonparametric statistics - nu.edu.sd nonparametric statistics.pdf · learning objectives...

32
introduction Nonparametric Statistics

Upload: others

Post on 16-Sep-2019

22 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

introduction

Nonparametric Statistics

Page 2: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Learning Objectives

1. Distinguish Parametric &

Nonparametric Test Procedures

2. Explain commonly used

Nonparametric Test Procedures

3. Perform Hypothesis Tests Using

Nonparametric Procedures

Page 3: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Hypothesis Testing Procedures

Hypothesis

Testing

Procedures

NonparametricParametric

Z Test

Kruskal-WallisH-Test

WilcoxonRank Sum

Test

t TestOne-Way

ANOVAMany More Tests Exist!

Page 4: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Parametric Test Procedures

1. Involve Population Parameters (Mean)

2. Have Stringent Assumptions

(Normality)

3. Examples: Z Test, t Test, 2 Test,

F test

Page 5: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Nonparametric Test

Procedures

1. Do Not Involve Population ParametersExample: Probability Distributions, Independence

2. Data Measured on Any Scale (Ratio or

Interval, Ordinal or Nominal)

3. Example: Wilcoxon Rank Sum Test

Page 6: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Advantages of

Nonparametric Tests

1. Used With All Scales

2. Easier to Compute

3. Make Fewer Assumptions

4. Need Not Involve

Population Parameters

5. Results May Be as Exact

as Parametric Procedures

© 1984-1994 T/Maker Co.

Page 7: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Disadvantages of

Nonparametric Tests

1.May Waste Information

Parametric model more efficient

if data Permit

2.Difficult to Compute by

hand for Large Samples

3.Tables Not Widely Available

© 1984-1994 T/Maker Co.

Page 8: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Popular Nonparametric Tests

1. Sign Test

2. Wilcoxon Rank Sum Test

3. Wilcoxon Signed Rank Test

Page 9: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum

Test

Page 10: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

1.Tests Two Independent Population

Probability Distributions

2.Corresponds to t-Test for 2 Independent

Means

3.Assumptions

Independent, Random Samples

Populations Are Continuous

4.Can Use Normal Approximation If ni 10

Page 11: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Procedure1. Assign Ranks, Ri, to the n1 + n2 Sample

ObservationsIf Unequal Sample Sizes, Let n1 Refer to Smaller-Sized Sample

Smallest Value = 1

2. Sum the Ranks, Ti, for Each Sample

Test Statistic Is TA (Smallest Sample)

Null hypothesis: both samples come from the same underlying distribution

Distribution of T is not quite as simple as binomial, but it can be computed

Page 12: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Example

➢ You’re a production planner. You want to see if

the operating rates for 2 factories is the same.

For factory 1, the rates (% of capacity) are 71,

82, 77, 92, 88. For factory 2, the rates are 85,

82, 94 & 97. Do the factory rates have the same

probability distributions at the .10 level?

Page 13: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0:

➢ Ha:

➢ =

➢ n1 = n2 =

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:

Ranks

Page 14: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ =

➢ n1 = n2 =

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:

Ranks

Page 15: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ = .10

➢ n1 = 4 n2 = 5

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:

Ranks

Page 16: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum

Table 12 (Rosner) (Portion)

n1

4 5 6 ..

TL TU TL TU TL TU ..

4 10 26 16 34 23 43 ..

n2 5 11 29 17 38 24 48 ..

6 12 32 18 42 26 52 ..

: : : : : : : :

= .05 two-tailed

Page 17: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ = .10

➢ n1 = 4 n2 = 5

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:Reject Reject

Do Not

Reject

12 28 Ranks

Page 18: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

Rank Sum

Page 19: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 85

82 82

77 94

92 97

88 ... ...

Rank Sum

Page 20: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85

82 82

77 94

92 97

88 ... ...

Rank Sum

Page 21: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85

82 82

77 2 94

92 97

88 ... ...

Rank Sum

Page 22: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85

82 3 82 4

77 2 94

92 97

88 ... ...

Rank Sum

Page 23: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85

82 3 3.5 82 4 3.5

77 2 94

92 97

88 ... ...

Rank Sum

Page 24: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94

92 97

88 ... ...

Rank Sum

Page 25: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94

92 97

88 6 ... ...

Rank Sum

Page 26: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94

92 7 97

88 6 ... ...

Rank Sum

Page 27: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94 8

92 7 97

88 6 ... ...

Rank Sum

Page 28: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94 8

92 7 97 9

88 6 ... ...

Rank Sum

Page 29: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Computation Table

Factory 1 Factory 2

Rate Rank Rate Rank

71 1 85 5

82 3 3.5 82 4 3.5

77 2 94 8

92 7 97 9

88 6 ... ...

Rank Sum 19.5 25.5

Page 30: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ = .10

➢ n1 = 4 n2 = 5

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:Reject Reject

Do Not

Reject

12 28 Ranks

T2 = 5 + 3.5 + 8+ 9 = 25.5

(Smallest Sample)

Page 31: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ = .10

➢ n1 = 4 n2 = 5

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:

Do Not Reject at = .10

Reject RejectDo Not

Reject

12 28 Ranks

T2 = 5 + 3.5 + 8+ 9 = 25.5

(Smallest Sample)

Page 32: Chap. 9: Nonparametric Statistics - nu.edu.sd Nonparametric Statistics.pdf · Learning Objectives 1. Distinguish Parametric & Nonparametric Test Procedures 2. Explain commonly used

Wilcoxon Rank Sum Test

Solution

➢ H0: Identical Distrib.

➢ Ha: Shifted Left or

Right

➢ = .10

➢ n1 = 4 n2 = 5

➢ Critical Value(s):

Test Statistic:

Decision:

Conclusion:

Do Not Reject at = .10

There is No evidence for

unequal distrib

Reject RejectDo Not

Reject

12 28 Ranks

T2 = 5 + 3.5 + 8+ 9 = 25.5

(Smallest Sample)