Using Quality Matters to Evaluate

Online Course Design

Britt WatwoodCTE Brown BagApril 23, 2010

About Quality Matters

•Rubric

•Peer Review Process

QM Rubric Eight General Standards:

1. Course Overview and Introduction2. Learning Objectives 3. Assessment and Measurement4. Resources and Materials5. Learner Interaction6. Course Technology7. Learner Support8. Accessibility

Key components must align.

Alignment: Critical course elements work together to ensure that students achieve the desired learning outcomes.

Course Learning Objectives (2)

Resources, Materials (4) & Technology (6)

Assessment and Measurement (3)

Learner Interactions & Activities (5)

Key sections that must align…

Rubric Scoring

Standards Points Relative Value

17 3 Essential

11 2 Very Important

12 1 Important

TOTALS

40 85

Team of 3 reviewers initially score individually One score per standard based on team majority Pre-assigned point value Yes/No decision; All/None points Consensus is NOT required

For QM Purposes, Quality Is…

• More than average; more than “good enough”

• An attempt to capture what’s expected in an effective online course at about an 85% level

• Based on research and widely accepted standards

85 %

To Meet Expectations…

A course must achieve:

• “Yes” on all 17 of the 3-point “essential” standards.

• A minimum of 72 out of 85 points

72/85 = 85%

Peer Course Review

Feedback

Course

Course Meets Quality Expectations

Course Revision

Instructional Designers

InstitutionsFaculty Course Developers National Standards &

Research Literature

Rubric

Faculty ReviewersTraining

Quality Matters: Peer Course Review

Process

Factors Affecting Course Quality

• Course design QM REVIEWS THIS

• Course delivery (i.e. teaching, faculty performance)

• Course content• Course management system• Institutional infrastructure• Faculty training and readiness• Student engagement and readiness