brown bag on quality matters

Using Quality Matters to Evaluate

Online Course Design

Britt WatwoodCTE Brown BagApril 23, 2010

About Quality Matters

•Rubric

•Peer Review Process

QM Rubric Eight General Standards:

1. Course Overview and Introduction2. Learning Objectives 3. Assessment and Measurement4. Resources and Materials5. Learner Interaction6. Course Technology7. Learner Support8. Accessibility

Key components must align.

Alignment: Critical course elements work together to ensure that students achieve the desired learning outcomes.

Course Learning Objectives (2)

Resources, Materials (4) & Technology (6)

Assessment and Measurement (3)

Learner Interactions & Activities (5)

Key sections that must align…

Rubric Scoring

Standards Points Relative Value

17 3 Essential

11 2 Very Important

12 1 Important

TOTALS

40 85

Team of 3 reviewers initially score individually One score per standard based on team majority Pre-assigned point value Yes/No decision; All/None points Consensus is NOT required

For QM Purposes, Quality Is…

• More than average; more than “good enough”

• An attempt to capture what’s expected in an effective online course at about an 85% level

• Based on research and widely accepted standards

85 %

To Meet Expectations…

A course must achieve:

• “Yes” on all 17 of the 3-point “essential” standards.

• A minimum of 72 out of 85 points

72/85 = 85%

Peer Course Review

Feedback

Course

Course Meets Quality Expectations

Course Revision

Instructional Designers

InstitutionsFaculty Course Developers National Standards &

Research Literature

Rubric

Faculty ReviewersTraining

Quality Matters: Peer Course Review

Process

Factors Affecting Course Quality

• Course design QM REVIEWS THIS

• Course delivery (i.e. teaching, faculty performance)

• Course content• Course management system• Institutional infrastructure• Faculty training and readiness• Student engagement and readiness