the open suny cote quality review (oscqr) process and rubric

Center for Online Teaching Excellence (COTE)

The Open SUNY Course Quality Review (OSCQR)

Process and Rubric

Who are we? How did we get here?

SLN Application

Support SLN HelpDesk

Online readiness

assessment

Open- SUNY.edu navigator Exploration

course

Student online

experience

SLN Education

Research

Faculty professional development

in online education

SLN Online Resources

LMS Administrative

support

LMS Hosting

Open SUNY Digital DNA

Campus and system-wide

initiatives and supports Student

supports

24/7 service hotline

Online academic tutoring

Library and open

educational resources

Student computer program

Academic initiatives

Lab for new models in teaching

and learning

Affordable broadband

for NYS

Revenue And cost models

Universal sign-on

Online readiness

assessment

Policy architecture

Open SUNY

NY State

SUNY

Prior learning

assessment

High-needs disciplines General

education

Signature SUNY

programs

Skill remediation

Offerings powered by Open SUNY

Open SUNY infrastructure

Educational resources

Competency-

based learning

Credit- bearing

third-party content

Open SUNY Global

ePortfolio

Open- SUNY.edu navigator

Credits and financial

aid across campuses

Student services hotline

Experiential learning

Exploration course

Student online

experience

Faculty supports

Research & innovation


in online education

Course supports Community

of practice Competency development

Open SUNY Learning Commons


Institutional pathways & readiness

Student concierge

Potential students

Monitoring and

continuous improvement

Stakeholder engagement and commu-

nications

Funders and

partners

Complete SUNY

IT enablers

Legal and compliance

policies

Identification & verification

Workforce development

Open SUNY Center for Online Teaching Excellence (COTE)

Campus and system-wide

initiatives and supports Student

supports


Online academic tutoring

Library and open

educational resources

Student computer program

Academic initiatives

Lab for new models in teaching

and learning

Affordable broadband

for NYS

Revenue And cost models

Universal sign-on

Online readiness

assessment

Policy architecture

Open SUNY

NY State

SUNY

Prior learning

assessment

High-needs disciplines General

education

Signature SUNY

programs

Skill remediation

Offerings powered by Open SUNY

Open SUNY infrastructure

Educational resources

Competency-

based learning

Credit- bearing

third-party content

Open SUNY Global

ePortfolio

Open- SUNY.edu navigator

Credits and financial

aid across campuses

Student services hotline

Experiential learning

Exploration course

Student online

experience

Faculty supports

Research & innovation


in online education



Open SUNY Learning Commons


Institutional pathways & readiness

Student concierge

Potential students

Monitoring and

continuous improvement

Stakeholder engagement and commu-

nications

Funders and

partners

Complete SUNY

IT enablers

Legal and compliance

policies

Identification & verification

Workforce development

COTE Center for

Online Teaching

Excellence

Research & innovation Faculty

professional development

in online education



Open SUNY Learning

Commons


Open SUNY

Course Supports

A COTE framework, process, and resource provider for:

- Course Review - Course Refresh - Learning Review

What are Course Supports?

Open SUNY COTE Quality Review Our Goal:

To ensure that all online courses meet quality instructional design and accessibility standards, and are regularly reviewed, refreshed, and improved to reflect campus guidelines and research-based online effective practices.

Meet OSCQR

Open SUNY COTE Quality Review Rubric

Meet OSCQR


The CHICO Rubric

Meet OSCQR


The CHICO Rubric

SUNY Campus Input

Meet OSCQR


The CHICO Rubric

SUNY Campus Input SLN/Open

SUNY EffecJve PracJces

Meet OSCQR


The CHICO Rubric



Gap Analysis with other rubrics: •  Quality MaOers •  iNACOL •  Bb Exemplary Courses

Meet OSCQR


The CHICO Rubric



Gap Analysis with other rubrics: •  Quality MaOers •  INACOL •  Bb Exemplary Courses

Accessibility Standards

Meet OSCQR

•  Based on Community of Inquiry (COI) model. •  37 discrete standards for online instructional

design. •  37 discrete standards for web accessibility. •  Research-based and built for SUNY by SUNY. •  Mapped to the COTE fundamental and core

competencies for online instructional design.

OSCQR Rubric

The Community of

Inquiry (Garrison, Anderson, and

Archer, 2000)

Bloom’s Taxonomy (Bloom et al., 1956)

Seven Principles For Good PracJce in Undergraduate

EducaJon (Chickering & Gamson, 1987)

The Adult Learner

(Malcom Knowles, 1973)

How People Learn

(Bransford et al., 1999)

Pedagogical Influences

The Community of

Inquiry (Garrison, Anderson, and

Archer, 2000)


Bloom’s Taxonom

y (Bloom et al., 1956)


The Adult Learner

(Malcom Knowles, 1973)


How People Learn

(Bransford et al., 1999)


Seven Principles For Good PracJce in Undergraduate

EducaJon (Chickering & Gamson, 1987)


Flexible, non-‐evaluaJve, and focused on improvement

The OSCQR Rubric

The sole intent of OSCQR is to help iden3fy how a course can be improved during the Course Refresh process.

The OSCQR Rubric

Many factors contribute to quality …

•  Alignment of course objecJves/ •  learning acJviJes/assessments •  Social Presence, Teaching Presence, •  CogniJve Presence •  The learner’s perspecJve:

•  NavigaJon •  Pacing •  Content presentaJon

•  Accessibility

Instructional Design Only

•  Self-‐serve rubric: bit.ly/OSCQRSelfServe.

•  Rubric remains private unless you wish to share.

Use the OSCQR Rubric to Review Your Course

Self-Assessment

•  Aggregated narraJve feedback. •  Engage librarians, instrucJonal designers, colleagues. •  External input promotes:

•  ObjecJvity. •  More robust acJon plans. •  The “student” perspecJve.

Have Multiple Reviewers’ Perspectives

Peer Review

•  Go to bit.ly/OSCQRSelfServe. •  Fill out two pieces of information. •  Check your email. •  Click on the link to your own rubric.

Bookmark the URL of the rubric.

Let’s Try It!

Achievement Levels

Tabs

A Brief Tour

•  ConstrucJve feedback = soluJons, not problems. •  Avoid: The Icebreaker Module does not include a forum for students to ask quesJons.

•  Provide: Create an “Ask a QuesJon” forum in the Icebreaker module.

•  All entries are automaJcally saved. •  All input is confidenJal, shared only when you share it.

A Few Rules of the Road Suggestions

1.  Review your own course or one from the Courses for Observation (links on worksheet).

2.  Choose two instructional design standards and apply them.

3.  Choose two accessibility standards and apply them.

Use your OSQCR Worksheet

Center for Online Teaching Excellence (COTE)

Campus and Program ImplementaJon of the OSCQR Rubric

•  Campuses create and manage their own OSCQR rubrics.

•  Rubrics can be customized for particular programs. •  Activity can be tracked and aggregated. •  Reviews are conducted on copies of courses (no

student activity).

OSCQR Dashboard

Review and refresh progress is aggregated

automa.cally.

OSCQR Dashboard

Data analyJcs allows a campus to idenJfy

trends.

Campus Analytics

Process is mulJ-‐faceted and flexible.

OSCQR Process

The focus remains on conJnuous

improvement and is an iteraJve process.

OSCQR Process

•  Become an Open SUNY COTE fellow: –  Interact with colleagues and practitioners across SUNY. –  Once registered, tap into professional development opportunities, instructional

resources, discipline-specific groups, and COTE community events. –  http://cotecommunity.open.suny.edu/

•  Learn more about Open SUNY/COTE –  http://commons.suny.edu/opensuny/faq/ –  http://commons.suny.edu/cote/

•  Learn more about OSCQR –  http://commons.suny.edu/cote/course-supports/

–  Get the Rubric –  http://commons.suny.edu/cote/course-supports/oscqr-rubric/

Next Steps