online faculty development and assessmentdocushare3.dcc.edu/docushare/dsweb/get/document-4304/online...

39
Online Faculty Development and Assessment Contents Present Program ................................................................................................................... 2 Sample Online Faculty Competency Model ............................................................................. 3 Proficiency Levels and Behavior Indicators for Online Faculty Competencies ..................... 4 Sample Online Faculty Development Curriculum .................................................................... 9 Distance Learning Course Assessment - Continual Quality Improvement ............................ 11 Peer Review ................................................................................................................... 11 Student Review .............................................................................................................. 11 Instructor Review and Follow-up Report......................................................................... 11 Performance-Based Competency Assessment for Online Faculty .......................................... 12 APPENDIX: FORMS, WORKSHEETS, AND REFERENCE....................................................................................... 18 SAMPLE - NEW COURSE FEASABILITY QUESTIONAIRRE .......................................................................... 19 Sample Memorandum of Agreement .......................................................................................................... 20 Sample Development of Electronically Delivered Course...................................................................... 20 Sample Online Course Assessment Form- Administrative................................................................... 21 Sample Checklist for Instructional Requirements ................................................................................... 24 Sample Peer Review.......................................................................................................................................... 25 Sample Curriculum, Instruction and Student Assessment ................................................................... 25 Sample Student Review and Evaluation Rubric for Student Feedback............................................... 27 Continuous Improvement Guide For Electronic Learning ..................................................................... 29 The Evaluation of Exemplary Online Courses........................................................................................... 32 Faculty Training Needs Survey ...................................................................................................................... 35 Sample BlackBoard Basics Course from UT ............................................................................................... 36 The Five Pillars of Quality Online Education ......................................................................... 37 Websites ........................................................................................................................... 379

Upload: others

Post on 18-Oct-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

  • Online Faculty Development and Assessment

    Contents Present Program ................................................................................................................... 2

    Sample Online Faculty Competency Model ............................................................................. 3

    Proficiency Levels and Behavior Indicators for Online Faculty Competencies ..................... 4

    Sample Online Faculty Development Curriculum .................................................................... 9

    Distance Learning Course Assessment - Continual Quality Improvement ............................ 11

    Peer Review ................................................................................................................... 11

    Student Review .............................................................................................................. 11

    Instructor Review and Follow-up Report......................................................................... 11

    Performance-Based Competency Assessment for Online Faculty .......................................... 12

    APPENDIX: FORMS, WORKSHEETS, AND REFERENCE ....................................................................................... 18

    SAMPLE - NEW COURSE FEASABILITY QUESTIONAIRRE .......................................................................... 19

    Sample Memorandum of Agreement .......................................................................................................... 20

    Sample Development of Electronically Delivered Course...................................................................... 20

    Sample Online Course Assessment Form- Administrative ................................................................... 21

    Sample Checklist for Instructional Requirements ................................................................................... 24

    Sample Peer Review .......................................................................................................................................... 25

    Sample Curriculum, Instruction and Student Assessment ................................................................... 25

    Sample Student Review and Evaluation Rubric for Student Feedback ............................................... 27

    Continuous Improvement Guide For Electronic Learning ..................................................................... 29

    The Evaluation of Exemplary Online Courses........................................................................................... 32

    Faculty Training Needs Survey ...................................................................................................................... 35

    Sample BlackBoard Basics Course from UT ............................................................................................... 36

    The Five Pillars of Quality Online Education ......................................................................... 37

    Websites ........................................................................................................................... 379

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    2

    Present Program

    Delgado’s present Online Faculty Development Program includes, but is not limited to the following courses, workshops, special presentations, and resources. As we grow into an

    exemplary distance learning college, these workshops will build upon one another into a

    cohesive, progressive creation of online course instruction.

    Blackboard Basics – 3 hours

    Adding items

    Adding folders

    Adding external links

    Adding learning units

    Converting to .rtf

    Enrolling students

    Making course available

    Pedagogy – 30 hours (semester long course)

    Best practices in teaching online – 2 hours

    Brief presentation by experienced

    faculty

    Valuable feedback and input by

    participants

    Content Course – 1 hour

    Name/description

    Adding files

    Adding learning units

    Converting .rtf and .pdf

    Adding assignments

    Adding external links

    Gradebook management – 1 hour

    Creating Community – 1 hour

    Making Material Friendly – 1 hour

    Converting .pdf., rtf., .ppt

    Testing – 1 hour

    Creating a test

    Tools and Options – 1 hour

    Adding announcements

    Choosing and using entry points

    Making courses available

    Adding tasks

    Adding staff information

    Managing discussion boards

    Sending email

    Using the digital drop box

    Collaboration Session – 1 hour

    Discussion Board – 1 hour

    Forums

    Managing discussions

    Designing user settings

    Managing threads

    Grading discussion boards

    Trouble-shooting, Problem-solving, and Creative Course Development – 2

    hours

    Other Resources

    MERLOT website and 1-on-1 mentoring by

    experienced faculty www.merlot.org

    UT website

    www.utexas.edu/world/lecture for course designs, syllabi, etc.

    Convocation workshops

    Open lab with consultants

    “Mock” Blackboard sites for exploration

    http://www.merlot.org/http://www.utexas.edu/world/lecture

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    3

    Sample Online Faculty Competency Model

    LCTCS guidelines require 45 hours of faculty development in online learning. Those guidelines echo the generally accepted technical education competencies required for exemplary distance

    learning. Furthermore, the skills, knowledge, and attributes within each domain fall into one of 4

    levels of progressively deeper competency development that should, in a manner agreed upon by the specific institution, be considered in any exemplary Online Faculty Development Program.

    The following competency model was adapted from several sources, including Delgado’s technical training program, LCTCS, and Dooley and Lindner (2001).

    Domain 1 – Technical Competency

    Basic Computer Usage

    Email Usage

    Web Browser Usage

    Desktop Application Usage

    Specialized Distance Learning Technical

    Skills

    Course Management System (Blackboard) Usage

    Institutional Design Requirements

    Domain 2 – Application of Learning

    Theory and Pedagogy

    Instructional Design and Pedagogy Skills

    Learning Styles Knowledge

    Learning Theory Knowledge

    Student Learning Outcome Application

    Domain 3 – Communication and Behavioral Skills

    Modeling Diversity Awareness

    Learning Assessment Application

    Feedback Delivery Skills

    Enthusiasm Transfer Ability

    Collaboration/Teamwork Skills

    Facilitation and Group Process Skills

    Domain 4 – Professional Skills

    Content Knowledge

    Administrative Knowledge

    ADA Familiarity

    Legal and Ethical Responsibility

    Continual Learning and Personal

    Development Attribute

    Collaboration/Contribution to Online

    Program Attribute

    The table that follows outlines these competencies by levels of proficiency and the particular behaviors

    that would indicate proficiency at each level. This can be used to build anew or to compare with current learning outcomes in an Online Faculty Development Program.

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    4

    Proficiency Levels and Behavior Indicators for Online Faculty Competencies

    Domain 1: Technical Competency

    The instructor appropriately uses the features, capabilities, and environment in the available course management

    system(s) to deliver a distance learning course in his/her discipline of expertise. This includes competence in the following:

    Basic Computer Usage – Prerequisite

    Identify the operating system of the computer being used to access the Internet course

    Define terms such as mouse, drag, open, select, choose, double-click, download, upload, send, etc.

    Save, copy and find files/folders on floppy and hard drives

    Explain the difference between a server, network and a local drive

    Use the Task Manager to switch between open applications and to end a task

    Navigate between two or more applications without closing and re-opening (multitasking) Minimize/maximize Windows

    Email Usage – Prerequisite

    Send, open, reply to, and forward a message

    Enter a message subject

    Send an attachment

    Open and/or save an attachment

    Add and find a contact

    Manage archive email (emptying “deleted” and “sent” files, saving email to file, etc.)

    List particular dos and don’ts of email etiquette

    Web Browser Usage – Prerequisite

    Go to specific URL

    Print a page

    Follow a hypertext link

    Conduct a basic search using a search engine

    Download and install plug-ins

    Define and explain the purpose of cookies (other than for snacks)

    Identify recommended precautions against viruses, spyware, etc.

    Desktop Application Usage – Prerequisite

    Open a new file

    Open an existing file

    Save a file

    Rename a file (Save As)

    Cut, paste, format text

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    5

    Domain 1: Technical Competency

    The instructor appropriately uses the features, capabilities, and environment in the available course management system(s) to deliver a distance learning course in his/her discipline of expertise. This includes competence in the

    following:

    Print a document

    Basic Blackboard Usage – Level 1

    enroll students to a course

    add a syllabus and other handouts to the site

    add links to external websites to the site

    add an announcement to the site

    post grades through Blackboard

    create an assessment with the test feature

    create an assignment with the assignment feature

    post and respond to items on a discussion board

    indicate standard set for faculty feedback turnaround to students (24-28 hours or less as recommended

    by LCTCS guidelines)

    Blackboard Instructional Knowledge – Level 1

    explain how to log onto Blackboard

    explain how to navigate a course site

    explain how to post assignments

    explain how to post and respond to an item on the discussion board

    Adherence to DCC’s Distance Learning Policies and Standards – Level 1

    create syllabus that complies with established department guidelines (i.e. follows master syllabus and includes course description, SLO/LA, course objectives, textbook, calendar etc.)

    use features to design an opening page that complies with established department guidelines (i.e.

    follows color scheme, navigation protocol, etc. and still expresses individual identity)

    use the course calendar to list events and assignments that are designed for ease of learning and that

    correlate with course objectives

    place a structured yet flexible test schedule in the appropriate spot

    list the planning activities required for testing, sites, and proctors (i.e., site notification; communication

    of location, time and contacts to students; appointment and advising of and necessary training for proctors)

    insert appropriate links for student services such as registration, counseling, financial aid, SGA, bookstore, etc.

    insert appropriate links to other learning resources such as information web sites, required software,

    content-specific sites, tutorials, DCC learning resources

    design an appropriate color scheme for optical ease

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    6

    Domain 1: Technical Competency

    The instructor appropriately uses the features, capabilities, and environment in the available course management system(s) to deliver a distance learning course in his/her discipline of expertise. This includes competence in the

    following:

    insert graphics in appropriate spots that are generally appealing to most humans

    identify Delgado’s internal and other external Blackboard resources and support available to faculty and

    students

    explain why, how, and what kinds of files should be stored outside of Blackboard

    explain Delgado’s requirements and procedure for requesting and creating a Blackboard site

    give examples of what responsibilities are in and outside the scope of Delgado IT technical support for

    Blackboard

    Specialized Application Usage – Level 4

    use Impatica to add a PowerPoint presentation to the site (needs specific tasks)

    format the site with the style, color, or pattern features

    use Front page or other web-creation software (needs specific tasks)

    use Tegrity to add a video lecture to the site (needs specific tasks)

    Domain 2: Application of Learning Theory and Pedagogy:

    The instructor promotes student learning by providing responsive instruction based on a chosen methodology, makes

    use of effective learning techniques and employs instructional strategies that actively engage students in the learning process.

    Online Instructional Design Acumen – Level 1

    define the purpose and components of an online course orientation

    give examples of “appropriate” and “inappropriate” language to use in site content

    give examples of a “well organized” and “not well organized” online course site

    define the policies for online discussion participation you will use on your site

    define policies for prompt student feedback you will employ in your course

    Teaching Strategy Usage – Level 1

    define the specific pedagogical technique you use in your instructional design

    present a workshop on a particular instructional strategy

    describe an ice-breaker or opening that gets students’ attention

    Effective Syllabus Creation – Level 2

    explain the required components of an online syllabus and present yours

    create a personal introduction that reflects your style, principles, and teaching/learning theory

    Student Learning Outcome Knowledge – Level 2

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    7

    Domain 1: Technical Competency

    The instructor appropriately uses the features, capabilities, and environment in the available course management system(s) to deliver a distance learning course in his/her discipline of expertise. This includes competence in the

    following:

    write measurable instructional objectives

    explain a rationale for how the objectives will help to achieve learning outcomes

    differentiate between outcomes, outputs, and objectives

    write course learning outcomes that are aligned with program learning goals

    Learning Style Knowledge – Level 3

    develop a learning-centered curriculum for your discipline that incorporates student learning styles

    list 20 learning activities and show how they apply to different learning styles

    identify how an attention to different learning styles is incorporated into instruction of the DL site

    identify different methods of inquiry in the learning activities

    Learning Theory Knowledge – Level 3

    compile a literature review on learning-centered teaching

    deliver a presentation on how to apply a particular learning theory in an online course

    Domain 3: Communication and Behavioral Skills

    The instructor creates an environment of respect and rapport, fostering a positive climate for learning, equity, and

    excellence appropriate for all students and based on feedback from continual learning assessment.

    Modeling Diversity Awareness – Level 2

    give rationale for techniques used to respond to various classroom management cases

    explain how to encourage students to engage in inquiry-based learning to develop individual identity and

    critical thinking

    Learning Assessment Application – Level 3

    demonstrate how assessments you choose are matched to course content and adhere to academic

    standards

    list 20 valid and reliable assessments for online learning and show how they are fair and adequate

    methods to assess mastery of content

    Feedback Delivery Skill – Level 3

    design appropriate synchronous and asynchronous communication methods for delivering course

    materials at a distance

    identify appropriate timeframe for feedback response and explains how different methods of delivering

    feedback have different impact

    Enthusiasm Transfer Ability – Level 3

    identify a method for building student rapport

    describe your motivation for learning about and teaching online

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    8

    Domain 1: Technical Competency

    The instructor appropriately uses the features, capabilities, and environment in the available course management system(s) to deliver a distance learning course in his/her discipline of expertise. This includes competence in the

    following:

    Collaboration/Teamwork Skills – Level 3

    create virtual teams for discussion threads

    design a collaborative learning activity

    Facilitation and Group Process Skills – Level 3

    facilitate a video conference or teamwork session

    give a rationale for techniques used to respond to discipline issues

    Domain 4: Professional Skills:

    The instructor fulfills professional roles and responsibilities and adheres to legal and ethical requirements of the

    profession.

    Content Knowledge – (Level ?)

    (Will be assessed by a peer review process to standards determined by the department)

    Administrative Knowledge – Level 2

    list questions for faculty to consider when planning an online site at Delgado

    explain how to set a timeline for creating and implementing an online site at Delgado

    explain the institutional outputs to which your course contributes and impacts

    ADA Familiarity – Level 2

    explain what would and what would not make an online course ADA compliant

    Legal and Ethical Responsibility

    rely on technical experts for scheduling and copyright clearance

    explain why copyright laws are important to understand when teaching a distance learning course

    define your procedure and rationale for managing disciplinary concerns online

    Continual Learning and Personal Development Attribute

    define your personal teaching and learning goals, scholarly pursuits, and their application in your online

    teaching experience

    list organizations, associations, or other entities to which you belong or that would add value to your

    continual learning of technology and trends in distance learning

    Collaboration/Contribution to Online Program Attribute

    submit reflection on teaching and respond to colleagues’ reflections in an online forum

    contribute to the online knowledge base

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    9

    Sample Online Faculty Development Curriculum

    An Online Faculty Development Program that builds instructional design and delivery competence might look something like this:

    Prerequisites:

    Individuals should possess certain basic computer skills in order to benefit from and contribute to an online program. Therefore, certain technical prerequisites such as the following should be required and

    assessed prior to engaging in online instructional development or teaching. An online pre-assessment for IC3 technical capabilities with remediation is recommended.

    Basic computer usage

    Email Usage

    Web Browser Usage

    Desktop Application Usage

    Level 1 Modules – BlackBoard Basics (4 weeks, face-to-face or online format)

    Basic Blackboard Usage

    Blackboard Instructional Knowledge

    Adherence to the Institution’s Distance Learning Policies and Standards

    Online Instructional Design Acumen

    During and upon completion of these Level 1 Modules, individuals are assessed for Level 1 proficiency

    and move on to Level 2 Modules.

    Level 2 Modules – Building Effective Content: Course Materials and Techniques (4 weeks, fact-to-face or online format)

    Effective Syllabus Creation

    Student Learning Outcome Knowledge

    Modeling Diversity Awareness

    Administrative Knowledge

    ADA Familiarity

    Legal and Ethical Responsibility Knowledge

    During and upon completion of these Level 2 Modules, individuals are assessed for Level 1 and 2 proficiency. Demonstration of competence at these levels shown through peer review and self-

    assessment is then formally approved by a Distance Learning Committee in a final course evaluation and checklist to be then considered a Level 3 course. At this point in the program, participants are ready to

    begin teaching their online course developed through Level 1 and 2 Modules. Level 3 Modules occur during the teaching of the first course.

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    10

    Level 3 Modules – Practicing and Developing Exemplary Online Instruction (first semester of online course delivery)

    Applying Learning Style Knowledge

    Applying Learning Theory Knowledge

    Assessment Application

    Feedback Delivery Skill

    Enthusiasm Transfer Ability

    Collaboration/Teamwork Skills

    Facilitation and Group Process Skills

    During implementation of Level 3 Modules, individuals are assessed for proficiency and provided continual feedback. At the end of the semester, a comprehensive course assessment and instructor review takes

    place, including the ways assessment feedback will inform future course design and delivery. At this point, individuals should have strengthened their online instructional competence to Level 4.

    Level 4 Modules – Applying Assessment Feedback Into Redesign (incorporating more sophisticated online strategies)

    Specialized Online and Multi-Media Application Usage

    Continual Learning and Personal Development Attribute

    Collaboration/Contribution to Online Program Attribute

    Level 4 represents an ongoing capability for continual learning, development, and improvement of online

    courses, both individually and programmatically by the individual’s continual contributions to its effectiveness. Assessments are ongoing, utilizing peer review, student evaluation, and instructor review.

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    11

    Distance Learning Course Assessment - Continual Quality Improvement (See Sample Online Course Content Assessment Checklist, pg. 19)

    (insert, if appropriate, any formal administrative process required by the program’s department or IE)

    Peer Review

    (See Sample Peer Review, pg. 25)

    Student Review

    (See Sample Student Review, pg. 27)

    Instructor Review and Follow-up Report

    (See Sample Instructor Review, pg. 29)

    Instructor report and follow-up synthesizes the feedback from peer review, student review, and faculty

    review of learning outcome assessment data, distributed with recommendations and feedback to (IT? Personal file?)

    At the end of each semester, online and classroom course faculty review learning outcome assessment feedback, discuss implications, and utilize data for decisions that will continue to improve learning

    outcomes. Dialogue should inform both online and classroom sections of the course in the collaborative

    effort to ensure the same learning outcomes.

    Share recommendations, ideas, relevant discussion topics on Learning Outcomes Blackboard site

    Share notable learning moments and innovative practices on Learning Outcomes Blackboard site

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    12

    Delgado Distance Learning Program: Performance-Based Competencies for Online Faculty

    According to the LCTCS guidelines and current literature review, the following Competency Domains represent the criteria required for successful

    online teaching and learning. LCTCS guidelines specify 45 hours of faculty development. The following table illustrates how course assessment flows from the faculty development program and how faculty development and course assessment methods might be applied and when. (adapted

    from http://continuinged.uml.edu/online/institutes.htm )

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    Note that all assessments generate feedback for change or continual improvement and learning.

    It is expected that all assessment feedback will be transparent and used as input into further development.

    Technical

    Competency: The instructor

    appropriately uses the features,

    capabilities, and

    technical environment in

    the available course

    management

    system(s) to deliver a distance

    learning course in his/her discipline

    of expertise.

    Basic Computer

    Usage (Prerequisite)

    Email Usage (Prerequisite)

    Web Browser Usage

    (Prerequisite)

    Desktop Application

    Usage (Prerequisite)

    1. IC3-based assessment tool administered

    online determines current level of DL faculty technical competence. It also determines

    whether or not faculty should remediate or proceed on to Blackboard course

    management training and online pedagogy

    development.

    2. Self-Assessment – Evaluation of Exemplary

    Online Courses, see pg. 32 completed online pre- and post- DL course delivery determines

    attitude, perceived competence, and

    concerns.

    3. Online Instructors – Training Needs Survey,

    see pg. 35, provides another means of determining competency development needs

    1. Grant written to purchase software as of 11/21

    Also recommended by Ed McGee for online faculty pre-assessment is www.howtomaster.com.

    Standard needs to be set by Tech Expert for

    minimum competence.

    2. During program development, this will provide a baseline from which we could estimate an

    ultimate increase in DL faculty to 35% of total full-time faculty (based on results of similar

    assessment at U. of Mass., Lowell) Many (90%?)

    of faculty who had to quickly adapt will fall into the “Minimum” category. New online faculty would

    be expected “Minimum.” “Effective” or “Exemplary” result as well as approval by the

    Distance Learning Committee certifies a course as a Level 3 course that can be listed in the

    academic schedule.

    3. Fac/Dev sets criteria for this assessment, including how results will be used.

    http://continuinged.uml.edu/online/institutes.htmhttps://owa.dcc.edu/exchweb/bin/redir.asp?URL=http://www.howtomaster.com

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    13

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    in the program.

    Basic Blackboard

    Usage (Level 1)

    Blackboard Instructional

    Knowledge (Level 1)

    Adherence to DCC’s Distance Learning

    Policies and

    Standards (Level 1)

    1. Level 1 Modules in the Blackboard Basics

    course curriculum culminate in the creation

    of a functional online course site that complies with state and Delgado standards

    and design requirements. Assessment is by Peer review – See pg. 25

    1. Online Faculty Participants must successfully

    complete the Level 1 Modules in Blackboard

    Basics and achieve a “Acceptable” result on the Peer review in order to proceed to Level 2

    Modules in the Online Faculty Development Program.

    Specialized Online

    and Multi-media Application Usage

    (Level 4)

    1. Level 4 modules in online application have

    imbedded assessment and culminate in Capstone assessment whereby participants

    design sophisticated multi-media features on

    their site.

    a. Peer review – Continuous Improvement

    Guide

    b. Instructor review – Continuous

    Improvement Guide

    1. Level 4 Modules in the Online curriculum should

    use the participant’s actual course wherever possible and build upon it with the specialized

    skills. Competency is determined by the

    successful completion of the course(s) as well as documentation of responses to feedback

    from peer review and self-assessment.

    Application of

    Learning

    Theory and Pedagogy:

    The instructor promotes student

    learning by

    providing responsive

    instruction based

    Online Instructional

    Design Acumen

    (Level 1)

    Teaching Strategy

    Usage (Level 1)

    Presentation Skills

    (Level 1)

    Effective Syllabus Creation (Level 2)

    1. Level 1 and 2 Modules in the Blackboard

    Basics course curriculum culminate in the

    creation of a functional online Level 3 course site that complies with state and Delgado

    standards and design requirements.

    a. Peer review

    b. Self-assessment – Evaluation of Exemplary Online Courses

    1. Online Faculty Participants must successfully

    complete the Level 1 and 2 Modules in

    Blackboard Basics and:

    a. achieve a “Acceptable” result on the Peer

    review;

    b. “Effective” self-assessment result from the Evaluation of Exemplary Online Courses;

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    14

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    on a chosen methodology,

    makes use of

    effective learning techniques and

    employs instructional

    strategies that actively engage

    students in the

    learning process.

    Student Learning Outcome

    Knowledge (Level

    2)

    Learning Style

    Knowledge (Level 3)

    Adult Learning Theory Knowledge

    (Level 3)

    c. Distance Learning Committee approval – Level 3 Online Course Approval Checklist,

    see pg. Error! Bookmark not defined.

    2. Level 3 Modules in the Online Faculty Development Program occur during actual

    instruction and are assessed at the beginning

    of the semester as per Level 3 Course Approval Guidelines (see above).

    a. During the semester, Level 3 Modules include assessments such as

    presentations, group assignments, and

    formative student learning assessment feedback.

    b. At the end of the semester, assessment includes:

    i. Self-Assessment - Evaluation of Exemplary Online Courses

    ii. Peer Review

    iii. Student Review – Student Course

    Review, see pg. 27

    iv. Instructor Review – Continuous

    Improvement Guide

    c. “Meets or Exceeds Criteria” as per the Level 3 Online Course Approval Checklist completed

    by the Distance Learning Committee. This

    result certifies the course at a Level 3 and allows the instructor who developed it to

    move into Level 3 Modules, which occur in real-time online instruction with that course.

    2. Level 3 Modules develop competency in course delivery and occur during a semester of teaching.

    The instructor’s choice of classroom learning

    assessments will contribute to his/her feedback during instruction.

    a. Presentations on topics of choice and responses to feedback from peer review demonstrate

    achievement of competencies at Level 3.

    b. Summative Assessments at the end of the Level 3 semester:

    i. Self-Assessment results should be at “Effective” or “Exemplary”;

    ii. Peer Review rating of “3” or above;

    iii. Student Review score of 75% or above

    iv. Continuous Improvement Guide is a

    summary of the course assessments by the

    instructor and includes plans for adaptation and continual improvement. This moves the

    instructor into Level 4 competencies, which

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    15

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    are those of continual professional development in and contribution to online

    learning.

    Communication and Behavioral

    Skills:

    The instructor

    creates an environment of

    respect and

    rapport, fostering a positive climate

    for learning, equity, and

    excellence

    appropriate for all students and

    based on feedback from

    continual learning assessment.

    Modeling Learning Outcomes/Objectiv

    es Ability (Level 2)

    Assessment

    Application (Level 3)

    Learning Needs

    Application (Level 3)

    Feedback Delivery Skill (Level 3)

    Questioning Skills

    (Level 3)

    Enthusiasm

    Transfer Ability (Level 3)

    Collaboration/Teamwork Skills (Level 3)

    Facilitation and

    Group Process Skills (Level 3)

    1. Level 2 Modules in the Blackboard Basics course curriculum culminate in the creation of

    a functional online Level 3 course site that complies with state and Delgado standards

    and design requirements.

    a. Peer review

    b. Self-assessment – Evaluation of Exemplary Online Courses

    c. Distance Learning Committee approval – Level 3 Online Course Approval Checklist

    2. Level 3 Modules in the Online Faculty Development Program occur during actual

    instruction and are assessed at the beginning

    of the semester as per Level 3 Course Approval Guidelines (see above).

    a. During the semester, Level 3 Modules include assessments such as

    presentations, group assignments, and

    formative student learning assessment feedback.

    b. At the end of the semester, assessment

    1. Online Faculty Participants must successfully complete the Level 2 Modules in Blackboard

    Basics and:

    a. achieve an “Acceptable” result on the Peer

    review;

    b. “Effective” self-assessment result from the Evaluation of Exemplary Online Courses;

    c. “Meets or Exceeds Criteria” as per the Level 3 Online Course Approval Checklist completed

    by the Distance Learning Committee. This

    result certifies the course at a Level 3 and allows the instructor who developed it to

    move into Level 3 Modules, which occur in real-time online instruction with that course

    2. Level 3 Modules develop competency in course delivery and occur during a semester of

    teaching. The instructor’s choice of classroom

    learning assessments will contribute to his/her feedback during instruction.

    a. Presentations on topics of choice and responses to feedback from peer review demonstrate

    achievement of competencies at Level 3.

    b. Summative Assessments at the end of the

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    16

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    includes:

    i. Self-Assessment - Evaluation of

    Exemplary Online Courses

    ii. Peer Review

    iii. Student Review

    iv. Instructor Review – Continuous Improvement Guide

    Level 3 semester:

    i. Self-Assessment results should be at

    “Effective” or “Exemplary”;

    ii. Peer Review rating of “3” or above;

    iii. Student Review score of 75% or above

    iv. Continuous Improvement Guide is the instructor’s summary of course assessments

    and plans for adaptation and continual

    improvement. This moves the instructor into Level 4 competencies, which are those of

    continual professional development in and contribution to online learning.

    Professional

    Skills:

    The instructor

    fulfills professional roles

    and responsibilities

    and adheres to

    legal and ethical requirements of

    the profession.

    Content Knowledge

    (Level ?)

    Administrative

    Knowledge (Level 2)

    ADA Knowledge (Level 2)

    Legal and Ethical

    Responsibility Knowledge (Level

    2)

    Continual Learning

    and Personal

    Development Attribute (Level 4)

    1. Level 2 Modules in the Blackboard Basics

    course curriculum culminate in the creation of a functional online Level 3 course site that

    complies with state and Delgado standards and design requirements.

    a. Peer review

    b. Self-assessment – Evaluation of Exemplary

    Online Courses

    c. Distance Learning Committee approval – Level 3 Online Course Approval Checklist

    1. Online Faculty Participants must successfully

    complete the Level 2 Modules in Blackboard Basics and:

    a. achieve an “Acceptable” result on the Peer

    review;

    b. “Effective” self-assessment result from the

    Evaluation of Exemplary Online Courses;

    c. “Meets or Exceeds Criteria” as per the Level 3

    Online Course Approval Checklist completed by the Distance Learning Committee. This

    result certifies the course at a Level 3 and

    allows the instructor who developed it to move into Level 3 Modules, which occur in

  • Working Papers: Distance Learning Program Guidelines December 15, 2005

    17

    Competency

    Domain

    Levels of Ability,

    Knowledge, Skill, and Attributes

    Assessment Method Assessment Criteria/Use of Assessment

    Feedback

    Collaboration/Contribution to Online

    Program Attribute

    (Level 4)

    2. Level 4 Modules utilize the feedback from

    prior assessments and include the adaptations

    that result from that feedback. Assessment at this level is in the form of:

    a. Self-Assessment - Evaluation of Exemplary Online Courses

    b. Peer Review

    c. Student Review – Student Course Review

    d. Instructor Review – Continuous Improvement Guide and Feedback

    Response

    real-time online instruction with that course

    2. Summative Assessments at the end of the

    Level 3 semester:

    a. Self-Assessment results should be at “Effective” or “Exemplary”;

    b. Peer Review rating of “3” or above;

    c. Student Review score of 75% or above

    d. Continuous Improvement Guide includes the Instructor’s summary of course assessments

    and plans for adaptation and continual

    improvement.

    In addition: existing online faculty would be

    expected to achieve an “Acceptable” result on random peer review of existing course site with the

    Online Course Content Checklist as well as respond to feedback on the Continuous Improvement Guide

  • 18

    Appendix: Forms, Worksheets, and Reference

  • Appendix: Forms, Worksheets, and Reference

    19

    SAMPLE - NEW COURSE FEASABILITY QUESTIONAIRRE

    WHY SHOULD THIS COURSE BE OFFERED IN AN ELECTRONIC FORMAT?

    The primary purpose of this evaluation is to help faculty and administrators determine the

    wisdom and/or feasibility of offering a course in an electronic format. This process is designed to improve these services and processes as they are continually developed and refined. By

    continually evaluating the instructional design and conversion lifecycle of a course, the objectives,

    scope and data gathering methods are more clearly and consistently defined and refined.

    1) Was a feasibility analysis conducted in order to determine whether this course should be converted to an electronic format in addition to offering it in a traditional format? If no, such a

    feasibility analysis should be conducted and its results considered before such a conversion is

    attempted.

    2) Was a feasibility analysis conducted in order to determine whether students would benefit

    from technology insertion into the existing traditional course format? If no, such an analysis should be conducted and its results considered before an insertion is developed

    3) What are the goals and objectives of the course to be converted or modified?

    4) How are you evaluating your courses for e-learning suitability?

    5) What instructional design considerations are being given to the development of an

    electronically-delivered course or components within the course?

    6) Are other courses being offered, at your college, in such numbers that your college can

    provide the support staff to avoid any downtime or crashes to the system that you plan to utilize?

    7) Has any staff development been conducted with existing staff resources or has contractor

    support been obtained?

    8) Is there a strategic education and training plan in place that would tie in strategic planning for

    electronic learning to the college’s master plan for technology and the budgeting and funding process?

    9) Have you developed metrics for tracking analyzing investments made toward electronic

    learning on your campus?

    10) Are all of your stock holders involved in the e-learning initiative and do you use standard

    project management techniques within the initiative?

    11) What are your college’s long-term goals for the e-learning program?

  • Appendix: Forms, Worksheets, and Reference

    20

    SAMPLE

    Memorandum of Agreement

    Development of Electronically Delivered Course

    I ____________________________am an employee of __________________________College at __________________________ Campus (hereinafter “the College”), a college within the

    Louisiana Community and Technical College System.

    As a part of my job duties at the College, I have been asked to develop and prepare educational

    materials for delivery over the Internet or other electronic means. These educational materials will consist of, but are not limited to, instructional text and related media such as course books,

    workbooks, images, graphics, web pages, assessment tests, etc.

    I acknowledge that developing educational materials fall within the scope of my regular duties of

    employment at the College. I acknowledge that the College has the right to govern the time, methods, and standards of my work. Accordingly I understand that, notwithstanding any policy

    to the contrary, any and all such educational materials are solely owned by the college.

    I understand that these educational materials will be maintained and published in the Louisiana Technical College online Library or the LCTCS online library and made available for reuse by the

    college or other institutions within LCTCS.

    _______________________ ___________________________

    Signature of Faculty Member Signature of Vice Chancellor of Instruction

    ___________________________

    Date

  • Appendix: Forms, Worksheets, and Reference

    21

    Sample Online Course Assessment Form- Administrative

    This checklist is based on several agencies recommendations for best practices including SREB, NEA and SACS-COC and is designed to assist states and schools in determining the quality and

    effectiveness of Web-based courses. It is suggested that each course be rated on the extent to which it meets the criteria, with 1 indicating that a course does not meet the criteria and 3

    indicating that it does.

    Course/Discipline: ________________________________________________________________

    Reviewer: ______________________________________________________________

    Date: __________________________________________________________________

    Curriculum, Instruction and Student Assessment

    Indicate 3, 2, 1, or 0 based on the following rubric:

    3 = Meets or exceeds criteria: evidence exists that criteria have been met

    2 = Barely meets criteria: some evidence exists that criteria have been met but may be incomplete or inaccurate in some areas

    1 = Does not meet criteria: little to no evidence exists that criteria have been met is too vague or completely inaccurate

    0 = Cannot determine whether criteria have been met.

    To What extent does the course meet the criteria in this area?

    Considerations

    1. The course provider is authorized to operate by the state where the course

    originates.

    State review of courses and accreditation of providers are ways to ensure that the course

    provider is of quality.

    3 2 1 0

    2. The College or Campus has reviewed the course to ensure its quality before it is used.

    There is documentation of these reviews. 3 2 1 0

    3. The College or Campus in which the

    student is enrolled will accept the course for credit.

    Is this course taught for credit? Will the College or

    Campus accept this course for credit?

    3 2 1 0

    4. Procedures for fees and payments are established before students enroll in a

    course.

    Tuition and fees related to the course are disclosed fully, and payment methods and

    schedules are provided.

    3 2 1 0

    5. Student work and personal data are secure.

    Student information remains confidential as required by the Family Education Rights and

    Privacy Act.

    3 2 1 0

    6. Students are monitored to ensure academic honesty.

    College or Campus provides means to monitor student performance. The course design

    promotes monitoring of student performance.

    3 2 1 0

    7. An instructor or educator coordinates and

    assists students with instructional, technical

    and management requirements.

    The course provider offers training and support to

    the e-learning coordinator, who assists with

    course requirements, assignments and grades and who acts as a liaison among students, the

    College or Campus, and the course provider.

    3 2 1 0

    8. The course provider offers the course instructor and e-learning coordinator

    assistance with technical and course management.

    The course provider offers orientation training, distance learning training, product/course

    updates, a help desk, special technical assistance and answers to frequently asked questions.

    3 2 1 0

  • Appendix: Forms, Worksheets, and Reference

    22

    Curriculum, Instruction and Student Assessment

    Indicate 3, 2, 1, or 0 based on the following rubric:

    3 = Meets or exceeds criteria: evidence exists that criteria have been met

    2 = Barely meets criteria: some evidence exists that criteria have been met but may be incomplete or inaccurate in some areas

    1 = Does not meet criteria: little to no evidence exists that criteria have been met is too vague or completely inaccurate

    0 = Cannot determine whether criteria have been met.

    9. Students have access to necessary,

    relevant learning materials.

    The course provider identifies materials and

    technological resources that students will need. There is a list of who is expected to provide these

    materials, which may include scanners, digital cameras, reference materials, books, videos,

    software and lab equipment.

    3 2 1 0

    10. The course provider has identified prerequisite sills in the use of technology.

    The course syllabus describes in detail what knowledge of certain programs and/or multimedia

    students should have for the course.

    3 2 1 0

    11. There are technical requirements for acceptable access.

    The course requirements include minimum technical requirements.

    3 2 1 0

    12. The instructor is trained to use the

    course and resources effectively to deliver instruction.

    If the course provider employs the instructor, the

    provider submits evidence that the instructor is certified in the subject matter and has been

    trained as an online instructor.

    3 2 1 0

    13. The students receive technical support to

    ensure ease of use of the course.

    Every student has access to a workstation,

    network, ISP and course support.

    3 2 1 0

    14. There is a policy for recourse or appeal if the Web-based course is not delivered as

    described.

    Contracts and licensing agreements specify how the course will perform and the sanctions and

    penalties that will result if it does not meet those

    expectations.

    3 2 1 0

    15. The course is coordinated with academic

    calendar of the students before it begins.

    The course can accommodate multiple calendars

    (block, 4x4, traditional).

    3 2 1 0

    16. Faculty information and office hours are clearly listed.

    Evidence of staff information and office hours are stated within the course.

    3 2 1 0

    17. The Web-based course’s success is

    measured by the achievement of students taking it.

    The course provider should have references

    concerning the number of students who complete the course and results of end-of-course tests.

    3 2 1 0

    18. The College, Campus or its designees

    evaluate the course over time.

    The course provider shall provide evidence of

    evaluations.

    3 2 1 0

    19. A new course provides documentation of

    its reliability and completeness.

    Evidence of beta testing, peer review and student

    evaluations are available upon request.

    3 2 1 0

  • Appendix: Forms, Worksheets, and Reference

    23

    Curriculum, Instruction and Student Assessment

    Indicate 3, 2, 1, or 0 based on the following rubric:

    3 = Meets or exceeds criteria: evidence exists that criteria have been met

    2 = Barely meets criteria: some evidence exists that criteria have been met but may be incomplete or inaccurate in some areas

    1 = Does not meet criteria: little to no evidence exists that criteria have been met is too vague or completely inaccurate

    0 = Cannot determine whether criteria have been met.

    20. Each instructor of a Web based course

    will be evaluated at least once a year.

    The course provider shall provide evidence of

    criteria for instructor evaluations.

    3 2 1 0

    21. The College or Campus can verify a

    student’s participation and performance in a

    Web-based course during the course and upon its completion.

    The course provider furnishes evidence of student

    participation and performance as needed.

    3 2 1 0

    22. Other criteria: 3 2 1 0

    Course is: � Recommended � Not Recommended

    Course: __________________________________________________________________

    Platform: _________________________________________________________________

    Dean or Authorized Designation: ______________________________________________

    e-learning Program Coordinator: _______________________________________________

  • Sample Checklist for Instructional Requirements

    Minimum Criteria (Principles of Good Practice – LCTCS)

    Site includes a “course orientation” (discuss criteria for an effective online course

    orientation)

    Site includes an introduction to the instructor, contact information

    Site includes policies for prompt student feedback (confirm standard turn-around time for

    instructors to give feedback)

    Site includes policies for assignment deadlines (confirm standard policies)

    Site includes policies for discussion participation (discuss relevance and effective criteria)

    Site includes policies for evaluating student performance (assessment techniques and

    rubrics) and easy access to student grades (confirm technical recommendations for # of

    clicks-whatever-to ensure easy access)

    Site includes syllabus modeled from corresponding master syllabus, including learning

    outcomes and assessment methods

    Site includes particular class objectives based on learning outcomes (discuss guidelines for

    writing objectives)

    Self-directed learning activities and discussions are structured and sequenced to assist

    learners in achieving learning outcomes(confirm validation techniques for this)

    Site includes performance expectations (confirm reasonable measurement for “high” expectations)

    Site includes guidelines for success, support information (discuss effective success strategies, confirm support recommendations and #s)

    Site includes a structured, flexible course schedule (confirm effective scheduling

    techniques)

    Instructional design reflects a deliberate pedagogical technique (discuss relevance and

    criteria)

    Instructional design addresses multiple learning styles (confirm effective methods)

    Active learning techniques are used (discuss effective techniques to use as effective

    examples)

    Site provides features for student-to-student interaction (discuss criteria for quality

    discussion forums or other collaborative features)

    Course content is well organized so that….(confirm criteria for well-organized course

    content)

    Site content and course material are grammatically correct and use language appropriate

    for the learner (discuss relevance and criteria)

    Site includes self-assessment methods for students to monitor progress (confirm methods, tools)

  • Appendix: Forms, Worksheets, and Reference

    25

    Sample Peer Review

    This checklist is based on several agencies recommendations for best practices including SREB, NEA and SACS-COC and is designed to assist states and schools in determining the quality and effectiveness of

    Web-based courses. It is suggested that each course be rated on the extent to which it meets the criteria, with 1 indicating that a course does not meet the criteria and 3 indicating that it does.

    Course/Discipline/Provider:_________________________________________________

    Reviewer: ______________________________________________________________

    Date: __________________________________________________________________

    Curriculum, Instruction and Student Assessment

    Indicate 3, 2, 1, or 0 based on the following rubric:

    3 = Meets or exceeds criteria: The considerations are consistently evident

    2 = Barely meets criteria: The considerations are evident less than 80% of the time

    1 = Does not meet criteria: The considerations are evident less than 50% of the time

    0 = Cannot determine if the criteria have been met.

    To What extent does the course meet the criteria in this area?

    Considerations

    1. The course content and assessments are aligned with the state’s academic standards. All grades are posted in the Gradebook feature of Blackboard and exceptions approved by Divisional Dean.

    Course objectives and student learning objectives are listed. Assessments are matched to course content and state academic standards. Students were required to submit something within the first five days of class for the purpose of attendance reporting.

    3

    2

    1

    0

    2. The course engages students in learning

    activities that address various learning styles.

    Learning activities and options, including case studies,

    simulations, and written assignments, Web resources, reading activities, discussions, labs and multimedia are embedded in the course.

    3

    2

    1

    0

    3. The course gives students opportunities to engage in abstract thinking and critical reasoning.

    Inquiry-based learning and discussions are used. Students are challenged and encouraged to predict, summarize, interpret, contrast and differentiate ideas.

    3

    2

    1

    0

    4. The course structure includes fair, adequate and appropriate methods and procedures to assess students’ mastery of content. Instructor tests Assessments by clicking on the test link and taking the test to make sure it works correctly.

    Valid and reliable assessments included online or proctored testing, performance assessments, standardized tests, projects, demonstrations, multimedia presentations, case studies, simulations and electronic portfolios. At least one proctored exam is incorporated into the course, coordinated times, dates, and locations done through Divisional Dean. All proctored exams posted in the Tests section of the classroom and password protected. Encourage students to complete course evaluations.

    3

    2

    1

    0

    5. The course provides appropriate instructor to student interaction, including timely, frequent feedback about student progress.

    Instructors respond to students within 24 hours. Feedback may include e-mails, discussions, portfolios, telephone calls, regular progress reports and term/semester grades. Use your DCC assigned Outlook account as your e-mail address for all communication with your students and the institution. Instruct students to use their DCC account as well and include in the subject line the course ID and section number.

    3

    2

    1

    0

  • Appendix: Forms, Worksheets, and Reference

    26

    Curriculum, Instruction and Student Assessment

    Indicate 3, 2, 1, or 0 based on the following rubric:

    3 = Meets or exceeds criteria: The considerations are consistently evident

    2 = Barely meets criteria: The considerations are evident less than 80% of the time

    1 = Does not meet criteria: The considerations are evident less than 50% of the time

    0 = Cannot determine if the criteria have been met.

    To What extent does the course meet the criteria in this area?

    Considerations

    6. The course provides opportunities for appropriate student-to-student interaction and a plan for monitoring that interaction.

    Collaborative learning opportunities, through e-mails, discussion threads, simulation, lab activities and other group projects are embedded in the course design. At least

    10 Discussion Boards per term are incorporated and have active participation.

    3

    2

    1

    0

    7. The course complies with the Americans with Disabilities Act and Section 508.

    See act requirements. 3

    2

    1

    0

    8. Students have access to resources that enrich the course content.

    All materials and/or Web links have been reviewed for appropriateness and are aligned with course objectives and specifications.

    3

    2

    1

    0

    9. A complete, clear course syllabus is submitted and available for review by the first day of registration.

    The syllabus outlines course content, expectations of students, required materials, the course’s credit value and a grading scale. It is located in the Syllabus section of the classroom. It is available no later than 8:00 am the first day of the semester.

    3

    2

    1

    0

    10. Issues associated with the use of copyrighted

    materials are addressed.

    The course provider guarantees in writing that all course

    materials comply with copyright laws.

    3

    2

    1

    0

    11. The instructor can adapt learning activities and assessments to accommodate students with disabilities.

    The course can be modified to meet the needs of students or instructors with disabilities.

    3

    2

    1

    0

    12. Course adheres to consistency in regards to navigation and design.

    The course follows guidelines for good format. Outdated materials are removed or revised.

    3

    2

    1

    0

    13. Course exhibits a student orientation. The course requires either an online student orientation or an on-campus orientation. Welcome Letter or Announcement to students outlining the course and where` to start is up the first week.

    3

    2

    1

    0

    14. Instructor manages schedule and record keeping then archives class at the end of term.

    An announcement is posted at the beginning of each week to explain the student’s expectations for the week. Attendance is recorded each week. All grade reporting is complete by college deadlines. Instructor uses Digital Drop Box or Assignments utility for student assignment submissions. Respond to all emails within 2 business days and explain that this does not include weekends or holidays; otherwise inform your students and your Divisional Dean. Instructor evaluates all assignments within a reasonable time, two days from submission for all but lengthy written assignments or essay exams. If there is a delay in posting grades, communicate with students and Divisional Dean.

  • Appendix: Forms, Worksheets, and Reference

    27

    Sample Student Review and Evaluation Rubric for Student Feedback

    (From LCTCS)

    Course #/Section Semester/Year Instructor Campus

    Please check “yes” or “no” to the following questions, explaining your response in the

    space provided.

    Yes No Explanation

    1. I was prepared for this class, completed all necessary assignments, and participated in each scheduled session.

    2. The Course material was appropriate to my level of education.

    3. I would recommend this course to other students.

    4. The course allowed for the appropriate amount of interaction with other students.

    5. The Syllabus and course expectations were relevant.

    6. Tests and assignments were relevant to the course.

    7. The learning objectives were clearly stated.

    8. The learning objectives were met.

    9. All material was presented in a concise/clear manner and was up-to-date.

    10. I obtained enough knowledge to move to the next level of this course.

    11. The grading scale and procedure was clearly explained and posted on the course site.

    12. Instructor was available for office hours that were clearly posted to the courses site and answered questions in a timely manner.

    13. The instructor was very knowledgeable about the course content and subject areas that were appropriate to this course

    14. The instruction was appropriate to my level of education

    15. I would recommend this instructor to other students

    16. The instructor was very professional in all forms of communication

    17. The amount of interaction between Instructor and student was appropriate to the course content

    18. The instructor provided all students with the syllabus and course expectations, including grading scales

    19. The instructor encouraged interaction between students

  • Appendix: Forms, Worksheets, and Reference

    28

    Please check “yes” or “no” to the following questions, explaining your response in the

    space provided.

    Yes No Explanation

    20. The instructor provided adequate feedback on tests and assignments

    21. Tests and assignments were graded in a timely manner

    22. The topics presented in oral or written form were in logical order

    23. The instructors notes, etc. were legible and easy to follow

    24. The instructors notes, etc. were legible and easy to follow

    25. Posted assignments, course work, and/or course projects encouraged students to think.

    A B C D F

    I expect to make the following grade in this course:

  • Appendix: Forms, Worksheets, and Reference

    29

    CONTINUOUS IMPROVEMENT GUIDE FOR ELECTRONIC LEARNING

    Teaching Faculty Observed:____________________________________________________

    Peer Faculty Name:___________________________________________________________

    Course:________________________ Semester/Date:_______________________________

    Course Items to be Observed: Comments:

    Home Page/ Opening Screen Shot

    Good Descriptions (and/or links) are properly

    used to guide students easily through the

    components of the course and identity with the

    instructor.

    Syllabus

    Complete, easy to understand, and complies

    with established guidelines

    Calendar of Events and Assignments

    Calendar of events and assignments are

    designed for ease of learning and for the

    meeting the course objectives.

    Testing

    The test schedule is available and appropriate

    Testing Sites/ Proctors

    Testing sites have been notified, students are

    advised of testing locations and contacts, and

    proctors have been secured, trained, and

    advised.

    Links to Student Services

    There are high-quality links to appropriate

    students services such as registration,

    counseling, financial aid, etc.

  • Appendix: Forms, Worksheets, and Reference

    30

    Learning Resource Links

    There are appropriate links to other learning

    resources such as information web sites,

    required software, etc.

    Textbook

    The textbook is suitable for the course

    Colors

    Color is properly used and easy on the eyes

    Graphics

    Appropriate graphics are utilized well.

    Discussion Group

    There is a discussion group available for student

    and faculty interaction

    Bookstore

    Students are made aware of how to secure

    textbooks and other materials for the course

    Turn-Around/ Feedback Loop

    The turn-around for faculty feedback to students

    is 24-48 hours or less.

  • Appendix: Forms, Worksheets, and Reference

    31

    Summary of Online Course Reviews

    Course is: Recommended Not Recommended

    Course: __________________________________________________________________

    Platform: _________________________________________________________________

    Dean or Authorized Designation: ______________________________________________

    e-learning Program Coordinator: _______________________________________________

  • Appendix: Forms, Worksheets, and Reference

    32

    The Evaluation of Exemplary Online Courses

    Minimal Effective Exemplary

    Online

    Organization

    & Design

    Much of my homepage is under construction, with some

    key components identified

    such as the syllabus. Not all of my course content has been

    migrated.

    My Homepage is organized and navigable. Students can

    understand the key

    components and structure of the course; the course is

    organized and easy to follow.

    My Homepage is well organized, easy to navigate

    and logical. Students can

    clearly understand all components and structure of

    the course; the course is well organized and easy to follow.

    My students are uncertain

    about what is expected of them in the online

    environment.

    My syllabus identifies and

    delineates the role the online environment will play in the

    total course.

    My syllabus is easily identified

    and clearly delineates the role the online environment will

    play in the total course.

    My aesthetic design (look) is

    rudimentary in conceptualization and

    construction.

    My aesthetic design presents

    and communicates course information.

    My aesthetic design

    effectively presents and communicates course

    information.

    My web page structure and format are inconsistent – links

    are in different places and format varies.

    There is consistency in some aspects of my web page.

    There is consistency in all Aspects of my entire web

    course.

    Accessibility issues are not

    addressed.

    I address accessibility issues. Accessibility issues are

    addressed and comply with prevailing guidelines for my

    website.

    I provide opportunities for

    student input and feedback

    that are limited and inconsistent.

    I have provided opportunities

    for student input and feedback

    regarding course design and navigability.

    I have provided opportunities

    for student input and

    feedback throughout the course.

    Instructional

    Design &

    Delivery

    Opportunities that I provide for interaction and

    communication are limited.

    My course offers some opportunities for interaction

    and communication among students, between students

    and instructor, and between

    students and content.

    My course offers multiple opportunities for interaction

    and communication among students, between students

    and instructor, and between

    students and content.

    My learning objectives are

    vague and may be incomplete. Performance expectations are

    unclear or absent.

    My learning objectives are

    identified and performance expectations are simplified.

    My learning objectives and

    performance expectations are clearly defined.

    I do not recognize multiple learning styles nor do I

    accommodate or integrate them in the design of the

    course.

    I provide some strategies for meeting multiple styles, a

    recognized attempt to ensure student understanding of

    content.

    I provide strategies for meeting multiple learning

    styles and promoting critical thinking skills. These are

    clearly implemented.

    I provide opportunities for

    student input and feedback

    I provide for student feedback

    about instructional design

    I provide for feedback that is

    regularly integrated into the

  • Appendix: Forms, Worksheets, and Reference

    33

    Minimal Effective Exemplary

    about instructional design that

    are limited and inconsistent.

    regularly. instructional design and is

    used to inform decisions about instructional strategies.

    Assessment

    &

    Evaluation

    of

    Student

    Learning

    Some of my course objectives,

    instructional strategies and assessment techniques may

    be aligned.

    My course provides students

    the opportunity to self-assess their readiness for online

    components/course.

    My course requires students

    to self-assess their readiness for the online components/

    course prior to or at the beginning of my class.

    My assessment strategies are not fully identified, developed

    or implemented.

    My course objectives, instructional strategies and

    assessment techniques are

    somewhat aligned.

    My course objectives, instructional strategies and

    assessment techniques are

    closely aligned.

    My assessment strategies are

    not comprehensive measuring only the most basic level of

    student knowledge.

    My assessment strategies are

    used to measure content knowledge, skills, or

    performance standards.

    My ongoing multiple

    assessment strategies are used to measure content

    knowledge, skills, and

    performance standards.

    I provide opportunities for

    students to receive feedback about their own performance

    that are infrequent and sporadic.

    I provide opportunities for

    students to receive feedback about their own student

    performance.

    Opportunities for students’

    self-assessment and/or peer feedback opportunities exist

    on my site. I provide regular feedback about student

    performance in a timely

    manner.

    Appropriate

    & Effective

    Use of

    Technology

    My course uses a few

    technology tools for communication and learning.

    My course uses some

    technology tools to facilitate communication and learning.

    My course uses a variety of

    technology tools that are appropriate and effective for

    facilitating communication

    and learning.

    Some technology may be used

    for its own sake. My course has a few bells but no

    whistles.

    Technology that I incorporate

    is mostly used to support student learning rather than

    for its own sake.

    Technology that I incorporate

    is used to enhance student learning rather than for its

    own sake.

    Multimedia and learning objects are largely absent.

    Multimedia elements and/or learning objects may be used

    to engage students in the learning process.

    Multimedia elements and/or learning objects are relevant,

    optimized for student Internet users and effectively

    engage students in the learning process on my site.

    I provide only limited

    opportunities for student feedback.

    I provide for student feedback

    that is used to assess delivery of course content.

    I use student feedback to

    continually improve technological delivery of

    course content.

    Learner

    Support &

    My Welcome Page has limited

    information (for example,

    course title and number,

    My Welcome Page follows the

    suggested University template

    for online course learner

    My Welcome Page includes

    important information about

    being an online student at

  • Appendix: Forms, Worksheets, and Reference

    34

    Minimal Effective Exemplary

    Resources

    instructor name, phone

    number and email).

    support and resources. the College (including, for

    example, links to student computing disabled student

    services, library services,

    student learning center, and the college’s policies; how to

    access department/ program and/or college for advising;

    prerequisites; a course overview and any time-

    certain meetings; and

    instructor contact information).

    My course provides some resources to support online

    student learning.

    My course provides course-specific resources to support

    online student learning.

    My course replicates or links to the Welcome Page

    information and provides a

    variety of course-specific resources to enhance online

    student learning.

    My course offers access to few

    or limited media resources.

    My course offers solid access

    to some media resources appropriate to my course.

    My course offers access to a

    range of media resources appropriate to my course,

    such as tutorials and

    necessary applications.

    I provide limited opportunities

    for students to give feedback to faculty.

    I solicit student feedback

    regarding learner support and resources.

    I solicit student feedback

    regarding learner support and resources to make

    modifications when

    appropriate.

  • Appendix: Forms, Worksheets, and Reference

    35

    FACULTY TRAINING NEEDS SURVEY

    Please, mark the electronic learning topics that would be of greatest interest/ benefit to you

    and/ or your college’s faculty/ staff/ administrators. Use the following designations to

    distinguish levels on interest/ benefit:

    5=Immense Benefit

    4=Benefit

    3=Neutral in Benefit

    2=Little Benefit

    1=No benefit

    _____ A Beginner’s Guide: Getting Past Screensaver

    _____ “So a CD came with the textbook, now what?” or “How do my students and I benefit from the new

    textbook electronic supplemental resources?”

    _____Teaching by Compressed Video: More Than “A Talking Head”

    _____Legal Issues in Distance Learning: Copyright and Intellectual Property

    _____ Proctor Training for Compressed Video Classes: Legal Issues

    _____ Satellite Broadcasting and Receiving: Effective Classroom and Professional Development Applications

    _____ Teaching Over the Internet: Beginners

    _____ Teaching Over the Internet: Intermediate

    _____ Teaching Over the Internet: Advanced

    _____ Creating Powerpoint Presentations and Insertions

    _____ Mixing Media

    _____ Creating Faculty and Student Orientations

    _____ Creating Faculty and Student 24/7 Help Desks and Accessibility

    _____ Using Streaming Video in the Classroom

    _____ Other:

    ________________________________________________________________________

    ________________________________________________________________________

    COMPLETE AND RETURN TO YOUR COLLEGE E-LEARNING COORDINATOR.

  • Appendix: Forms, Worksheets, and Reference

    36

    Sample BlackBoard Basics Course from UT The following learning objectives from UT Austin represent the kind of Level 1 Module activities outlined above in the Sample Online Faculty Development Curriculum

    The Basics

    Introduction

    The Control Panel

    Modifying your Courses List

    Course Management

    Adding an Item

    Using the Collaboration tool

    Using the Discussion Board

    Copying courses from Blackboard5

    Copying courses in Blackboard6

    Combining course sites

    Customizing your course menu

    Importing an archived file

    User Management

    Enrolling a user

    Modifying a user

    Adding TAs to Blackboard

    Adding and modifying a group

    Gradebook tool

    Adding grades to your Gradebook

    Downloading your Gradebook

    Uploading your Gradebook

    Assignments

    Adding an Assignment

    Downloading an Assignment

    Entering grades for an Assignment

    Using Item File Clean Up feature

    Assessment tools

    What is an Assessment?

    Creating a test

    Making your test available

    Creating a survey

    Making your survey available

    Using the Pool Manager

    Create a test from a pool

    Upload test questions

    Viewing Test/Survey Results

    Downloading Test/Survey Results

    Manuals

    Instructor manual - HTML

    Instructor manual - PDF

    For Students...

    Using the Digital Drop Box

    Downloading Assignment

    Uploading an Assignment

    Change your e-mail address

    Student manual - HTML

    Student manual - PDF

    http://www.utexas.edu/academic/blackboard/tutorials/intro/intro.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/control/panel.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/mod/course.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/additem/add.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/collab_a/index.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/discuss/discuss.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/copy5/course.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/copy6/course.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/combining/combining.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/managehttp://www.utexas.edu/academic/blackboard/tutorials/import/import.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/enroll/enroll.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/modify/user.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/clips_ta/clips_ta.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/groups/add.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/grade_a/add.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/grade_d/down.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/grade_u/up.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assign_a/add.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assign_b/down.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assign_c/grade.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assign_d/clean.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_a/what.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_b/create.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_c/post.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_d/create.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_e/post.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_f/pool.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_g/test.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_h/upload.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_i/results.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assess_j/download.htmlhttp://www.blackboard.com/docs/r6/instructor/bbls_r6_instructor/http://www.utexas.edu/academic/blackboard/tutorials/manual/instruct.pdfhttp://www.utexas.edu/academic/blackboard/tutorials/dropbox/drop.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assigns_d/down.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/assigns_u/up.htmlhttp://www.utexas.edu/academic/blackboard/tutorials/Emailhttp://www.blackboard.com/docs/r6/6_1/student/bbls_r6_1_student/http://www.utexas.edu/academic/blackboard/tutorials/manual/student.pdf

  • The Five Pillars of Quality Online Education By George Lorenzo and Janet Moore

    Sponsered by: The Alfred P. Sloan Foundation

    November 2002

    Reference: http://www.sloan-c.org/effectivepractices/learning

    I. Learn Effectiveness

    Learning Effectiveness means that learners who complete an ongoing course receive

    an education that represents the distinctive quality of the institution and that online

    learning is equivalent to or better than learning through the traditional delivery mode.

    II. Student Satisfaction

    A vital aspect of any education is to ensure that students are satisfied with their

    education experience and Student Satisfaction reflects the effectiveness of all aspects

    of that experience.

    III. Faculty Satisfaction

    Faculty Satisfaction means that instructors find the online teaching personally

    rewarding and professionally beneficial.

    IV. Cost Effectiveness

    Cost effective practices enable institutions to offer their best education to their

    learner.

    V. Access

    Access provides the means for all qualified, motivated students to complete degrees

    or programs in their disciplines of choice.

  • Appendix: Forms, Worksheets, and Reference

    38

    WEBSITES December 6, 2005: http://www.usdla.org/html/aboutUs/home.htm (definition of distance learning)

    IVETa Annual Conference, 2001, Linda Martinez (domains of competency for DL professionals)

    MERLOT (http://www.merlot.org/Home.po) Resource for instructors/ students. Materials,

    presentations, activities to use in class, links to on-line materials.

    Nine Principles of Good Practice for Assessing Student Learning (http://www.aahe.org) The American

    Association of higher Education…a list of “Best Practices.”

    An Introduction to Online Assessment

    (http://www.lc.cc.il.us/virtual_campus.nsf/87ff8a33284ba82b86256aaf006a2c91/c49c

    b7a356 92be8286256ab5006e2da8?OpenDocument) )

    Online Assessments (http://www.cshe.unimelb.edu.au/assessinglearning/03) 34 strategies for the

    development on ongoing assessment as well as a TABLE of objectives, modes of online

    assessment and learning characteristics intersects.

    Surface and Deep Learning (http://www.dmu.ac.u,~jamesa/learning/deepsurf.htm) Clarifies what

    “surface” and “deep” learning are.

    Surface and Deep Learning (http://vccslitonline.cc.va.us/mrcte/deep_learning.htm) Promoting

    Deep Learning…asked faculty to consider what proportions of their coursework and testing

    supports Deep Learning.

    Copyright Article (http://chronicle.com/free/v49/i29/29a02901.htm.) Article discusses the long-

    awaited easing of the copyright restrictions.

    Guidelines for online Course Delivery (http://home.ubalt.edu/ntsbarsh/index.html ) The website contains

    information on developing and delivering good online courses.

    http://www.usdla.org/html/aboutUs/home.htmhttp://www.merlot.org/Home.pohttp://www.aahe.org/http://www.lc.cc.il.us/virtual_campus.nsf/87ff8a33284ba82b86256aaf006a2c91/c49cb7a356http://www.lc.cc.il.us/virtual_campus.nsf/87ff8a33284ba82b86256aaf006a2c91/c49cb7a356http://www.cshe.unimelb.edu.au/assessinglearning/03http://www.dmu.ac.u,~jamesa/learning/deepsurf.htmhttp://vccslitonline.cc.va.us/mrcte/deep_learning.htmhttp://chronicle.com/free/v49/i29/29a02901.htm

  • Appendix: Forms, Worksheets, and Reference

    39

    Impact of the Internet on Learning and Teaching

    (http://www.usdla.org/html/journal/MAR02_Issue/article01.html ) Website discusses successful

    planning and operation of Internet-based courses and Offers tips.

    Learning Styles (http://www.vark-learn.com) Excellent web resource on Learning Styles.

    http://www.vark-learn.com/