Creating and Managing Assessments

Erin Shelley

Today’s Workshop

• Overview of Assessments• Creating Questions• Creating Assessments and Adding

Questions• Managing the Questions Database• Editing Assessment Properties• Grading and Viewing Assessments with

Assessment Manager• Generating Assessment Reports

Learning Outcomes

After completing this workshop, you will be able to: • identify the differences between the available

assessment types.• create a variety of question types.• create assessments and add questions to them.• edit assessment settings.• add question sets and alternates.• manage questions in the Question Database.• grade assessments and view survey results.• generate assessment reports to evaluate student

performance and the effectiveness of assessments.

Overview of Assessments

Types of AssessmentsYou can create three unique types of assessments in WebCT.

– Quiz

– Self-test

– Survey

Overview of Assessments

Assessment ToolsAssessments Tool Functions by Tab

BuildFrom the Build tab, using the Assessments tool, you can:create and edit questions and assessments..manage the Question Database

Build

TeachFrom both the Build and Teach tabs, you can edit assessment properties.

Teach From the Teach tab, using the Assessment Manager tool, you can grade assessments and run reports.

Overview of Assessments

Assessment Creation ProcessTo create an assessment, you must complete the

following tasks: – create questions.– create the assessment and add the questions.– apply assessment settings.

Activity: Logging In

Log into Your Practice Course

The URL is http://build2.vista.nau.edu

Use your NAU ID and password to log in.

Creating Questions

• True-False Questions

• Multiple Choice Questions

• Creating Other Question Types

Activity: Creating True/False and

Multiple Choice Questions

• Create a true false question

• Create a simple multiple choice question with one correct answer.

• Create a multiple choice question with several correct answers.

Creating Assessments and Adding Questions

• Assigning Points to Questions

• Editing and Managing Questions within Assessments

Activity: Creating Assessments and Adding Questions

• Create a self test and add the questions. Edit the points assigned to each question so that the total points add up to 60.

• Create a quiz based on the self test.• Create a survey. Create and add a true

false and a multiple choice question while creating the survey.

Activity: Creating Other Question

Types

• Combination multiple choice question

• Fill in the blank question

• Jumbled sentence question

Activity: Creating Other Question

Types

• Matching question

• Paragraph question

• Short answer question

• Calculated question

Activity: Editing and Managing Questions within Assessments

• Divide your quiz into two parts and practice re-ordering questions within the parts.

• Add one of the new questions you created to your self test.

Activity: Editing and Managing Questions within Assessments

• Create a question set by adding two question alternates to the question.

• Ensure that WebCT will select two of the three questions from the set and assign points to the questions.

Editing Assessment Properties

Available Assessment Properties

SelfTest

Title Question titles Question delivery Dates Available

Survey • All of the settings above, plus: Duration Submission Settings Security Settings

Quiz • All of the settings above, plus: Attempts allowed Attempts separation Student score Student score release Results Settings

The Assessment Creation Process

• Quiz properties define how a quiz will be delivered to students and how results will be released to students. Properties are grouped into:

• Settings• Dates Available• Results Settings• Submission Settings• Security Settings.

Editing Assessment Properties

Quiz Properties• Quiz properties define how a quiz will be delivered

to students and how results will be released to students. Properties are grouped into:

• Settings• Dates Available• Results Settings• Submission Settings• Security Settings.

Activity: Specifying How

Questions are Delivered • Edit your self-test settings:

• Re-title the test.

• Make it available starting today and for an unlimited duration.

Activity: Specifying How

Questions are Delivered • Edit your survey settings:

• Email submissions to your external e-mail address.

• Require students to enter a password in order to access the survey.

Activity: Specifying How

Questions are Delivered • Enter a message for students to receive

when they submit their surveys.

• Edit your quiz settings:

• Do not display question titles to students.

Activity: Specifying How

Questions are Delivered • Deliver questions one at a time, without

allowing students to revisit them.

• Allow students to attempt the quiz three times and use the highest attempt score for students’ grades.

• Ensure that students will receive any feedback and grader’s comments when they view their graded quizzes.

Managing the Question Database

• Creating Categories

• Switching Between Category and Question View

• Default Columns in the Question Database

• Creating Custom Columns

Managing the Question Database

Creating Categories

Use categories to help browse the database.

For example, Create categories based on topics or themes that students are studying.

Managing the Question Database

Switching Between Category and Question View

Managing the Question Database

Default Columns in the Question Database

Column Description

Title The title entered for the question when it was created.

Type The type of question, e.g., Paragraph, Matching, Multiple choice, etc.

Used By The assessments in which the question appears.

Category

The name of the category in which the question is grouped.

Managing the Question Database

Creating Custom Columns

You can create custom columns to include additional information about your questions. Once created, custom columns appear as

fields in the question creation process.

Activity: Setting Up the Question

Database • Create a custom column that will allow

you to enter descriptive information for your questions.

• Create several categories you might use to organize the questions you plan to create.

Grading and Viewing the Assessments with Assessment Manager

• With Assessment Manager, you can: – Grade Assessments by Student– Grade Assessments by Question– Regrade Questions– Modify Quiz Grades– Run Reports

Grading and Viewing the Assessments with Assessment Manager

Grading Assessments Manually

You will need to grade an assessment manually if:

-the assessment includes a paragraph question-a student successfully defends an incorrect response on a question-a question was originally scored incorrectly.

You can grade manually grade questions in two ways:-grade by student -grade by question

Grading and Viewing the Assessments with Assessment Manager

Viewing Survey Submissions

Although you can view whether students have or have not submitted a survey, survey

submissions are anonymous.

Activity: Grading Quiz

Submissions • Grade the paragraph question in the

Workshop Intro Quiz. Note how paragraph questions can be graded by student or question.

• Add five points to your student’s total score for the Diagnostic Quiz.

• Adjust your student’s score on question six of the Workshop Intro Quiz; give five points for the response.

Generating Assessment Reports

• There are four reports for quizzes:

• Performance

• Item Statistics

• Summary Statistics

• Class Statistics

Activity: Generating Reports

• Select different reports to view for the two quizzes.

• Run a Performance Report for the Workshop Intro Quiz.

• Display the statistics for several questions.

Learning More

• Online Help

• www.webct.com

– Ask Dr. C (www.webct.com/askdrc)– Support (www.webct.com/support )

• Campus Resources– Resource One– Resource Two

Looking Ahead

• Additional F2F Workshops• Online Training Opportunities• Brown-bag Sessions

Questions and Answers

Workshop Evaluation and Feedback

Workshop Evaluation and Feedback