Using Blackboard™

for On-line Training

Robin GoodloeEnvironmental Health & SafetyCornell University

Topics

Background Why use web-based

training Why use Blackboard

technology How Blackboard works Sample programs

Background

Cornell EH&S underwent an External Review, where our programs were reviewed by a team of outside experts

Resulted in “Unit Review” teams, and a “Training Task Team”

Resulted in surveys of the current status of our safety training compliance  

Training Task Team Charge

Review and reengineer training processes

Identify how to better serve stakeholders with more flexible offerings

Track compliance to law and policyProvide more flexible training options

Compliance Issues

We looked at compliance in having 100 % of our employees trained for the OSHA Lab Standard and Hazard Communication

We looked at compliance for having the training completed before the employee starts work

How many of you are in compliance?

Customer Feedback

Training Format Preference

78.1 7568.8

18.8 21.9 21.9

6.3

0

10

20

30

40

50

60

70

80

90

Lect

ures

Demon

strat

ions

Video

sDVDs

Web-

base

d

Compu

ter-b

ased

Oth

er

Training Format

Per

Cen

t o

f R

esp

on

ses

Customer Feedback

One of our surveys resulted in this comment:

“Web based training is the only viable solution that I can think of. It is impossible to adequately provide the diversity of training required using the current system.”

Our current system consisted in providing only live classroom training programs.

Customer Feedback

Some more customer feedback:

Web-based training would be easier for the sites located off campus

Customer Feedback

What do you think could improve safety training on campus?

Re-emphasize web-based trainingOffering web-based training

Training Task Team Recommendations

The final report to the vice-president states:“The University needs to develop other training delivery options, such as web-based training and other alternative training methods, in addition to the traditional classroom style lectures.”

Why use web-based training?    

  Make training more accessible

 Complaints that students, especially undergrads, couldn’t attend our classroom safety sessions, because they had classes (tried offering late afternoon programs)

 Professors may be reluctant to attend classes along with undergrads

Why use web-based training?

Better compliance – new employees and new students can get training before they start working (including students who arrive late, after the start of a summer program)

Ability to track employee attendance, like with live training

Can also test for competencyCan get feedback from evaluations

Why use web-based training?

Opportunity to reach people – they may be reluctant to walk across campus to attend a classroom session, but they will take the training if it is offered on-line, so they can take it at their convenience

Can train one person at a time, cost effectively

Why use web-based training?

Offer more different types of training programs than practical with live training

Offer specialized programs for a smaller audience, like compressed gas safety, centrifuge rotor safety, cryogen safety

   

“I would found an institution where any person can find instruction in any study”

we can add “at any time, at any place” (as long as they have a computer with web access)

So now to Cornell’s vision statement made by Ezra Cornell in 1865

Other Options

Explored other alternatives (Skillsoft, custom modules) Too expensive Not customizable for what we wanted –

site-specific material about our campus issues

Some – difficult to get statistical information for tracking purposes

What is Blackboard?

The Blackboard Learning System ™ provides a system for building and managing courses on the web

The Blackboard Learning System ™ includes a header frame with images and buttons that can be customized and tabs that navigate to different areas

Clicking on a tab will open that area in the content frame

From Blackboard™ Learning System Manual

What is Blackboard?

Courses contain Content Tools for teaching and learning

Instructor oversees the course through the Control Panel

A course consists of the Course Menu and the content frames

What is Blackboard?

Area Description

Announcements Post timely information

Course areas Contain content items: multimedia files, quizzes

Communication Open discussion boards

External links Connect users to outside materials

Tools View gradesFrom Blackboard™ Learning System Manual

 Low Cost (campus license)

A technology that is already being used on campus by academic side, for class work

Availability of campus training classes for instructors on how to use for developing programs – also technical support

Ease of use

Why Use Blackboard?

Why Use Blackboard?

Allows us to easily offer more classes to campus customers (particularly classes that are not offered regularly)

Functionality: Can get the data out that we need - based on netID

Why Use Blackboard?

How many of you know whether you have the Blackboard Learning System on your campus?

If you don’t have the Blackboard system, you may have another Learning Management System

Mechanics of Blackboard

How to get courses online

How to use it (both as administrator and a user)

How we get the data out

How much time it takes to get a course and materials put up - once course content is set

How easy it is to make changes to program – change PowerPoint, add handouts or videos – it is a very flexible system

Blackboard Demo

Get a Blackboard Account

LOG IN

Blackboard Course ListingCourses you are teaching

Welcome, Robin

Laboratory Safety

Course Catalog

Environmental Health & Safety

Course Catalog

Shipping Hazardous Materials & Dangerous Goods

Safety for Administrative and Office Professionals

Residence Hall Fire Safety

Laboratory Safety

Laboratory Safety for Faculty

Hazard Communication for Veterinary Professionals

New User Radiation Safety

Click on Laboratory Safety

Laboratory Safety Presentation ppt

Laboratory Safety Quiz

You must take this quiz and submit it in order to receivecredit for this training.

Quiz Questions

Tests are created to check knowledge and skill level of users

Instructor assigns point values for each question

The test results are recorded in the Gradebook

Quiz Questions

Multiple ChoiceTrue-FalseMultiple Answer - choose all correct

answersMatchingOrderingFill in the BlankEssay

Quiz Questions

Can create a pool of questionsPool Manager allows instructor to

store questions for repeated useCan have random selection of

questions from the pool, so each test is different

May choose questions based on category, keyword, or question type

Quiz or “Receive Credit”

Simple True or False – ”I have reviewed this program and understand that if I have questions I can call EH&S at ----- for more information”

Reinforce important informationTest of knowledge – like for DOT

training, to test that the person has learned the important information, needs to get a passing grade

Quiz Questions

Need to think hard about the questionsNeed to word the answer responses

carefullyWant people to get important information

even though they may have clicked through the slides quickly

Do not want to reinforce incorrect information – we have no “trick” questions

Quiz Questions

Intended to reinforce understandingQuestions like:

In case of an emergency, call Cornell Police by dialing 911 (True or False)

You can find the following information on the Cornell EH&S web page www.ehs.cornell.edu: -information on training classes and how to register -links to MSDS websites -a link to report accidents -all of the above

Quiz Question Feedback

If answer “All of the above”, get message: Correct! In addition to other information, the EH&S website provides access to information on training classes and how to register, links to MSDS websites, and a link to report accidents.

If do not get the correct answer, get message: Not quite. In addition to other information, the EH&S website………

Quiz Questions

True or False:If an inspection by a regulatory agency such as the EPA discovers a violation within a laboratory that results in a fine, the department of the laboratory will be responsible for paying the fine.

If they answer “True”, get “That’s right!, your department is responsible for paying any fine.”

Quiz Questions

Key Responsibilities of Lab PersonnelChemical Hygiene PlanEmergency ResponseEye wash UseGlove UseFood in LabsReporting AccidentsLab HazardsFume HoodsHazardous Chemical Waste

Gradebook

Spreadsheet lists students in rows and graded items in columns

Can view assessment statistics Average score % of correct and incorrect answers on

a question

Course Evaluation

Evaluation Questions Your status:

-undergrad -grad student -staff -faculty -other (ex. visitor, volunteer)

The overall quality of this program: poor, fair, good, very good, excellent

Environmental Health & Safety

Chemical and Lab Safety

Lab Safety Manual and Chemical Hygiene Plan

Cornell Police

Gannett Health Center

Chemical Recycling Program

Material Safety Data Sheets

External Links

External Links

Control Panel

Control Panel

Control Panel

Where you control the courseAdd announcementsUpdate announcementsAdd course content Post the quizUse the Gradebook – for attendance

and for checking quiz grades

Statistics – Number of “hits”

PerCent "Hits" for Course Sections

Course Information

10%

Course PowerPoint

18%

Video15%Handouts

15%

External Links15%

Quiz22%

Evaluation5% Course Information

Course PowerPoint

Video

Handouts

External Links

Quiz

Evaluation

Statistics – Number per Day

Statistics – Access/Hour of Day

Statistics – Access/Day of Week

Getting a Course On-line

Need to make the PowerPoint slides stand alone – the things you talk about need to be written down

Or you can have your presentation videotaped, in Jim Hilker style ( Jim Hilker, 4U Training Solutions, Inc. ) [Jim gave a workshop on “Effective Presentations” at the 2005 SEHSA Fall Conference in Corning]

Need to prepare a quiz, to ensure completion of the course

To Set Up Course Initially

Contact Information Technology, takes a few days

Use the control panel Create announcement Create a display banner Add course content Add links to PowerPoint files, videos, or

videotaped presentations (Jim Hilker style)

To Set Up Course

Prepare quiz and add to site Prepare handout documents and add Prepare evaluation questions and add Create list of useful web-links and add

To Set Up Course

Set limitations on access to courseSet dates to limit accessArrange for enrollment – we use

self-enrollment

To Set Up Course

Be prepared to trouble shootPeople called to say that they were

denied access to the course – in fact, they had not clicked on the “Enroll” button

Need to click on the“Enroll” button to enroll yourself in theclass

Enroll

To Change Course Content

To update PowerPoint slides, just delete old file and create link to new file

Easy to do – we have done this many times as we make slight revisions to the slides

Evaluation Responses: What part of the program did you find most helpful?

What actions/measures to take if something happens, such as chemical splashing into the eye

I liked seeing pictures of what other labs have done wrong Information on the hazards of the lab Re-enactments of accidents How to use a hood Reminder of lab safety techniques, emergency response

protocol Entire program PowerPoint slides Web option Ease of use – web-based

Evaluation Results – LengthLength of Program

0.0% 0.0%

69.4%

23.1%

5.6%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

Much tooshort

Too short Just right Too long Much too long

Rating

Per

cen

t A

nsw

ered

Evaluation Results – Quality

Overall Quality of Program

0.9%

14.5%

34.3%

42.6%

6.5%

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

40.0%

45.0%

Poor Fair Good Very Good Excellent

Rating

Per

cen

t A

nsw

ered

Evaluation Results – Slide Quality

Quality of PowerPoint Slides

1.9%

13.0%

30.6%

40.7%

13.0%

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

40.0%

45.0%

Poor Fair Good Very Good Excellent

Rating

Per

cen

t A

nsw

ered

Evaluation Results – How Well was Information Presented

How Well was Information Presented

0.9%

11.1%

34.3%

46.3%

6.5%

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

40.0%

45.0%

50.0%

Poor Fair Good Very Good Excellent

Rating

Per

cen

t A

nsw

ered

88 % Good, Very Good, or Excellent

Evaluation Results – Status

Over 74 % are students

Status

51.9%

22.2% 19.4%

2.8% 2.8%

0.0%

10.0%20.0%

30.0%40.0%

50.0%60.0%

Underg

radua

te st

uden

t

Gradu

ate

studen

tSta

ff

Facult

y

Other

:visit

or, v

oluntee

r...

Status

Per

cen

t A

nsw

ered

Over 74% Students

Evaluation Results – Status

Status

Undergraduate student, 51.9%

Other:visitor, volunteer, etc,

2.8%Faculty, 2.8%

Graduate student, 22.2%

Staff, 19.4%

Over 74% Students

Comparison: Jan 1 – Aug 31, 2006Live program vs. Blackboard

Numbers Jan 1 - Aug 31, 2006

Live Session, 884, 75%

Blackboard, 294, 25%

Live Session

Blackboard

Blackboard On-line384 accessed course294 completed quiz

Laboratory Safety Training Methods

38

106

33 37

122

67

145

233

148

453028

0 0

3723

51

167

0

50

100

150

200

250

J anuary February March April May J une J uly* August September

Month

Classroom Attendance

On-line Blackboard (IncludesLab Safety for Faculty

Comparison: Jan 1 – Aug 31, 2006Live program vs. Blackboard

Summary: Advantages over Purchased Programs

Make information site-specificProvide information on your local policiesShow photos of local work sitesShow pictures of accidentsCan provide contact information – who to callLower costsFlexible – can add/remove/update programs

easilyCan incorporate different formats (PowerPoint,

videos, Word documents, videos like Jim Hilker’s)

Summary: Possible Negatives

No interaction with other people or with the instructor

Does not fit some people’s learning styles

Can be difficult to know how well people understand and retain the information, but there is a testing function

Possible Negatives

Employees in some departments do not routinely have access to computers for training – for example, shops workers, dining workers, grounds workers, custodians

Illiteracy may be a problem – also computer illiteracy

Our Current Use

Right now mostly just using our PowerPoint slides

Laboratory Safety Laboratory Safety for Faculty Hazard Communication Cornell Health and Safety Basics Chemical Waste Disposal DOT Shipping Hazardous Materials

Future Plans

More video-presentations like the videos produced by Jim Hilker, 4U Training Solutions, Inc. http://4utraining.com/clients/CUEHS/LabSafety06/msh.html

More interactive materials, like interactive quiz questions

More interactive scenarios, with questions

A few thoughts….

If you are a one person EH&S program, producing web-based training programs may really ease the burden of presenting lots of different types of training programs to small numbers of trainees

Help is Available

I found this really useful

Questions?