digging deeper: discovering how and why faculty use blackboard learn
TRANSCRIPT
Slidesavailableatfacdev.niu.edu/bbworld17
DiggingDeeperDiscoveringhowandwhyfacultyuseBlackboardLearn
JasonRhodeDirector
[email protected]@JasonRhode
PeterGowenOnlineAnalyticsCoordinator
[email protected]@petergowen
@slrichter
Presenters
• MaincampusinDeKalb,ILlocated65milesWestofChicago
• Totalenrollment:19,015
• 1,174Instructionalfaculty• Studenttoinstructor/facultyratio:15:1
NorthernIllinoisUniversityOverview
64%ofcreditcoursesusedBlackboardinfall2016
95%ofstudentsusedBlackboardinfall2016
88%offacultyusedBlackboardinfall 2016
FacultyDevelopmentofferstraining&supportforfaculty
Facultyadoptionhasalwaysbeenvoluntary
Blackboardclientforover15years
BlackboardUseatNIU
• HowarefacultyusingBlackboard?•WhattoolsarefacultyusinginBlackboard?
•WhyarefacultyusingBlackboard?
• Howcanweimproveoursupport?
WeHadMoreQuestions
(Al-Busaidi &Al-Shihi,2010)
TechnologyAcceptanceModel
Phase2• Whatfactorsimpactfacultydecisionstoadopt,continuetouse,orabandontheLMS?
Phase1• WhatarethemostusedtoolsintheLMS?
• Howhastoolusagechanged?• Whatfactorsimpacttoolusage?
ResearchQuestions
Phase2• DistributedasurveytoallNIU“instructorsofrecord”• AskedaboutreasonsforusingBb,Toolsused,andsatisfaction/easeofuse• Codedqualitativedatawithmultiplereviewers• 25%responserate
Phase1• SysAdminqueriesdatabase• Refinedsearchesovertimebasedonobservation• Dummy-codedtoolusageaspresentorabsent(whetheritwasusedvs.howmuchitwasused)• Comparedwithcoursemodality(e.g.,onlinevs.face-to-face)
Methods
• SQLqueryofOpenDatabase• AdaptedfromScottKodai’s (2013)BbWorldpresentationslideshare.net/skodai/bb-w-skodai
Ourqueriesavailablebyrequest–[email protected]
Queries
Queries
• Run~2weeksafterasemesterends
• Countsthenumberoftimesatoolisusedinacourse
• ReturnsaCSVfile
MostlyCOUNTsofreferencestoagiventoolcnthndlr_handleforagivencoursecrsmain_pk1,inthecourse_contents table
OccasionallynecessarytoJOINanothertableforcertainstats
Examples• Howmanytestsdeployed?• Howmanyitemsposted?• Howmanyfolderscreated?• Howmanygradecolumns?• Howmanyannouncements?
TechnicalDetails
DataTransformationandAnalysis
• Ifatoolwasusedatleastonce,wecounteditas“used”
• Recodeddatato1or0• Aggregatedwheredesiredorneededex:SafeAssign istracked2ways
• CombinedwithdatafromSISforcoursemodality
Howdoyouknowthatatoolisused?
DataDictionaryandKeyDefinitions
• Whateachdatapointmeasures
• Nuancesinitsmeasurement
• Howthemethodofmeasurementhaschangedovertime
Discussions
Countofreplies,separateforCourseandGroupdiscussionboards
MEDIAL
Countofdiscretepiecesofcoursecontentwhichcontaineitheratext-basedlinktoMEDIALvideos,orMEDIALvideosembeddedviatheMashuptool
testsdiscussionrepliesplagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Results– Usage
testsdiscussionrepliesplagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Usagehasbeenincreasingforalltools
testsdiscussionrepliesplagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
SharperincreasesstartinginFall2015
testsdiscussionrepliesplagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Peakedbehavioreverysummer
ToolUseforAllCourses
testsdiscussionrepliesplagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
ToolUseforIn-PersonCourses
testsdiscussionreplies
plagiarismdetectionweblinks
assignmentsfilesfoldersgradesitemsannouncements
plagiarismdetection
weblinksfiles
tests
discussionrepliesgradesassignmentsfoldersannouncementsitems
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
ToolUseforOnlineCourses
TechnologyAcceptanceModel• BasedontheTechnologyAcceptanceModel
• Questionsvalidatedbyanexternalexpert
• Senttoallinstructorsofrecordviaemail
Viewthesurveyatfacdev.niu.edu/lmsusagesurvey
SurveyDetails
MotivationforadoptingtheLMS
95%offacultyrespondinghadadoptedBlackboard
PerceivedasRequired
PerceivedValue
PerceivedEaseofUse
MotivationforadoptingtheLMS
5%offacultyrespondinghadnoteveradoptedBlackboard
Perceivedlackofneed
UseofAlternativeTool
PerceivedLackofTraining
PerceivedDifficultyofUse
LackofNeed2%offacultyhadstoppedusingBlackboard
MotivationforabandoningtheLMS
DiscussionandInterpretation
Usageisincreasing
• Considertoolsinadditiontooverallusage
• Usageseems tobedifferentbasedonmodality
LMSisvaluedbyfacultyandstudents
• Perceptionthatitisrequired
• Helpsfacultybemoreeffectiveandefficient
Facultystillneedsupport
• PerceptionthatBlackboardisdifficult
• Numberoffeaturescanbeoverwhelming
• Lackofself-confidenceinusingBlackboard
Weneedtoknowmore!
• Furtheranalysisofourexistingdata• Additionaldata,fromothercontexts
Letusknowifyou’dliketopartnertoofferthesurveyatyourowninstitution–
JasonRhodeDirector
[email protected]@JasonRhode
PeterGowenOnlineAnalyticsCoordinator
[email protected]@petergowen
@slrichter
Questions?