2011approaches to assessing students
TRANSCRIPT
![Page 2: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/2.jpg)
Online Course
• Fundamentals of Geneticso Fully onlineo 150 studentso Single summer session (7 weeks)o Not proctored, remote
• Assessmentso Problem Sets, short answer, word problemso Summative assessments, weekly “mid-term”
like exams
![Page 3: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/3.jpg)
Academic Dishonesty
Infractions included:
• Plagiarism from internet sources• Copying answer key (verbatim!!)
provided by other students• Submitting, obtaining the key,
resubmitting with the key (LMS bug)
Suspected many; failed 6 students in 2009, 2010
![Page 4: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/4.jpg)
Pedagogical Best Practices
• Tutorial on academic integrity
• Synchronized assessments
• Question pools• Random delivery of
questions and answers
• Exam review controlled
• Required exam proctoring
Testing center at the University of Central Florida
NY Times July 5, 2010
![Page 5: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/5.jpg)
Comprehensive Remote Proctoring System
Desired System Features1. Authenticates student
identity2. Monitors student
activity3. Secures computer
access4. Compact, portable5. LMS compatible
Desired End User Features1. Flexible2. Cost-effective3. Easy to employ for
faculty and students4. Tech-support5. Customer-support
![Page 6: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/6.jpg)
Securexam Remote Proctoring System (SRPS) Solution
Authenticateso Biometric data
Secures computero Lockdown browser
Monitors studentso 360° camera
Compact & portableo Desktop, USB, disassembles
Records o Video record of exam session
Reportso Exam policy violations
![Page 7: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/7.jpg)
Securexam System: How it Works
• INSERT VIDEO HERE
![Page 8: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/8.jpg)
Remote Proctoring Solutions
Provided students with two options:
• Securexam Remote Proctoring System (SRPS)
• National College Testing Association (NCTA), Consortium of College Testing Centers (CCTC) In-person Proctoring
![Page 9: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/9.jpg)
SRPS vs. Testing Center
Feature SRPS CCTCSystem Authentication X X
Monitoring X X
Browser security X Human
Compact/portable X
End-user
Convenient X
Cost-effective X
User friendly X X
Tech support X N/A
Customer support X N/A
![Page 10: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/10.jpg)
Cost ComparisonTesting Center
Hours Fee CTCC 2011
SRPS
MSU M 8AM-5PM $30/exam
$180
$100
W 12PM-5PMFerris State University
M 9AM-4PM $20/hour $240W 9AM-4PM
Grand Rapids CC M 7:30AM-7:30PM
$10/hour $120W7:30AM-7:30PM
Kalamazoo CC M 8:30AM-9PM $20/test $120W 8:30AM-9PM
Central Michigan University
M 9AM-1AM $30/test $180W 9AM-1AM
Lake Superior State
M 8:30AM-4PM $15/hour $180W 8AM-12PM
Southwestern Michigan College
M 8AM-5PM $20/exam
$120W 8AM-5PM
![Page 11: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/11.jpg)
Remote Proctored Exams
• 86 students opted to use the SRPS• 6 exams over 7 weeks• Semi-synchronous exam periods• 2 hour time limit• Multiple choice, short answer, essay (word
problems)• Survey of proctoring experience delivered for
credit at the end of the course
![Page 12: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/12.jpg)
SRPS Protected Integrity
84%
8%4%4%
Impossible/Dif-ficult to Cheat
Easy to Cheat
Knows someone who cheated
No reponse
CMS Bug
![Page 13: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/13.jpg)
Student Testimony
“It looks like something out of Star Wars!”
“It’s a great way to have the freedom to take the exam on your own time in whatever setting you want”
“It’s easy to use and you can take [the test] when you want”
“The remote proctoring device was easy and convenient…you could take your exam in your own home and at whatever time you wanted.”
“You couldn’t cheat and I took my test in the comfort of my own home.”
“Remote proctoring tech support was VERY NICE and HELPFUL.”
“The lowered cost compared to the in-person proctoring exam was a plus.”
![Page 14: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/14.jpg)
Future Best Practices• Inform students of proctoring requirement (and associated costs) at the
time of registration.
• Deploy device at least 2 weeks prior to the beginning of a course (especially for a short course).
• Institute a required practice assessment the first week of the course with the device to ensure students set it up properly.
• Institute a backup exam plan for students who add the course late.
• Establish good communication with your CMS IT personnel.
• Provide clear instructions for contacting Technical Support for CMS and Software Secure.
• Anticipate some technically challenged students!
![Page 15: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/15.jpg)
Take Home Points• Securexam Remote Proctoring system effectively
protects academic integrity• SRPS was a comprehensive proctoring system
o Authenticates student identityo Monitors student activityo Secures computero Records exam sessiono Reviews and Reports to instructors
• SRPS met the needs of the end usero Easy to use (faculty and students)o Conveniento Cost effectiveo Responsive tech supporto Attentive customer service
![Page 16: 2011Approaches to Assessing Students](https://reader035.vdocuments.net/reader035/viewer/2022081602/555eb8f6d8b42a74708b458a/html5/thumbnails/16.jpg)
Top Three Features
77%
15%7% Flexible (time,
location)
Easy to use
Prevented cheat-ing