transformingexams · write essays answer multiple choice questions demonstrate digital and c21st...
TRANSCRIPT
![Page 1: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/1.jpg)
Pedagogy of e-Exams: Examples and Transition
Dr Mathew Hillier (Monash University), A/Prof Matthew Bower (Macquarie University) Dr Andrew Fluck (University of Tasmania)
e-Exam Symposium 24 Nov 2018 Melbourne, Australia
TRANSFORMINGEXAMS.COM A Scalable Examination Platform for BYOD Invigilated Assessment
Scratch programming task
Multimedia and video
![Page 2: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/2.jpg)
Pedagogical aspirations
Meaningful learning Authentic
(Jonassen et al, 2008)
Meaningful learning is:
Authentic learning involves: 1. Authentic context 2. Authentic activities 3. Expert performance 4. Multiple roles and perspectives 5. Reflection 6. Collaboration 7. Articulation 8. Coaching and scaffolding 9. Integrated authentic assessment 10. Professional learning
(Herrington & Kervin, 2007)
![Page 3: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/3.jpg)
Constructive alignment (Biggs & Tang, 2011)
Outcomes Tasks Assessments
Authentic
Traditional Academic, abstract knowledge and skills
Situated, industry relevant, digital
‘Bookwork’
Software use, modelling, programming
Write essays Answer multiple choice questions
Demonstrate digital and C21st problem solving capabilities
![Page 4: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/4.jpg)
Discussion Question 1:
What would authentic assessment ideally look like
in your discipline area?
![Page 5: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/5.jpg)
Authentic - Writing Tools
Authen'cNot
5
![Page 6: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/6.jpg)
Authentic - Engineering Problem Solving
6
Authen'cNot
![Page 7: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/7.jpg)
http://ta.vu/e-exam-roadmap
Phased implementation strategy Start> > > > >>> >>> >>> >Future>
GetReady Phase 1 Phase 2 Phase 3 Phase 4 Phase 5
Ins'tu'onalapprovals,
researchethics,hardwareandinfrastructure.
Paper equivalent small scale.
Post-paper small to medium.
Medium to large scale.
Whitelisted and logged Internet
Open but fully logged Internet
Basic doc exams to begin.
Expanding the landscape with
apps and media.
Adding the power of an LMS (Moodle).
Network BYOD exam.
Network mixed mode BYOD
exam.
Crawling Walking Running Jumping Flying!
7
![Page 8: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/8.jpg)
8
Scratch SDK
Start! Exam doc Video
Specialist applications
Sims
Start simple and build up!
Spreadsheets as ‘forms’ or as calculation and analysis.
e-Exam Trials: Towards ‘post-paper’ (phase 1 to 2)
![Page 9: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/9.jpg)
Paper equivalent using word documents Suitable format adjustments were made to cater for both paper and screen.
![Page 10: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/10.jpg)
Student’s choice - Macquarie U ICTinEduca'on,80min40%Finalexam
Worddocument:10xMCQand1xEssay.
Phase1~toeinthewater.
10
![Page 11: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/11.jpg)
Language exams – UQ Frenchlanguage.120min30%.Worddocument:ar'cletransla'onandresponseessay.TypeEnglishandFrench.• QWERTYwithaccents• AZERTYlayout
11
Example: Accent agiu é: type a 'single quote' then type the letter e.
![Page 12: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/12.jpg)
Post-paper e-exams at UTAS (Andrew) Word document question and response space – links to e-tools
12
Final exam: 47%, 2 hours. Word doc with short and long text. Constructed response tasks.
Multimedia video prompts. Scratch programming task
Chemistry education software evaluation
Solve a problem in Scratch (block programming for primary school students)
Critique student understanding (video)
![Page 13: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/13.jpg)
Critique student understanding(video) Teaching Secondary Mathematics
Comment on the child’s understanding of symmetry based on her response to this task.
![Page 14: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/14.jpg)
Solve a problem in Scratch Digital Technologies Education
Write a program in Scratch using Felix the cat and a blank stage that: a) Allows Felix to be moved by pressing arrow keys on the keyboard b) Allows the user to draw a picture of a house as they move Felix around the stage.
![Page 15: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/15.jpg)
Spread sheet as a Form Phase 2.5! A form – but with no network. Intro to Chinese (first year): 2017 Semester 2. 22 students at pre-exam practice. 16 typed the exam. Two components: Student XLS file Marking XLS file
![Page 16: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/16.jpg)
Spread sheet as a Form Language tools available according to LOTE selection
Respond in designated cells (other cells are locked).
![Page 17: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/17.jpg)
Mat
hem
atic
s ex
ampl
e
Candidates can access wxMaxima, SciLab, GeoGebra, GNU Octave (like MatLab), R (statistics package) alongside the standard LibreOffice suite (word processor, spread sheet etc), media, plus programming tools such as Python, Scratch etc. Responses via documents or Moodle LMS.
![Page 18: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/18.jpg)
Programming e-Exam – ECU TeachingPythonProgrammingexam:
Worddocument+PythonIDLE
18
![Page 19: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/19.jpg)
Robust Moodle - Monash Monash–Chineselanguage–twounits(1styearand3rdYear)
Moodlequizques'on/responsemediumSelected3rdpartyso_wareincluded.
RobustMoodleworkedtorescuenetworkoutages(doublelayeredbackup!)
Audio data files cached at the start of the exam. Students used headsets to listen.
![Page 20: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/20.jpg)
Third party software included.
This is an offline dictionary tool ‘Dim Sum’ LMS
questions in Safe Exam Browser
![Page 21: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/21.jpg)
Case studies – hand out (double sided!)
UTAS – Post-paper word document based e-exam Monash – ‘robust’ online e-exam in Moodle …. Discussion!
![Page 22: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/22.jpg)
Innovation in education depends on teachers…
Roger’s (2010) Diffusion of Innovation
![Page 23: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/23.jpg)
Barriers to technology integration
First order (external) barriers:
• Resources
• Hardware
• Software
• Training
• Support
Second order (internal)
barriers:
• Confidence
• Beliefs about student learning
• Perceived value of technology in learning & teaching
Ertmer et. al. (2012)
![Page 24: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/24.jpg)
Discussion Question 2:
What are the main barriers that universities/institutions/schools face in order to apply authentic assessment practices, and what are the best ways to overcome
them?
![Page 25: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/25.jpg)
References • Biggs, J., & Tang, C. (2011). Teaching for Quality Learning at University
(3rd Edition) (3rd ed.). Maidenhead, UK: McGraw-Hill. • Ertmer, P. A., Ottenbreit-Leftwich, A. T., Sadik, O., Sendurur, E., &
Sendurur, P. (2012). Teacher beliefs and technology integration practices: A critical relationship. Computers & Education, 59(2), 423-435.
• Herrington, J., & Kervin, L. (2007). Authentic learning supported by technology: Ten suggestions and cases of integration in classrooms. Educational Media International; v44 n3 p219-236 Sep 2007 44(3), 219-236.
• Jonassen, D. H., Howland, J., Marra, R., & Crismond, D. (2008). Meaningful learning with technology: Pearson/Merrill Prentice Hall Upper Saddle River, NJ.
• Rogers, E. (1995). Diffusion of Innovations. New York, NY: The Free Press of Simon and Schuster.
![Page 26: TRANSFORMINGEXAMS · Write essays Answer multiple choice questions Demonstrate digital and C21st problem solving ... listen. Third party software included. This is an offline dictionary](https://reader035.vdocuments.net/reader035/viewer/2022071018/5fd1f6e600c2db31d4228e5b/html5/thumbnails/26.jpg)
e-Exam Symposium 24 Nov 2018 Monash University Caulfield Campus Melbourne, Australia
TransformingExams.com [email protected]