1. 1. Designing Engaging Learning Experiences in Digital Environments A/Prof Abelardo Pardo (@abelardopardo) Faculty of Engineering and IT slideshare.net/abelardo_pardo SanAndreasickr.com Biosciences Education Forum BEAN 11 December 2017
2. 2. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 2 AftabUzzamanickr.com Design Problem Student View Our Brain In Digital
3. 3. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 3 AftabUzzamanickr.com Our Brain
4. 4. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 4 TimPierceickr.com
5. 5. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 5 table reply handle below dene bli_ _ pia_ _ clo_ _ stu_ _ dan_ _
6. 6. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 6 How does our brain work? RosarioLizanaickr.com Psychology Neuroscience
7. 7. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 7 Philhearingickr.com Gawronski, B., & Creighton, L. A. (2013). Dual Process Theories. In D. E. Carlston (Ed.), The Oxford handbook of social cognition (pp. 282-312). New York, NY: Oxford University Press. CarstenTolkmitickr.com RationalAutomatic
8. 8. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 8 table reply handle below dene bli_ _ pia_ _ clo_ _ stu_ _ dan_ _ Dual Process Theory System 1: fast, intuitive, implicit (automatic), subconscious System 2: slower, deliberative, explicit (controlled), conscious
9. 9. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 9 System 2 is lazy JrgKanngieerickr.com
10. 10. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 10 AftabUzzamanickr.com Student View Our Brain
11. 11. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 11 Simple information transfer is not working Mazur, E. (2009). Farewell, lecture. Science, 323(5910), 50-51. Krugazorickr.com
12. 12. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 12 JuantanKwonickr.com Unprecedented amount of learning opportunities: resources, spaces, formats, devices, etc.
13. 13. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 13 HungarianSnowickr.com More complex decisions Unlimited Choices Recorded lectures Lecture notes Collections of previous questions, answers, etc
14. 14. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 14 Beware of technology pushing us away from rational thinking JenRickr.com
15. 15. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 15 totemisottapaickr.com Continuous Decision Making while Learning
16. 16. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 16 Students metacognitive judgements affect their achievements Dunlosky, J., & Thiede, K. W. (2013). Four cornerstones of calibration research: Why understanding students' judgments can improve their achievement. Learning and Instruction, 24, 58-61. doi:10.1016/j.learninstruc.2012.05.002 HackNY.orgickr.com
17. 17. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 17 Overcondence produces underachievement Dunlosky, J., & Rawson, K. A. (2012). Overcondence produces underachievement: Inaccurate self evaluations undermine students learning and retention. Learning and Instruction, 22(4), 271-280. doi:10.1016/j.learninstruc.2011.08.003
18. 18. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 18 Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: beliefs, techniques, and illusions. Annu Rev Psychol, 64, 417-444. doi:10.1146/annurev-psych-113011-143823 Understand human memory and learning Know useful techniques to study Know how to monitor Understand existing biases IsraeliDefenseForcesickr.com
19. 19. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 19 5 Low-effect Learning Strategies AlanLevineickr.com Images for text Summaries Highlighting Rereading Keyword mnemonic Dunlosky, J. (2013). Strengthening the Student Toolbox. Study Strategies to Boost Learning. American Educator, 37(3), 12-21.
20. 20. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 20 MartinFischickr.com Elaborative interrogation Self-explanation Interleaved practice Distributed practice Practice Dunlosky, J. (2013). Strengthening the Student Toolbox. Study Strategies to Boost Learning. American Educator, 37(3), 12-21. 5 Effective Learning Strategies
21. 21. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 21 AftabUzzamanickr.com Design Problem Student View Our Brain
22. 22. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 22
23. 23. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 23 JansonHewsickr.com
24. 24. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 24 teaching in higher education will necessarily shift the balance of its efforts towards a greater investment in design as a way of coping with otherwise intolerable pressures on staff and resources Goodyear, P. (2015). Teaching as Design. HERDSA Review of Higher Education, 2, 27-50.
25. 25. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 25 There is no such thing as a neutral design JeremyBrooksickr.com Thaler, R. H., & Sunstein, C. R. (2008). Nudge. Great Britain: Yale University Press.
26. 26. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 26 Thaler, R. H., & Sunstein, C. R. (2008). Nudge. Great Britain: Yale University Press. People make good choices in contexts in which they have experience, good information, and prompt feedback DerekBruffickr.com
27. 27. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 27 TomHawkickr.com Approach the design as if you were a choice architect Help students to make the right decisions Every small detail counts!
28. 28. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 28 Bonwell, C. C., & Eison, J. A. (1991). Active Learning: Creating Excitement in the Classroom ASHEERIC Higher Education Report No. 1. Washington, DC, USA: George Washington University. Active Learning Any instructional method that engages students in the learning process Active learning requires students to do meaningful learning activities and think about what they are doing
29. 29. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 29 Active Learning Works
30. 30. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 30 Kugel, P. (1993). How professors develop as teachers. Studies in Higher Education, 18, 315-328. doi:10.1080/03075079312331382241 Self Course Topic Student as receptive Student as active Student as independent EdYourdonickr.com
31. 31. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 31 1. Dual Role Dual Mind Judge CoachDomain ofKnowledge Mentality RogerMommaerts 1
32. 32. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 32 SamAbrahamickr.com Frontier between physical and virtual spaces is blurring 2. Multiple Spaces2
33. 33. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 33 3. Sense of Purpose (Why?) After this lecture/week students should be able to CCSUNZ2013ickr.com 3
34. 34. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 34 trainingpahickr.com Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: beliefs, techniques, and illusions. Annu Rev Psychol, 64, 417-444. doi:10.1146/annurev-psych-113011-143823 4. Promote Practice 4
35. 35. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 35 hijukalickr.com Think outside of the box 5. Maximise Power of Face-to-Face5
36. 36. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 36 AftabUzzamanickr.com Design Problem Student View Our Brain In Digital
37. 37. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 37 Widen the design space
38. 38. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 38 -NACH-ickr.com InLectureTutorial/Assignments Revised Blooms Taxonomy Pohl, M. (2000). Learning to think thinking to learn: Models and strategies to develop a classroom culture of thinking. Hawker Brownlow Education. Cognitive Skills Remembering Understanding Applying Analysing Evaluating Creating
39. 39. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 39 -NACH-ickr.com Understanding Applying Analysing Evaluating Creating PrepareLecture/Tutorial Revised Blooms Taxonomy Pohl, M. (2000). Learning to think thinking to learn: Models and strategies to develop a classroom culture of thinking. Hawker Brownlow Education. Cognitive Skills Remembering
40. 40. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 40 Available: bit.ly/elec1601 (Only Australian Universities) 1
41. 41. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 41 3
42. 42. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 42 Explain the context, discuss expectations 2
43. 43. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 43 1
44. 44. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 44 1
45. 45. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 45 1
46. 46. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 46 2
47. 47. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 47 4
48. 48. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 48 Practice 4
49. 49. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 49 Preparation: Summative assessment 4
50. 50. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 50 In-class Activities 5
51. 51. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 51 Schell, J. (2012). Can you ip large classes? https://blog.peerinstruction.net/2012/04/06/can-you-ip-large-classes/ Used in Large Classes 5
52. 52. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 52 1. Use the theatre areas (ve) 2. Assign an identier to each area 3. Assign a digital gate to each area 4. Show input values: students raise hand if output is 1 5. Acknowledge the fastest area in the theatre 6. Repeat from step 3 changing the assignments Outcome: Understand How Digital Gates Work 5
53. 53. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 53 2
54. 54. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 54 Hattie, J. A. (1999). Inuences on student learning. Inaugural professorial address, University of Auckland, New Zealand If You Could Choose One More than 500 meta-analyses of student achievements 100 factors with potential inuence Feedback in top ve (74 meta-analyses) Most effective form: video, audio, computer-assisted instructional feedback, and/or related goals
55. 55. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 55 Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81-112. doi:10.3102/003465430298487 Tom Feedback Levels 1. Task Level (understanding, performance) 2. Process Level (what to do to understand, perform) 3. Self-regulation level (detecting and directing effort) 4. Self level (personal evaluation and affect)
56. 56. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 56 Krause, K.-L., Hartley, R., James, R., & McInnis, C. (2005). The First Year Experience in Australian Universities: Findings from a decade of National Studies. University of Melbourne: Centre for the Study of Higher Education. Eleafickr.com The feedback question gets systematically lower values in student surveys
57. 57. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 57 Students are less likely to engage in pre-class activities if they are not interactive, do not provide formative feedback, and not coherently linked with the face-to-face activities O'Flaherty, J., & Phillips, C. (2015). The use of ipped classrooms in higher education: A scoping review. The Internet and Higher Education, 25, 85-95. doi:10.1016/j.iheduc.2015.02.002 DanKlimkeickr.com
58. 58. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 58 Pardo, A. (2017). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 1-11. doi: 10.1080/02602938.2017.1356905 FarukAteickr.com Feedback is a process to positively inuence how students engage with their work in a learning experience so that they can improve its overall quality with respect to an appropriate reference and increase their self-evaluative capacity
59. 59. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 59 ontasklearning.org
60. 60. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 60
61. 61. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 61 Automatic Email 2.Process Level(w hatto do to understand)
62. 62. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 62 Helpful feedback Effect size (Cohens d) = 0.49 Medium positive effect Midterm Scores Effect size (Cohens d) = 0.21 Small positive effect Pardo, A., Jovanovi, J., Dawson, S., Gaevi, D., & Mirriahi, N. (In press). Using Learning Analytics to Scale the Provision of Personalised Feedback. British Journal of Educational Technology. doi:10.1111/bjet.12592
63. 63. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 63 Support instructors to manage personalised feedback processes Simple rule-base knowledge encoding Provide appropriate view of data sources Scale to large and highly diverse cohorts Open-source project Pilots in 2017 nished Contact us if interested ontasklearning.org
64. 64. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 64 DrewLeavy Rethink student engagement There is no neutral design choice architect Dual mind role, multiple spaces, sense of purpose, promote practice, value of face-to-face The power of feedback Conclusions
65. 65. Designing Engaging Learning Experiences in Digital Environments A/Prof Abelardo Pardo (@abelardopardo) Faculty of Engineering and IT slideshare.net/abelardo_pardo Biosciences Education Forum BEAN 11 December 2017 SanAndreasickr.com