etug spring 2013 - e-portfolios in assessment by gail morong and donna desbien
TRANSCRIPT
![Page 1: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/1.jpg)
E-Portfolios in Assessment:Emerging Learning-Centred Pedagogy
Collect… Select… Reflect… Connect
Gail MorongDonna DesBiensTRU
ETUGJune 6, 2013
![Page 2: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/2.jpg)
Presentation Outline
• Portfolio definitions• Pedagogy• Benefits and challenges• Emerging Trends• Research Lessons/Tips• Future Research Directions• Discussion
![Page 3: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/3.jpg)
What’s a portfolio?•A collection of items or artifacts that
represent an individual in some way
Many kinds, both traditional and digital: •Showcase •Teaching •Educational
![Page 4: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/4.jpg)
Showcase Portfolio
![Page 5: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/5.jpg)
Teaching portfolio
![Page 6: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/6.jpg)
What is an educational portfolio?
“ an educational portfolio contains work that a learner has collected, reflected upon, selected, and presented to show growth and change over time”
(Barrett, 2007)
![Page 7: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/7.jpg)
What is an educational portfolio?
“Purposeful selection of artifacts together with reflections that represent some aspect of the owner’s learning.”
(Chen, Stanford University,2009)
![Page 8: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/8.jpg)
Traditional educational portfolios•Paper based, 3 ring binder
•May include CD / DVD file (Prior Learning Association Canada, 2008)
![Page 9: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/9.jpg)
Traditional Portfolios at TRU
![Page 10: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/10.jpg)
TRU Traditional PLAR Portfolio
![Page 11: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/11.jpg)
e-Portfolio Research Beginning
![Page 12: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/12.jpg)
What is an e-Portfolio?
“e-Portfolios are personalized, online collections of your work, chosen by you to represent to diverse audiences your knowledge, skills and interests.”
(UBC Portfolio Community of Practice, accessed 2013)
![Page 13: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/13.jpg)
E-Portfolios may include•Presentations, papers, projects •Multimedia images, videos •Reflections on learning / work •Selective collaboration and feedback•Customization for different audiences
![Page 14: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/14.jpg)
Many e-portfolio systems
TRU – Mahara & WordPress
![Page 15: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/15.jpg)
Mahara e-portfolio features
![Page 16: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/16.jpg)
Levels of educational e-portfolios•Course (Individual or Group)
•Program
•Campus-wide
![Page 17: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/17.jpg)
Individual e-Portfolio in WordPress
![Page 18: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/18.jpg)
Digital Storytelling Project (iPad)
TRU Education and Skills Training Program
TRU Student Group e-portfolio
![Page 19: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/19.jpg)
Program Level
![Page 20: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/20.jpg)
Campus-level Portfolio
TRU Centre for Student Engagement & Learning InnovationRecognizes intercultural and international experiences in any credit program
![Page 21: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/21.jpg)
Contemporary Technology
Traditional E-PortfolioCollect ArchiveSelect Link/ThinkReflect Tell a storyProject CollaborateCelebrate Publish
(Barrett, 2007)
Learning shift
![Page 22: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/22.jpg)
Educational uses of e-portfolios•Job search•Learning assessment•Course evaluation•Plan educational programs•Track development within a program•Document ‘KSA’ and learning•Monitor and evaluate performance
(Barrett, 2007; Lorenzo & Ittleson , ELI, 2005)
![Page 23: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/23.jpg)
Major Uses of Student e-Portfolios • Career preparation• Showcase accomplishments• Capture the learning process• Document specific learning outcomes• Learning representation, reflection and
revision
(Barrett, 2007; Lorenzo & Ittleson, ELI, 2005)
![Page 24: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/24.jpg)
Critical Parts of Learning PortfoliosDocument, reflect, and collaborate:
•Individual learning artifacts•Overall story of learning
(Barrett, 2007; Zubizaretta, 2004, cited in Barrett)
![Page 25: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/25.jpg)
So…what are the benefits of using e-portfolios for learning?
![Page 26: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/26.jpg)
Potential Benefits •Engage students in active learning•Help students become critical thinkers•Help develop writing and communication
skills•Help develop information and digital
literacy •Promote deep learning•Integrate learning across multiple
contexts•Enable life-long learning
(Lorenzo & Ittleson , ELI, 2005; Tosh et al., 2005)
![Page 27: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/27.jpg)
Learning Potential
![Page 28: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/28.jpg)
Shared Challenges •Multiple purposes & stakeholders•Ownership issues•Assessment issues – what, how, why?•Multiple new technologies•Workload – time and effort•Training and support access•Interoperability – silos vs. collaborative
COP•Storage capacity
(Goodine, 2010; EIfEL team blog, 2009; Barrett 2007)
![Page 29: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/29.jpg)
Assessment Purposes Tension
2 main purposes:
•Assessment of learning•Assessment for learning
(Barrett 2007)
![Page 30: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/30.jpg)
Assessment of learning•Document achievement of standards, e.g.
learning outcomes, competencies•Assume meaning is constant across users,
contexts and purposes•Measure prescribed learning
(Barrett, 2007)
Past to Present
![Page 31: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/31.jpg)
Assessment for learning•Invite digital stories of deep learning•Provide structure for systematic critical
reflection on learning process over time•Improve /negotiate learning
Present to Future
(Barrett, 2007)
![Page 32: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/32.jpg)
Things to think about•Can tension be resolved?•What learning outcomes do you want to
assess?•What kind of assessment is appropriate?
![Page 33: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/33.jpg)
Supporting Multiple Needs 3 interconnected systems:
•Archive of student work•Authoring environment for creative
learning•Institutional assessment management
system
(Barrett, 2007)
![Page 34: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/34.jpg)
Challenges for Students•Buy-in •Motivation•Assessment•Technology
(Tosh et al., 2005)
![Page 35: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/35.jpg)
Buy-in / Motivation Concerns
•Weak induction and instructions•Didn’t understand reasons for collecting
info•Need to know ‘What’s in it for me?’
![Page 36: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/36.jpg)
Assessment Concerns•Sensitive to grading of personal
reflections•Didn’t understand what was wanted •Tension between trying to give what was
wanted and meaningful learning•Grade weight / workload imbalance
![Page 37: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/37.jpg)
Technology Concerns•Time required to learn system•Difficult to customize •Public vs. private access – when public,
concern for appearance trumped content and learning
![Page 38: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/38.jpg)
Challenges for Faculty•What is purpose?•How to assess•Tech overload•Time shortage•Training & support
![Page 39: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/39.jpg)
Pause for thought•How many of you have made an e-
portfolio or used them in student assessment?
•What are some of your experiences?
•What technology did you use?
![Page 40: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/40.jpg)
AAEEBL e-Portfolio Survey 2012Ass’n for Authentic Experiential and Evidence-Based
Learning
• 243 responses from 13 countries representing 97 institutions
Who responded? • US (80%)• UK (20) • Canada (9) • Australia (8)
![Page 41: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/41.jpg)
Emerging Trends• Program vs. course-based •Collaborative assessment •More learner/learning-centred beliefs - Student responsibility for learning - Student choices in what, how & how to represent - Cross-disciplinary evaluation teams - Assess multiple examples of student work
(Brown, Chen & Gordon, IJeP, 2012)
![Page 42: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/42.jpg)
Lessons from ResearchFirst step: Define your purpose
![Page 43: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/43.jpg)
Lessons from ResearchEngage learning•Explain and demo how students can benefit•Show examples – good, messy, your own•Align with course & program•Give feedback, support and time to reflect•Connect classroom, community & work
learning
![Page 44: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/44.jpg)
Lessons from ResearchGuide assessment•Scaffold skills in how to reflect•Clear assessment criteria •Self-assessment to develop reflection
and self-management skills•Peer review to develop thinking,
communication, and collaboration skills
![Page 45: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/45.jpg)
CHALLENGE: How do I mark that?
![Page 46: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/46.jpg)
![Page 47: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/47.jpg)
Lessons from ResearchFaculty•Build an evidence-based learning culture•Validate learning evidence •Collaborate on what works and why
![Page 48: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/48.jpg)
Lessons from ResearchTech•Focus on learning vs. ‘look & feel’•Use flexible, user-friendly systems •Enable multimedia file use•Ensure selective permissions/multiple
views •Separate authoring and official record
systems •Need active technology coordinator &
equipment
(Johnson, 2012; Barrett, 2007; Tosh et al., 2005)
![Page 49: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/49.jpg)
Future research•What is valid evidence that e-portfolios
support successful learning & assessment?•What is evidence of deep learning in e-
portfolios?•How does learning-centred practice impact
student critical reflection and agency? •Explore systems that differentiate student-
owned e-portfolios from official records
![Page 50: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/50.jpg)
E-Portfolio Research
![Page 51: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/51.jpg)
Faculty buy-in/uptake in your institution?
TRU-OL:•Mahara and WordPress are supported•Pockets in Communications, Education,
English and Nursing•PLIRC research
![Page 52: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/52.jpg)
More Discussion Questions
•How do different portfolio systems support and influence learning?
• What do we know about how students from different cultural backgrounds response to e-portfolios?
•How long should e-portfolios be kept on server?
•How well do current practices meet challenges?
![Page 54: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/54.jpg)
Key References• Barrett, H.C. 2007. Researching electronic portfolios and learner engagement: The
REFLECT Initiative. Journal of Adolescent & Adult Literacy (JAAL) 50:6 March 2007. doi: 10.1598/JAAL.50.8.2
• Brown, G., Chen, H. & Gordon, A. 2012. The Annual AAEEBL Survey at Two: Looking Back and Looking Ahead. International Journal of ePortfolio, Vol 2 Number 2, 129-138. Accessed at: http://www.theijep.com
• Chen, H. 2009. ePortfolios: emerging definitions. Accessed at: http://www.youtube.com/watch?v=KKd5pDuGDJA
• EIfEL team blog. 2009. Learning Futures: 10 ePortfolio challenges. Accessed at: http://www.learningfutures.eu/2009/09/10-eportfolio-challenges.html
• Goodine, M. 2010. Eportfolios: In Search of a Silver Bullet. Accessed at: https://portfolios.kwantlen.ca/view/view.php?id=515
![Page 55: ETUG Spring 2013 - E-Portfolios in Assessment By Gail Morong and Donna Desbien](https://reader034.vdocuments.net/reader034/viewer/2022042723/542a950b8d7f7212438b4af6/html5/thumbnails/55.jpg)
Key References• Johnson, H.L. 2012. Making Learning Visible with ePortfolios: Coupling the Right
Pedagogy with the Right Technology. International Journal of ePortfolio, Vol 2, Number 2, 139-148.
• Lorenzo, G. & Ittleson, J. 2005. (D. Oblinger, Ed.). An Overview of E-Portfolios, EDUCAUSE Learning Initiative (ELI). Accessed at:. http://www.educause.edu/library/resources/overview-e-portfolios
• Tosh, D., Light, T., Fleming, K. & Haywood, J. 2005. Engagement with Electronic Portfolios: Challenges from the Student Perspective. Canadian Journal of Learning and Technology, V31(3) Fall, 2005.
• UBC website. E-Portfolios @UBC – Archive of Projects. Accessed at: http://blogs.ubc.ca/projectportfolio/