modeling and assessing online discussions for faculty learning and technology development janet de...
TRANSCRIPT
![Page 1: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/1.jpg)
Modeling and AssessingOnline Discussionsfor Faculty Learningand Technology Development
Janet de Vry and George WatsonUniversity of Delaware
Barbara FreyUniversity of Pittsburgh
Copyright de Vry, Frey, Watson, 2006. This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the author.
![Page 2: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/2.jpg)
Agenda
• Faculty Development Class Janet de Vry
• Problem Based Learning ContextGeorge Watson
• Assessment Barbara Frey
• Application to Your Campus
![Page 3: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/3.jpg)
Workshop Goal:Experience Learning in an Online
Discussion
• Participate in collaborative discussions
• Engage in critical thinking
• Interact at a high level
![Page 4: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/4.jpg)
“The principal idea behind PBL is that the starting point for learning should be a problem, a query, or a puzzle that the learner wishes to solve.”
—Boud (1985)
What is Problem-Based Learning?
![Page 5: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/5.jpg)
“…careful inspection of methods which are permanently successful in formal education…will reveal that they depend for their efficiency upon the fact that they go back to the type of situation which causes reflection out of school in ordinary life. They give pupils something to do, not something to learn; and if the doing is of such a nature as to demand thinking, or the intentional noting of connections; learning naturally results.”
—John Dewey (1916)
What is Problem-Based Learning?
![Page 6: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/6.jpg)
PBL is a learning approach thatchallenges students to “learn to learn,”working cooperatively in groups,to seek solutions to real world problems.
What is Problem-Based Learning?
![Page 7: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/7.jpg)
What is Problem-Based Learning?
PBL prepares studentsto think critically and analytically,to find and use appropriate learning resources,to communicate effectively, orally and in writing,to work well as members of a team.
![Page 8: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/8.jpg)
What are the Common Featuresof PBL?
• Learning is initiated by a problem.
• Problems are based on complex, real-world situations.
• All information needed to solve problem is not initially given.
• Students identify, find, and use appropriate resources.
• Students work in permanent groups.
![Page 9: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/9.jpg)
Problem-Based Learning CycleOverview/
Assessment Problem, Project, or Assignment
Group Discussion
Research
Group Discussion
Preparation ofGroup “Product”
Whole Class Discussion
Mini-lecture(only when needed!)
![Page 10: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/10.jpg)
A Typical Day in a PBL Course
![Page 11: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/11.jpg)
Good PBL Problems…• Relate to real world, motivate students• Require decision-making or judgments• Are multi-page, multi-stage• Are designed for group-solving• Pose open-ended initial questions that
encourage discussion• Incorporate course content objectives,
higher order thinking, other skills
![Page 12: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/12.jpg)
Workshop Design Issues
• Developing problem
• Gathering authentic data
• Simulating asynchronous world in a synchronous setting
• Developing questions, activities, staging
• Sequencing activities; both online and face to face
![Page 13: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/13.jpg)
The Problem in 5 Stages
1. Identify problems with your students’ discussion
2. Formulate strategies for solutions
3. Post best solutions for entire class
4. Get expert advice
5. Develop an individual action plan
![Page 14: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/14.jpg)
Initial Online Instructions
![Page 15: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/15.jpg)
AuthenticData—
DiscussionTopics
![Page 16: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/16.jpg)
Subject: War in IraqI think that if you don't support the war, you don't support our troops.
You are DISLOYAL!------------------------------------------------------------
There are veterans and families who don't support the war. What do youthink about that?------------------------------------------------------------
>I think that if you don't support the war, you don't support our troops.>You are DISLOYAL!
I agree!!!! ------------------------------------------------------------
You are just wrong, you idiot!!!!!
Authentic Data—Sample Student Dialogue
![Page 17: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/17.jpg)
We are in the classroom.
Talking is permitted.
![Page 18: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/18.jpg)
We are in the “Online World.”
Please refrain from talking.
![Page 19: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/19.jpg)
Activities
Online Face to Face
1. Pre-class to analyze problem
1. Warm up exercise
2. Group to generate & evaluate strategies
2. Group to compare online experience to actual class
3. Individual to pose comments and develop questions for experts
3. Mini lecture on rubrics; presentation of action plan
![Page 20: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/20.jpg)
Ongoing Activities
• Chat with experts• Submit Resources• Individual action plan
![Page 21: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/21.jpg)
Asynchronous Discussions
• Strengths– Student interaction– Flexible format– Reflection time to
develop thoughts– Permanent record of
discussion
• Weaknesses– Time consuming – Multiple simultaneous
threads – Linear presentation of
postings– Late contributions are
not developed– Single-pass reading
for unread messages
![Page 22: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/22.jpg)
Small Group Discussion Map
Discussion Question:Develop a list of at least 10 different strategies to improve the quality of online discussions. Share your top 3 strategies with the whole class.
![Page 23: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/23.jpg)
Analyzing Discussions
• Consider trigger or initial questions
• Review whole thread
• Consider depth vs. breadth of discussions
• Assess levels of thinking (Bloom’s Taxonomy)
• Reflect on unanswered questions and undeveloped topics
• Consider timeliness of responses
![Page 24: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/24.jpg)
Evaluation
Synthesis
Analysis
Application
Comprehension
Knowledge
Bloom’s Levels of Cognitive Skill
http://www.umuc.edu/ugp/ewp/bloomtax.html
![Page 25: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/25.jpg)
Small Group Discussion Map
![Page 26: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/26.jpg)
Advantages & Disadvantagesof Discussion Map
• Easy to visualize where a posting is located within the structure of a thread
• Easy to see the complexity or simplicity of a thread
• Provides a mechanism for reviewing the postings – code by level of thinking, date or participant
• Time consuming to develop
![Page 27: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/27.jpg)
Observations• Postings were on-topic• Subject lines did not change to reflect content
or intent of posting• Thread initiators usually responded to thread
contributors• Type of trigger question affected cognitive skill
demonstrated in postings more than level/depth within thread
• Expectations woven into some discussion questions
• Some threads ended with unanswered question or comment
![Page 28: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/28.jpg)
Recommendations
Basic training and guidelines for participants should include guidelines to:– Change Subject Lines which act as advanced
organizers– Take “ownership” of initiated threads; if
appropriate, respond to questions and be responsible for summarizing the thread
![Page 29: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/29.jpg)
Recommendations
Facilitators should set clear guidelines and expectations. These should include:– Design good initiator or trigger questions– Keep topics specific and focused– Establish specific time frame– Provide models of well composed subject
lines and postings – Encourage participants to summarize
threads – Consider the facilitator’s role in discussions
![Page 30: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/30.jpg)
Feedback from Participants
What will be useful in your teaching?
– “Managing online discussions”– “Rubrics for online discussion”– “How to moderate discussion”– “How to keep students on topic”
![Page 31: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/31.jpg)
3 months later—what was the impact of workshop?
• “Defining topics is as important as setting guidelines”
• “Experience with what can go wrong with discussions”
• “Concrete ideas for implementation and evaluation”
• “I still had trouble figuring out how to use discussions.”
![Page 32: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/32.jpg)
Questions?
![Page 33: Modeling and Assessing Online Discussions for Faculty Learning and Technology Development Janet de Vry and George Watson University of Delaware Barbara](https://reader035.vdocuments.net/reader035/viewer/2022070307/551a8ee8550346e0158b5037/html5/thumbnails/33.jpg)
Workshop website
www.udel.edu/janet/MARC2006