presentation outline - division of student...
TRANSCRIPT
![Page 1: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/1.jpg)
![Page 2: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/2.jpg)
Presentation Outline
0 Outcomes
0 Introduction to qualitative research
0 Primary forms of qualitative data collection methods
0 Questions
![Page 3: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/3.jpg)
Outcomes
0 Team members will be able to define qualitative research/assessment
0 Team members will gain a basic understanding of four strategies for collecting qualitative data for assessment purposes
![Page 4: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/4.jpg)
Qualitative Research/Assessment
0 Employed to understand how people interpret their experiences, how they construct their worlds, and what meaning they attribute to their experiences
0 Attempts to gain a better understanding of an event or phenomenon
0 Answers the questions of “How?” and “What?”
0 Not used to make predictions
0 Samples are typically small and purposefully chosen
![Page 5: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/5.jpg)
Strategies for Data Collection
0 Interviews
0 Observations
0 Document Analysis
0 Rubrics
![Page 6: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/6.jpg)
Interviews
Common Interview Formats
0E-mail
0Face-to-face
0Focus groups
0Online focus groups
0Telephone
Interview Types
• Structured
• Semi-structured
• Unstructured
![Page 7: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/7.jpg)
Interviews Cont.
Challenges
0Transcription
0Focus group dynamics
0 Sensitive nature of topics
0 Size of groups
Advantages
• Make connection with participants
• Rich descriptive data
• Balance flexibility and intentionality
![Page 8: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/8.jpg)
Interviews Activity
0 Listening Exercise
![Page 9: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/9.jpg)
Observations
What is it?
0Observations take place in the setting where the phenomenon occurs naturally
0Data represent a first-hand encounter with the phenomenon of interest (Merriam, 2009)
Popular
Observation Types
• Complete participant
• Observer as participant
• Complete observer
![Page 10: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/10.jpg)
Observations Cont.
Advantages
0 Help to uncover information participants find routine
0 Triangulation
0 Behavior and actions observed firsthand
0 Better understanding of uncomfortable topics
Challenges
• Balancing insider/outsider views
• Affect of administrator presence
• Human perception is highly selective
• Very time intensive
![Page 11: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/11.jpg)
Observations Activity
0 Love Actually
![Page 12: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/12.jpg)
Document Analysis
What is it?
Document analysis is a technique for making inferences by objectively identifying characteristics of messages
Types of Documents
• Public records
• Personal documents
• Physical evidence (artifacts)
![Page 13: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/13.jpg)
Document Analysis Cont.
Advantages
0 Unobtrusive
0 Helps avoid survey fatigue
0 Low cost
0 Administrator does not influence the document
0 Connect the administrator to a social, political, and historical frame of reference
Challenges
• Incomplete documents
• May be difficult to locate
• Documents contain bias
• No way to clarify confusing documents
![Page 14: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/14.jpg)
Document Analysis Activity
0 The Sentinel
![Page 15: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/15.jpg)
Rubrics
What is it?
A rubric is a scoring tool developed to measure a student’s performance, achievement, or mastery on a given activity. A rubric lists the areas of performance to be evaluated and the specific criteria used to evaluate each area.
Types of Documents
• Structured Observation Guide
• Holistic Rubric
• Rating Scale Rubric
• Analytic Rubric
![Page 16: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/16.jpg)
Rubrics Cont.
Advantages
0 Help students understand your expectations/involve students in the assessment of learning
0 Provide a direct measure of student learning/promote learner-centered education
0 Make measurement more unbiased and consistent
0 Improve feedback to administrators and students
Challenges
• Creating rubrics takes time
• Developing rubrics is complex
• Lack of clarification on assessment items
• They don’t always consider environmental factors
![Page 17: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/17.jpg)
Rubrics Cont.
CRITICAL THINKING VALUE RUBRIC for more information, please contact [email protected]
Definition Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or conclusion.
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone
4
Milestones
3 2
Benchmark
1
Explanation of issues Issue/problem to be considered critically is stated clearly and described comprehensively, delivering all relevant information necessary for full understanding.
Issue/problem to be considered critically is stated, described, and clarified so that understanding is not seriously impeded by omissions.
Issue/problem to be considered critically is stated but description leaves some terms undefined, ambiguities unexplored, boundaries undetermined, and/or backgrounds unknown.
Issue/problem to be considered critically is stated without clarification or description.
Evidence Selecting and using information to investigate a point of view or conclusion
Information is taken from source(s) with enough interpretation/evaluation to develop a comprehensive analysis or synthesis. Viewpoints of experts are questioned thoroughly.
Information is taken from source(s) with enough interpretation/evaluation to develop a coherent analysis or synthesis. Viewpoints of experts are subject to questioning.
Information is taken from source(s) with some interpretation/evaluation, but not enough to develop a coherent analysis or synthesis. Viewpoints of experts are taken as mostly fact, with little questioning.
Information is taken from source(s) without any interpretation/evaluation. Viewpoints of experts are taken as fact, without question.
Influence of context and assumptions Thoroughly (systematically and methodically) analyzes own and others' assumptions and carefully evaluates the relevance of contexts when presenting a position.
Identifies own and others' assumptions and several relevant contexts when presenting a position.
Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others' assumptions than one's own (or vice versa).
Shows an emerging awareness of present assumptions (sometimes labels assertions as assumptions). Begins to identify some contexts when presenting a position.
Student's position (perspective, thesis/hypothesis)
Specific position (perspective, thesis/hypothesis) is imaginative, taking into account the complexities of an issue. Limits of position (perspective, thesis/hypothesis) are acknowledged. Others' points of view are synthesized within position (perspective, thesis/hypothesis).
Specific position (perspective, thesis/hypothesis) takes into account the complexities of an issue. Others' points of view are acknowledged within position (perspective, thesis/hypothesis).
Specific position (perspective, thesis/hypothesis) acknowledges different sides of an issue.
Specific position (perspective, thesis/hypothesis) is stated, but is simplistic and obvious.
Conclusions and related outcomes (implications and consequences)
Conclusions and related outcomes (consequences and implications) are logical and reflect student’s informed evaluation and ability to place evidence and perspectives discussed in priority order.
Conclusion is logically tied to a range of information, including opposing viewpoints; related outcomes (consequences and implications) are identified clearly.
Conclusion is logically tied to information (because information is chosen to fit the desired conclusion); some related outcomes (consequences and implications) are identified clearly.
Conclusion is inconsistently tied to some of the information discussed; related outcomes (consequences and implications) are oversimplified.
![Page 18: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/18.jpg)
Rubrics Activity
0 Chocolate Chip Cookies and Rubrics
![Page 19: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/19.jpg)
Homework Assignment
0 Choose “problem” in your department/unit/area
0 Complete steps 1-6
![Page 20: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/20.jpg)
References
Creswell, J. (1994). Research design: Qualitative & quantitative approaches. Thousand Oaks, CA: Sage Publications.
Glesne, C. (2006). Becoming qualitative researchers: An introduction (3rd Ed.). Boston: Pearson Education.
Merriam, S.B. (2009). Qualitative research: A guide to design and implementation. San Francisco: Jossey-Bass.
Suskie, L. (2009). Assessing student learning: A common sense guide. San Francisco: Jossey-Bass.
![Page 21: Presentation Outline - Division of Student Affairsstudentaffairs.kennesaw.edu/assessment/docs/AssessmentTeam-Wee… · Presentation Outline ... 0 Triangulation ... •Personal documents](https://reader034.vdocuments.net/reader034/viewer/2022052516/5adb8a467f8b9aee348e2cf0/html5/thumbnails/21.jpg)