Measuring Civic Learning: Meaningful Strategies for Educating 21st Century Citizens

Download Measuring Civic Learning: Meaningful Strategies for Educating 21st Century Citizens

Post on 07-May-2015




0 download

Embed Size (px)


Using the recent AAC&U report A Crucible Moment: College Learning and Democracys Future and research arising from the Personal and Social Responsibility Inventory, participants will discuss current areas of research related to civic learning and identify areas for additional research. Discussion of best practices will focus on both indirect and direct measures of civic learning and campus engagement, including existing and available measures that can be adapted for use on participants campuses. Robert D. Reason, Associate Professor of Student Affairs and Higher Education, and Joshua J. Mitchell, doctoral student and Graduate Research Assistant in the Research Institute for Studies in Education, both at Iowa State University


<ul><li>1.Robert Reason Josh Mitchell Kathleen GillonIowa State UniversityUpper Midwest Civic Engagement SummitDubuque, IAMay 29, 2013</li></ul><p>2. Introductions: Who we are Our interest in civic learning research and assessment What we hope to gain from this workshop Workshop Goals and Interests: Why Measure Civic Learning? What is Civic Learning? How do we Measure Civic Learning? 3. General Workshop Structure: Assessing Civic Learning: Challenges and Opportunities Defining Civic Learning: What Works? A Crucible Moment History and Call to Action Key Findings and Recommendations Key recommendations for Researchers Campus-Based Assessment: Assessing Engagement Indirect vs. Direct Methods of Evaluation Connecting Assessment Models with Measurable Learning Outcomes Tools and Techniques 4. Group Discussion - Major Issues in Assessing Civic Engagement on Campus What are some of the biggest obstacles in assessing civic learning andengagement on your campus? What are some of the solutions found to address these challenges? 5. Commissioned by The Department of Education, initiated by MarthaKanter, Under Secretary of Education Partnership between Global Perspective Inventory, Inc. (GPI) and theAssociation of American Colleges and Universities National Task Force on Civic Learning and Democratic Engagement A series of five national roundtables representing leaders from awide range of constituent groups inside and outside of highereducation Several open sessions at a number of national and regionalconferences A commissioned paper on what we know from research on theimpact of civic learning and democratic engagement on studentlearning and development6 6. KEY RECOMMENDATIONS FOR HIGHEREDUCATION1. Foster a CIVIC ETHOS across all parts of the campus andeducational culture.2. Make CIVIC LITERACY a core expectation for all students.3. Practice CIVIC INQUIRY across all fields of study.4. Advance CIVIC ACTION through transformativepartnerships, at home and abroad. 7. WHY STUDY CIVIC LEARNING?? 8. EVIDENCE SUPPORTING NEED FORCOMPREHENSIVE CIVIC LEARNING U.S. ranked 139th in voter participation of 172world democracies in 2007. Only 24% of graduating high school seniorsscored at the proficient or advanced level in civicsin 2010. (NCES, 2011) Less than of 12th graders reported studyinginternational topics as part of a civics education.(NCES, 2011) 9. STUDENTS VIEWS ON CIVIC LEARNING ANDHIGHER EDUCATION 10. FINDINGS RELATED TO CIVIC LEARNINGAND HIGHER EDUCATION A group of 14,000 college seniors surveyed in 2006-07averaged just over 50% in a civic literacy exam.(Intercollegiate Studies Institute, 2007) Just over 1/3 of college faculty surveyed strongly agreedtheir campus actively promotes awareness of US or globalsocial, political, and economic issues. Only slightly more than one-third of students surveyedfelt strongly that faculty publicly advocated the need forstudents to become active and involved citizens. (Dey et al.2009) 11. A FOUNDATION PARTIALLY LAIDCurricular civic pathways Making civic literacy a core expectation for all studentsin general education programs Integrating civic inquiry into a central field of studyPowerful civic pedagogies Intergroup and deliberative dialogue Service Learning and Volunteer Service Collective civic problem solving 12. THE CHALLENGE OF THE NEXT DECADES OFCIVIC LEARNING From elective to expected From one time to progressive learning over time From individually oriented civic action tocollaboratively oriented action From some departments, divisions, and people toeveryone all over campus From parallel practices and programs tointegrated ones 13. PRIORITIES FOR FUTURE RESEARCH Disseminate existing assessment tools for measuring civic learning. Amass and publicize evidence that shows how civic learning, civic agency, anddemocratic engagement result in increased retention and college success. Use the Civic Investment Plan matrix to identify specific action research projectsthat could be initiated at ones own institution. Establish standards in civic learning to serve as guidelines for measuring andreporting progress. Sponsor and support further research on the impact of programs andpartnerships that foster civic learning and democratic engagement on learningoutcomes and student development. Include additional research questions in routinely administered higher educationsurveys to explore how learning environments can enhance key civiccompetencies Develop national civic indicators and report on levels of civic and democraticknowledge, skills, values, and action achieved by high school and collegegraduates. 14. FIVE AREAS IN WHICH MORE EVIDENCE ONCIVIC LEARNING IS NEEDED: Existing data on civic outcomes is almost entirely based on student self-reports oftheir behaviors, attitudes, and growth over time. Multiple measures are needed tocapture students ability to demonstrate civic competencies. Data on civic outcomes connected with the experiences of underserved students(underrepresented minorities, first-generation, transfer, and low income). Greater evidence is needed on outcomes more closely associated with civiccompetencies or capacity building, particularly for success in an increasingly globaland diversifying nation (e.g. collaborative problem-solving, deliberative dialogue,teamwork). Research on outcomes or evidence related to global knowledge and skills isparticularly thin Though there is strong evidence linking civic learning experiences with improvedrates of retention and completion, greater evidence is needed on the ways in whichvariations in civic learning (i.e. forms of practice and levels of intensity) impactmeasures of student success.- Excerpted from A Brief Review of the Evidence on Civic Learning inHigher Education, Finley, 2011 15. WHAT IS CIVIC LEARNING? 16. ASSESSING CIVIC LEARNING: TERMS Direct measures Indirect measures Constructs Self-reports 17. ASSESSING CIVIC LEARNING: MEASURABLEOUTCOMES Knowledge, skills, and values (Saltmarsh, 2005) Knowledge, skills, and behaviors (Cogan, 1999) Knowledge, skills, dispositions, identity (Stokamer, 2011) Knowledge, skills, practice, and disposition (The Centerfor Engaged Democracy, 2012) 18. KNOWLEDGE Understanding of topics related to democratic society;systems and processes of democratic decision-makingand governance- Civic knowledge is understanding of how democracyoperates 19. SKILLS Necessary abilities to understand and advocate for acomplex position- includes intercultural communication, decision-making,critical thinking 20. DISPOSITIONS Values and attitudes related to actionstheinclination to engage in civic actions 21. CIVIC IDENTITY Commitment to civic responsibility through efficacy inaction (Stokamer, 2012, p. 51).- Requires the incorporation of civic responsibility intoones self-concept 22. HOW DO WE ASSESS CIVIC LEARNING? 23. INDIRECT MEASURES Assume: that engagement in educationally-purposeful activitiesresult in learning outcomes that engagement with educationally-purposefulcampus climate supports learning outcomes 24. INDIRECT CLIMATE MEASURES National Survey of Student Engagement ( Benchmarks Active and Collaborative Learning Enriching Educational Experiences Supportive Campus Environment Global Perspectives Inventory ( The GPI reflects a global and holistic view of student learning and developmentand the importance of the campus environment in fostering holistic studentdevelopment. The GPI measures how a student thinks, views herself as a person with a cultural heritage, and relates to others from other cultures, backgrounds and values. 25. GLOBAL PERSPECTIVE INVENTORYInterpersonal -- Social Responsibility I think of my life in terms of giving back to society. I work for the rights of others. I put the needs of others above my own personalwants. I consciously behave in terms of making a difference. Volunteering is not an important priority in my life. 26. PERSONAL &amp; SOCIAL RESPONSIBILITYINVENTORY (PSRI)STRIVING FOR EXCELLENCE: developinga strong work ethic and consciously doing onesvery best in all aspects of collegeCULTIVATING PERSONALAND ACADEMIC INTEGRITY: recognizingand acting on a sense of honor, ranging fromhonesty in relationships to principled engagementwith a formal academic honors codeCONTRIBUTING TO A LARGERCOMMUNITY: recognizing and acting onones responsibility to the educationalcommunity and the wider society, locally,nationally, and globallyTAKING SERIOUSLY THEPERSPECTIVES OF OTHERS: recognizingand acting on the obligation to inform onesown judgment; engaging diverse andcompeting perspectives as a resource forlearning, citizenship, and workDEVELOPING COMPETENCE INETHICAL AND MORAL REASONINGAND ACTION: developing ethical and moralreasoning in ways that incorporate the otherfour responsibilities; using such reasoning inlearning and in life 27. PERSONAL &amp; SOCIAL RESPONSIBILITYINVENTORY (PSRI)Striving for Excellence Overall Climate for Excellence** Motivation to Develop a Strong WorkEthic Communicating Expectations aboutExcellence** Developing a Strong Work EthicCultivating Academic Integrity General Climate for AcademicIntegrity** Faculty Roles in AcademicIntegrity** Developing Academic IntegrityContributing to a Larger Community General Climate for Contributing to aLarger Community** Advocating for Contributing to aLarger Community** Developing a Commitment toContributing to a Larger CommunityTaking Seriously the Perspectives of Others General Climate for PerspectiveTaking** Advocating for Perspective Taking** Developing Perspective TakingRefining Ethical and Moral Reasoning General Climate for Ethical andMoral Reasoning** Sources of Support for Ethical andMoral Reasoning****Indicates a factor score that is comparable to professionalsfactor score. The factor is comprised of exact (oranalogous) items as the studentsfactor. 28. DIRECT MEASURESAttempt to measure (directly) the outcomesbelieved to be associated/comprise the construct ofcivic competency or civic learning. 29. CIVIC ATTITUDES &amp; SKILLS QUESTIONNAIRE(MOELY ET AL., 2002)Factor 1: Civic ActionI plan to do some volunteer workI am committed to making a positivedifference.Factor 2: Interpersonal and problem-solving skillsI can listen to other peoples opinions.I can successfully resolve conflicts with others.I try to place myself in the place of others intrying to assess their current situation.I tend to solve problems by talking them out.Factor 3: Political AwarenessI am aware of current events.I plan to be involved in the political process.Factor 4: Leadership SkillsI am a good leader.I have the ability to lead a group of people.I feel I can make a difference in the world.Factor 5: Social Justice AttitudesPeople are poor because they choose to be poor.(Reverse scored)In order for problems to be solved, we need tochange public policy.We need to change peoples attitudes in order tosolve social problems.Factor 6: Diversity AttitudesI find it difficult to relate to people from a differentrace or culture. (Reverse scored)I enjoy meeting people who come frombackgrounds very different from my own.Cultural diversity within a group makes the groupmore interesting and effective. 30. ACTIVISM ORIENTATION SCALE(CORNING &amp; MYERS, 2002)Conventional Activism Display a poster or bumper sticker with apolitical message? Invite a friend to attend a meeting of apolitical organization or event? Purchase a poster, t-shirt, etc. that endorses apolitical point of view? Serve as an officer in a politicalorganization? Attend an informational meeting of apolitical group? Organize a political event (e.g., talk, supportgroup, march)? Give a lecture or talk about a social orpolitical issue? Go out of your way to collect information ona social or political issue? Campaign door-to-door for a politicalcandidate?High-Risk Activism Engage in a political activity in whichyou knew you would be arrested? Engage in a physical confrontation at apolitical rally Engage in a political activity in whichyou feared that some of yourpossessions would be damaged? Engage in an illegal act as part of apolitical protest? Engage in a political activity in whichyou suspect there would be aconfrontation with the police orpossible arrest? Block access to a building or publicarea with your body? 31. EXPECTED POLITICAL VOICE MEASURE(SEIDER, GILLMOR, &amp; RABINOWIC, 2012) Contact or visit a public official to express your opinion Contact a newspaper or magazine to express your opinion on an issue Call in to a radio or television talk show to express your opinion Write a comment on a political blog Take part in a protest, march, or demonstration Sign a written or email petition about a political or social issue NOT buy something because you dislike the conditions under which it was made Go door to door to campaign for a political cause Work together with others to solve a problem in the community where you live Run for a political position at the local, state, or national level 32. COMMUNITY SERVICE SELF-EFFICACY SCALE(REEB ET AL., 2010) If I choose to participate in community service in the future, I will be able to make a meaningfulcontribution. In the future, I will be able to find community service opportunities which are relevant to myinterests and abilities. I am confident that, through community service, I can help in promoting social justice. I am confident that, through community service, I can make a different in my community. I am confident that I can help individuals in need by participating in community service activities. I am confident that, in future community service activities, I will be able to interact with relevantprofessionals in ways that are meaningful and effective. I am confident that, through community service, I can help in promoting equal opportunity forcitizens. Through community service, I can apply my knowledge in ways that solve real-life problems. By participating in community service, I can help people to help themselves. I am confident that I will participate in community service activities in the future. 33. OPEN ENDED QUESTIONS/NARRATIVE DATA Open ended question:What experiences at this campus have helped you to further develop yourwork ethic? Please describe 1-2 examples below. Narrative Data Just the sheer amount of work that I need to do to stay afloat in a class. Andthe result of high grades, especially at such a rigorous institution, isrewarding Work-load: sink or swim. Without a strong work ethic, you will truly drown. Well, the academic standards are such that to "get by" you have to have atleast a DECENT work ethic or be very passionate about your subject matter.While Ive struggled with procrastination, small class sizes and theopportunity to work closely with professors has enabled me to grow as astudent and a person. 34. PURPOSES OF NARRATIVE DATANarrative data can1. Provide a Comprehensive Understanding of Civic Engagement Insight into Quantitative Measures Overall climate Recent situations2. Allow for E...</p>