Transcript
Page 1: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/1

STUDENT LEARNING ASSESSMENT PROGRAMSUMMARY FORM AY 2013-2014

Degree andProgram Name:

Submitted By:

PART ONEWhat are the learning objectives?

How, where, and when are they assessed?

What are the expectations? What are the results? Committee/ person responsible? How are results shared?

1. Broad Content Knowledge in HistoryHistory with Teacher Licensure majors will know and understand the standard content of U.S. and world civilizations. Specific content knowledge is mandated in the Illinois Core Standards for Social Science Teachers and broad thematic knowledge is indicated in the National Council for the Social Studies (NCSS) Ten Thematic Strands.

Scores on the History Common Core, World History, and U.S./Illinois history sections of the Content Area Test for history (test 114). The CAT is typically taken the semester prior to student teaching, and it has four sections:1. Social Science Common

Core2. History Common Core3. World History4. U.S. and IL History

A minimum of 90% of 2012-2013 test takers will pass the History CAT, and 80% will receive a 240 or higher on the three history sections. All program completers must have achieved passing composite scores of 240 or higher on their CAT, but it is possible to pass the overall test but score below 240 in one or more of the sub-tests.

100% of test takers (n=14) passed the History CAT. ICTS CAT score results for the three history sub-tests are as follows: 92.8% of test takers

(13/14) received scores of 240 or higher on section 2, History Common Core.

78.5% (11/14) of test takers (23/26) received scores of 240 or higher on section 3, World History.

92.8% (13/14) of test takers (23/26) received scores of 240 or higher on section 4, U.S./IL history.

While the goal was met it

Test Score results are monitored by Associate Dean Doug Bower in CEPS, the History department advisor, and the Social Science Teaching Coordinator. Both the advisor and coordinator keep running spreadsheets that are updated each time the content test is given, and the Associate Dean produces reports of test data each October. Test results are shared with the SOS Program Committee in meetings held once per semester.

B.A. in History with Teacher Licensure

Please complete a separate worksheet for each academic program (major, minor) at each level (undergraduate, graduate) in your department. Worksheets are due to CASA this year by June 13, 2014. Worksheets should be sent electronically to [email protected] and should also be submitted to your college dean. For information about assessment or help with your assessment plans, visit the Assessment webpage at http://www.eiu.edu/~assess/ or contact Karla Sanders in CASA at 581-6056.

Bonnie Laughlin-Schultz

Page 2: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/2

NCSS ten themes survey data on history-based themes. This data is gathered at two program points: during SOS 3400 and during student teaching.

Point 1. During SOS 3400 students complete a portfolio that included four lesson plans. These were reviewed by the Teacher Education Committee in the History department and assessed. Ratings are: “does not meet”; “occasionally meets”; “meets”; “occasionally exceeds”; and “exceeds.” See appendix B for description of the themes.

Point 2. Cooperating teachers of all 2013-2014 student teachers were surveyed over student teacher knowledge of each of the NCSS ten themes. The same survey instrument as in point 1 was used.

At point 1, a minimum of 75% of portfolio submissions will receive ratings of “meets,” “occasionally exceeds,” or “exceeds” (3, 4, or 5) on the NCSS ten themes evaluation form. (The n does not always equal thetotal number, as reviewers can mark N/A for history-related themes. Data is gathered anonymously it represents both History with Teacher Licensure and History with Teacher Licensure majors.)

At point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,” or “exceeds” (3, 4, or 5) on the NCSS ten themes evaluation form. (The n does not always equal thetotal number, as reviewers can mark N/A for history-related themes. Data is

is worth noting that 3 scores on world history were below passing. See Appendix B for full data.

Theme 2: 100% (n=12) earned ratings of 3, 4, or 5.Theme 8: 100% (n=12) earned ratings of 3, 4, or 5.Theme 9: 91.6% (n=12) earned ratings of 3, 4, or 5.

Theme 2: 100% (n=12) earned ratings of 3, 4, or 5.Theme 8: 100% (n=12) earned ratings of 3, 4, or 5.Theme 9: 91.6% (n=12) earned ratings of 3, 4, or 5.

The Social Science teaching coordinator gathers data for the NCSS ten themes survey at two program points and then shares data with the History with Teacher Licensure program and curriculum committees in meetings held once per semester. Data is also shared with CEPS in preparation for accreditation by NCSS.

The Social Science teaching coordinator gathers data for the NCSS ten themes survey at two program points and then shares data with the History with Teacher Licensure program and curriculum committees in meetings held once per semester. Data is

Page 3: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/3

gathered anonymously it represents both History with Teacher Licensure and History with Teacher Licensure majors.)

also shared with CEPS in preparation for accreditation by NCSS.

2. Content Knowledge: Historical ThinkingHistory with Teacher Licensure majors will be able to analyze a source document using the historical method. This includes close reading, sourcing (asking questions about author credentials/ motivation and audience and evaluating claims and detecting limitations), corroborating, and contextualizing in order to analyze what the document tells us about the past. (UG: Critical Thinking; Writing and Critical Reading)

Every History major submits one source analysis paper from HIS 2010 (required of all majors). The History Curriculum Committee evaluates the papers holistically using a departmental rubric that ranks candidates with scores 4 (highly competent), 3 (competent), 2 (minimally competent), and 1 (not competent). Their understanding of historical characteristics of the document, point of view, organization, development, style, and mechanics are considered in assigning the rating.

20% will be rated highly competent50% will be rated competent20% will be rated minimally competent10% will be rated not competent

Of the selections analyzed for 2013-2014 (n=34):20.5% (n=7) were rated as highly competent50% (n=17) were rated competent23.5% (n=8) were rated minimally competent5.9% (n=2) was rated not competentWe did meet all expectations.

The Curriculum and Assessment committees work with faculty to gather items for assessment and to carry out scoring. The Curriculum Committee and the chair discuss the data and results and share information with the rest of the faculty. The Social Science teaching coordinator is on both the Curriculum and Assessment committees and shares information with the Social Science Studies Program and curriculum committees as needed.

3. Broad Content Knowledge in Social ScienceHistory with Teacher Licensure majors will know and understand the standard content of economics, geography, political science, psychology, and sociology-anthropology as described in the Illinois Core

Scores on the Social Science Foundations section of Content Area Tests Scores attained on the appropriate Illinois Certification Testing System (ICTS) Content Area Tests (CAT): 113 (GEG); 117 (PLS); 118 (PSY); and 121 (SOC/ANT). The CAT is typically taken the semester prior to student teaching.

A minimum of 80% of 2013-2014 test takers will receive a 240 or higher on the Social Science Foundations section. All Social Science program completers must have achieved passing composite scores (240 or higher) on their concentration’s CAT, but it is possible to pass the overall test but score below

100.0% of test takers (n=14) passed the Social Science Foundations segment. See Appendix B for full data.

Test Score results are monitored by Associate Dean Doug Bower in CEPS, the History undergraduate advisor, and by the Social Science Teaching Coordinator. Both the advisor and coordinator keep spreadsheets that are updated each time the test is given, and

Page 4: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/4

Standards for Social Science Teachers and as indicated in the National Council for the Social Studies Ten Thematic Strands.

NCSS ten themes survey data on broad social science themes. This data is gathered at two program points: during SOS 3400 and during student teaching.

Point 1. During SOS 3400 students complete a portfolio that included four lesson plans. These were reviewed by the Teacher Education Committee in the History department and assessed. Ratings are: “does not meet”; “occasionally meets”; “meets”; “occasionally exceeds”; and “exceeds.” See appendix B for description of the themes and data.

Point 2. Cooperating teachers of all 2013-2014 student teachers were surveyed over student teacher knowledge of each of the NCSS ten themes.

240 in non-concentration areas.

At point 1, a minimum of 80% of portfolio submissions will receive ratings of “meets,” “occasionally exceeds,” or “exceeds” (3, 4, or 5) on the NCSS ten themes evaluation form. (The n does not always equal thetotal number, as reviewers can mark N/A. Data is gathered anonymously it represents both History with Teacher Licensure and History with Teacher Licensure majors.)

At point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,” or “exceeds” (3,

Theme 1: 100% (n=12) earned ratings of 3, 4, or 5.Theme 3: 90% (n=10) earned ratings of 3, 4, or 5.Theme 4: 100% (n=6) earned ratings of 3, 4, or 5.Theme 5: 100% (n=6) earned ratings of 3, 4, or 5.Theme 6: 91.6% (n=12) earned ratings of 3, 4, or 5.Theme 7: 100% (n=7) earned ratings of 3, 4, or 5.Theme 10: 90.9% (n=11) earned ratings of 3, 4, or 5.

Theme 1: 90.9% (n=12) earned ratings of 3, 4, or 5.Theme 3: 90% (n=10) earned ratings of 3, 4, or

the Associate Dean produces reports of test data each October. Test results are shared with the History with Teacher Licensure Program Committee in meetings held once per semester.

The Social Science teaching coordinator gathers data for the NCSS ten themes survey at both program points and then shares data with the History with Teacher Licensure program and curriculum committees in meetings held once per semester. Data is also shared with CEPS in preparation for accreditation by NCSS.

Page 5: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/5

The same survey instrument as in point 1 was used.

4, or 5) on the NCSS ten themes evaluation form. . (The n does not always equal the total number, as reviewers can mark N/A. Data is gathered anonymously it represents both History with Teacher Licensure and History with Teacher Licensure majors.)

5.Theme 4: 100% (n=6) earned ratings of 3, 4, or 5.Theme 5: 83.30% (n=9) earned ratings of 3, 4, or 5.Theme 6: 91.6% (n=12) earned ratings of 3, 4, or 5.Theme 7: 100% (n=7) earned ratings of 3, 4, or 5.Theme 10: 90.9% (n=11) earned ratings of 3, 4, or 5.

4. Effective Planning for Instruction & AssessmentSocial Science majors will effectively plan for instruction, developing objectives that are tied to appropriate learning goals and standards; designing appropriate instructional strategies and lessons to build content understanding and support learning needs of students; integrating attention to literacy into instruction; and planning how to assess student learning. (UG: Critical Thinking; Writing and Critical Reading)

Four lesson plans are submitted as part of Department Approval Portfolio, and they are rated on a variety of criteria by members of the History Department Teacher Education Committee. Each student is given a score between 0 and 10 by each of the three members of the History Department Teacher Education Committee, and the average of the scores will be reported here.

In departmental methods

75% of students submitting lesson plans within the department assessment portfolio (DAP) will receive an average score of 8 or above, and at least 40% will earn scores of 9 or 10.

A minimum of 80% of

83.3% (n=12) of HIS-TL students earned scores of 8 or higher, and 50% earned scores of 9 or 10.

90.9% (n=11) of HIS-TL

The Teacher Education Committee for Social Science and History assesses the portfolios and communicates midterm conditional approval of all students applying for student teaching to CEPS and, specifically, to Associate Dean Doug Bower. All instructors of SOS 3400 are part of the Teacher Education Committee, and in assessing portfolio s/he/they discover areas in which students need to improve and adapt instruction accordingly.

SOS 3400 instructors

Page 6: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/6

(SOS 3400) students are required to submit a unit plan to Livetext for the CEPS unit assessment, and SOS 3400 instructors rate the unit plans on a rubric developed by the Unit Assessment Committee in consultation with Associate Dean Doug Bower. Eleven criteria are then assessed using a five-point rubric; see appendix D for full data and criteria. (Data shown represents both HIS-TL and SOS majors.)

submissions will receive ratings of “meets,” “occasionally exceeds,” or “exceeds” (3, 4, or 5) in all eleven criteria.

submissions received ratings of “meets,” “occasionally exceeds,” or “exceeds” (3, 4, or 5) in all eleven criteria.

complete the rubrics on Livetext, and data is used for both program and unit assessment. CEPS Associate Dean Doug Bower monitors and uses this data for unit assessment and accreditation, while the Social Science teaching coordinator monitors it for programmatic assessment, using data gathered to improve assignments in SOS 3400 and bringing pertinent data to the attention of the History with Teacher Licensure program and curriculum committee meetings each semester.

5. Implementing Instruction and Engaging Students in LearningSocial science teaching majors will demonstrate professional teaching competency by planning, organizing, effectively presenting, and reflecting upon social studies lessons that are designed to reach a diverse group of learners. (UG: Speaking/Listening; Responsible Citizenship)

Data is gathered at two program points.

Micro-Teaching: Students enrolled in SOS 3400 teach a lesson (what we call microteaching modules) during the semester. The instructor use a 20-item microteaching checklist to assess the effectiveness of student presentation skills, including appropriate use of technology, incorporation of effective teaching strategies,

A minimum of 80% of students will receive a score of 160 or higher (out of 200) on the MT checklist. This means that microteaching modules were presented in a clear, articulate, and organized manner and will have used instructional technology and research-based strategies.

100% (n=11) of HIS-TL students earned scores of 160 or higher.

The Social Science teaching coordinator and undergraduate advisor are the instructors of record for this course, and they communicate frequently about problems with any microteaching. If problems persist or become severe, the

Page 7: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/7

classroom management and presence, and connection between goals and lesson itself as well as a reflective component.

Student Teaching Evaluation: Student teachers are assessed for their ability to use diverse strategies to plan and execute effective instruction. Student teachers are evaluated on 18 different elements of instructional planning in the “diverse strategies” section of the student teaching evaluation form. Note: Data from 2014 is not yet available, so the data used is the 2013 ISBE data.

A minimum of 90% of History with Teacher Licensure student teachers will receive ratings of “meets” through “exceeds” on the “diverse strategies” components of the Student Teaching Evaluation form. Ratings are: “does not meet”; “occasionally meets”; “meets”; “occasionally exceeds”; and “exceeds.”

95.9% (n=24) of HIS-TL earned ratings of “meets” through “exceeds,” with 100% of students receiving “meets” through “exceeds” in 15 of 18 categories. See Appendix C for complete data.

Social Science teaching coordinator can withhold approval for student teaching and communicates with CEPS Associate Dean Doug Bower and Student Teaching.

Cooperating teachers and student teaching supervisors from the Department of Student Teaching (CEPS) conduct the assessment. The Chair of the Department of Student Teaching, the Associate Dean of CEPS, and the coordinator of Social Science Teaching monitor assessment results, sharing with other department chairs and committees when data is troubling or indicates broad programmatic issues.

6. Assessing Student Learning and Reflecting Upon Instruction Social science teaching majors will be reflective teachers, understanding the variety of learning needs in their classroom; planning assessments (formative and summative) to monitor and

At present reflection upon planning and implementation has been incorporated into the lesson and unit plan assignments in SOS 3400. In the future data will be available from both the practice edTPA done prior to SOS 3400 in SED 3330/EDP 3331 and the edTPA

Students will begin to incorporate reflection into lesson planning, submitting rationales in all lesson and unit plans. A specific rubric will be added for SOS 3400 assignments in 2014-2015 so that student competency can be assessed at multiple program points.

N/A N/A

Page 8: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/8

support student learning; and adapting classroom instructional strategies in response to assessment data. In doing this they also demonstrate aspects of global citizenship, particularly understanding of diversity and respect for the needs of all learners.(UG: Writing and Critical Reading; Quantitative Reasoning; Responsible Citizenship)

completed during student teaching. Six of the 15 edTPA rubrics focus on assessment and reflection upon/use of assessment data. (See the list in part III below.) I would also like to incorporate data and information from a focus group of practicing teachers alums.

7. WritingSocial science teaching majors will demonstrate the ability to write effectively. (UG: Writing and Critical Reading)

The ability to write clearly is one element that is assessed in the Department Approval Portfolio for Student Teaching, and students are rated on a scale of 1-5 by each of the three members of the History Department Committee on Teacher Education. Scores of the three reviewers will be averaged and reported in the data here.

100% of students submitting unit and lesson plans within the department assessment portfolio (DAP) will receive an average score of 3 or above, and at least 50% will earn scores of 4 or 5.

100% (n=11) of HIS-TL students earned ratings of 3 or above, and 81.8% earned scores of 4 or 5.

Concerns with student writing are first addressed by asking students to re-submit the portfolio. If problems persist, the social science teaching coordinator communicates issues with approval of all student teachers to CEPS Associate Dean Doug Bower and to Student Teaching.

8. Critical Thinking and Social Studies Literacy SkillsSocial science teaching majors will demonstrate the ability to incorporate historical thinking (a subset of critical thinking) and discipline-specific literacy development into their

In fall 2013, social studies literacy and historical thinking rubrics were piloted in SOS 3400 to assess student ability to incorporate literacy work and to teach with primary documents. SOS 3400 instructors assessed student performance using two five-point rubrics created

A minimum of 80% of students enrolled in SOS 3400 will receive ratings of “meets” through “exceeds” on the “Critical Thinking and Social Studies Literacy” portion of the rubrics used to assess lesson plans in SOS 3400.

On the Planning for Social Studies Literacy assignment, 100% (n=11) received ratings of “meets” (7), “occasionally exceeds” (3), and “exceeds” (1).

On the Teaching Historical Thinking

The Social Science teaching coordinator gathers data in both SOS 3400 and in tabulating the exit surveys and then shares data with the History with Teacher Licensure program and curriculum committees

Page 9: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/9

teaching and align lessons with Common Core Histor/Social Studies literacy standards. (UG: Critical Thinking; Writing and Critical Reading)

by the Social Science Teaching coordinator: (1) Planning for Social Studies Literacy and (2) Teaching Historical Thinking. Both rubrics included specific assessments of Critical and Historical Thinking, and full data is in Appendix F.

An exit survey of program completers was also piloted in 2013-2014, and it contained a specific question of how EIU prepared respondents to teach historical thinking.

Respondents should indicate that SOS 3400 assignments helped identify key tenets of historical thinking and assisted them in developing abilities to teach such skills.

assignment, 62.5% (n=8) received ratings of “meets” (2), “occasionally exceeds” (2), and “exceeds” (1).

Some students identified specific courses (including SOS 3400) that prepared them to teach historical thinking, but the answers to this question were so varied that I cannot really extrapolate any conclusions.

in meetings held once per semester. Consultation with department chairs in HIS, PLS, GEG, and SOC is part of this process and is designed to improve disciplinary-specific instruction in the social studies. Information is also shared with CEPS in meetings about Common Core alignment and preparation of students for edTPA.

9.ProfessionalismSocial science teaching majors will demonstrate professional dispositions and responsibilities.(UG: Responsible Citizenship)

Dispositions surveys done at multiple points throughout the professional education sequence (including departmental methods and student teaching) rate students on 5 dispositions:• Interaction with students (IWS)• Professional and ethical practices (PEP)• Effective communication (EC)• Planning for teaching and student learning(PTSL)• Sensitivity to diversity and equity (SDE)

A minimum of 90% of SOS 3400 students will receive ratings of “meets” through “exceeds” in all five components of the dispositions evaluation instruments. (Ratings are: “does not meet”; “occasionally meets”; “meets”; “occasionally exceeds”; and “exceeds.”)

100% of students (n=15) were rated as “meets” through “exceeds” on all dispositional elements. See Appendix E for full dispositions data.

This data comes from LiveText and is an integral part of the CEPS-History Department-History with Teacher Licensure Committee assessment loop. If problems exist, the social science teaching coordinator communicates issues with approval of any students applying for student teaching to CEPS Associate Dean Doug Bower.

Page 10: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/10

PART TWODescribe your program’s assessment accomplishments since your last report was submitted. Discuss ways in which you have responded to the CASA Director’s comments on last year’s report or simply describe what assessment work was initiated, continued, or completed.

The learning goals for the program were overhauled in 2012-2013, and we revised them slightly this year, tweaking descriptions, incorporating the revised university learning goals, and working to highlight new Common Core and edTPA skillsets. In 2013-2014, we continued to revise and re-envision the broader social science teaching program and to adapt to changes in teacher preparation in Illinois and to improve our curriculum and student performance. We were particularly focused on recruitment this year and improving communication with (and retention of) current majors, and we also focused on revisions to SOS 3400, social science teaching methods. We worked to integrate Common Core learning goals into the course, focusing especially on preparing future teachers to address disciplinary-specific literacy, historical thinking, and the Common Core ELA subset of History/Social Studies reading strands. Literacy assignments were embedded into SOS 3400 and the departmental approval portfolio (DAP), and rubrics were created in order to provide feedback to students and to gather data for programmatic assessment. Additionally, we worked to incorporate the disciplinary lenses that the Common Core (and NCSS’s C3 framework) require, and in consultation with program committee members from Geography, History, Political Science, Psychology, and Sociology, discussed how to better incorporate disciplinary literacy into SOS 3400. Faculty members from four different disciplines made presentations in the class, and a variety of measures to better incorporate multiple disciplines will be developed in future years. I added a more extensive unit plan to SOS 3400 in spring 2013 as a pilot, and it was strengthened and aligned more with the edTPA standards in 2013-2014 and submitted as the culmination of SOS 3400. Data from it is included in the report above. Finally, emphasis was also placed on preparing students to reflect upon their teaching and to offer research-based rationales for teaching strategy. This skill is something that good teachers possess and it is also central to edTPA, the new performance assessment required for teacher licensure in Illinois beginning in fall 2015. In 2013-2014 much work to incorporate asking students to write rationales for teaching decisions and to use assessment data in making decisions; data from edTPA work in multiple points in the program will be used for future assessment reports. Additionally, History with Teacher Licensure continues to benefit from the ongoing curriculum revisions and attention to transferable skills and critical thinking in the History department.

To address areas of concern in the response to the Student Learning Assessment Program report from last year, we continued to clarify learning objectives, working on defining historical thinking and improving the objectives that pertain to critical thinking and literacy, two areas which are becoming more and more critical to teacher training in the era of the Common Core. We worked to gather data at various points in the program, adding assessment of NCSS ten themes knowledge prior to student teaching, piloting a student teacher exit survey, and trying to draw data from various program points whenever possible. I am making plans for a future focus group of graduates; in my second year as social science teaching coordinator, I have identified a small group of graduates and soon-to-be graduates who will form the core of a focus group that can grow over time. Instead of just offering information about the program in retrospect, this focus group will also serve as a resource, connecting me to what is going on in secondary classrooms.

PART THREESummarize changes and improvements in curriculum, instruction, and learning that have resulted from the implementation of your assessment program. How have you used the data? What have you learned? In light of what you have learned through your assessment efforts this year and in past years, what are your plans for the future?

Page 11: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/11

Student performance on many goals continues to be strong—all History with Teacher Licensure students passed the Content Test, and students’ performance on the Department Portfolio, Ten Themes assessments, and Student Teaching was strong. Two areas of concern emerge in the data above. The first deals with historical knowledge and performance on the content test. All 14 HIS-TL students who took the Content Test passed it; several students scored in the high 270s (300 is the maximum). However, three students struggled with the world history portion, an area where we have noticed lower scores in the past. As students take and succeed in a core of world history classes and consistently do well student teaching in world history, I am not overly concerned about this one indicator. But in 2014-2015, we will begin to offer a content test preparation session each semester. We will also undertake a full curriculum review in fall 2014.

The second area where students lag relates to disciplinary-specific literacy (how to think like a geographer, historian, etc.) and our goals relating to future performance on edTPA, particularly student ability to reflect on teaching and cite research-based strategies and approaches. Students in HIS-TL do not seem particularly better prepared to discuss “historical thinking” than any of the other social science fields, and data from the SOS 3400 rubrics that pertains to critical thinking and literacy reveal that students perform lower in these categories than in other categories on the rubric (see Appendix F). SOS 3400 students—both HIS-TL and SOS majors—were particularly weak in teaching historical thinking. I expect that this trend will change over time, particularly as CEPS is building more work on Common Core, disciplinary literacy, and academic vocabulary into their professional education sequence and as we work to strengthen the program overall. We have begun revising the SOS 3400 curriculum to include more work on disciplinary specific literacy and edTPA preparation. In 2013-2014 I added several weeks devoted to literacy and historical thinking to SOS 3400, and we brought in guests from Political Science, Geography, and Sociology to speak to those disciplinary perspectives. Over time we hope to build modules on the various disciplines that comprise social science teaching (ECN, GEG, HIS, PLS, PSY, and SOC-ANT). This summer I will create a model for HIS to share with the other departments. The hardest component of edTPA, according to nationwide pilot data shared with us in meetings in CEPS, is the reflective commentaries that students are required to write about their planning, implementation, and assessment. We incorporated rationales into lesson planning and microteaching in SOS 3400, with students writing paragraph-length justifications of their choices of teaching strategies and implementation. Student performance on these rationales was not systematically assessed; rather, I wanted to use this year to feel out how students were doing and to think carefully about how to assess this performance in the future. For next year we will revise the microteaching module and unit plan assignment to further reflect edTPA reflective teaching goals and to create an assessment apparatus for both of those. We will also look at revising the Department Approval Portfolio process to incorporate reflection upon teaching. edTPA is tied to the cycle of effective teaching, building student learning through a cycle of planning, instructional delivery, assessment, and use of assessment data to improve instruction. We should get data from the 2013-2014 pilot as well as next year. In fall 2015, students will be required to take and pass the official edTPA and we will receive data on their overall performance as well as sub-scores on 15 rubrics that will allow us to pinpoint areas of program weakness. The rubrics will cover the following: Planning for History/Social Studies Instruction; Planning to Support Varied Student Learning Needs; Using Knowledge of Students to Inform Teaching and Learning; Identifying and Supporting Language Demands; Planning Assessments to Monitor and Support Student Learning; Learning Environment; Engaging Students in Learning; Deepening Student Learning; Subject-Specific Pedagogy; Analyzing Teaching Effectiveness; Analysis of Student Learning; Providing Feedback to Guide Learning; Student Use of Feedback; Analyzing Students’ Language Use and History/Social Studies Learning; and Using Assessment to Inform Instruction. I have begun incorporating edTPA language into objectives above, and expect to continue to do so. For goal four, for example, edTPA data will eventually become part of our assessment program.

Page 12: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/12

Finally, over the past year, it has become increasingly obvious that more concentrated work with social science teaching majors is needed, and preferably, earlier in the program. Simply put, students are expected to graduate knowing much more about pedagogy and teaching disciplinary-specific literacy in order to successfully tackle the Common Core and, as important, the new Danielson model of teacher evaluation that has been legally mandated statewide. To that end, I drew up a sketch for a new course and consulted with the History department curriculum committee to refine it. We then presented to both the History department and Social Science Studies program committee a preliminary proposal for a new course, SOS ####: Introduction to Social Science Teaching, that will allow me to introduce students to all of these issues earlier in the program. I will begin the formal course approval process through COTE, etc., in fall 2014 and I hope to begin offering the class in fall 2015. SOS #### is a one-credit course that would be taken prior to practicum by all History with Teacher Licensure and Social Science Studies majors. This course would provide an introduction to social science education research/theory; the various disciplinary perspectives of all social sciences; edTPA and reflective teaching; and the secondary classroom setting. This once-a-week course will allow us to introduce students to social science disciplinary thinking and teaching methods before they undertake practicum—where now they will do a practice edTPA. The addition of this course will mean that students have a three-step process in which to build their teaching methods and ability to reflect upon their teaching choices (central to success on edTPA) prior to student teaching: SOS ####, Practicum, and finally, our capstone SOS 3400. In terms of assessment, it will provide another point in which we can gather data.

Page 13: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/13

Appendix A. NCSS Ten Themes Data, 2013-2014

NCSS Thematic Strand Explanation1 Culture elements of culture; similarities and differences among cultural groups across time, place2 Time, Continuity, and Change historical roots3 People, Places, and Environments geography, regional studies, world cultures; location, regions, interaction w/

environment4 Individual Development and Identity human growth, behavior, perception; social, political, cultural impact on identity5 Individuals, Groups, and Institutions role of institutions; change over time & cultural place; individual in institutional change6 Power, Authority, and Governance purposes/function of govt; rights/responsibilities of citizens7 Production, Distribution, & Consumption economics – production/distribution questions; market decisions; scarcity8 Science, Technology, and Society tech change in history; influence of technology/science; global access9 Global Connections10 Civic Ideals and Practices civic ideals; civic participation; democratic ideals; rights/responsibilities; world policy

Lesson Plans/DAP Assessment, 2013-2014

1. Culture

2. Time, Cont, and Change

3. People, Places, Env

4. Indiv Deve/Identity

5. Individuals, Grps, Institutions

6. Power, Authority, Govt

7. Production, Distrib, Consump

8. Science, Tech, Society

9. Global Connections

10. Civic Ideals/Practices

0 1 2 3 4 5 6 7 8

N/ADoes not meetOccasionally MeetsMeets StandardsOccas ExceedsExceeds

Page 14: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/14

Page 15: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/15

Student Teaching Ten Themes Evaluations, 2013-2014

1. Culture

2. Time, Cont, and Change

3. People, Places, Env

4. Indiv Deve/Identity

5. Individuals, Grps, Institutions

6. Power, Authority, Govt

7. Production, Distrib, Consump

8. Science, Tech, Society

9. Global Connections

10. Civic Ideals/Practices

0 1 2 3 4 5 6 7 8

N/ADoes not meetOccasionally MeetsMeets StandardsOccas ExceedsExceeds

Page 16: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/16

Appendix B. Content Test Scores, 2013-2014

HIS test 114 SS fds HIS cc con-world US-ILName P/F Exam Date Total 1 2 3 4asdASasASasA P 7/6/2013 254 272 211 232 256asdASasASasA P 7/6/2013 279 275 293 289 268asdASasASasA asdASasASasA

P 9/7/2013 260 269 265 246 243

asdASasASasA asdASasASasA

P 9/7/2013 279 269 279 279 300

asdASasASasA P 9/7/2013 265 266 293 246 249asdASasASasA P 9/7/2013 261 253 272 268 262asdASasASasA P 9/7/2013 268 272 272 268 256Shimer, Ethan P 9/7/2013 267 260 272 232 294asdASasASasA P 11/16/2013 245 252 252 215 236asdASasASasA P 11/16/2013 244 245 252 177 257asdASasASasA P 2/8/2014 266 261 293 258 257asdASasASasA asdASasASasA

P 4/12/2014 267 266 244 279 281

asdASasASasA P 4/12/2014 261 260 258 268 262asdASasASasA P 4/12/2014 278 272 272 268 300

Page 17: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/17

Appendix C. Student Teaching Assessment, 2013 ISBE Report

Diverse Strategies-1)Clarity and suitability of goals and objectives

2 (8%) 9 (39%) 12 (52%)

Diverse Strategies-2) Integration of goals and objectives

2 (8%) 9 (37%) 13 (54%)

Diverse Strategies-3) Resources for teaching and students

10 (41%) 14 (58%)

Diverse Strategies-4) Learning activities 1 (4%)

7 (29%) 16 (66%)

Diverse Strategies-5) Instructional materials and resources

1 (4%)

8 (33%) 15 (62%)

Diverse Strategies-6) Instructional groups 2 (8%) 13 (54%) 9 (37%)

Diverse Strategies-7) Lesson and unit structure 2 (8%) 5 (20%) 17 (70%)

Diverse Strategies-8) Congruence of assessment with instructional goals and objectives

1 (4%)

9 (37%) 14 (58%)

Diverse Strategies-9) Criteria and standards 1 (4%)

3 (12%) 3 (12%) 17 (70%)

Diverse Strategies-10) Used student needs in planning

4 (16%) 8 (33%) 12 (50%)

Diverse Strategies-11) Directions and procedures 3 (12%) 6 (25%) 15 (62%)

Diverse Strategies-12) Levels of questions and response time

4 (16%) 8 (33%) 12 (50%)

Diverse Strategies-13) Discussion techniques 1 (4%)

1 (4%)

10 (41%) 12 (50%)

Diverse Strategies-14) Student participation 5 (20%) 8 (33%) 11 (45%)

Diverse Strategies-15) Feedback to students 2 (8%) 9 (37%) 13 (54%)

Diverse Strategies-16) Management of transitions 1 (4%)

3 (12%) 11 (45%) 9 (37%)

Diverse Strategies-17) Management of materials 2 (8%) 7 (29%) 15 (62%)

Page 18: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/18

Diverse Strategies-18) Classroom arrangement and accessibility

1 (4%)

6 (25%) 17 (70%)

Does Not Meet Standard Occasionally Meets Meets Standard Occasionally Exceeds Exceeds Standard

Page 19: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/19

Appendix D. Unit Plan Assessment Data, 2013-2014This data is gathered by CEPS from SOS 3400 instructors, and it includes both History with Teacher Licensure and History with Teacher Licensure majors. Since the data reflects a course taken by all social science teaching majors in both programs, the data is not separated out by degree.

Fall 2013, SOS 3400

Page 20: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/20

Spring 2014, SOS 3400

Page 21: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/21

Appendix E. Dispositions DataSOS 3400, 2013-2014This data includes both History with Teacher Licensure and History with Teacher Licensure majors. Since the data reflects a course taken by all social science teaching majors in both programs, the data is not separated out by degree.Fall 2013

Spring 2014

Page 22: Student Learning Assessment Program - EIUassess/HIS TC.docx · Web viewAt point 2, a minimum of 90% of program completers will receive ratings of “meets,” “occasionally exceeds,”

Laughlin-Schultz/HIS-TL/22

Appendix F. Disciplinary-Specific Critical Thinking and Literacy DataPlanning for Social Studies Literacy, 2013-2014 Note: Fall 2013 students worked on this assignment in pairs, while most spring 2014 students submitted it individually.

Goals

ContentKnow

Instr. St

rat

Resource

s

CritTh

ink/Lite

racy

Effort/

Engag

emen

t0123456789

ExceedsOccas ExceedsMeets StandardsOccasionally MeetsDoes not meet

Teaching Historical ThinkingNote: All students completed this assignment in pairs, and each pair is represented ONCE in the data that follows.

Goals

Content K

nowledge

Connections/A

nalysis

Instruc S

trateg

ies

CritTh

inking/L

iterac

y

Effort/

Enga

gemen

t0

1

2

3

4

ExceedsOccasionally ExceedsMeets StandardsOccasionally Does Not MeetDoes Not Meet


Top Related