tim brower professor & chair manufacturing & mechanical engr. oregon institute of technology...
TRANSCRIPT
Tim BrowerProfessor & Chair
Manufacturing & Mechanical Engr.
Oregon Institute of Technology
MSP Regional Meeting, San Francisco, February 14 & 15, 2008
Edith GummerDirector
Classroom-Focused Research & Eval.
Northwest Regional Educational Lab
2
Partners Include....Partners Include....
2
OregonInstitute of Technology
OregonInstitute of Technology
Northwest Regional Educational Laboratory
3
Project GoalsProject Goals
The vision for this partnership is to introduce new contextualized learning curriculum called Project Lead The Way (PLTW) into school districts within Oregon and to engage the local community colleges, skill centers, and industry to leverage resources to gain capacity for the program.
The vision for this partnership is to introduce new contextualized learning curriculum called Project Lead The Way (PLTW) into school districts within Oregon and to engage the local community colleges, skill centers, and industry to leverage resources to gain capacity for the program.
Goal 1: Increase teachers’ content knowledge and teaching skills.
Goal 2: Increase the academic performance of students in math, science, and technology.
Goal 3: Establish the infrastructure necessary to implement and sustain the program in Oregon schools.
Evaluation ModelEvaluation Model
Evolving process Lessons learned and capacity built
Goals and objectives orientedTeacher and student changeProgram capacity as intervention
Mixed methodologySingle group – no control or comparison
Formative and summative processes implemented
Evolving process Lessons learned and capacity built
Goals and objectives orientedTeacher and student changeProgram capacity as intervention
Mixed methodologySingle group – no control or comparison
Formative and summative processes implemented 4
Goal 1: Teacher Content Knowledge
Goal 1: Teacher Content Knowledge
PLTW assessments developed nationally
Same as assessments developed for students
No ceiling effect in pre-test experienced
Administered as pre/post-testSignificant differences
PLTW assessments developed nationally
Same as assessments developed for students
No ceiling effect in pre-test experienced
Administered as pre/post-testSignificant differences
5
Year 2 Teacher DataYear 2 Teacher Data
PLTW COURSEPLTW COURSE # Teachers# Teachers % Gain% Gain
Principles of Engineering
4 28%
Digital Electronics 5 29%
Computer Integrated Manufacturing
5 30%
6
Limitations:• Low number of teachers tested• Lack of comparison group• No delayed post-test
Goal 1: Teacher Instructional Practices
Goal 1: Teacher Instructional Practices
Use of Reformed Teaching Observation Protocol
Overall RTOP scores greater than those reported in other Title IIB MSP projects evaluated by NWREL
Limitations Variable number of observations per
teacher Range in fidelity of implementation Comparison group issues
Use of Reformed Teaching Observation Protocol
Overall RTOP scores greater than those reported in other Title IIB MSP projects evaluated by NWREL
Limitations Variable number of observations per
teacher Range in fidelity of implementation Comparison group issues 7
Goal 1: Teacher Instructional Practices
Goal 1: Teacher Instructional Practices
Survey of Enacted Curriculum – Part A, Instructional Practices and Beliefs
Year 3 is most systematic use of SEC
LimitationsSEC designed for science and
mathematics teachersLow number of teachers in projectComparison groups
Survey of Enacted Curriculum – Part A, Instructional Practices and Beliefs
Year 3 is most systematic use of SEC
LimitationsSEC designed for science and
mathematics teachersLow number of teachers in projectComparison groups
8
Goal 1: Teacher Instructional Practices
Goal 1: Teacher Instructional Practices
Documentation of what teachers are doing in a PLTW course
Use of SCOOP notebookCaptures 5 days of instructionStudent assignments and assessmentsTeacher reflections
LimitationsVariability of implementation fidelityUnknown use of curricular materials
Documentation of what teachers are doing in a PLTW course
Use of SCOOP notebookCaptures 5 days of instructionStudent assignments and assessmentsTeacher reflections
LimitationsVariability of implementation fidelityUnknown use of curricular materials
9
Goal 2: Increase in Student Achievement
Goal 2: Increase in Student Achievement
Use of PLTW national testsYear 3 focus of the evaluation Issue will be the number of teachers
who are implementing full PLTW coursesConnection to national PLTW
evaluation Supplemental contract with True Outcomes Timeframe and access has been problematic Lack of uniform model of measuring PLTW
across the states
Use of PLTW national testsYear 3 focus of the evaluation Issue will be the number of teachers
who are implementing full PLTW coursesConnection to national PLTW
evaluation Supplemental contract with True Outcomes Timeframe and access has been problematic Lack of uniform model of measuring PLTW
across the states10
Goal 3: Establish Infrastructure
Goal 3: Establish Infrastructure
OIT PLTW project is not just increasing teacher content knowledge
Effort is bringing new curricular program into the state
Infrastructure issues Coordination with other engineering initiatives Bringing school districts into process Building master teachers to decrease reliance
on national program
OIT PLTW project is not just increasing teacher content knowledge
Effort is bringing new curricular program into the state
Infrastructure issues Coordination with other engineering initiatives Bringing school districts into process Building master teachers to decrease reliance
on national program 11
Goal 3: Establish Infrastructure
Goal 3: Establish Infrastructure
12
Fig. 1. Oregon Teachers Receiving PD
02468
101214161820
'2003/04 2005 2006 2007
STI Year
# o
f T
each
ers
To date: 4 “Science”
Teachers 8 “Math” Teachers
To date: 4 “Science”
Teachers 8 “Math” Teachers
Goal 3: Establish Infrastructure
Goal 3: Establish Infrastructure
Two “Master Teachers” are slated to be trained during the 2008 Summer training Institute in OregonHigh school teachers that have taught
the curriculum at least 2-yearsNational screening processTrained with fully certified Master
TeacherPrep training held once per year
Two “Master Teachers” are slated to be trained during the 2008 Summer training Institute in OregonHigh school teachers that have taught
the curriculum at least 2-yearsNational screening processTrained with fully certified Master
TeacherPrep training held once per year 13
Supplemental Goal: Evidence of Partnership
Supplemental Goal: Evidence of Partnership
Interview protocol developed based on work of Gordon Kingsley
Interviews of key stakeholders conducted spring 2007
Partnership profile
Interview protocol developed based on work of Gordon Kingsley
Interviews of key stakeholders conducted spring 2007
Partnership profile
14
Evaluation ChallengesEvaluation Challenges
Comparison groups of teachers and students
Appropriate instrumentsPLTW content courses?Instructional practices
Adequate sample sizes of teachers and students
Sufficient description of nature of intervention
Comparison groups of teachers and students
Appropriate instrumentsPLTW content courses?Instructional practices
Adequate sample sizes of teachers and students
Sufficient description of nature of intervention 15
16
The instructional practices and assessments discussed or shown in this presentation are not
intended as an endorsement by the U.S. Department of Education.
The instructional practices and assessments discussed or shown in this presentation are not
intended as an endorsement by the U.S. Department of Education.
Questions?Questions?
Dr. Tim BrowerProfessor & Chair
Manufacturing & Mechanical Engr.
Oregon Institute of [email protected]
Dr. Edith GummerProgram Director
Classroom-Focused Research & Eval.
Northwest Regional Educational Lab
Contacts:Contacts: