inter-rater reliability

23
Inter-Rater Reliability CHCCS November 13 th 2012

Upload: drew-hoover

Post on 31-Dec-2015

52 views

Category:

Documents


0 download

DESCRIPTION

Inter-Rater Reliability. CHCCS November 13 th 2012. Today’s Presenters. Cynthia Martin, Ed.D . Professional Development Consultant Region 3 [email protected]. Paul Marshall Professional Development Consultant Region 5 [email protected]. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Inter-Rater Reliability

Inter-Rater Reliability

CHCCS

November 13th 2012

Page 2: Inter-Rater Reliability

Today’s Presenters

Cynthia Martin, Ed.D.Professional Development

ConsultantRegion 3

[email protected]

Paul MarshallProfessional Development

ConsultantRegion 5

[email protected]

Page 3: Inter-Rater Reliability

PHI DELTA KAPPA International Research Bulletin

“The most powerful influence on students’ learning is the quality of the teacher.”

http://www.pdkintl.org/research/rbulletins/resbul27.htm

Ksas5532.eduldogs.org

Page 4: Inter-Rater Reliability

Outcomes

• Explore resources

• Explore the Evaluation Process

• Explore the relationship between Evaluation and Supervision

• Provide opportunity to participate in inter-rater reliability activity

• Provide updated information about Standard VI

Page 5: Inter-Rater Reliability

Wikicentral.ncdpi.wikispaces.net

Page 6: Inter-Rater Reliability

Additional Resources:• http://ncees.ncdpi.wikispaces.net

Page 7: Inter-Rater Reliability

7

Educator Effectiveness Website

Email specific questions about educator effectiveness to:

[email protected] from Microsoft online gallery

Page 8: Inter-Rater Reliability

Reflecting on Data

What trends do you see with your district’s or school’s data?How can you use this data/trends as a leader?http://www.ncpublicschools.org/docs/recruitment/effectiveness/680.pdf

These data represent only a portion of the educators employed by this local education agency. Not all teachers were evaluated during the 2010-2011. If the number of individuals in a school is fewer than 5, then results are shown as a N/A.

Page 9: Inter-Rater Reliability

Evaluation & Supervision

Describe the relationship between principal supervision and evaluation.

Page 10: Inter-Rater Reliability

Inter Rater Reliability

• http://www.youtube.com/watch?v=U6lrnAZxjiQ

• How did we rate this lesson?

• Anonymously enter response using Poll Everywhere

Page 11: Inter-Rater Reliability

Polleverywhere

• Please take out your cell phones

• Text 22333 to 193788

• This will welcome you to this session

• Once there, please text the letter or number that corresponds to your intended response for each element

Page 12: Inter-Rater Reliability

Element A

Page 13: Inter-Rater Reliability

Element B

Page 14: Inter-Rater Reliability

Element C

Page 15: Inter-Rater Reliability

Element D

Page 16: Inter-Rater Reliability

Element E

Page 17: Inter-Rater Reliability

Element F

Page 18: Inter-Rater Reliability

Element G

Page 19: Inter-Rater Reliability

Element H

Page 20: Inter-Rater Reliability

Reflection Activity

How do you ensure that the behaviors in the classroom align with the rating of the behaviors?

Solutions

Page 21: Inter-Rater Reliability

Standards 6 and 8

Incorporating

student growth into

the NC Educator

Evaluation System

Page 22: Inter-Rater Reliability

SBE Policy on Standard 6

• The Department of Public Instruction will complete the sixth and eighth standard ratings after the results of the 2011 – 2012 testing program have been finalized and approved by the State Board of Education, and the EVAAS value-added scores have been calculated.  This population should take place in late September 2012.

Page 23: Inter-Rater Reliability

• What Questions do you have?