inter-rater reliability

Inter-Rater Reliability

CHCCS

November 13th 2012

Today’s Presenters

Cynthia Martin, Ed.D.Professional Development

ConsultantRegion 3

cynthia.martin@dpi.nc.gov

Paul MarshallProfessional Development

ConsultantRegion 5

paul.marshall@dpi.nc.gov

PHI DELTA KAPPA International Research Bulletin

“The most powerful influence on students’ learning is the quality of the teacher.”

http://www.pdkintl.org/research/rbulletins/resbul27.htm

Ksas5532.eduldogs.org

Outcomes

• Explore resources

• Explore the Evaluation Process

• Explore the relationship between Evaluation and Supervision

• Provide opportunity to participate in inter-rater reliability activity

• Provide updated information about Standard VI

Wikicentral.ncdpi.wikispaces.net

Additional Resources:• http://ncees.ncdpi.wikispaces.net

7

Educator Effectiveness Website

Email specific questions about educator effectiveness to:

educatoreffectiveness@dpi.nc.govImage from Microsoft online gallery

Reflecting on Data

What trends do you see with your district’s or school’s data?How can you use this data/trends as a leader?http://www.ncpublicschools.org/docs/recruitment/effectiveness/680.pdf

These data represent only a portion of the educators employed by this local education agency. Not all teachers were evaluated during the 2010-2011. If the number of individuals in a school is fewer than 5, then results are shown as a N/A.

Evaluation & Supervision

Describe the relationship between principal supervision and evaluation.

Inter Rater Reliability

• http://www.youtube.com/watch?v=U6lrnAZxjiQ

• How did we rate this lesson?

• Anonymously enter response using Poll Everywhere

Polleverywhere

• Please take out your cell phones

• Text 22333 to 193788

• This will welcome you to this session

• Once there, please text the letter or number that corresponds to your intended response for each element

Element A

Element B

Element C

Element D

Element E

Element F

Element G

Element H

Reflection Activity

How do you ensure that the behaviors in the classroom align with the rating of the behaviors?

Solutions

Standards 6 and 8

Incorporating

student growth into

the NC Educator

Evaluation System

SBE Policy on Standard 6

• The Department of Public Instruction will complete the sixth and eighth standard ratings after the results of the 2011 – 2012 testing program have been finalized and approved by the State Board of Education, and the EVAAS value-added scores have been calculated.  This population should take place in late September 2012.

• What Questions do you have?