Demonstration of Narrative Analysis Software (NVivo 7.0)

Lori Kurth and Fumiyo Tao

Abt Associates Inc.

Overview

• Quantitative and qualitative analysis of first year MSP reports

• Types of qualitative data• Method of qualitative analysis• Coding categories• Software demo• Developing models from analyses• Questions and comments

Quantitative and Qualitative Analyses

• Quantitative analyses for numerical Project Profile data

• Qualitative analyses of narrative data in Project Profiles and Project Narratives

• Preliminary quantitative analyses and some qualitative analyses from Project Profile data presented tomorrow

Types of Qualitative Data

• Attributes– Definable characteristics of a project (e.g.,

content area or grade span)

• Larger categories– Specific themes of PD activities and evaluation

(e.g., details of summer institutes or matched comparison evaluation design)

Method of Qualitative Analysis

• NVivo 7.0 software– Flexible coding of narrative data within specific

categories– Analyze data within and between categories

Coding Categories

*See Coding Tree handout (end of slides)

1 Description of Project

2 Characteristics of Professional Development

3 Project Evaluation

Software Demo

Developing Models from Analyses

Materials and assessments PD models

Questions and Comments

DRAFT Coding Tree - ED MSP APR Narrative Data

 1 Description of Project

1-1 Goals

1-1-1 Goals – Addl info

1-2 Abstract

1-3 Partners and their Roles/Providers

1-3-1 Partners and their Roles/Providers – Addl info

1-41-4 Other Information on Project (Including Budget, Schedule, Antic Outcomes, Dissem Plans, Innovative Activ, Lessons

Learned, Future Plans, etc)

1-5 Appendices

1-6 Great Quotes on Project

 2 Characteristics of Professional Development

2-1 Types of PD Activities and Structure

2-1-1 Summer Institutes

2-1-2 On-line Course Work

2-1-3 Distance Learning Networks

2-1-4 On-site Professional Learning Experience

2-1-5 Study Groups

2-1-6 Types of PD Activities and Structure – Addl info

2-2 Content

2-2-1 Math Content Only

2-2-2 Science Content Only

2-2-3 Math and Science

2-2-4 Other

2-2-5 Content – Addl info

2-3 Resource Development (including curric materials, use for states not implementing a PD program)

2-4 Needs of Districts/Participants (including basic info on participants and recruitment and retention issues)

2-4-1 Needs of Districts/Participants – addl info,including names, #s, etc.

2-5 Purposes of PD Activities

2-5-1 Train teacher leaders/mentors/coaches

2-5-2 Increase teacher content knowledge

2-5-3 Purpose of PD Activities – Addl Info

2-6 Other PD Information

2-7 Great Quotes on PD

DRAFT Coding Tree (continued)

ED MSP APR Narrative Data

3 Project Evaluation

3-1 Evaluation Design and Analysis Methods

3-1-1 Evaluation Design and Analysis Methods – Addl info

3-2 Student Assessments

3-2-1 Math State Assessment

3-2-2 Science State Assessment

3-2-3 Other Assessment

3-2-4 Student Assessments – Addl info

3-3 Teacher Assessments

3-3-1 Tchr Content Knowledge Assessment

3-3-2 Classroom Observation Protocol

3-3-3 Other

3-3-4 Teacher Assessments – Addl info

3-4 Student Findings

3-4-1 Student Findings - Addl info

3-5 Teacher Findings

3-5-1 Teacher Findings - Addl info

3-6 School-Level Findings

3-6-1 School-Level Findings - Addl info

3-7 Other Evaluation Information

3-8 Great Quotes on Evaluations