using nsse in accreditation and quality improvement plans nsse user workshop october, 2005 jillian...

Using NSSE in Using NSSE in Accreditation and Accreditation and

Quality Improvement Quality Improvement PlansPlans

NSSE User NSSE User Workshop Workshop

October, 2005October, 2005

Jillian KinzieJillian Kinzie

NSSE InstituteNSSE Institute

OverviewOverview

• Introduction and Rationale for Using Introduction and Rationale for Using NSSE in AccreditationNSSE in Accreditation

• NSSE and Regional Accreditation NSSE and Regional Accreditation TimelinesTimelines

• Mapping NSSE to Accreditation Mapping NSSE to Accreditation StandardsStandards

• Institutional Examples Institutional Examples • Discussion of best practicesDiscussion of best practices• QuestionsQuestions

One of the most common institutional uses of NSSE data is for

accreditation.

But Why?

PublicPublicAccountabilityAccountability

ProspectiveProspectiveStudentsStudents

AccreditingAccreditingBodiesBodies

PerformancePerformanceIndicatorsIndicators

AlumniAlumni

Fund-Fund-raisingraising

Focus onFocus on““RightRight

Things”Things”

ParentsParentsMediaMedia

GoverningGoverningBoardsBoards

StateStatePolicyPolicyMakersMakers

Using NSSE for Public Using NSSE for Public Accountability:Accountability:

Introduction: Introduction: Using NSSE in AccreditationUsing NSSE in Accreditation

• Accreditation agencies de-Accreditation agencies de-emphasize indicators of emphasize indicators of institutional resources, and institutional resources, and mandate evidence of student mandate evidence of student learninglearning

• Regional and discipline-specific Regional and discipline-specific standards encourage use of data standards encourage use of data in ongoing, strategic reviews of in ongoing, strategic reviews of institutional effectiveness and institutional effectiveness and improvement plansimprovement plans

Rationale for Using NSSE Rationale for Using NSSE in Accreditationin Accreditation

• Measures effectiveness in key Measures effectiveness in key areas of interestareas of interest

• Systematically identifies areas of Systematically identifies areas of strength and needs for strength and needs for improvementimprovement

• Serves as example of Serves as example of documenting assessment effortsdocumenting assessment efforts

Rationale for Using NSSE Rationale for Using NSSE in Accreditation, cont’d in Accreditation, cont’d

• Enables institutions to benchmark Enables institutions to benchmark against similar and aspirational against similar and aspirational peer comparison groupspeer comparison groups

• Results reveal widely held Results reveal widely held assumptions about students and assumptions about students and how they use institutional how they use institutional resources to enhance learningresources to enhance learning

• Results are accessible and Results are accessible and understandable by various internal understandable by various internal and external stakeholdersand external stakeholders

Using NSSE in AccreditationUsing NSSE in Accreditation

• NSSE as evidenceNSSE as evidence– Provides student learning process and Provides student learning process and

outcomes indicators outcomes indicators – BenchmarkingBenchmarking– Participation in survey demonstrates Participation in survey demonstrates

ongoing evaluation, institutional ongoing evaluation, institutional improvement, and effectiveness activitiesimprovement, and effectiveness activities

• NSSE in quality improvement effortsNSSE in quality improvement efforts– Catalyst for institutional actionCatalyst for institutional action– Guide for improvement planGuide for improvement plan– Baseline and outcomes measures to assess Baseline and outcomes measures to assess

improvementimprovement

Types of MeasuresTypes of Measures

Outcomes measuresOutcomes measures

-- Evidence of what -- Evidence of what students have students have

learned or learned or can do can do Process MeasuresProcess Measures

-- Evidence of effective -- Evidence of effective educational activity by educational activity by students and students and institutionsinstitutions

BenchmarkingBenchmarkingTwo Approaches:Two Approaches:• NormativeNormative - compares your students’ - compares your students’

responses to those of students at responses to those of students at other colleges and universities. other colleges and universities.

• CriterionCriterion - compares your school’s - compares your school’s performance against a performance against a predetermined value or level predetermined value or level appropriate for your students, given appropriate for your students, given your institutional mission, size, your institutional mission, size, curricular offerings, and so forth. curricular offerings, and so forth.

• LongitudinalLongitudinal – compare you – compare you student’s scores over timestudent’s scores over time

NSSE Accreditation Tool-kitNSSE Accreditation Tool-kit

1.1. Background information on Background information on using student engagement using student engagement in accreditationin accreditation

2.2. Customized to each of the Customized to each of the six regional accrediting six regional accrediting bodies bodies

3.3. Complete map of NSSE items Complete map of NSSE items to accreditation standardsto accreditation standards

4.4. Vignettes from other Vignettes from other institutions on using NSSE in institutions on using NSSE in accreditationaccreditation

National Survey of Student Engagement

AccreditationTool-kit

Guide to help maximize use of NSSE data for accreditation

NSSE and Regional NSSE and Regional Accreditation TimelinesAccreditation Timelines

EXAMPLE: Standard Reaffirmation SACS – EXAMPLE: Standard Reaffirmation SACS – 10 year cycle10 year cycle• Years 1-4Years 1-4 Preplanning: Review accreditation principles, past Preplanning: Review accreditation principles, past

reaffirmation materials; prepare Impact Report; reaffirmation materials; prepare Impact Report; Register for & Register for & administer NSSE (1 or 2 times) to assess institutional effectiveness administer NSSE (1 or 2 times) to assess institutional effectiveness and impact [ex. NSSE years 3 & 4]and impact [ex. NSSE years 3 & 4]

• Year 5Year 5 Impact Report due from previous reaffirmationImpact Report due from previous reaffirmation

Consider additional NSSE administration (or other assessment tools)Consider additional NSSE administration (or other assessment tools)• Year 7Year 7 Orientation of Accreditation Leadership TeamOrientation of Accreditation Leadership Team

Use NSSE results as evidence for Compliance and to identify areas Use NSSE results as evidence for Compliance and to identify areas for institutional engagement and reflection in the QEP for institutional engagement and reflection in the QEP

• Year 8Year 8 Compliance Certification due; off-site peer review Compliance Certification due; off-site peer review • Year 9 Year 9 Quality Enhancement Plan dueQuality Enhancement Plan due• Year 10Year 10 Reaffirmation decisionReaffirmation decision

NSSE administration to demonstrate impact of QEP [NSSE year NSSE administration to demonstrate impact of QEP [NSSE year following full implementation of QEP goals, no later than year 13]following full implementation of QEP goals, no later than year 13]

• Year 15Year 15 Impact Report dueImpact Report due


• Short CycleShort Cycle– Due in less than three years?Due in less than three years?

• Year one – administer NSSEYear one – administer NSSE• Years two and three – review and share NSSE Years two and three – review and share NSSE

results with internal and external stakeholdersresults with internal and external stakeholders

• Long CycleLong Cycle– Seven to Ten Year CycleSeven to Ten Year Cycle

• Year one or two – administer NSSEYear one or two – administer NSSE• Year three or four – administer NSSEYear three or four – administer NSSE

– Allows time to implement assessment results, Allows time to implement assessment results, review impactreview impact


• Coming up for Reaffirmation in a Coming up for Reaffirmation in a Year or Two?Year or Two?September - register for NSSESeptember - register for NSSESpring - NSSE administeredSpring - NSSE administeredAugust - results availableAugust - results availableUse the information as a baseline Use the information as a baseline

for areas of strength and for areas of strength and improvementimprovement

Accreditation Timeline Accreditation Timeline ConsiderationsConsiderations

• Plan to administer NSSE once, Plan to administer NSSE once, and perhaps twice, to establish and perhaps twice, to establish baseline databaseline data

• Develop a communication plan for Develop a communication plan for disseminating data to internal disseminating data to internal and external audiences and keep and external audiences and keep them abreast of progressthem abreast of progress– websites, annual reports, websites, annual reports,

presidential speeches, retreats, presidential speeches, retreats, student organizations, etc.student organizations, etc.

Developing “Actionable” Plans Developing “Actionable” Plans NSSE and AccreditationNSSE and Accreditation

• The “Actionable” PlanThe “Actionable” Plan– 2003: register for NSSE2003: register for NSSE– 2004: administer NSSE (Spring)2004: administer NSSE (Spring)– 2004- 05: review NSSE results; developed 2004- 05: review NSSE results; developed

action plan and area of focusaction plan and area of focus– 2005: attend Summer Academy, 2005: attend Summer Academy, – 2005-06: refine and implement the action 2005-06: refine and implement the action

planplan– 2006: register for 2007 NSSE (to assess action 2006: register for 2007 NSSE (to assess action

plan area of focus) plan area of focus) – 2007: administer NSSE, determine impact of 2007: administer NSSE, determine impact of

changes on area of focuschanges on area of focus

• What Cycle has worked for your What Cycle has worked for your campus??campus??

Mapping NSSE to Accreditation Mapping NSSE to Accreditation StandardsStandards

• Begin with an audit of evaluation Begin with an audit of evaluation practices and extant data that can be practices and extant data that can be used for accreditationused for accreditation

• Always use multiple sources of dataAlways use multiple sources of data• NSSE can be linked as evidence of NSSE can be linked as evidence of

meeting certain accreditation meeting certain accreditation standardsstandards

• NSSE is most meaningful when NSSE is most meaningful when coupled with other forms of formative coupled with other forms of formative and summative evaluationand summative evaluation

NSSE Items Mapped to NSSE Items Mapped to HLC – NCA CriteriaHLC – NCA Criteria

2005 NSSE Questions HLC

1.a. Asked questions in class/contributed to class discussion

3c, 4b

1.b. Made a class presentation 3c, 4b

1.e. Included diverse perspectives in class discussions or writing assignments

1c, 2a, 3b, 3c, 4c, 4d

3. To what extent have exams during the current year challenged you to do your best work?

3a, 3b, 4b

NCA Accreditation Standards

1c Understanding of and support for the mission pervade the organization.

1e The organization upholds and protects its integrity.

NSSE Items Mapped to NSSE Items Mapped to HLC – NCA CriteriaHLC – NCA Criteria

2005 NSSE Questions HLC

8.b. How would you rate the quality of your relationships with faculty members?

3b, 4a, 4c, 5c

10.b. To what extent does your institution emphasize providing support you need to help you succeed academically?

2b, 3d, 4d

11.e. To what extent has your experience at this institution contributed to your skills at thinking critically and analytically?

3b, 3c, 4b, 4d

12. Overall, how would you rate the quality of academic advising you have received at your institution?

3d, 4d, 5c, 5d

Using NSSE for Accreditation: Using NSSE for Accreditation: Institutional ExamplesInstitutional Examples

North Central AssociationNorth Central Association• Lawrence Technological UniversityLawrence Technological University

• Improvement plan included NSSE Improvement plan included NSSE results which indicated a need to more results which indicated a need to more closely study the types and amounts of closely study the types and amounts of required writingrequired writing

• University of Missouri-St. LouisUniversity of Missouri-St. Louis• Self-study included 2000 – 2004 NSSE Self-study included 2000 – 2004 NSSE

results to support evidence of results to support evidence of compliance with life-long learningcompliance with life-long learning


Northwest Commission on Northwest Commission on Colleges and UniversitiesColleges and Universities• Southern Utah UniversitySouthern Utah University

• Used NSSE 2001 and 2002 results to Used NSSE 2001 and 2002 results to develop self-study for 2003 discipline-develop self-study for 2003 discipline-specific accreditationspecific accreditation

• Portland State UniversityPortland State University• Used online portfolio, filled with bar Used online portfolio, filled with bar

graphs, to depict peer and aspirational graphs, to depict peer and aspirational comparisonscomparisons


Middle States Commission on Higher Middle States Commission on Higher EducationEducation

• Saint Francis UniversitySaint Francis University– NSSE data were used to foster NSSE data were used to foster

academically innovative measures that academically innovative measures that reflected essential skills indicated in reflected essential skills indicated in MSA’s Standard 12 (general education)MSA’s Standard 12 (general education)

• Shippensburg UniversityShippensburg University– NSSE data were included in the NSSE data were included in the

accreditation report to demonstrate accreditation report to demonstrate compliance with emphasis on ongoing compliance with emphasis on ongoing planning and utilization of assessment for planning and utilization of assessment for institutional renewal (MSA’s Standard 2)institutional renewal (MSA’s Standard 2)


Southern Association of Colleges and Southern Association of Colleges and Schools (SACS)Schools (SACS)

• Radford UniversityRadford University– NSSE 2001 – 2003 results were used to NSSE 2001 – 2003 results were used to

develop the QEP around student develop the QEP around student engagement and higher levels of engagement and higher levels of performance and learning performance and learning

• Agnes Scott CollegeAgnes Scott College– Used results from 2002 and 2003 Used results from 2002 and 2003

administrations to frame QEP and will administrations to frame QEP and will administer NSSE in 2006 to assess impact administer NSSE in 2006 to assess impact of improvement initiatives in the first of improvement initiatives in the first year experienceyear experience


Western Association of Schools and Western Association of Schools and Colleges (WASC)Colleges (WASC)

• California State University, Monterey California State University, Monterey BayBay– NSSE results included as an electronic NSSE results included as an electronic

appendix to a supportive essay submitted appendix to a supportive essay submitted for the Educational Effectiveness Review for the Educational Effectiveness Review (Standard 2.5)(Standard 2.5)

• Chapman UniversityChapman University– Used NSSE to illustrate academic Used NSSE to illustrate academic

programs were designed to facilitate programs were designed to facilitate student learning outcomesstudent learning outcomes

NSSE and Accreditation NSSE and Accreditation Final ThoughtsFinal Thoughts

1.1. Results are one direct indicator of what Results are one direct indicator of what students put into their education and an students put into their education and an indirect indicator of what they get outindirect indicator of what they get out

2.2. Items can be used to appraise Items can be used to appraise effectiveness of mission fulfillmenteffectiveness of mission fulfillment

3.3. Data are actionable and easily understood Data are actionable and easily understood by internal and external constituentsby internal and external constituents

4.4. Share data widely Share data widely 5.5. Use FSSE to identify areas of strength and Use FSSE to identify areas of strength and

to stimulate discussions related to to stimulate discussions related to improving teaching and learningimproving teaching and learning

Discussion and CommentsDiscussion and Comments

NSSE InstituteNSSE Institute

Indiana University Center Indiana University Center for Postsecondary for Postsecondary ResearchResearch

1900 East 10th Street1900 East 10th Street

Eigenmann Hall, Suite 419Eigenmann Hall, Suite 419

Bloomington, IN 47406 Bloomington, IN 47406

Ph: 812-856-5824Ph: 812-856-5824

Fax: 812-856-5150Fax: 812-856-5150

[email protected] [email protected]

www.iub.edu/~nsse


EXAMPLE: Standard Reaffirmation WASC – EXAMPLE: Standard Reaffirmation WASC – 10 year cycle10 year cyclePreplanning: Preplanning: Register for and administer NSSERegister for and administer NSSEUse NSSE to identify areas for institutional engagement and Use NSSE to identify areas for institutional engagement and reflection in the proposal and reviewreflection in the proposal and review

• Year 1Year 1 Proposal approvedProposal approved• Year 1 & 2 Analyze NSSE results, incorporate into Capacity and Year 1 & 2 Analyze NSSE results, incorporate into Capacity and

Prep. Review, demonstrate use of results to improve practicePrep. Review, demonstrate use of results to improve practice

• Year 3 Year 3 Capacity and Preparatory review Capacity and Preparatory review Possible second NSSE administration to use in the Educational Possible second NSSE administration to use in the Educational Effectiveness ReviewEffectiveness Review

• Year 4 Year 4 Educational effectiveness reviewEducational effectiveness review• Year 9 Year 9 Preparing for new proposal or possible Special VisitPreparing for new proposal or possible Special Visit

Register for and administer NSSE to demonstrate ongoing Register for and administer NSSE to demonstrate ongoing review or change based on improvement planreview or change based on improvement plan

• Year 10 Year 10 Progress report or new proposal submittedProgress report or new proposal submitted


New England Association of Schools and New England Association of Schools and Colleges (NEASC)Colleges (NEASC)

• Gordon CollegeGordon College– Used NSSE results as evidence of learning Used NSSE results as evidence of learning

outcomes and general education outcomes and general education achievements (NEASC 4.19)achievements (NEASC 4.19)

• Plymouth State UniversityPlymouth State University– Used NSSE as evidence of institutional Used NSSE as evidence of institutional

assessment activities (NEASC Standard assessment activities (NEASC Standard Two) in combination with other sources of Two) in combination with other sources of datadata

using nsse in accreditation and quality improvement plans nsse user workshop october, 2005 jillian...

Documents

accreditation nsse

institutional improvement

effectiveness activities

improvement plansregional

external stakeholders

institutional action

improvement plan baseline

process measures