assessing institutional effectiveness

An initiative of the Research & Planning Group

for California Community Colleges

Assessing Institutional Effectiveness

An RP Group initiative funded by the Hewlett FoundationFall 2010



Background & Description



Background

Institutional effectiveness generally refers to the extent to which a college achieves its mission, as expressed through the goals and objectives developed in a strategic or master plan.

Includes aggregated student and institutional data on major college milestones and indicators.

Program review, planning and SLO assessment are all part of institutional effectiveness.

Pg. 5 – Background



AACC Core Indicators● Student goal attainment Persistence (fall to fall) Degree completion rates Placement rate in the work force Employer assessment of students Number and rate of transfers Performance after transfer Success in subsequent, related coursework Demonstration of critical literacy skills Demonstration of citizenship skills Client assessment of programs and services Responsiveness to community needs Participation rate in service area




League for Innovation 5 major missions: Basic skills Transfer Career preparation Continuing education and community service Access Suggested operational definitions, questions to be

answered, and data sources.




ACCJC Standards

Program Review Planning Student Learning Outcomes rubrics for identifying the maturity of a college’s

development in those three areas




AACC Voluntary Framework of Accountability

Student Progress and Outcomes College Readiness Progress Outcomes and SuccessesWorkforce, Economic, and Community Development● Career and Technical Education Non-credit courses Adult Basic Education/GED




AACC Voluntary Framework of Accountability

Student Learning Outcomes Analytical reasoning and critical thinking Communication (ability to speak, read, write, and

listen) Innovative and creative thinking Quantitative literacy Information literacy Teamwork and collaborative skills Global Understanding and citizenship Content/career specific skills and knowledge




National Benchmark ProjectStudents and Student Outcomes Certificate, degree completion, and transfer rates Fall-spring and fall-fall persistence rates Performance in transfer institutions Student satisfaction and engagement ratings Educational goal attainment College-level course retention and success rates Developmental course retention and success rates Developmental student success in first college-

level courses




National Benchmark ProjectStudents and Student Outcomes Career program completers' employment status

and employer ratings Success rates in core academic skill areas Institution-wide grade information Participation rates High school graduate enrollment rates Distance learning outcomes Distance learning sections and grade distributions




Program and Services



Program Review Process

Pg. 18– Components & Strategies



Outcomes Reporting



Balance Scorecard Approach

Measured strategies are well communicated

Critical performance indicators 2-3 multiple measures each

Lead and Lag indicators View from “30,000 feet” Cascading scorecards




Examples of IE Approaches

National Approach: AACC’s Voluntary Framework of Accountabi l i ty

h t t p : / / w w w. a a c c . n c h e . e d u / R e s o u r c e s / a a c c p r o g r a m s / v f a / D o c u m e n t s / V FA% 2 0 P r e l i m i n a r y % 2 0 Te c h n i c a l % 2 0 D e fi n i t i o n s % 2 0 M a n u a l % 2 0 v _ 1 _ 1 . p d f

Defi ning IE by Ut i l i z ing ARCC Measures : Long Beach C i ty Co l lege

http : / /www. lbcc .edu/ IE /documents /fi nal _ IE_2010_Report_9_13_10 .pdf

Defi ning IE Loca l l y and maximiz ing presentat ion : Vic tor Va l ley Co l lege

http : / /www. lbcc .edu/ IE /documents /fi nal _ IE_2010_Report_9_13_10 .pdf

http://www.lbcc.edu/IE/documents/final_IE_2010_Report_9_13_10.pdf

National Approach: AACC’s Voluntary Framework of Accountabi l i tyh t t p : / / w w w. a a c c . n c h e . e d u / R e s o u r c e s / a a c c p r o g r a m s / v f a / D o c u m e n t s / V FA% 2 0 P r e l i m i n a r y % 2 0 Te c h n i c a l % 2 0 D e fi n i t i o n s % 2 0 M a n u a l % 2 0 v _ 1 _ 1 . p d f

Defi ning IE by Ut i l i z ing ARCC Measures : Long Beach C i ty Co l legehttp : / /www. lbcc .edu/ IE /documents /fi nal _ IE_2010_Report_9_13_10 .pdf

Defi ning IE Loca l l y and maximiz ing presentat ion : Vic tor Va l ley Co l legehttp : / /www. lbcc .edu/ IE /documents /fi nal _ IE_2010_Report_9_13_10 .pdf

National Approach: AACC’s Voluntary Framework of Accountabi l i tyh t t p : / / w w w. a a c c . n c h e . e d u / R e s o u r c e s / a a c c p r o g r a m s / v f a / D o c u m e n t s / V FA% 2 0 P r e l i m i n a r y % 2 0 Te c h n i c a l % 2 0 D e fi n i t i o n s % 2 0 M a n u a l % 2 0 v _ 1 _ 1 . p d f

Defi ning IE by Ut i l i z ing ARCC Measures : Long Beach C i ty Co l legehttp : / /www. lbcc .edu/ IE /documents /fi nal _ IE_2010_Report_9_13_10 .pdf

Defi ning IE Loca l l y and maximiz ing presentat ion : Vic tor Va l ley Co l legehttp : / /www.vvc .edu/off ices /pres ident /VVCCD_AR_Communi ty_2009_FINAL.pdf

http://www.aacc.nche.edu/Resources/aaccprograms/vfa/Documents/VFA%20Preliminary%20Technical%20Definitions%20Manual%20v_1_1.pdf

















http://www.vvc.edu/offices/president/VVCCD_AR_Community_2009_FINAL.pdf

http://www.vvc.edu/offices/president/VVCCD_AR_Community_2009_FINAL.pdf



Examples of IE Approaches

The Minimal i s t Approach (Less i s More) : Fu l ler ton Co l lege

http : / / research . fu l l co l l .edu/

Defi ning IE as Achiev ing Strateg ic P lanning Goals : Los Medanos Co l lege

Defi ning IE as Achiv ing the Miss ion o f the Co l lege : Santa Rosa Junior Co l lege


http://research.fullcoll.edu/




Dialogue



Data Integration Strategy Matrix


•Website postings•Research Committee Newsletter

•Action Research Teams•College Research Committee Facilitations•Sharing of Actions Taken on Data

•Informational Sessions•Presentations•Technical Assistance Meetings

•Facilitated Briefings•Data Integration Workshops•Research & Assessment Workshops•Research Agenda Development

SC

OP

E

IMPACT

High

Low

High Low



RP Group Websitewww.rpgroup.org

BRIC TAPhttp://www.rpgroup.org/projects/BRIC.html

Rob Johnstone, BRIC Project [email protected]

Kathy Booth, RP Group Executive [email protected]

Priya Chaplot, BRIC Project [email protected]

Find Out More!

http://www.rpgroup.org/

http://www.rpgroup.org/projects/BRIC.html

mailto:[email protected]





BRIC TAP Inquiry Guide SeriesBRIC TAP Inquiry Guide Series

1. Assessing Student Learning Outcomes

2. Assessing Strategic Intervention Points in Student Services

3. Assessing Institutional Effectiveness

4. Assessing Student Equity

5. Assessing Basic Skills Outcomes

6. Maximizing the Program Review Process

7. Turning Data into Meaningful Action

8. A Model for Building Information Capacity and Promoting a Culture of Inquiry

9. Research and Assessment for Non-credit Institutions

http://www.rpgroup.org/content/BRIC-inquiry-guides

http://www.rpgroup.org/content/BRIC-inquiry-guides