DeterminingYour Organization’s Value

Jane S. HalonenUniversity of West Florida

A Consultation with Association of College Honor Societies

February 7, 2014

“Assessment” and dessert may not be a good mix

High Risk Luncheon Talk

Postmodern life in higher education requires ◦ Continuous

improvement◦ Performance

standards◦ Assessment of

impact◦ Benchmarking

Why bother (in general)?

Postmodern Assessment Drivers

Legislative Mandates (e.g., Florida’s ALCs)Institutional Accreditation (e.g., SACS)Program-specific Accrediting Organizations Internal Practices (e.g.,QEPs)Institutional Budgeting & PlanningAcademia need to control its destinyDo the Right Thing for the Right Reason

Postmodern Assessment Climate • Formal standards have been emerging in disciplines for the past decade • Co-curriculum not quite under the same mandate, but organizations recognize “positioning” for resources and profile

Never doubt that a small groupof thoughtful committed people can change the world. Indeed, it is the only thing that ever has.

~Margaret Mead

◦ Continuous improvement helps maintain vigor

◦ Communication of great results builds pride and development potential

◦ Honors organizations uniquely positioned to provide elevator success stories to key campus figures

Why bother (in specific)?

Strive to help campus catch “good-to-great” disease

Need good stories with good evidence of quality for PR and “advancement”

College Officials

Taxonomy of Faculty Reactions to Assessment

Faculty NotAlways Thrilled

Session 1: Put assessment of honors organizations in

context Identify relevant assessment dimensions of

target performanceSession 2: Design strategies to optimize evidence of

quality and impact strategicallyOverall: Move your taxonomic status in a positive

direction

Goals for Today:

Time Out for Some Reminiscing…

• Why is the existence of an honors program important?• To the honoree (and significant others)• To the chapter administration• To the campus• To the host community• To the parent organization

Critical Questions Driving Assessment Decisions

What impact did your own honor society experience have on your development?

And as a warm up for Session 2: What tangible evidence would help

“capture” that impact?

In pairs, trios, or tables

• Higher caliber students for entire campus• Retention 6/year persistence rate often much higher for Honors• Intellectual and social enrichment of the campus• Social enrichment of the community through service• Personalized attention (the small College within the large university feel)• Community of like-minded individuals• Donation and development opportunities• A constant source of exemplary student performance • Faculty/student interactions/mentoring opportunities• Student Leadership & involvement on campus• Active and effective alumni base

Overall Value of an Honors Society

Why should Honors be funded? (Or be worthy of any other campus resource)?

What kind of evidence makes a compelling case?

What strategies can promote success?

Critical Questions Driving Assessment Decisions

Leadership Transience Student Caliber Variability Size of Chapter Scope of Effort (recognition only or larger

scope?) Motive for Measurement (requirement,

growth, or recognition?) Level of Analysis

The Challenges of Applying Evidence Strategies to Honors Organizations

Student Growth Advisor Quality Chapter Quality Board Quality Society Quality Society Leadership Quality

(you can begin to see out assessment possession

is within reach…)

Level of Analysis

Many of you are engaged in evidence generation already in response to◦ Campus reporting requirements◦ Chapter annual reports

But is your evidence of quality --pro forma or compelling?

--efficient or time intensive? --read by anyone but the evidence gatherer?

“And the Survey Says…”

Campus Profile ◦ yours versus other honor societies on campus

National Profile ◦ yours versus other chapters in the honor society

The Big Question:Does ACHS wish to invest in distinguishing

high quality performers from just functional ones?

Benchmarking Adventures

Seems like a good point for a break..

On return, we will --briefly discuss value of rubrics--organize by chapter size to share strategies that are most effective

Session 2:Finding and UsingEffectiveness Evidence

Let’s get started…

Methods Best Suited to Honor Societies

DIRECT MEASURES

Archival Data◦ Induction Numbers◦ Attendance Figures◦ Scheduled Events◦ $ Raised◦ # of Collaborations◦ # Service Projects

Performance Rubrics

INDIRECT MEASURES

Satisfaction Surveys◦ Inductees◦ Parents◦ Faculty in Related

Discipline◦ Service Learning

Beneficiaries

Reflection Papers

Handouts provide existing strategies already in play

Rubric Exemplars

Share ideas about what works well in evidence gathering what new directions might be optimal communication strategies that exploit gains

Scribe needed to capture key ideas.Spokesperson needed to provide report.

At your table

Keep it SIMPLE!

--feasible --manageable --transparent --measurable

Whatever you decide…

What do the data say about the strength and weaknesses of your target?

How can we capitalize on the strengths (showcase activities)?

How can we redress areas of weakness? What challenges inhibit performance?

Closing the Loop:The Assessment Cycle

Set improvement goals at a static but reasonable level? (e.g., 1% improvement over last year’s metrics)

Compare your achievements to other comparable groups

(this is where a bold move on ACHS’ part could help capture attention…)

Gauging Progress through Benchmarking

ACHS could provide a “seal” of exemplary performance for honor societies that would

--increase ACHS profile with campus administrators--provide shorthand for high quality

performance--potentially increase interest in getting more

ACHS members of high caliber on campus

Exemplary Chapter Status

Time to Evaluate this Session

Take a moment and write down the most important insight gained from our time together.

Estimate how likely you are to make a change.

Identify where you are taxonomically.

ASSESSMENT HOSTILE RESISTANT NEUTRAL ENTHUSED ENERGIZED POSSESSED

Thanks for coming. [especially with Bourbon Street

calling your name] jhalonen@uwf.edu

Questions or Comments?