Program Assessment ModelUniversity of Miami

ASILA AL HASHIMINARJIS AL HANAI

Assessment Process

Academic programs Administrative unitsGeneral Education Assessment

Why ?

Ensures student learning .The Educational and support efforts

effectiveness.

Assessment Cycle at the U

Implement Change(Improvement Strategies)

Assess & Collect Data

Define Outcomes & Measures

Analyze Findings & Develop Improvement Strategies

Academic Program Assessment

What …

Program Outcomes Student Learning Outcomes

Program Outcome

What

• It’s Relation to the structure, administration, and support services.

• .Meet institutional, regional, and accreditation/assessment expectations

Why• improve the quality of the programs as a whole.

Example

• enrollment trends, admission selectivity, graduation rates, publications by faculty/students, selected items from student satisfaction surveys, and job placement.

How can I make this program more efficient?

Student Learning Outcomes

What• How well students are learning. • Knowledge, skills, values, and behaviors.

How

• Teaching effectiveness• Curriculum design• Academic support services.

Why• To develop specific strategies

Example

• knowledge of the discipline ,use of technology, critical thinking, and written/oral communication skills.

What should students know or be able to do by the time they graduate?

Specific Is the

expected behavior

and/or skill clearly

indicated?

Measureable Can the student learning outcome

be measured?

Attainable Is it viable given the program courses

and resources?

Relevant Does it pertain to the major goals of

the program?

Timely Can

graduates achieve

the outcome prior to

graduation?

Student Learning Outcomes

Program Outcomes (efficiency measures)

Related to program level goals, not to student learning

One Useful Strategy for Assessment

Curriculum Mapping

Curriculum maps help identify where the learning outcomes are addressed within the curriculum and provide a means to determine whether the

elements of the curriculum are aligned

Planning

Curriculum Learning Outcomes

Identifying

Gaps ImprovementAreas Measures

Tying Outcomes to Curriculum: Curriculum Maps

Make Changes as AppropriateIf there are any gaps in teaching or assessing learning outcomes

Create a Curriculum MapCourses in one axis and learning outcomes in the other

Identify Major Assignments within CoursesDiscuss how accurately they measure the learning outcomes

Collaborate with Faculty and Staff MembersDetermine where the outcomes are introduced, practiced, developed, and assessed within each of the required courses

Collect All Relevant or Required InformationCourse syllabi, curriculum requirements, and major learning competencies

Assessment

Assessment Report

• State the assignment / artifact being assessed

• Include when, how often and how data is collect data

• Describe the instrument are used to assess

• Include the sample assessed (all students, percentage, random)

Understanding Types of Measures

• Direct Measure: • Learning assessed by instructors or reviewers.• Determining if students have learned competencies as

defined in outcomes

• Indirect Measure: • Self-assessments of learning• provide details that may help a program understand

how students think

Understanding Types of Measure

• Program Measure: • Provides data at the program level • Exit exams and graduation surveys

• Course Measure: • Provides data at the course level• Competencies achieved • Final projects/presentations and pre-post exams

Examples of Measures

Direct Measures• Standardized exams• Exit examinations• Portfolios • Pre-tests and post-tests• Locally developed exams• Papers• Oral presentations• Behavioral observations• Thesis/dissertation• Simulations/case studies• Video taped/audio taped

assignments

Indirect Measures• Dept. Surveys or

questionnaires• Student perception• Alumni perception• Employer perception

• Focus groups• Interviews• Student evaluations• Course evaluations• University Surveys (e.g.,

GSS, GMS)

Examples of Measures

Course Level

•Essays•Presentations•Minute papers•Embedded questions•Pre-post tests

Program Level

•Portfolios•Exit exams•Graduation surveys •Discipline specific national exams (e.g., Law, FTCE, Dietetics, Medical)

The End