The Program Learning Outcomes Review Process

A Summary of the Procedure

for the Evaluation and Improvement of Program Effectiveness

in Relation to General Education and Program Learning Outcomes

for Division Directors and Program Supervisors

Office of Institutional Planning and Assessment Northeast Alabama Community College

July 2015

ii

Northeast Alabama Community College Office of Institutional Planning and Assessment and SACSCOC Accreditation Liaison Brad Fricks, Director Lynde Mann, Secretarial Assistant July 2015

iii

Contents

Summary of Procedures 1 Guidelines for Completing Effective Reviews 5 Instructions for Annual Submission of Completed Reviews 11 Listing of General Education and Program Learning Outcomes 15

iv

Reserved

1

Summary of Procedures

2

Reserved

3

Summary of the Program Learning Outcomes (PLO) Review Process

The review of general education and program learning outcomes for any given academic year will be limited to fall and spring semesters, with the exception of those courses taught only during the summer of the specified review year. The review year is made up of the fall, spring, and PREVIOUS summer semester.

Fall and Spring Semesters

Division Director/Program Supervisor Responsibility Beginning of semester:

Remind the faculty who teach courses in which PLO assessments are embedded of the PLO review process.

Orient any instructors new to the process.

Announce deadline for PLO Form submission to your office (same as deadline for submission of final grades).

End of semester:

Review each instructor’s PLO Form in a timely manner.

Obtain necessary revisions from instructors.

Collate evaluations for each PLO assessment, noting any suggested improvements to be made to program delivery.

Discuss results of evaluations with faculty as needed.

Send completed PLO Forms to the Office of Institutional Planning and Assessment through the OIPA Shared Folder. The deadline for submission of PLO Forms to OIPA will be two weeks into the next semester.

Instructor Responsibility Beginning of semester:

Review syllabus in order to ensure a thorough PLO evaluation. End of semester:

All instructors teaching a course in which a PLO assessment is embedded must individually complete a PLO Form. Instructors document the results of the assessments of the outcomes and explain how these results may be used to improve the program.

4

Summer Semester Instructor Responsibility Any courses taught only during the summer semester of the review year are to be evaluated. Follow the same procedure as for fall and spring semesters. General education and program outcomes assessed in courses during the fall and/or spring semesters are not evaluated during the summer. Division Director/Program Supervisor Responsibility During the summer semester:

Collate the PREVIOUS summer, fall and spring evaluations for each PLO assessment.

Compile the data to determine the degree to which general education and program learning outcomes have been met and the degree to which instructors have formulated acceptable plans to improve the program(s).

Meet with instructors to discuss changes in program delivery to improve student attainment of program learning outcomes

Complete the RESULTS OF EVALUATION and IMPROVEMENTS columns on the Unit Goals (Program Outcomes) form.

At the end of summer semester: Follow the same procedure for general education and program learning outcomes evaluated during the summer semester. (These outcomes will be reported on the Unit Goals/Program Outcomes form for the following academic year.)

Submission of Completed Reviews by the Division Director/Program Supervisor

Deadline: Last Friday in July (specific date determined by the Office of Institutional Planning and Assessment).

Completed reviews include all PLO Forms and the completed Unit Goals (Program Outcomes) forms. These will be submitted to the Office of Institutional Planning and Assessment through the OIPA Shared Folder found on your computer desktop.

Approval of completed reviews:

Reviews are checked by the Director of Institutional Planning and Assessment, who recommends approval by the Student Learning Outcomes Committee.

Incomplete or incorrect forms will be returned to the director/supervisor for revision.

5

Guidelines:

Completing Effective Reviews

6

Reserved

7

Guidelines for Completing Effective Reviews:

Improving PLO Forms

Evaluation of General Education & Program Learning Outcomes

The following information is intended to assist instructors in producing completed forms that fulfill the purpose of the review process and present the results in a uniform format. Purpose of General Education and Program Learning Outcomes Reviews The purpose of the evaluation of general education and program learning outcomes is to ensure that the general education outcomes and program learning outcomes are being attained by students in their program of study. The general education outcomes and program learning outcomes to be assessed and the methods employed to assess each stated outcome in any given course are included in the course syllabus. Course Review Schedule Course reviews for each academic year are to be completed during the fall and spring semesters, with the exception of those courses taught only during the summer of the specified review year.

8

PLO Form (to be completed by instructors at the end of each semester, as appropriate) Each instructor must complete an independent evaluation of student attainment of program learning outcomes. A separate form must be completed for each mode of delivery (dual enrollment, online, and traditional). All instructors, both full-time and adjunct, are required to evaluate the program learning outcomes embedded in their courses. Column 1: General Education/Program Learning Outcome This column specifies the outcome that is to be assessed. Column 2: Institutional Evaluation Method and Benchmark This column specifies the manner in which the outcome will be assessed. Column 3: Evaluation Results—Of the students who completed the assessment, how many demonstrated attainment of the stated outcomes (for example, 22/28, 19/28, etc.). Do not give a narrative. Only list the raw numbers of students who successfully demonstrated attainment of the outcome compared to the number who completed the assessment. Note that this is different than in previous years. The bottom number in the fraction is the number who completed the assessment (not the number who made a C in the course or who completed the course). Column 4: Suggested Improvements—Based on an analysis of the evaluation results, what improvements can be made in the program? The Suggested Improvements column is the most vital part of this process. First, we evaluate. Then, we study the results and determine how we can improve the program in order to improve the general education outcomes/program learning outcomes that are assessed in the course.

Do not leave this section blank. In many cases, even for 100% attainment, an instructor realizes that improvements in the program should be made. Do NOT describe how you think the evaluation should change. You MUST suggest ways that program delivery/instruction can be improved. Each proposed improvement must be specific and detailed. Vague notations such as spending more time on a topic are not acceptable.

9

Unit Goals/Program Outcomes Form (to be completed by the division director/program coordinator at the end of the annual review cycle) Column 1: General Education/Program Learning Outcome

This column specifies the outcome that is to be assessed. Column 2: Institutional Evaluation Method and Benchmark

This column specifies the manner in which the outcome will be assessed. Column 3: Evaluation Results—Of the students who completed the assessment, how many demonstrated attainment of the stated outcomes? (For example, 22/28, 19/28)

Do not give a narrative. Only list the raw numbers of students who successfully demonstrated attainment of the outcome compared to the number who completed the assessment. These numbers must be separated into categories for dual enrollment, online, and traditional. Note that this is different than in previous years. The bottom number in the fraction is the number who completed the assessment (not the number who made a C in the course or who completed the course).

Column 4: Improvements that have resulted from an analysis of the evaluation of the outcome. (DO NOT USE FUTURE TENSE.) The decision concerning improvements in program delivery should be based on your review of all PLO Forms and your discussions with the instructors. See the flowchart on the next page for assistance on how to complete this part of the review. List the improvements THAT HAVE BEEN MADE in program delivery as a result of the assessment. List improvements in a very specific manner. Vague notations such as spending more time on a topic are not acceptable. Do NOT include changes in the way the outcome is evaluated. If you wish to change evaluation methods, you must make a proposal to the Student Learning Outcome Committee.

Select the most appropriate verb tense. In each case, use wording to indicate that the improvement has been—is being—was made. Avoid the use of will or will be! All forms incomplete or in need of any type of revision will be returned to the division director/program coordinator. Therefore, it is to your advantage to carefully review every form before submitting the annual reports to the Office of Institutional Planning and Assessment.

10

2. Division Director/Program Supervisor reviews the PLO forms and discusses improvements with

instructors.

4. The improvement is IMPLEMENTED and is reported on the Unit Goals/ Program Outcomes Form as having been

made already.

1. Instructor

completes PLO form.

3. Division Director/Program Supervisor determines the improvement(s) that should be made in the program to

enhance the PLO.

11

Instructions:

Annual Submission

of Completed Reviews

12

Reserved

13

Instructions for Submission of Forms

Submission of PLO Forms by Instructor to Division Director or Program Supervisor: Instructors are to use the PLO Forms posted online. Complete the form, then save it as a Word file. Use the following format to name each file: Instructor Name_Course_Format (online, dual enrollment, or traditional)_Term (FA/SP/SU+year) Example: Ragsdale_ENG101_Trad_FA15 Walker_MAT229_Trad_FA15 Ragsdale_ENG101_Online_FA15 Walker_MAT229_Online_FA15 Ragsdale_ENG101_DE_FA15 (for dual enrollment) All forms must be submitted electronically. Do not accept print forms. Each director or supervisor should specify whether documents are to be submitted via email, CD-RW, or USB drive. Important Technical Note: For the email option, each document must first be saved as a Word file, then attached to the email. Instructors sending more than one file should attach all their files to a single email to be submitted to the director/supervisor. This will aid in the management of a large number of emails and files.

14

Annual Submission of All Forms by Division Director or Program Supervisor to the Office of Institutional Planning & Assessment: Each division director and program supervisor submits all completed PLO Forms to the Office of Institutional Planning and Assessment two weeks into each semester through the OIPA Shared Folder. To organize your files in the OIPA Shared Folder, click on the Program Learning Outcomes folder, and click on your unit’s subfolder. Create folders as necessary following the naming conventions below. Save all PLO Forms for a given course in a single folder for each semester, titled as follows: ENG 101_PLO Forms_FA15 MTH 100_PLO Forms_FA15 ILT 192_PLO Forms_FA15 CHD 204_PLO Forms_FA15, etc. The Unit Goals/Program Outcomes Forms will be saved in the Unit Goals folder under your division/program name. All submissions are to be made via the OIPA Shared Folder. Do not email the submissions or send print copies.

15

General Education Learning Outcomes

Program Learning Outcomes

for all Programs

16

Reserved

17

General Education Learning Outcomes General education outcomes are concerned with the global knowledge and abilities of students upon completion of a two-year degree. In order to establish a set of outcomes specific to this college, among the questions considered by the Student Learning Outcomes (SLO) Committee were the following: What abilities, skills, and attitudes are expected of students when they complete a general education program and how can these outcomes be assessed? When students complete a program for the A.A. and/or A.S. degree, have they learned what is needed to succeed in that field? Committed to answering these questions, the SLO Committee identified five competencies that students should exhibit as a result of completing the general education core courses at NACC: Written Communication—Students will demonstrate adequate writing skills by developing ideas and organizing content effectively. (ENG 101) Oral Communication—Students will articulate ideas, concepts, and theories in a clear fashion using language and elocution skills indicative of college-level preparation. (SPH 107) Mathematical Computation—Students will compute basic mathematical operations accurately, comprehend mathematical information, and utilize analytical thinking skills to solve problems. (MTH 100 and MTH 116) Computer Literacy—Students will use current technology and develop computer skills for informational, academic, personal, and professional needs. (CIS 146) Information Literacy—Students will locate, access, and analyze information that facilitates learning and critical inquiry. (Library Orientation in ENG 101 and SPH 107)

18

Northeast Alabama Community College

Program Learning Outcomes

A.A. and A.S. Degree Programs The A.A. and A.S. degree programs are designed for transfer and, as such, constitute a general/pre-liberal arts curriculum. The general education outcomes serve as the five competencies identified by the College that students should attain as a result of completing the A.A. or A.S. Degree Programs: Written Communication—Students will demonstrate adequate writing skills by developing ideas and organizing content effectively. (ENG 101) Oral Communication—Students will articulate ideas, concepts, and theories in a clear fashion using language and elocution skills indicative of college-level preparation. (SPH 107) Mathematical Computation—Students will compute basic mathematical operations accurately, comprehend mathematical information, and utilize analytical thinking skills to solve problems. (MTH 100 and MTH 116) Computer Literacy—Students will use current technology and develop computer skills for informational, academic, personal, and professional needs. (CIS 146) Information Literacy—Students will locate, access, and analyze information that facilitates learning and critical inquiry. (Library Orientation in ENG 101 and SPH 107) A.A.S. Degree Programs In addition to the general education outcomes, for each career and technical program the College has identified program learning outcomes (PLO) based on the principle that each graduate should exhibit, in a professional manner, the knowledge and skills of a qualified practitioner in the field. The PLO for each career/technical program are listed as follows: A.A.S.-Business Graduates of the Business Program will be able to:

Demonstrate competence in financial accounting process and systems. (BUS 241)

Demonstrate an understanding of macroeconomic theory, analysis, and policy applications, including supply and demand and market equilibrium, the American banking system and the Federal Reserve. (ECO 231)

A.A.S.-Child Development Graduates of the Child Development Program will be able to:

Function as a competent entry-level child care worker by performing necessary skills for working in a child care facility. (CHD 215)

Plan programs that promote and maintain safe and healthy learning environments. (CHD 206)

Apply foundational knowledge of methods and materials for teaching young children from birth to age 8. (CHD 204)

Exhibit a positive work ethic. (CHD 215)

19

A.A.S.-Computer Information Systems Graduates of the Computer Information Systems Program will be able to:

Demonstrate knowledge of computer terminology and components. (CIS 199)

Install, configure, and upgrade a computer operating system. (CIS 268)

Install and troubleshoot computer hardware. (CIS 269) A.A.S.-Criminal Justice Graduates of the Criminal Justice Program will be able to:

Function as a competent entry-level worker in a law enforcement agency demonstrating knowledge and skills retained from course work. (CRJ 280)

Exhibit a thorough knowledge of the law enforcement agency. (CRJ 280) A.A.S.-Drafting and Design Technology Graduates of the Drafting and Design Technology will be able to:

Perform tasks in a safe manner. (DDT 233)

Exhibit a positive work ethic and good employability skills. (DDT 193)

Sketch orthographic views of objects. (DDT 127)

Read and interpret technical drawings. (DDT 113)

Employ basic operating system functions in order to use CADD software to produce and plot pictorial and multi-view working drawings. (DDT 127)

Function as a competent entry-level draftsman. (DDT 193) A.A.S.-Emergency Medical Services (Paramedic) Graduates of the Emergency Medical Services (Paramedic) Program will be able to:

Perform tasks in a safe manner. (EMS 255)

Display a positive work ethic. (EMS 256)

Function as a competent, entry-level paramedic student. (EMS 254)

Use current technology and develop computer skills for informational, academic, personal, and professional needs. (EMS 255)

A.A.S.-Engineering Technician Graduates of the Engineering Technician Program will be able to:

Function as a competent entry-level engineering technician by demonstrating knowledge and skills retained from coursework. (ENT 242)

Perform tasks in a safe manner. (ENT 242)

Exhibit a positive work ethic. (ENT 242) A.A.S.-Industrial Electronics Technology Graduates of the Industrial Electronics Technology Program will be able to:

Perform all tasks in a safe manner. (ILT 192)

Exhibit a positive work ethic. (ILT 192)

Function as a competent entry-level industrial electrician. (ILT 192)

20

A.A.S.-Industrial Systems Technology-Electrical and Instrumentation Option Graduates of the Industrial Electronics Technology Program (Electrical and Instrumentation Option) will be able to:

Function as a competent entry-level Industrial Maintenance Technician by demonstrating knowledge and skills retained from course work. (INT 192)

Perform tasks in a safe manner. (INT 192)

Exhibit a positive work ethic. (INT 192) A.A.S.-Industrial Systems Technology-Multi-Skilled Option Graduates of the Industrial Electronics Technology Program (Multi-Skilled Option) will be able to:

Function as a competent entry-level Industrial Maintenance Technician by demonstrating knowledge and skills retained from course work. (INT 192)

Perform tasks in a safe manner. (INT 192)

Exhibit a positive work ethic. (INT 192) A.A.S.-Industrial Systems Technology-Machine Tool Technology Option Graduates of the Industrial Systems Technology Program (Machine Tool Technology Option) will be able to:

Function as a competent entry-level machinist by demonstrating knowledge and skills retained from course work. (INT 192)

Perform tasks in a safe manner. (INT 192)

Exhibit a positive work ethic. (INT 192) A.A.S.-Industrial Systems Technology-Welding Technology Option Graduates of the Industrial Systems Technology Program (Welding Technology Option) will be able to:

Function as a competent entry-level welder by demonstrating knowledge and skills retained from course work. (INT 192)

Perform tasks in a safe manner. (INT 192)

Exhibit a positive work ethic. (INT 192) A.A.S.-Medical Assistant Graduates of the Medical Assistant Program will be able to:

Function as a competent entry-level medical assistant by performing clinical and administrative duties. (MAT 229)

Perform tasks in a safe manner. (MAT 229)

Exhibit a positive work ethic. (MAT 229)

21

A.A.S.-Nursing Graduates of the Nursing Program will be able to:

Demonstrate proficiency in performing advanced nursing skills for clients with health alterations in a variety of settings. (NUR 203)

Demonstrate professional behaviors and roles of a registered nurse upon entry into practice. (NUR 204)

Utilize relevant technology and develop computer skills by successfully completing appropriate documentation of client care. (NUR 203)

Apply the nursing process in providing advanced nursing care for clients throughout the lifespan. (NUR 203)

Perform within the legal/ethical framework and standards of care for nursing. (NUR 204) Certificate-Practical Nursing Graduates of the Practical Nursing Program will be able to:

Demonstrate competency in performing nursing skills following a prescribed plan of care for clients with common health alterations. (NUR 107)

Demonstrate and accept responsibility for professional behaviors associated with entry level practice. (NUR 107)

Utilize relevant technology and develop computer skills by successfully competing appropriate documentation of client care. (NUR 109)

Apply knowledge of the nursing process to assist in providing nursing care for clients across the lifespan. (NUR 107)

A.A.S.-Office Administration-General Option Graduates of the Office Administration Program (General Option) will be able to:

Use the ten-key numeric touch method to solve mathematical business problems with speed and accuracy. (OAD 130)

Transcribe documents from dictated recordings. (OAD 200) A.A.S.-Office Administration-Medical Office Option Graduates of the Office Administration Program (Medical Office Option) will be able to:

Interpret medical terms used in medical records. (OAD 211)

Use the ten-key numeric touch method to solve mathematical business problems with speed and accuracy. (OAD 130)

Transcribe a dictated letter or report without errors in mail-ready document using a computer. (OAD 212)

A.A.S.-Office Administration-Paralegal Option Graduates of the Office Administration Program (Paralegal Option) will be able to:

Explain the role of the paralegal and identify the skills, knowledge, and ethics required of legal assistants. (PRL 101)

Demonstrate the ability to prepare a trial notebook for litigation purposes. (PRL 262)

22

A.A.S.-Salon and Spa Management-Cosmetology Option Graduates of the Salon and Spa Management Program (Cosmetology Option) will be able to:

Function as a competent entry-level salon and spa professional. (COS 190)

Perform tasks in a safe manner. (COS 190)

Exhibit a positive work ethic. (COS 190) A.A.S.-Salon and Spa Management-Esthetics Option Graduates of the Salon and Spa Management Program (Esthetics Option) will be able to:

Function as a competent entry-level salon and spa professional. (COS 190)

Perform tasks in a safe manner. (COS 190)

Exhibit a positive work ethic. (COS 190) A.A.S.-Salon and Spa Management-Therapeutic Massage Option Graduates of the Salon and Spa Management Program (Therapeutic Massage Option) will be able to:

Function as a competent entry-level massage therapist. (MSG 206)

Perform tasks in a safe manner. (MSG 206)

Exhibit a positive work ethic. (MSG 206)