& educational support units · 2020. 11. 26. · assessment planning for administrative &...
TRANSCRIPT
ASSESSMENT PLANNING FOR ADMINISTRATIVE & EDUCATIONAL SUPPORT UNITSPRESENTED BY: KAROL BATEY, ASSESSMENT SPECIALIST
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
WHAT IS ASSESSMENT?
Ongoing and systematic process of identifying objectives and means to measure them, gathering measurements of the objectives, using the information to make decisions about improvement, and implementing improvements based on the data gathered.
CONTINUOUS IMPROVEMENT
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
CONTINUOUS IMPROVEMENT
What?
A belief that no matter how well we do things, we can do better!
How?
By constantly examining how well we perform key functions, looking for weaknesses in our performance, and figuring out how to correct those weaknesses.
Why?
It is remarkably powerful, and is what separates industry leaders from the rest of the pack.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
ASSESSMENT PROCESS
You will complete an initial assessment plan now, and update the plan each year when you submit your assessment report. This connects the results from the previous cycle to the changes planned for the new cycle.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
FIVE COMPONENTS OF AN ASSESSMENT PLAN
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
MISSION GOALS
OBJECTIVES
OUTCOMES
MEASURES TARGETS ASSESSMENTPLAN
DEFINE THE MISSION STATEMENTCOMPONENT ONE
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
DEFINE THE MISSION STATEMENTUnit Mission should support the Institutional Mission as well as itself. Ask yourself these four essential questions:
1. Who are we?
State the name of your office/department (i.e. “The mission of TAMIU is ____”)
Avoid vague pronouns like “Our mission is…”
2. What do we do?
Includes the primary functions or activities of the office/department.
Illustrates the most important functions, operations, outcomes and/or offerings of the office/department.
3. Why do we do it?
State the purpose of the office/department.
Should include the primary reasons why you perform your major activities or operations
4. For Whom do we do it?
These are the stakeholders (e.g.,students) of your office/department.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
STRUCTURE OF A MISSION STATEMENT
The mission of <the name of your office/department> is to <your primary purpose(s)> by providing <your primary functions or
activities> to <your stakeholder(s)>.(Any additional clarifying statements.)
Note: The order of the pieces of the mission statement may vary from the above structure.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
MISSION STATEMENT EXAMPLE
The mission of the Office of Institutional Assessment, Research & Planning (OIARP) is to support programs, faculty and staff in
achieving student success by promoting institutional effectiveness through ongoing, systematic planning and evaluation efforts; and by ensuring institutional data integrity, consistency, and accuracy.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
MISSION STATEMENT MISTAKES
Too long
Too general
Not clear/vague
Too boring
Unbelievable
Unachievable
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
CHARACTERISTICS/ATTRIBUTES OF A POORLY WRITTEN MISSION STATEMENT
Difficult to understand
Unable to achieve
Not relatable
Does not accurately reflect functions
Does not convey impact/influence
Does not include/engage employees
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
UNIT GOALSCOMPONENT TWO
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
UNIT GOALS
Specific to the unit
Anchored in the mission
Overarching achievement tied to the purpose
Frames the functions of the unit
It bridges the mission and support outcomes
Use TAMIU’s Strategic Plan to help your unit discover your goals. This ensures unit goals are aligned with TAMIU’s institutional goals.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
ADMINISTRATIVE OBJECTIVES AND STUDENT LEARNING OUTCOMESCOMPONENT THREE
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
ADMINISTRATIVE OBJECTIVES
Objectives are statements of intention, describing a task to accomplish or a goal to meet. Administrative Objectives should:
Reflect what the decision makers have identified as the important initiatives or improvements for the administrative year.
Do NOT use your normal operations as part of your initiatives, but should focus on improvements and special projects that will enhance the entity.
Be Specific, Measureable, and Quantifiable statements to determine progress to overall mission.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
ADMINISTRATIVE OBJECTIVES
Formula on how to write an objective:
Objective = Target/Subject + Verb/Action + Object + Modifiers
Example: Increase research skills of TAMIU researchers by developing and conducting workshops and seminars on analyzing research.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
SHULTS DORIMÉ-WILLIAMS TAXONOMY
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING (FALL 2019)
SHULTS DORIMÉ-WILLIAMS TAXONOMY
STUDENT LEARNING OUTCOMES
Because many student services not only perform administrative functions, but also TEACH students, the unit should include student learning outcomes (SLOs)
Many student service departments may have both performance objectives to assess, as SLOs.
Assessing SLOs provides a deeper assessment that demonstrates that a student services department not only carries out its administrative responsibilities, but makes a positive impact in their interaction with students.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
STUDENT LEARNING OUTCOMES
Formula on how to write a SLO:
SLO = Students will be able to + Verb/Action + Object + Modifiers
Example: Students will be able to cite literary resources using American Psychological Association Standards.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
BLOOM’S TAXONOMY
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
Higher Order Thinking Skills
Lower Order Thinking Skills
BLOOM’S TAXONOMY VERBS
HOW MANY OBJECTIVES AND/OR OUTCOMES?
Administrative offices should have about three to five objectives
However, those offices offering direct instructional responsibilities should have one to two SLOs in place of an objective.
Plan to assess only two or three objectives/outcomes each cycle, and make sure to test all objectives and outcomes within three cycles.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
MEASURESCOMPONENT FOUR – “IF YOU CANNOT MEASURE IT YOU CANNOT IMPROVE IT” – BARON KELVIN
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
GUIDELINES FOR DEVELOPING MEASURES/METRICS
Develop at least two measures for every expected objective/outcome
You can have multiple measures per objective/outcome
You could have one measure that aligns with multiple objectives/outcomes
Be sure measures are appropriate and align with objectives and outcomes Do the chosen measure provide data on what you need to know?
Utilize a variety of measures Some of it you may already be collecting
Build an inventory of existing evaluation and assessment activities
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
GUIDELINES FOR DEVELOPING MEASURES/METRICS
Common Mistakes to Avoid
Simply restating the objectives/outcomes as a measure
Not aligning the measure with expected outcomes
Inserting actions (activities) in place of measures
Utilizing measure that do not measure what you need to know to determine progress
Measures need to provide useful and meaningful data
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
TARGETSCOMPONENT FIVE
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
TARGETS
For each measure, an achievement target must be established; in other words, how or when will you know if you’ve been successful?
Targets communicate clearly the expected level of accomplishment for a measure
Targets must always indicate what is expected to be achieved in this single, current administrative year.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
TARGETS
Targets must specify something quantifiable (a number, percent, rating, score, or level of proficiency)
Targets can offer directionality (an increase or decrease)
Targets should change to reflect improvement over time
Sometimes an anticipated date for completion can be a target, if no other targets seem appropriate
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
TARGET FORMULA
There is no easy rule for determining what the target should be for any objective. Generally, an entity either has an idea of the current level of
achievement and defines a new target from that, or they have a desired level of achievement and work toward that.
Target = Level + Subject + Action + Object + Modifiers
Target Example: 90% (level) of first year experience students (subject) will rate on a customer satisfaction survey (action) their Preview experience (object) as a 3 or better on a 5-point scale (modifiers).
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
TARGETS
It is important to note that targets must be clear not just in numbers, but in words. “Satisfactory” and “successful” are positive, but they are not streamlined
across units or campus. A better way is to create a scale to quantify these types of qualitative results.
Remember Targets should be appropriately challenging never do absolutes in your targets (no 0% or 100%)
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
You have now completed the complex and time consuming work of planning your assessment activities.
CREATED BY THE OFFICE OF INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING ((FALL 2019)
REFERENCES
Baker, W. (2012). Assessment 101: Non-Academic & Co-Curricular Assessment.
http://www.counciloakassessment.com/
Herrera, Dyanne, and Clarissa Gomez. How to Write an Effective Mission Statement. Texas Tech University Health Science Center, https://elpaso.ttuhsc.edu/oire/_documents/1 How to Write an Effective Mission Statement.pdf.
Resources, https://elpaso.ttuhsc.edu/oire/Resources.aspx.
Shults, Christopher, and Marjorie Dorime-Williams. “Enhancing Administrative, Educational, and Student Support (AES) Assessment: Introducing the SDW Support Outcomes Taxonomy.” York College, https://www.york.cuny.edu/president/institutional-effectiveness/middle-states/enhancing-aes-assessment-introducing-the-sdw-support-outcomes-taxonomy.pdf.
OFFICE OF ASSOCIATE VP FOR INSTITUTIONAL ASSESSMENT, RESEARCH, AND PLANNING