intro to rubrics
DESCRIPTION
For TWTI Fall 2011 - originally done for 2009 PD sessions at Mohawk CollegeTRANSCRIPT
![Page 1: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/1.jpg)
Relevant, User-friendly Benchmarks; Reinforcing Instruction; Cultivating Success
Intro to Rubrics for TWTI Fall 2011
![Page 2: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/2.jpg)
Teaching as a Subversive Activity
Have Humanities faculty instruct Math, Math instructors Business,…
Limit teachers to three declarative sentences per class, and 15 interrogatives
Prohibit teachers from asking any questions to which they already know the answers
Require all teachers to take a test prepared by students on what the students know
![Page 3: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/3.jpg)
Today’s Objectives
1. Getting the lay of the land
2. Showing you the sights
3. Highlighting tools in eLearn
![Page 4: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/4.jpg)
I can’t explain it. It just wasn’t an A
paper.~ pre-rubric educators
![Page 5: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/5.jpg)
Getting the Lay of the Land: Defining The JargonRubric a guide used to score performance assessments in
a reliable, fair, and valid manner generally composed of:
dimensions for judging student performance a scale for rating performances on each
dimension standards of excellence for specified
performance levels(SRI International)
![Page 6: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/6.jpg)
Why Rubrics?
1. Provide students with expectations about what you will assess
2. Inform students on the standards they must meet/work towards meeting
3. Indicate to students where they are in relation to course/program goals
4. Increase your consistency in ratings or performance, products, or understanding
5. Gather data to support grades
![Page 7: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/7.jpg)
Jargon Cont’d
Authentic Assessment meaningful, real-life learning
experiences includes:
recording evidence of the learning process applications in products and performances integrations of new knowledge reflecting on one's own progress interpreting meaning
(Herberger College of the Arts, Arizona State University)
![Page 8: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/8.jpg)
Jargon Cont’d
Analytic Rubric: outline or list of major elements that students should include in a finished work
YAY!: Provides considerable information on
assignments Can be a peer review tool Converts from assessment to evaluation by
adding point values to each component
Caveat: Highly prescriptive
![Page 9: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/9.jpg)
Jargon Cont’d
Holistic Rubric: assess the whole process or product. Although holistic rubrics contain criteria, the element under investigation is given one score for its entirety. This type of rubric requires instructors to “know quality when they see it.”
YAY!: Ability to evaluate a large number of projects quickly Transparency in elements needed for quality for
products or assignments where appraisal is more subjective
Caveat: Highly subjective
![Page 10: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/10.jpg)
Jargon Cont’d
Annotated Holistic Rubric: hybrid of analytical and holistic rubrics with defined quality levels plus commentary
YAY!: Reduces ambiguity, increases efficiency,
and allows students to see road to improvement (IMHO)
Caveat: May take considerable time to construct
![Page 11: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/11.jpg)
Validity is Key
Reliability: measures educational objectives as consistently as possible
Relevance: measures educational objectives as directly as possible
Utility: provides formative or summative results effectively - clear implications for evaluation and improvement
![Page 12: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/12.jpg)
If the only tool you have is a hammer,
you tend to see every problem as a nail.
~ Abraham Maslow
![Page 13: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/13.jpg)
Add Rubrics to Your Toolkit; Don’t Throw Out Other Tools
Rubrics are best used when:
Assignments are multi-faceted; combining lower and higher order skills
Your subjectivity is/could be called into question
Assessing an action or combination of actions rather than a thing
![Page 14: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/14.jpg)
Let’s Not Reinvent the Wheel
There are current and authoritative resources that can save you immense amounts of time
Ontario College Writing Exemplars developed by the Heads of Language (HOL)
with funding from School/College/Work Initiative program of the Ontario Ministry of Education
College Diploma and Certificate Program Standards from the Ministry of Training, Colleges, and
Universities
![Page 15: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/15.jpg)
2. Showing You the Sights
We’re taking the economy tour…
Five Questions – That’s It!
![Page 16: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/16.jpg)
Question 1: What dimensions ensure highest quality?
Hint: Can include knowledge, skills & abilities/Content specific or life-long goals
Consideration: Students may experience difficulty with course specific mixing with life-long goals
Most Common Misstep: Learning outcomes don’t match assessment
LO = critical thinking; assessment dimensions = format, mechanics, and citation style
![Page 17: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/17.jpg)
Some Usual Dimensions
From high school, students are familiar with categories:
Knowledge and Understanding
Thinking
Communication
Application
![Page 18: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/18.jpg)
Some Usual Dimensions
Bloom’s Taxonomy Knowledge
Comprehension
Application Analysis Synthesis Evaluation
Big 6 Task Definition Info Seeking
Strategies Location and Access Use of information Synthesis Evaluation
Or adopt a learning theory
![Page 19: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/19.jpg)
Question 2 How many levels of achievement/performance to include?
Hint: Give yourself some wiggle room
Consideration: Letters vs. levels vs. descriptors
A, B, C, D vs. 1, 2, 3, 4 vs. unacceptable, marginal, proficient, exemplary vs. novice, apprentice, proficient, distinguished
Most Common Misstep: Using too many levels of achievement
![Page 20: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/20.jpg)
Question 3: What is a clear description at each level?
Hint: Try to determine qualitative differences that characterize work or performance. Start with B/acceptable/proficient level
Consideration: Comparative language alone fails to highlight unique features, but using unique language may connote different meanings
Most Common Misstep: Including value laden terms that showcase judgement, but little guidance
![Page 21: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/21.jpg)
Question 4: What rating scheme/ weighting of dimensions do I use?
Hint: Add this in a way that fits with your philosophy and course requirements
Consideration: Different assignments may measure the same dimensions in differing degrees. One rubric could serve an entire course.
Most Common Misstep: Using a weighted rating in your head, but not communicating it to the students
![Page 22: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/22.jpg)
Question 5: What worked and what didn’t?
Hint: Do a trial run with colleague(s) rather than one, entire class
Consideration: Do you need more focus on content, format, delivery? Was one dimension weighted too heavily? Etc…
Most Common Misstep: Viewing rubric as a permanent panacea
![Page 23: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/23.jpg)
Rubrics Recap
Decide which assignments suit a rubric
Use our 5 questions as a checklist or frame
Get help/feedback/constructive criticism whenever and wherever you can
From colleagues From students From the literature
![Page 24: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/24.jpg)
How eLearn@Mohawk can assist
Turnitin integration with eLearn@Mohawk includes GradeMark
Build a rubric in Turnitin and attach it to assignments
OR Have peggy build your rubric in Turnitin
Enter rubric mark in Discussions or Dropbox and have Grades automatically populated
![Page 25: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/25.jpg)
How eLearn@Mohawk can assist
Rubrics tool in eLearn@Mohawk Attach rubric as an ‘activity’ directly to
discussion threads and dropbox submissions and associate with Grades for easier assessment
Rubrics as activities can stand alone or be incorporated into competencies.
Competencies track students’ knowledge and skill development. Under its umbrella are learning elements (objectives) and activities that assess and evaluate the objectives.
![Page 26: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/26.jpg)
![Page 27: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/27.jpg)
Beginning(0-12 points)
Proficient(13-16 points)
Advanced(17-20 points)
Score
1. Determine the Extent of the Information Needed (20 points)
Creates an unfocused or unmanageable research question. Student identifies few or no relevant information tools.
Formulates a question that is focused and clear. Student identifies concepts related to the topic, and identifies some useful information tools to meet the information need.
Formulates a research question that is focused, clear, and complete and identifies key concepts. Student identifies most or all relevant information tools in various potential formats.
2. Access the Needed Information Effectively (20 points)
Uses information tools poorly and gathers information that lacks relevance, quality, and balance.
Executes an appropriate research strategy. Student solves problems by finding a variety of relevant information resources and evaluates search effectiveness.
Implements a clear and focused research strategy, uses tools effectively, and finds information that directly fulfills the information need.
3. Evaluate Information and Its Sources Critically (20 points)
Uses inadequate criteria to judge information quality. Student makes little effort to examine the information located for reliability.
Examines information using criteria such as authority, credibility, relevance, timeliness, and accuracy, and makes good judgements aboutwhat to keep and what to discard.
Compares and evaluates multiple and diverse sources and viewpoints according to specific criteria appropriate for the discipline.
4. Use Information Effectively to Accomplish a Specific Purpose (20 points)
Shows little evidence of incorporating information into their knowledge base. Student uses information poorly to accomplish a specific purpose.
Often uses appropriate information and evidence to support their claims and conclusions and to accomplish a specific purpose.
Effectively synthesizes and integrates information from a variety of sources, draws appropriate conclusions, and clearly communicates ideas to others to accomplish a specific purpose.
5. Use Information Ethically (20 points)
Inadequately cites ideas and information of others.
Cites ideas and information of others with few errors.
Consistently and accurately cites ideas and information of others.
Research Paper Grading RubricFor Research Component
Uses: 1.To set performance expectations by distributing to students when a paper is assigned.2.To evaluate the portion of a student’s paper related to research and information use.
![Page 28: Intro to rubrics](https://reader035.vdocuments.net/reader035/viewer/2022081511/5549d11fb4c9057c6d8b4dbb/html5/thumbnails/28.jpg)
CRITERIA/DIMENSION
LEVEL OF ACHIEVEMENT/PERFORMANCE
Excellent Good Needs Improvement
Load supported greater than 12 kg 6 to 12 kg less than 6 kg
Weight of bridge less than 30 grams 30 to 60 grams over 60 grams
Bridge span greater than 385 mm 360 to 385 mm less than 360 mm
Ability of matchbox car to roll across bridge
does not stop stops 1 or 2 timesstops 3 or more times or cannot roll entire length of bridge
Analytic Rubric Example