ap studio art portfolios in transition to next generation assessment: a continuum of performance...
TRANSCRIPT
AP Studio Art Portfolios
in
Transition to Next Generation Assessment: A Continuum of
Performance Assessment Approaches
CCSSO Conference June 20, 2013
Rosemary Reshetar, The College Board
1
•The Studio Art ProgramCollege Level Course and Portfolio Exam
BackgroundSubmission RequirementsScoringAddressing psychometric quality
2
The Studio Art Program (High School)College Level Course and Portfolio Exam Designed for students who are seriously
interested in the practical experience of art
No written exam Students submit portfolios for evaluation at end of the year
Three options, corresponding to the most common college foundation courses– 2-D Design– 3-D Design– Drawing
3
AP Scores Reported as 1 through 5
4
5
4
3
2
1
Possibly qualified
No recommendation
–Quality, mastery of principles• 5 actual works (Drawing and 2-D) • 10 images of 5 works (3-D)
– Concentration, thoughtful investigation of specific visual idea• 12 digital images, some of which may be
detail• Written summary, not scored
– Breadth• 12 images of 12 different works (Drawing
and 2-D)• 16 images of 8 different works (3-D)• No images to overlap with concentration
submissions
Portfolio Submission Requirements
5
AP Studio Art Portfolio Scoring
…Conducted in June each year
One week All on-site Readers, or scorers, are AP Studio Art
teachers or teachers of first year college studio art courses
In 2012:– 153 readers– 43,619 portfolios• 23,591 (2-D Design)• 16,188 (Drawing)• 3,840 (3-D Design)
6
AP Studio Art Portfolio Scoring
…arriving at total scores (max 72 points)
Each reader scores on a 6-point scale– Quality (3 readers) = 18 points– Concentration (2 readers) = 12 points– Breadth (2 readers) = 12 points
Quality, Breadth, and Concentration are all weighted equally, 1:1:1– The 18 available points for Quality are multiplied by a
factor of 1.3333– The 12 available points (each) for Concentration and
Breadth are multiplied by a factor of 2.0– Total “raw” points available are then 72.
Cut scores (1 – 72) establish AP grades 1 through 5
7
Arriving at accurate/consistent scores… …with two moving targets
8
Double and triple scoring
Adjudication
‘Trend scoring’ for leniency or stringency over time
Directions to students and scoring guidelines stay the same every year.
Score Reliability and Consistency
Cutscores were set initially on 72 point scale for AP scores 1 through 5 to be indicative of college level performance in introductory course
Portfolio requirements and scoring guidelines remain the same year to year
Cutscores from prior year are used, with minor adjustments if needed based on trend scoring
9
