Slide 1

A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for ICT Courses Repository of WisdomALTA Forum May 9 th, 2014 James Harland james.harland@rmit.edu.au Joint work with Margaret Hamilton, Daryl DSouza, Raymond Lister (UTS), Ali Reza (UTS), Donna Teague (QUT)

Slide 2

A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for ICT Courses Repository of WisdomALTA Forum May 9 th, 2014 James Harland james.harland@rmit.edu.au Joint work with Margaret Hamilton, Daryl DSouza, Raymond Lister (UTS), Ali Reza (UTS), Donna Teague (QUT) Repository of Wisdom

Slide 3

But First Repository of WisdomALTA Forum May 9 th, 2014

Slide 4

What? Repository of Wisdom Database of exam questions for introductory programming Hosted on NECTAR Research Cloud (!!) Classification based on BABELnot project framework for questions Syllabus specification based on ProGoSs Developing front-end with comments and ratings features Ready by 30 th June ALTA Forum May 9 th, 2014

Slide 5

Question Attributes Repository of WisdomALTA Forum May 9 th, 2014 Programming LanguageTopic StyleCourse level MarksSkill Required Open/closedDifficulty ExplicitnessLinguistic Complexity Conceptual ComplexityIntellectual Complexity Code LengthExternal domain references

Slide 6

Question Attributes Repository of WisdomALTA Forum May 9 th, 2014 Topic Up to three from a given list Style multiple choice, short answer, program code, Parsons problem, graphical representation Skill Required knowledge recall, trace code, explain code, write code, modify code, debug code, design program, test program Open/closed Closed if exactly one answer. Open otherwise Intellectual knowledge, comprehension, application, analysis, evaluation, synthesis (Bloom levels) Conceptual Low, medium, high (depending on rules about concepts) Code Length Low, medium, high External Low, medium, high Linguistic Low, medium, high Explicitness High, medium, low Difficulty Low, medium, high

Slide 7

Question Attributes Repository of WisdomALTA Forum May 9 th, 2014 Question itself is in PDF or similar Answers and Marking Guide (optional) Performance data (optional) Often anonymised Variable level of detail Can have several per question Comments and ratings (1-5 stars)

Slide 8

Front page Repository of Wisdom Content ALTA Forum May 9 th, 2014

Slide 9

Heading Repository of Wisdom Content ALTA Forum May 9 th, 2014

Slide 10

Heading Repository of Wisdom Content ALTA Forum May 9 th, 2014

Slide 11

Heading Repository of Wisdom Content ALTA Forum May 9 th, 2014

Slide 12

Heading Repository of Wisdom Content ALTA Forum May 9 th, 2014

Slide 13

Conclusion Repository of Wisdom Try it here Try it here Comments and Ratings are relatively new Will also be adding keyword search (soon!) Due for completion by 30 th June Aim is to enable, not prescribe Build it (IT?) and they will come Comments and feedback most welcome ALTA Forum May 9 th, 2014 QUESTIONS?