Effective Creation

Developing Tests & Evaluation Surveys for the Classroom

REINVENTING SOCIETY IN THE WAKE OF BIG DATAA Conversation with Alex (sandy) Pentland [8.30.12]

• “With Big Data you can easily get false correlations, for instance, "On Mondays, people who drive to work are more likely to get the flu." If you look at the data using traditional methods, that may actually be true, but the problem is why is it true? Is it causal? Is it just an accident? You don't know. Normal analysis methods won't suffice to answer those questions. What we have to come up with is new ways to test the causality of connections in the real world far more than we have ever had to do before. We no can no longer rely on laboratory experiments; we need to actually do the experiments in the real world”(Edge, 2012) .

What did you mean about that?

Introduction

• “Trainers, and others in organizations who author tests, often have a high degree of technical and subject matter expertise, but many haven't been exposed to the basic principles and criteria for writing tests” (Censeo (2007).

• Producing effective tests and surveys takes some consideration when preparing. The following presentation will assist you in developing these by following guidelines for content. These guidelines should help you determine the purpose of the test, how to test, whether scores need to be recorded, and how to deliver feedback.

• “By "effective tests" we mean that they will accomplish the objectives for which they are intended” (Censeo (2007).

• “Some tests are designed to certify that people have acquired, and can apply, a certain set of skills or a body of knowledge. Other tests are designed mainly to help people further develop by measuring skills and knowledge, and then providing specific feedback” (Censeo (2007).

• One way to assist you in the development of an effective test in by using our application: SurveyMonkey.

• We have developed this application for use by those needing to create surveys or testing material.

• This application is easy to use and easily edited to fit most any need.

• There is a free version and an upgraded version available for a very reasonable price

• Another example of how the educator can determine what technologies are best to use is to subscribe to the Horizon report.

• “Each of the three global editions of the NMC Horizon Report-higher education, primary, and secondary education, and museum education-highlights six emerging technologies or practices that are likely to enter mainstream use with their focus sectors within three adoption horizons over the next five years” (Horizon Report, 2012).

• What are the six emerging technologies or practices mentioned in the Horizon Report?

• Place your answers on my wiki on the page labeled Horizon Report by following the link below.

http://student-assistance.wikispaces.com/Horizon+Report

Testing GoalsWhy Test?

• To measure the progress of learners• To assist learners in measuring their own progress• To certify learner’s knowledge• To certify learner’s skills• To motivate learners• To exercise independent learning skills• To teach new knowledge and skills• To diagnose learner’s knowledge and skills• To measure the effectiveness of learning modules

Test Question Types

• True/False• Pick-one• Pick-multiple• Fill-in-the-blank• Matching-list• Sequence• Composition• Performance

Questioning Sequencing

• Ask multiple questions about one scenario• Ramp up the difficulty• Keep the sequence short• Enable navigation• Mix different forms of questions• Design each question to test for a different common

conception• Vary the forms of the questions• Vary the position of the correct answer• Arrange test questions in a predictable pattern

Feedback

• Report test scores simply• Provide complete information• Gently correct wrong answers• Avoid wimpy feedback• Give feedback at the right time

Provide your feedback to this presentation at

http://student-assistance.wikispaces.com/Test-Survey+Training

Results Processing

• Monitor results• Make tests fair to all learners• Test early and often• Set the right passing score• Define a scale of grades• Pre-test to propel learners• Explain the test• Keep learners in control

References

• Censeo Corporation (2007). White Paper, Guidelines for Writing Effective Tests: A Practical "Short Course" for Test Authors. Retrieved March 16, 2012 from http

://www.censeocorp.com/downloads/whitepapers• Edge (2012, September 9). Reinventing society in the wake of big data.

Retrieved from Edge: http://www.edge.org/conversation/reinventing-society-in-the-wake-of-big-data

• Horton, W. (2012). E-Learning by design (2nd ed.). San Francisco, CA: Wiley

• Horizon Report (2012). Higher education edition. Retrieved October 28, 2012 from http://www.nmc.org/pdf/2012-horizon-report-

HE.pdf

• SurveyMonkey. http://www.SurveyMonkey.com