an introduction to edu john lindsay orr department of mathematics university of nebraska - lincoln

52
An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Post on 21-Dec-2015

218 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

An Introductionto EDU

John Lindsay OrrDepartment of Mathematics

University of Nebraska - Lincoln

Page 2: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Presentation Plan

What is EDU?Educational benefitsEDU use at NUSoftware featuresGrants & contractsOther users

Page 3: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Introducing EDU

Student assessment over the Web Software developed out of UNLUsed by thousands of UNL studentsUsed by schools across the country http://calculus.unl.edu/edu/classes/demo/

Page 4: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Introducing EDU

Educational Benefits

Repeatable computer graded homework, quizzes, tests, exams, tutorials…

Mastery LearningOutcomes orientationStudents responsible for their success

Page 5: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Introducing EDU > Educational Benefits

Mastery Learning

Very effective learning strategy Very resource intensive

Page 6: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Introducing EDU > Educational Benefits

On-Line Mastery Learning

Mastery learning is very resource-intensive, but…

The Web enables: Repeatable assignments Automatic grading Individualized assignments 24/7 access

Page 7: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Introducing EDU > Educational Benefits

24/7 Access

0

50

100

150

200

250

300

12:00 1:

002:

003:

004:

005:

006:

007:

008:

009:

0010

:0011

:0012

:00 1:00

2:00

3:00

4:00

5:00

6:00

7:00

8:00

9:00

10:00

11:00

Testing Center

All Others

Page 8: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Project begun in Math Dept in 1996 Invited other departments to use systemNU Foundation and College of Arts &

Sciences Testing Center, 1999Commercial development since 1998

Page 9: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Case Study: Calculus In 1994 we moved to a “reform” course

Adopted new text Greater emphasis on applications Projects, homework, group work

Follow-up Concerns about partial credit

On-Line Gateway Exams Introduced in 1996 Require high standards Protect classroom time

Page 10: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL > Case Study

Gateway Exams

Calculus I Single “Gateway Exam” One retake per day over 3 week period All-or-nothing credit for 10% of final grade Students work under proctor supervision Covers basic computation skills of calculus 600+ students per semester

Page 11: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

UNL Testing Center

60+20 Computers, hi-tech classroom, tutoring environment

Grant from NU Foundation and College of Arts and Sciences, 1999

Serves Math 102, 103,106,107,203; Psyc 181, PolS 100, Astr 103...

Page 12: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Disciplines Served

Accounting Curr & Instruction PsychologyAg. Marketing Educational Psych. School of MusicAgro. & Hort. Electrical Eng. Veterinary ScienceAnthropology Entomology Lincoln High SchoolArchitecture Family & Consumer ScienceAstronomy GeographyBiochemistry GeosciencesBiological Sciences HistoryBio Systems Eng. Industrial Eng.Children, Family & Law LibrariesChemistry MathematicsCivil Engineering Modern LanguagesCommunication Studies Natural Resource SciencesComputer Science PhysicsConst. Management Political Science

Page 13: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL > Disciplines Served

Active Classes

Fall 2003

170 active classes set up

Page 14: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Students Served

Fall 2003

Student accounts: 10,650 Active (5+ sess.): 7,075

Spring 2004

Student accounts: 8,863 Active (5+ sess.): 5,310

Page 15: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Assignments Graded

Fall 2003

Total assignments: 277,148

Daily average: 2,500

Spring 2004

Total assignments: 292,888

Daily average: 2,650

Page 16: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL > Assignments Graded

Demand: Peaks & Troughs

0

1000

2000

3000

4000

5000

6000

7000

8000

webtests3

webtests2

webtests1

Page 17: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL > Assignments Graded

Cost Savings

Fall 2003

Total assignments: 277,148GTA hourly rate: $20GTA assignments/hour: 10

Cost of human grading: $554,296

Page 18: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at UNL

Infrastructure

SysadminHelp DeskThree Redhat Linux boxesApache front-end, load balancingBlackboard plugin

Page 19: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software Assignment modes Question types Assignment creation Question writing Grade book

Page 20: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Key Features 1 2 3 4 5Multiple Assignment Modes

Anonymous Homework Printable Proctored Tutorial “Mastery”

Page 21: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Key Features 1 2 3 4 5 Sophisticated question types

Fill in blank Short phrase Numeric with units Mathematical content Graph sketching Spreadsheet Multipart questions …and many more

Page 22: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Key Features 1 2 3 4 5Easy Assignment Creation

Three step creation wizard Write your own

questions or use pre-loaded banks

Page 23: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Key Features 1 2 3 4 5Powerful Question Bank Editor

Wizards for different question types Edit, save,

modify, merge question banks on-line

Page 24: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Key Features 1 2 3 4 5Fully-featured Grade Book

Traditional tabular grade book Analyze assignments and questions

Page 25: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

EDU and Mastery LearningDesigned for mastery learningRepeatable assignments

Question selection schemes Algorithmic questions

Sophisticated hints and feedback

Page 26: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Mastery Learning

Question Selection

Page 27: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Mastery Learning

Algorithmic Questions

$a = range(4, 9); $k = decimal(2, rand(1, 2));

$right = sum(x, 1, $a, x($a-x)e^(-$k x));

$low =$right - 3; $high = $right + 3;

Page 28: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Mastery Learning

Immediate Feedback

- Engineering

Page 29: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software

Quantitative EDU Stengths in numeric/quantitative questions Content-based math grading

Formula grading Graph sketching Maple T.A.

Embedded MathML MathML editor in Question Bank Editor LaTeX question authoring WYSIWYG math entry for students

Page 30: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Quantitative EDU

Formula GradingGrade on content:

xe^x + e^x equals (1+x)e^xRecognize:

Natural syntax: xsin x Vectors, lists, etc: (1/sqrt(2), 3) Equations: y=x-1 equals y+1=x Integrals: xln(x) equals xln(x)+1

Page 31: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Quantitative EDU

Graph SketchingClick out spline nodesQualitative and

quantitative grading

Page 32: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Quantitative EDU

Maple Grade by evaluating Maple expression Maple algorithms and plots

Page 33: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU Software > Quantitative EDU

Math in Inline Questions

Page 34: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU software

EDU and BlackboardBrownstone is a Blackboard Building

Blocks PartnerEDU can be used transparently within

Blackboard

Page 35: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU software > EDU and Blackboard

Blackboard Plugin EDU in Bb Control Panel

Page 36: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU software > EDU and Blackboard

Blackboard PluginFull EDU

capabilities

inside Bb

experience

Page 37: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU software > EDU and Blackboard

Blackboard PluginPlace EDU

assignments

in any Bb

content area

Page 38: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

The EDU software > EDU and Blackboard

Blackboard PluginEDU grades appear in Bb grade book

Page 39: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at Other Schools

University of MichiganFlorida State UniversityClemson University

Page 40: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at Other Schools

University of Michigan Gateway Exams

Precalculus, Calculus I and II Proctored on-line exams in labs Practice sessions from home/dorms Passing grade required Value is:

“Immediate feedback” “Moves work of grading

off instructors”

Page 41: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at Other Schools

Florida State University1 practice quiz per week over web……followed by proctored quiz in labAll course assessment done on-lineValue is

“Standardizing precalculus course” “Force the students to work”

Page 42: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU at Other Schools

Clemson UniversityCampus-wide use Integrated with campus course

management systemHundreds of classeshttp://galleon.clemson.edu:8080/classes/

Page 43: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Grants and Contracts

John Wiley & SonsNational Science FoundationBrownstone Learning

Page 44: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Grants and Contracts

John Wiley & Sons

Product branded as “eGrade”Published this software since 1998Contracts and royalties for over $74,000http://www.wiley.com/college/egrade/

Page 45: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Grants and Contracts

National Science Foundation

Assessment of Student Achievement in Undergraduate Education

$493,156 over 3 yearsAcross SMET disciplines Study efficacy of on-line assessment

Page 46: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

Grants and Contracts

Brownstone Learning

Development and marketing of EDUContracts for $331,919 over 2001-04http://www.brownstone.net/

Page 47: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Publishers

“Powered by Brownstone”

Wiley - eGradePrentice Hall - PH GradeAssistW. H. Freeman – ISolveMcGraw-Hill – NetGrade/MHHM

Page 48: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Publishers

Prentice HallProduct branded as “PH GradeAssist”Access to all students buying selected

textshttp://www.prenhall.com/phga

Page 49: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Publishers

W. H. FreemanProduct branded as “ISolve”Available through Freeman websiteStructured problems in physicshttp://www.whfreeman.com

Page 50: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Publishers

McGraw-Hill

Page 51: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Other Companies

MaplesoftProduct branded as Maple T.A. Integrated with powerful Maple scientific

computing platformMarketed to Math Departmentshttp://www.mapleta.com/

Page 52: An Introduction to EDU John Lindsay Orr Department of Mathematics University of Nebraska - Lincoln

EDU and Other Companies

BlackboardBrownstone is a Blackboard Building

Blocks PartnerEDU can be used transparently within

Blackboardhttp://demo.brownstone.net/