using moocs for teaching analytical...

18
1 sisu.ut.ee/measurement 1 Using MOOCs for teaching analytical chemistry Ivo Leito, Irja Helm, Lauri Jalukse [email protected] 13.09.2016 EuCheMS 2016 Seville I. Leito, I. Helm, L. Jalukse. Anal Bioanal Chem, 2015, 407, 1277–1281 Massive Open Online Courses Term coined in 2008 – by D. Cormier and G. Siemens MOOCs were hailed as the future of higher education – 2012: „Year of the MOOC“ by NYT Since then, a lot of criticism – insufficient interaction between teachers and students, low course completion rates, etc – It is now acknowlegded that MOOCs were orginally overhyped 13.09.2016 EuCheMS 2016 Seville Cormier D (2008) The CCK08 MOOC – connectivism course, 1/4 way. Available from Dave Cormier’s blog. http://davecormier.com/ edblog/2008/10/02/the-cck08-mooc- connectivism-course-14-way/ Pappano L (2012) The year of the MOOC. The New York Times, Nov 2, 2012 I. Leito, I. Helm, L. Jalukse. Anal Bioanal Chem, 2015, 407, 1277–1281

Upload: others

Post on 03-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

1

sisu.ut.ee/measurement

1

Using MOOCs for teaching analytical chemistry

Ivo Leito, Irja Helm, Lauri Jalukse

[email protected]

13.09.2016 EuCheMS 2016 Seville

I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281

Massive Open Online Courses

• Term coined in 2008– by D. Cormier and G. Siemens

• MOOCs were hailed asthe future of higher education– 2012: „Year of the MOOC“

by NYT• Since then, a lot of criticism

– insufficient interaction between teachers and students, low course completion rates, etc

– It is now acknowlegded that MOOCs were orginallyoverhyped

13.09.2016 EuCheMS 2016 Seville 2

Cormier D (2008) The CCK08 MOOC – connectivism course, 1/4way. Available from Dave Cormier’s blog. http://davecormier.com/edblog/2008/10/02/the-cck08-mooc-connectivism-course-14-way/

Pappano L (2012) The year of the MOOC. The New York Times, Nov2, 2012

I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281

Page 2: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

2

MOOCs: stillvery promising

• MOOCs have undoubted advantages• Offered by many leading universities• Offered by many online providers

– Coursera, edX, Udacity, …13.09.2016 EuCheMS 2016 Seville 3

"Gartner Hype Cycle" by Jeremy Kemp at Wikipedia.Licensed under CC BY-SA 3.0 via Wikimedia Commons

MOOCs areapproximately here

sisu.ut.ee/measurement

13.09.2016 EuCheMS 2016 Seville 4

On-line course: Estimation of measurement uncertainty in chemical analysis

Page 3: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

3

5

Measurand, C

„TrueValue“

Value, error and uncertainty

Measured value

CmCT

Error

Δ = Cm - CT

Cm+UCm-U

Uncertainty rangeCm – U … Cm + U

13.09.2016 EuCheMS 2016 Seville

Measurement result

• This way of writing:

The benzene content of a fuel isCbenzene = (32 ± 6) mg/kg, k = 2, norm.

• Is a measurement result and means the following:The true content of benzene in the fuel is in the range of 26 … 38 mg/kg with the approximateprobability 95%

• The “± 6 mg/kg” is the measurement uncertainty– It is the expanded uncertainty

13.09.2016 EuCheMS 2016 Seville 6

Estimate of measurementuncertainty

Page 4: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

4

Why do we need measurementuncertainty estimates?

13.09.2016 EuCheMS 2016 Seville 7

Comparison withpermissible limits

Necessary forenforcing legislation

Optimizingmeasurementprocedures

Quality assurance of decisions

Required in legislation

Comparing tworesults

Following temporal trends in environment, labs, etc

Measurement uncertainty

Required byISO 17025

Measurement uncertainty inChemistry

• „Notoriously difficult“

• Needs:– In-depth understanding of the particular chemical

analysis procedure: physical-chemical pronciples, influencing factors

– Knowledge and skills in mathematics (randomquantities, distribution functions, …)

• Chemical analysis usually cannot be modeled well13.09.2016 EuCheMS 2016 Seville 8

In practice: oftenunderestimated

uncertainties

Page 5: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

5

Teaching measurementuncertainty

• Very difficult

• Usually taught in connection with analyticalchemistry

• Many guideline materials and courses• Most of them stop exactly at the moment when

it starts getting interesting and useful

13.09.2016 EuCheMS 2016 Seville 9

It is usually taught at the level of basics but

difficulties emergefirst of all with

practical applications

Consequences?

13.09.2016 EuCheMS 2016 Seville 10EstOil-5 Final report, 2009

http://www.ut.ee/katsekoda/ILC/

Page 6: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

6

13.09.2016 EuCheMS 2016 Seville 11

Our goal• Web-based teaching material for

– Independent learning to estimate measurement uncertainty in real-life situations

– On-line reference point of explanations of concepts and approaches

– Support for auditorial teaching of metrology inchemistry at UT, summer schools, etc

– Offering as MOOC

• Required previous knowledge– General analytical chemistry knowledge

Course contents

• Theoretical basis as well as practical skills• Detailed and example-based treatment

– Modeling (ISO GUM)– Within-lab validation (Nordtest)

• Close to 50 short video lectures– Supplemented by textual explanations and downloadable

slides and calculation files• Numerous tests and calculation exercises

– Understanding of main concepts– Calculation exercises from real life situations– Feedback is given

13.09.2016 EuCheMS 2016 Seville 12

Page 7: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

7

13.09.2016 EuCheMS 2016 Seville 13

sisu.ut.ee/measurement

13.09.2016 EuCheMS 2016 Seville 14sisu.ut.ee/measurement

Page 8: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

8

13.09.2016 EuCheMS 2016 Seville 15

sisu.ut.ee/measurement

sisu.ut.ee/measurement

13.09.2016 EuCheMS 2016 Seville 16

Page 9: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

9

13.09.2016 EuCheMS 2016 Seville 17sisu.ut.ee/measurement

13.09.2016 EuCheMS 2016 Seville 18sisu.ut.ee/measurement

Page 10: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

10

13.09.2016 EuCheMS 2016 Seville 19

sisu.ut.ee/measurement

13.09.2016 EuCheMS 2016 Seville 20sisu.ut.ee/measurement

Page 11: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

11

13.09.2016 EuCheMS 2016 Seville 21sisu.ut.ee/measurement

Platforms

• Course contents:sisu.ut.ee

• Admin, forums,knowledge evaluation(graded tests):moodle.ut.ee

13.09.2016 EuCheMS 2016 Seville 22

Page 12: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

12

MOOC: UT Moodle Environment

13.09.2016 EuCheMS 2016 Seville 23

Divided into 6 weeks1. The concept and origin of measurement uncertainty2. The basic concepts and tools3. The first uncertainty quantification

– On the example of pipetting

4. The principles of measurement uncertainty estimation (random and systematic effects and definitions for precision, trueness, accuracy)

5. Overview of the measurement uncertainty estimation approaches. The ISO GUM modeling approach– On the example of photometric determination of NH4

+

6. The single lab validation approach. Comparison of different approaches. Comparing measurement results.– On the example of LC-MS determination of acrylamide

13.09.2016 EuCheMS 2016 Seville 24

Page 13: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

13

Weeks in Moodle

13.09.2016 EuCheMS 2016 Seville 25

„Easy“ Test

13.09.2016 EuCheMS 2016 Seville 26

Page 14: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

14

„Difficult“ Test

13.09.2016 EuCheMS 2016 Seville 27

MOOC: Spring 2014 edition270 participants from 40 countries!

13.09.2016 EuCheMS 2016 Seville 28

Page 15: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

15

High participation activity– More than 300 posts to the forums– Constant counseling by our team

Overall completion rate: 52%Completion rate of those who started: 67%13.09.2016 EuCheMS 2016 Seville 29

MOOC: Spring 2015 edition489 participants from 70 countries

3013.09.2016 EuCheMS 2016 Seville

Overall completion rate: 34%Completion rate of those who started: 60%

Page 16: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

16

MOOC: Spring 2016 edition757 participants from 85 countries

Around 600 forum posts

3113.09.2016 EuCheMS 2016 Seville

Overall completion rate: 40%Completion rate of those who started: 67%

MOOCs vs „traditional“ teaching

13.09.2016 EuCheMS 2016 Seville 32

Aspect Conventional university course

Practitioner training (short) course MOOC

Interaction between students and teachers Direct Direct Remote

Possibility to deliver the course simultaneously to many participants Low Low High

Level of self-discipline needed from participants Average Average High

Time constraints, time to “digest” the knowledge Not a problem Serious time

constraintsNot a

problem Possibility of independent homework Possible Usually impossible Possible Possibility of hands-on problem-solving Possible Possible (within the

time constraints) Possible

Possibility of teamwork Possible Possible (within the time constraints) Not easy

Possibility of experimental work Easy Possible, but not easy Not possible

Possibility of working with participants of uneven level or preparation Difficult but doable Difficult Possible

Possibilities of meaningful assessment of obtained knowledge Wide possibilities Difficult Possible

Danger of cheating during knowledge assessment Can be made low Can be made low Can be

high Costs of setting up the coursea Medium Medium Medium Costs of running the coursea High High Low Travel and accommodation costs Can be high Can be high None

I. Leito, I. Helm, L. JalukseAnal Bioanal Chem, 2015,407,1277–1281

Page 17: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

17

„Usage modes“

13.09.2016 EuCheMS 2016 Seville 33

Estimation of MeasurementUncertainty in Chemical analysis

sisu.ut.ee/measurement

On-line course forindependent

learningavailable any time

anywhere

On-line referencepoint

of terminology, explanations and

self-testingpossibilities

Running asMOOC

with registeredparticipation, on-linecounseling, gradedtests and certificate

Course materialfor running trainingcourses e.g. by labs

Support touniversity teaching

Students can bedirected here e.g. for

self-testing

I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281

Visiting statistics

13.09.2016 EuCheMS 2016 Seville 34

Page 18: Using MOOCs for teaching analytical chemistryeach.ut.ee/.../2016/09/Leito_Measurement_Uncertainty_MOOC_EuCh… · MOOC: UT Moodle Environment 13.09.2016 EuCheMS 2016 Seville 23 Divided

18

Many thanks to the team!Materials development

Lauri JalukseIrja Helm

VideoEnno Kaasik

Web design, study administrationTriin Marandi

Lehti PiltEsta Pilt

13.09.2016 EuCheMS 2016 Seville 35

13.09.2016 EuCheMS 2016 Seville 36

sisu.ut.ee/measurement

MOOC – Fourth edition: Spring 2017Registration will open in the beginning of 2017

Thank you for your attention!

I. Leito, I. Helm, L. Jalukse.Anal Bioanal Chem, 2015, 407, 1277–1281