Dimensions and parameters for the evaluation of e-

learningDr. Bernhard Ertl

Why evaluation?

• To ensure the quality of the learning environment

• To ensure acceptance of the learning environment

• To learn about learners´ needs

• To prove the value and benefits of the environment to financers and participants

Results of an Evaluation

• Increased knowledge of learning processes

• Knowledge of the effectiveness of the learning environment

Target-group-specific improvements

Evaluation Forms

• Formative Evaluation– Takes place during the course

• Summative Evaluation– Takes place at the end of the course

Formative evaluation

Analysis of the learning process:

– Discovering problems

– Optimisation of the learning environment

Summative Evaluation

Analysis of the outcomes:

– Knowledge gain

– Acceptance

Evaluators

• Learners

• Teachers

• Experts– Internal– External

Dimensions of evaluation

• Cognitive dimension

– do the learners have the necessary strategies to work

in the learning environment? • Epistemological dimension

– the structure and implementation of the content

• Social dimension – available facilitation, tutoring and sociability

• Technical dimension– usability and technical support offered

Cognitive Dimension

• Learning prerequisites- Does the learning environment allow learners

to activate existing knowledge?- Do the learners have required prior

knowledge?

• Learning strategies- Which strategies are encouraged in the

environment?- Are the learners supported in their use of

strategies?

Epistemological Dimension

• Appropriateness of content- Who is the target group?- Is the content up-to-date?

• Didactical design- Based on a particular education theory?- Which concrete learning goals?

• Acceptance- Would participants recommend the course?- Did it meet their expectations?

Social Dimension

• Facilitation- To what extent do the users receive support

in collaborative learning?- Do tutors and pupils have set roles and

tasks?

• Sociability- Are the face-to-face and online elements well

integrated?- Is there a positive social environment within

the groups?

Technical Dimension

• Usability- Are the tools appropriate and adequate?- Usability and design of the environment?

• Support- Is the technical support offered to the users

adequate?

Evaluation Model during Implementation

Planning phase Implementation

• Aims

• Appropriateness

• Didactical Design

• Learning prerequisites

• Learning strategies

• Appropriateness

• Didactical Design

• Learning prerequisites

• Learning

results

• Fulfillment

of aims

• Acceptance

formative summative

Pilot

• Learning processes

• Learning strategies

• Sociability

• Technical Support

• Learning prerequisites

Evaluation during productive Use

Learners in learning environment

formative: summative: learning process outcomes acceptance

Analysis of test results

Addition of necessary changes

Summary

• Evaluation is key to any e-learning project

• Evaluation may take place continuously throughout a project

• A number of parameters must be considered in order to evaluate a learning environment as a whole

Thank you for your attention