Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Evaluation‚ Review of remote experiments and curriculum improvement by EU partners‘

Andreja Rojko, University of Maribor

3. PQCC MeetingBelgrade, 14.5.2015

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

SCOPE

One of the comments provided at first monitoring visit of National Erasmus+Office representatives held on 5/12/2014:Following the visit findings, we would like to make the following recommendation and kindly ask you to take them on board during the next implementation of the project:• EU partners need to review all remote experiments and

curriculum improvement at RS institutions initiated under NeReLa project;

In this presentation contains some suggestion how necessary action can be executed and draft of one of the questionnaires.

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

TaskReview of all remote experiments and curriculum improvement at RS

institutions

1. Review of remote experiments 2. Review of curriculum improvement

Two separate activites,

common final report

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Framework

DEV 2: Building up NeReLa network of remote engineering laboratories• DEV2.4 Developing of set of new remote

engineering experiments at partner universities (May 2016)

1. Review of remote experiments

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

• After DEV2.4 Developing of set of new remote engineering experiments at the partner universities is available June 2016

• All instructions on how the experiments can be accessed need to be provided to EU partners (maybe within DEV2.4 report).

1. Review of remote experiments

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

• List of remote experiments according to topics• Reviews will be assigned according to

specializations of EU partners• Review will be organised in such way that we

have at least 4 reviews for each experiment.• Organization:UNIMB

1. Review of remote experiments

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

SUMMARY• Shortly describe the experiment, detected

weaknesses and advantages from technical and educational point of view. Provide any other comments that may help at improvement of the experiment.

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

GENERAL (Depends on final solution)• Booking system Yes/No• Usefulness of booking system 0 .. 5 (excellent)• Integration with existing course management

system 0 .. 5 (excellent)• Simplicity of sign-on system 0 .. 5 (excellent)

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

INSTALLATION AND PLATFORMS • Is additional software/application necessary? Yes/No• Does additional software/application require installation (so

that the user needs to have admin rights)? Yes/No• Is installation easy and straightforward? 0 .. 5 (excellent)• Cross-platform attribute; on which platforms it can be

executed? MS Windows, Linux, MAC OS X, FreeBSD• Cross-platform attribute; access from mobile devices

(smartphone, tablets). Android, IOS, MS Win

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

COMMUNNICATION• Tutorial on usage of remote experiment is clear and concise. 0 ..

5 (excellent)• Intuitiveness of the user interface/software 0 .. 5 (excellent)• Response time after user action. 0 .. 5 (excellent)• Level of access to physical hardware 0 .. 5 (excellent), not

applicable• Level of access to software 0 .. 5 (excellent), not applicable• Capture of experimental results 0 .. 5 (excellent), • Storage of experimental results 0 .. 5 (excellent)

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

COMMUNNICATION• Visual feedback yes/no• Quality of visual feedback 0 .. 5 (excellent)• Audio feedback 0 .. 5 (excellent)• Quality of audio feedback 0 .. 5 (excellent)• Comprehensiveness of a provided visual/audio feedback 0 .. 5

(excellent)• Reliability of the experiment 0 .. 5 (excellent)• Conveys an expression of conducting a real experiment 0 .. 5

(excellent)

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

EDUCATIONAL• The educational goals of the experiment are clearly set. 0 .. 5 (excellent)• The educational goals are fulfilled. 0 .. 5 (excellent)• The experiment is accompanied by an adequate explanations 0 .. 5

(excellent)• Suitability of the experiment for a secondary level. 0 .. 5 (excellent)• Suitability of the experiment for a university level. 0 .. 5 (excellent)• Educational material for teacher 0 .. 5 (excellent)• Educational material for learner, secondary level 0 .. 5 (excellent), not

applicable• Educational material for learner, university level 0 .. 5 (excellent), not

applicable

1. Review of remote experiments

DRAFT EVALUATION FORM

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Framework

DEV 4: Piloting of using the LiRex resources at at HE institutions and secondary vocational schools• DEV 4.1 Integration of remote experiments into the

curricula of networked partner universities (May 2016)

• DEV 4.4. Integration of remote experiments into the curricula of selected vocational schools (June 2016).

2. Review of curriculum

improvement

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Implementation

• Based on DEV 4.1 and 4.4 each EU partner provides a short review, 1-2 pages based on template (Andreja).

• Template can be presented and discussed at the 4th PQCC.

• Deadline for the report of EU partners: 1 month after DEV 4.1 and DEV 4.4 are available.

• Joined review: 2 months after DEV4.1 and 4.4

2. Review of curriculum

improvement

Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration

LOGOof

partnerinstitution

Conclusion

• Draft evaluation questionnaire for ‘Review of remote experiments by EU partners’ will be further developed. Its results can be used also for QA of WP2 and in the evaluation form for the teachers.

• Review of curriculum improvement will be done based on template and DEV4.1 and DEV4.4.

• Next version of questionnaire can be discussed at 4th PQCC meeting