criteria for evaluating an educational blog as a scientific one

27
Vasileios Sotiroudas (Bsc, Med, IT Teacher) Antonios Lionarakis (Assistant Professor at HOU) “Criteria for evaluating an educational blog as a scientific one” 1

Upload: vasilis-sotiroudas

Post on 12-Nov-2014

2.071 views

Category:

Education


3 download

DESCRIPTION

The research work with the title ""Criteria for evaluating an educational blog as a scientific one" was presented by Vasilis Sotiroudas and Antonis Lionarakis (Assistant Professor at the Hellenic Open University) at the 7th International Conference in Open and Distance Learning in Athens.

TRANSCRIPT

Page 1: Criteria for evaluating an educational blog as a scientific one

Vasileios Sotiroudas (Bsc, Med, IT Teacher)

Antonios Lionarakis (Assistant Professor at HOU)

“Criteria for evaluating an educational blog as a scientific

one”

1

Page 2: Criteria for evaluating an educational blog as a scientific one

The aim…

This research paper explores the criteria by which an educational blog can be characterized as scientific

2

Page 3: Criteria for evaluating an educational blog as a scientific one

Methodology

A combination of quantitative and qualitative approach was used in this research work. In order to answer the research questions, a complex two-phase-strategy was followed, ensuring the maximum validity of the survey’s content

3

Page 4: Criteria for evaluating an educational blog as a scientific one

First Phase - Purpose

In the first phase, the literature review led to the development of a qualitative questionnaire which 10 experts on the field were invited to answer. The purpose of this phase was firstly to record the criteria by which they evaluate an educational blog as scientific and secondly, to check the findings of the literature review for completeness.

4

Page 5: Criteria for evaluating an educational blog as a scientific one

First Phase - Participants

The ten experts who have accepted the invitation and who returned a completed questionnaire were:

1.Professor Peter Jarvis 2.Professor Knud Illeris 3.Professor Michel Alhadeff-Jones 4.Assistant Professor Antonis Lionarakis5.Assistant Professor Vasilios Dagdilelis 6.Assistant Professor Andreas Oikonomou 7.Researcher George Palaigeorgiou

5

Page 6: Criteria for evaluating an educational blog as a scientific one

First Phase - Participants

8. Author Nikos Dapontes9. Special Advisor Konstantinos Kiourtsis10. School Counselor Leonidas Katsiras

6

Page 7: Criteria for evaluating an educational blog as a scientific one

First Phase – Findings

Experts seem to give more importance to issues such as :

1. The contribution of the blog on various aspects of science (production, dissemination, monitoring and questioning of scientific knowledge)

2. The personality of the blog administrator3. The reliability of published information4. The democratic policy they follow regarding

how to publish the post comments5. The online community created between the

blog and its readers6. The transparency to the purposes and goals of

the blog

7

Page 8: Criteria for evaluating an educational blog as a scientific one

Second Phase - Purpose

In the second phase, after synthesis and critical evaluation of the responses given by the experts, a questionnaire was prepared and posted on the internet and in which readers of educational weblogs were asked to answer the questions

The purpose of this phase was to assess the criteria by which the readers themselves evaluate an educational blog as a scientific one.

8

Page 9: Criteria for evaluating an educational blog as a scientific one

Online Questionnaire

Most of the questions in the questionnaire were posed according to Likert’s hierarchy scale of 5 degrees in a table. The outcome was that a total of 26 online questions created 55 independent and dependent research variables.

The independent variables of the study were sex, age, education, employment status, marital status and income. All independent variables were nominal. From the dependent variables, 48 were ordinal, while 7 were nominal.

9

Page 10: Criteria for evaluating an educational blog as a scientific one

Analysis

Due to the fact that the research variables were nominal or ordinal, for every two variables (one independent with each of the dependent) was made an inspection of the nonparametric statistic test of x2, applying as a correction the exact test of Monte Carlo in the cases where observed frequency <5. All tests were performed in a confidence interval of 95%.

10

Page 11: Criteria for evaluating an educational blog as a scientific one

Analysis

The tested cases were:H0: there is independence between the two

variablesH1: there is no independence between the two

variables

11

Page 12: Criteria for evaluating an educational blog as a scientific one

Participants

The questionnaire was completed by 519 people over a period of 45 days which was available for online completion. In the presentation of results that follows, there are no remaining answers, since the answer to all the questions in the questionnaire was mandatory

12

Page 13: Criteria for evaluating an educational blog as a scientific one

Findings

The online questionnaire shows good level of internal reliability/consistency (a = 0.825).

13

Page 14: Criteria for evaluating an educational blog as a scientific one

Findings

Readers of educational blogs rank in order of importance the categories of evaluation criteria of an educational blog as a scientific one as follows:1. Quality of Content2. Transparency3. Contribution to Scientific Knowledge4. Design

14

Page 15: Criteria for evaluating an educational blog as a scientific one

Findings

Categories of evaluation criteria

15

Page 16: Criteria for evaluating an educational blog as a scientific one

Findings

Quality of Content

16

Page 17: Criteria for evaluating an educational blog as a scientific one

Findings

Transparency

17

Page 18: Criteria for evaluating an educational blog as a scientific one

Findings

Contribution to Scientific Knowledge

18

Page 19: Criteria for evaluating an educational blog as a scientific one

Findings

Design

19

Page 20: Criteria for evaluating an educational blog as a scientific one

Findings

In each of the above categories of evaluation criteria a host of other sub-criteria were included, the analysis of which is beyond the scope of this paper. However, the overall analysis produced the following table of evaluation criteria of an educational blog as a scientific one, in a hierarchical order.

20

Page 21: Criteria for evaluating an educational blog as a scientific one

Criteria for evaluating an educational blog as a scientific one

1. Quality of Content clarity - understandability of information objectivity in the presentation of issues completeness in coverage that addresses the

blog lack of spelling and grammar errors frequency of new content blog posts refer on other reliable sources accuracy of the information provided support the blog posts with literature

21

Page 22: Criteria for evaluating an educational blog as a scientific one

Criteria for evaluating an educational blog as a scientific one

2. Transparency declaration of the purpose and the goals of

the blogdeclaration of blog’s topicsdeclaration of who sustains and / or finance

the blog

22

Page 23: Criteria for evaluating an educational blog as a scientific one

Criteria for evaluating an educational blog as a scientific one

3. Contribution to Scientific Knowledge they make more accessible to the public

scientific works and researches contribute to the dissemination of scientific

knowledge allow readers to judge and comment on

previously published works and articles the interaction of readers develop critical

thinking that contributes to building knowledge

offer to everyone the opportunity to publish their work and put them in public review

23

Page 24: Criteria for evaluating an educational blog as a scientific one

Criteria for evaluating an educational blog as a scientific one

provide the ability to all researchers to publish their works, but without criteria their posts should be published first in scientific journals and / or conferences should apply peer review process for unpublished works and researches before posting them

24

Page 25: Criteria for evaluating an educational blog as a scientific one

Criteria for evaluating an educational blog as a scientific one

4. Designability to internally search in blog postsarchiving blog postsaccessibility for people with disabilitiesthe overall aesthetics of the blog (colors,

background, etc.)possibility of translation into foreign

languages

25

Page 26: Criteria for evaluating an educational blog as a scientific one

Conclusion

Grouping the above criteria in the category of contribution to scientific knowledge of four aspects of science, leads to the following ranking in order of importance:

1. dissemination of scientific knowledge2. test of scientific knowledge3. dispute of scientific knowledge4. production of new scientific knowledge

26

Page 27: Criteria for evaluating an educational blog as a scientific one

Thank you very much for your attention!!!

27