training and evaluation tool milan jovic dusan jevtic dr dragan jankovic public reporting on project...

Training and Evaluation ToolTraining and Evaluation Tool

Milan JovicMilan Jovic

Dusan JevticDusan Jevtic

Dr Dragan JankovicDr Dragan Jankovic

Public Reporting on Project ResultsPublic Reporting on Project ResultsTEMPUS projectTEMPUS project

Outlines Outlines ::

IntroductionIntroduction About existing solutionsAbout existing solutions TET packageTET package ConclusionConclusion


IntroductionIntroduction

This is the century when school system can not be imagine This is the century when school system can not be imagine to work without computer assistance. Software developed to work without computer assistance. Software developed for learning in classrooms or from home are present in for learning in classrooms or from home are present in large percent of schools in every country. This kind of large percent of schools in every country. This kind of software is almost always developed for some of next software is almost always developed for some of next purposes :purposes :

Distance learning Distance learning Question generators Question generators Test generatorsTest generators Students testingStudents testing Away laboratories Away laboratories


Large analysis number of existing packages shows that Large analysis number of existing packages shows that followingfollowing set of functionalities should be implemented in set of functionalities should be implemented in every serious application dedicated to evaluation or training :every serious application dedicated to evaluation or training :

Possibility to make fast tests easyPossibility to make fast tests easy Large number of different formats for the same testLarge number of different formats for the same test Fast creating different set of tests for each studentFast creating different set of tests for each student Creating set of tests with switched question places (in Creating set of tests with switched question places (in

every test every question is different numbered)every test every question is different numbered) Unlimited number of tests Unlimited number of tests Unlimited number of questions per testUnlimited number of questions per test Possibility to transform created test for any other devicePossibility to transform created test for any other device Possibility to already created test for some device can Possibility to already created test for some device can

easily transform for any othereasily transform for any other Every student should have his/her own Every student should have his/her own accountaccount


Notice start time, for every test and each student, when Notice start time, for every test and each student, when he/she began solving some test and also end time.he/she began solving some test and also end time.

Templates for adding tests in database from fileTemplates for adding tests in database from file Possibility for hand marking correct and wrong answersPossibility for hand marking correct and wrong answers In period of learning, possibility to give, as much as In period of learning, possibility to give, as much as

possible, good answers and explanations for each question.possible, good answers and explanations for each question. Possibility to put in the group any set of questions, so test Possibility to put in the group any set of questions, so test

should consist whole set or none of them.should consist whole set or none of them. Possibility to set time that some student has to solve the Possibility to set time that some student has to solve the

test.test. Software should automatic do all necessary statistics after Software should automatic do all necessary statistics after

every given answer. every given answer. Possibility to create reports with statistics that we wantPossibility to create reports with statistics that we want Possibility to make new test from the set of exist tests.Possibility to make new test from the set of exist tests. Possibility to attach multi-media files (sounds, pictures, Possibility to attach multi-media files (sounds, pictures,

movies) to any questionmovies) to any question


Possibility to review the answers of some student after Possibility to review the answers of some student after some period and to compare them with the key for same set some period and to compare them with the key for same set of questions.of questions.

To embed filters in purpose of exporting any document to To embed filters in purpose of exporting any document to MS-Word, for example, or some other.MS-Word, for example, or some other.

To embed FTP protocol for distance database changeTo embed FTP protocol for distance database change Different level of access for every type of usersDifferent level of access for every type of users Word processing with options for font and color change, Word processing with options for font and color change,

for example (with Find dialog , Replace dialog, etc.)for example (with Find dialog , Replace dialog, etc.) Possibility to add references to any question in faze of Possibility to add references to any question in faze of

creatingcreating Check the validation of test, meaning that data in test is Check the validation of test, meaning that data in test is

inserted correctly.inserted correctly. Possibility to disable some questions to be inserted in test Possibility to disable some questions to be inserted in test Computer should read questions on speakers. This option is Computer should read questions on speakers. This option is

very important in last few years.very important in last few years.


About TET packageAbout TET package This package is developed in program language DelphiThis package is developed in program language Delphi asas

KylixKylix application. Database server that we used is MySQL.application. Database server that we used is MySQL.

TETTET packagepackage consists consists ooff three separated partsthree separated parts Administrating partAdministrating part Question and test generatorQuestion and test generator TesterTester

Common for all known packages is separated part for Common for all known packages is separated part for administration administration


Question generatorQuestion generator ( (with this generator we can make with this generator we can make questions and create groups of questions where every question questions and create groups of questions where every question belongs to some of them)belongs to some of them)

Test generatorTest generator (dedicated to make tests using questions from (dedicated to make tests using questions from existing groups. We can choose one or more groups, and take existing groups. We can choose one or more groups, and take one or more questions from everyone of them.)one or more questions from everyone of them.)

TesterTester (with this tool we can test every student - solving some (with this tool we can test every student - solving some of already prepared tests)of already prepared tests)


TTEETT package package featuresfeatures ::

Flexible interfaceFlexible interface Dynamic forms and componentsDynamic forms and components Simple upgrade of databaseSimple upgrade of database Application portability on Linux operating systemApplication portability on Linux operating system Easy work with application.Easy work with application.


Types of question in question generatorTypes of question in question generator

Yes/No questions Yes/No questions Questions with more Questions with more

given possible answersgiven possible answers Connect familiar words Connect familiar words Put pictures on right placesPut pictures on right places Fill blanks in sentencesFill blanks in sentences




given possible answersgiven possible answers Connect familiar words Connect familiar words Put pictures on right placesPut pictures on right places Fill blanks in the sentencesFill blanks in the sentences



Yes/No questions Yes/No questions Questions with moreQuestions with more

given possible answersgiven possible answers Connect familiar words Connect familiar words Put pictures on right placesPut pictures on right places Fill blanks in sentencesFill blanks in sentences




given possible answersgiven possible answers Connect familiar wordsConnect familiar words Put pictures on right placesPut pictures on right places Fill blanks in sentencesFill blanks in sentences




given possible answersgiven possible answers Connect familiar words Connect familiar words Put pictures on Put pictures on

right placesright places Fill blanks in sentencesFill blanks in sentences




given possible answersgiven possible answers Connect familiar words Connect familiar words Put pictures on right placesPut pictures on right places Fill blanks in Fill blanks in

sentencessentences


Test generator features :Test generator features :

There are two different ways of test making that we can apply There are two different ways of test making that we can apply in this package :in this package :

We can personally decide witch questions will be on the We can personally decide witch questions will be on the test, picking one by onetest, picking one by one

As it’s said that every question has to belong to some of As it’s said that every question has to belong to some of existing groups (areas), we can just pick the groups and, existing groups (areas), we can just pick the groups and, separated for each of them, choose percent of questions separated for each of them, choose percent of questions those we want on the test from each group of questionsthose we want on the test from each group of questions


TesterTester

Test selectionTest selection Notice date and time for every test that student worked onNotice date and time for every test that student worked on Notice number of points won on each testNotice number of points won on each test Testing – all question are on the same form (imitation of paper Testing – all question are on the same form (imitation of paper

work)work) Errors and points review for each testErrors and points review for each test


ConclusionConclusion

Until now, developed parts of package are almost ready to be Until now, developed parts of package are almost ready to be used and tested on our faculty. For the beginning, it will be used and tested on our faculty. For the beginning, it will be tested with programming exam, techniques and methods of tested with programming exam, techniques and methods of programming, etc.programming, etc.

We are planning to spread this package to some kind of tool We are planning to spread this package to some kind of tool for making questions and tests where we will not be limited by for making questions and tests where we will not be limited by five different types of question. There should be a board with five different types of question. There should be a board with all necessary elements next it and we should just put elements all necessary elements next it and we should just put elements on the board, set their properties and connect them, making a on the board, set their properties and connect them, making a question on that way.question on that way.


Thank you !Thank you !

Contact e-mails :Contact e-mails :

Milan Jovic – [email protected] Jovic – [email protected] Dusan Jevtic – [email protected] Jevtic – [email protected] Dr Dragan Jankovic – [email protected] Dragan Jankovic – [email protected]


training and evaluation tool milan jovic dusan jevtic dr dragan jankovic public reporting on project...

Documents

test computer

created test

test generatortesterc

validation of test

new test

set of questions

different set of tests

accountpublic reporting