etest solution
DESCRIPTION
Presentation of eTest Solution: Software Integrating Large- and Small-scale Assessment by Srdjan Verbic, Srdjan Božovic and Saša Velickovic (Proceedings if the IADIS international conference e-learning 2012, Lisbon, Portugal, July 17 - 20, 2012, ed. Miguel Baptista Nunes and Maggie McPherson, ISBN: 978-972-8939-71-7, pages 441-444)TRANSCRIPT
![Page 1: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/1.jpg)
eTest Solution: Software for Integrating Large- and
Small-scale Assessment
Srdjan Verbić1, Srdjan Božović2, Saša Veličković2
1 Institute for Education Quality and Evaluation, Belgrade2 MFC Mikrokomerc, Belgrade
18th July 2012 @ Lisbon
![Page 2: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/2.jpg)
Context of e-assessment project
still undeveloped Internet infrastructure just adequate computer classrooms MS Windows only available free software lack of experience curious students unmotivated and
untrained teachers
![Page 3: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/3.jpg)
Typical small- and large-scale tests
Small-scale Large-scale
Sample size classroom hundreds of schools
Example final exam standards setting, PISA, TIMSS
Examinees all students representative sample
Purpose mostly summative mostly formative
Measure how much student knows
what competences students have
Risk-level high-stakes low-stakes
![Page 4: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/4.jpg)
Trial-testing
Trial testing (or pilot-testing)
the same conditions as for final testmore-less the same questionssmaller sample (usually volunteers)(very) low-stakeslooking for items’ characteristics
meeting point of assessment
professionals and teachers
![Page 5: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/5.jpg)
Prehistory of the project
Moodle testing machine, 2007Moodle large-scale on-line test, 2009
![Page 6: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/6.jpg)
Large-scale e-assessment 2007(the evil plan)
put Ttest instead of Quiz adjust Moodle distribution distribute Moodle installation to schools encourage teachers to use it ask them to download test :) collect data
![Page 7: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/7.jpg)
Never-ending series of problems
Moodle is not so good solution for on-line tests, after all.
memory leaking, again unreliable Internet connections slow update of the awkward database …
![Page 8: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/8.jpg)
New system 2011
Microsoft technology
XML based interoperability (like IMS QTI)
Separate system components
On- and off-line testing
Efficient use of multimedia
![Page 9: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/9.jpg)
Digital Schools
2808 schools (95% of all schools in SRB)30,000 working places
2 Multipoint Servers and16 workstations per clssrm
Unfortunately, broadband connection is not included!
htt
p:/
/dig
italn
ask
ola
.rs/
![Page 10: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/10.jpg)
eTest Solution
eTest PlayereTest School PortaleTest Management PortaleTest Question Editor
•SQL Server as database•IIS as Web server•ASP.NET as Web application
platform•Silverlight as a browser plug-
in that for hosting eTest Player
htt
p:/
/mfc
.rs/
![Page 11: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/11.jpg)
Example of unexpected results
![Page 12: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/12.jpg)
Questionnaires’ feedback
Students prefer e-testing mode……and don’t have problem to
communicate with computers.“collective behavior”Teachers agree that <30% of colleagues
would be able to conduct e-testing.Main obstacle: untrained teachersMain challenge: to prepare enough high-
quality tests ready for download
![Page 13: eTest Solution](https://reader033.vdocuments.net/reader033/viewer/2022061110/545310bcaf795904308b51cc/html5/thumbnails/13.jpg)
Further steps
Teachers’ training
Installing software in all digital classrooms
More training
Providing high-quality tests