© leactivemath, 2006 annual review source: erica melis language-enhanced, user-adaptive,interactive...

© LeActiveMath, 2006 annual review

Source: Erica Melis

Language-enhanced, user-adaptive,interactive eLearning for Mathematics

A Project funded by the European Community under the Sixth Framework Programme for Research and Technological Development

LeActiveMathLeActiveMath

Status and Prospectus

Erica MelisCoordinator

Scuola de Athene, Socrates in dialogue with Alexander

2Source: Erica Melis annual review 2006

Objectives: Objectives: ONEONE Distributed System Distributed System

Adaptivity and personalisationDistributed architecture and servicesOpen student modelingDiagnosis and support of motivational state (autonomy & approval)Variety of learning toolsTutorial dialogues, other language facilitiesModerate constructivist material and ped strategies

Variety of evaluations


Work PackagesWork PackagesWP1 Requirement analysis (DFKI)

WP2 Knowledge representation (UdS)

WP3 Components and tools (DFKI)

WP4 Student modeling (Glasgow)

WP5 Natural language facilities (Edinburgh)

WP6 Content (Augsburg)

WP7 Exercise repository (Tue)

WP8 Implementation, evaluation (Augsburg)

WP9 Dissemination (Klett)

WP10 Management (Eurice)


Interdisciplinary WorkInterdisciplinary Work

AI

Learningpsychology

Education

Web technology

ComputationalLinguistics

mathematics

LeActiveMath


Ambition of LeActiveMathAmbition of LeActiveMath

Large and complex project!

Some of best of (semantic) Web + ITS worlds!

Research + practical results!Cutting edge themes from various disciplines

Basic research + stable system

Practical goals

One system

Thorough evaluations

Recommendations for future research


Some Cutting Edge ThemesSome Cutting Edge Themes

Reuse and interoperability

Services, architecture

Semantics and its usage (search, services, ontologies)

Presentation of Maths on the Web

Student modelling (competencies, motivation ..)

Open learner modeling (man-machine interaction)

NLU and NLG for tutoring and maths, coherent dialogue

Pedagogical + technological innovations


Progress, Progress, statusstatus

requirements

KR

architecture

presentation

Dialogue corpus

internationalization

LM

CASintegrationphrasebooks

dictionary

SietteInteg

content

dialogue

pedStrategies

repository+

design+GUI

Input editor

OLM

iCMap

CASinteraction

Copy&paste

diagnosis

usability

translations

Experiment design


Event-based MVC ArchitectureEvent-based MVC Architecture


ComponentsComponents

Tutorial component: course planner, mediatoexercise choicesuggestor

xLMLM, historySMOLM

Dialogue componentiCMapSearch Semantic Input editorFunction plotter

Exercise repositoryAssessment tool


Exercises Exercises

CAS interaction

Architecture (broker, phrasebooks)

Queries, context

Extension to domain reasoner

Diagram of FSM exercise


Student Modelling: novel approachesStudent Modelling: novel approaches

Need input from Glasgow:

Architecture diagram

Diagnoses algos


Tutorial Dialogues: basic researchTutorial Dialogues: basic research

Need input from Edinburgh:

DM architecture - issues


User Tests and EvaluationsUser Tests and Evaluations

Usability tests (FHG with Klett, UdS, DFKI)

GUI design (progress bar, TOC, menu..)

Small formative tests

Midterm formative evaluation in schools (partial)

Midterm evaluation at university

User-tests of components

Plan for main evaluations in several countries


SE Work and Management TasksSE Work and Management Tasks

Professional software engineeringVersion management

Maintenance of 3 versions

Integration of vairety of modules

Efficiency of implementations

Release management

AmendmentsNew partner: Glasgow

New partner Munich

Leaving partners

Some delays

Communication of partners


Issues Raised Issues Raised (interim review 2005)(interim review 2005)

D11 corpus collectionNumber interactions

Few derivative examples

English only

D15 search – evaluation: precision and recall?

D20 pedagogical strategies methodology of validation?

D21 exercise repository links to other modules?

D22 authoring tool feedback for learner, state-of-art?

D23 design of GUIs evaluation methodology, state-of-art?

Demos needed


D11D11

Number of interactions for corpusStandard among research in tutorial dialogues (BEE, Monroe,Why2-Atlas)

For exploratory purposes to inform initial system

results statistically significant (symbolic and natural language)

Only derivativeRecommended by domain experts

Various phenomena and skills (deriv, algebraic transformations)

13 hours interaction

Domain reasoner feasible

Only EnglishDifficulty of task, stated in DoW, reusable for other languages


D15 D15 evaluation?evaluation?

Precision of common sample (found relevant/found)

Recall of common sample (found relevant/ overall relevant)

No common samples with maths

Comparison with text search od Google search (special access preparation)


D20 D20 evaluation of pedagogical strategiesevaluation of pedagogical strategies

Questionnaires for teachers and studentsAttitudes, acceptance, suggestions, when

Online questionnaires

Small scale comparative lab studies (LearnNew)


D22 D22 authoring toolauthoring tool

Exercise feedback in LeAM Flag feedbackProcess helpProduct helpauthorable

Diagnosis capabilities (multi-step exercises)

Media files help illustrate task, motivate tasks, make task understandable (multi-channel)Sound sometimes helpful

Interactions, answer maps


D23 D23 usability studyusability study

Total Quality Management DIN ISO 9004

Heuristic expert evaluation

Discussion and implementation possibilities

New design FHG

Usability lab tests 10 subjects school, university

Re-design and dynamic implementation UdS/DFKI


Conclusion: Conclusion: www.leactivemath.orgwww.leactivemath.org

Ambitious research project, practical usage

Good progress in second year

Deliverables essentially completed

Demos ahead


DemonstrationsDemonstrations

Overall systemInput editor

Content

GUI design

search

Tutorial dialogue

xLM + open learner model

Services: repository, Siette

iCMap

Copy and paste

CAS interaction


THIS ENDS OVERVIEW TALKTHIS ENDS OVERVIEW TALK

The other slides can answer more questions


Additional WorkAdditional Work and Deviations and Deviations

Domain reasoner

Exercise system

competency-pedagogy

postponed deliverablesOLM dialogue

TC

Univ. content

Midterm evaluation

More time for WP5

More time for system consolidation

Due to changing places personell problems:


Multi-disciplinary ResearchMulti-disciplinary Research

Cognitive and pedagogical basis

Specialists from variousIntelligent tutoring

Web technology

Adaptive hypermedia

User modeling

Knowledge representation

Computational linguistics

Socio-linguistics

HTN planning

Computer algebra systems

Data bases

Competency-based pedagogy

Test theory


WP6 Pedagogy, ContentWP6 Pedagogy, Content

Knowledge is constructed by humans

Learning is an active and self-directed

situated, contextual, social process

Learners’ active role and responsible for own learning

exploration, tool usage, dialogue, reflection, etc

Moderate constructivism: sensible balance between construction and briefing

Competence connection between knowledge and ability

competence- levels determined by theory and empirical tests


WP9 DisseminationWP9 Dissemination

Press releases

Talks

Scientific publications

Conferences and workshops

D36Web site, leaflet, poster …


WP10 ManagementWP10 Management

Arno Schwarz, ministry of education, Saarland

Christian Bokhove, teacher secondary school Zaandam, NL

Hermann K. Baeumel, teacher secondary school Scotland

Rolf Schulmeister, multi-media pedagogy, Germany

Edith Schneider, teacher eduaction, Austria

Donald Peterson, IoE London UK

Sofoklis Sotiriou, EU-project CONNECT

Advisory BoardAdvisory Board


WP10: External CooperationsWP10: External Cooperations

Kaleidoscope NoE

ProLearn NoE

iClass

COLDEX

MKM

Others: CMU, IU


TitleTitle

Erste EbeneZweite Ebene

Dritte Ebene

Vierte Ebene

© leactivemath, 2006 annual review source: erica melis language-enhanced, user-adaptive,interactive...

Documents

erica melis annual review

annual review source

erica melis language

alexander slide

future research slide

architecture semantics

architecture issues

basic research need