an experimental analysis of the behaviour of a personalized case-based recommendation strategy for...

1
An experimental analysis of the behaviour of a personalized case-based recommendation strategy for the learning domain Almudena Ruiz Iniesta, Guillermo Jiménez Díaz and Mercedes Gómez Albarrán [email protected] , [email protected] , [email protected] Computer Science School – Complutense University of Madrid Acknowledgments Supported by: Spanish Ministry of Science and Education under grant TIN2009-13692-C03-03; and Complutense University of Madrid and BSCH under grant 921330-1079 for consolidated Research Groups. Experiment results: Conclusions Research problem The students are overwhelmed due to the high number of educational resources in repositories. Experimental analysis of the behaviour Retrieve LOs that cover same or similar concepts Filter LOs not ready to be explored Rank according to the LO Quality Retrieva l step Ranking step Student query Ranked list of recommended LOs Study of the ranked list of recommended resources Pedagogical Utility for a LO, a metric that assigns high utility values to a LO if it covers concepts in which the student has shown a low competence level and Similarity between the concepts gathered in the query and the concepts that a LO covers The analysis of the expected behaviour in two dimensions: the adaptation to the student long-term learning goals and the satisfaction of her short-term interests The Normalized Discounted Cumulative Gain (NDCG) measures the usefulness of a result list based on the relevance and the position of the retrieved documents and it compares the obtained gain with the ideal one The case-based strategy obtains high values for pedagogical utility, so the strategy proposes recommendations that satisfy the long-term learning goals. The recommendation strategy always ensures that the proposed LOs meet the short-term goals, because a high similarity with the query is guaranteed. Which one to choose? We propose a recommendation approach for repositories of Learning Objects (LOs) that adapts to the student learning profile Solution Goals How t o Metric s 1 2 2 1 2 2 () () () log () () () (,) (,) () log () () () k i i PU PU PU PU k i i Sim Sim Sim Sim PU L PU L DCG k i NDCG k IDCG k IDCG k Sim L Q Sim L Q DCG k i NDCG k IDCG k IDCG k

Upload: almudena-ruiz

Post on 16-Aug-2015

91 views

Category:

Automotive


1 download

TRANSCRIPT

Page 1: An experimental analysis of the behaviour of a personalized case-based recommendation strategy for the learning domain

An experimental analysis of the behaviour of a personalized case-based recommendation strategy for the learning domain

Almudena Ruiz Iniesta, Guillermo Jiménez Díaz and Mercedes Gómez Albarrán [email protected], [email protected], [email protected]

Computer Science School – Complutense University of Madrid

AcknowledgmentsSupported by: Spanish Ministry of Science and Education under grant TIN2009-13692-C03-03;

and Complutense University of Madrid and BSCH under grant 921330-1079 for consolidated Research Groups.

Experiment results: Conclusions

Research problemThe students are overwhelmed due to

the high number of educational resources in repositories.

Experimental analysis of the behaviour

Retrieve LOs that cover same or similar

concepts

Filter LOs not ready to be explored

Rank according to

the LO Quality

Retrieval step

Ranking step

Student queryStudent query

Ranked list of recommended

LOs

Ranked list of recommended

LOs

Study of the ranked list of recommended resources Pedagogical Utility for a LO, a metric that assigns

high utility values to a LO if it covers concepts in which the student has shown a low competence level

and Similarity between the concepts gathered in the

query and the concepts that a LO covers

The analysis of the expected behaviour in two dimensions: the adaptation to the student long-term learning goals

and the satisfaction of her short-term interests

The Normalized Discounted Cumulative Gain (NDCG) measures the usefulness of a result list based on the relevance and the position of the

retrieved documents and it compares the obtained gain with the ideal one

The case-based strategy obtains high values for pedagogical utility, so the

strategy proposes recommendations that satisfy the long-term learning goals.

The recommendation strategy always ensures that the proposed

LOs meet the short-term goals, because a high similarity with the

query is guaranteed.

Which one to choose?

We propose a recommendation approach for repositories of Learning Objects (LOs) that adapts to the student learning profile

Solution

Goals

How to Metrics

12 2

12 2

( )( )

( ) log( )

( ) ( )

( , )( , )

( ) log( )

( ) ( )

ki

iPUPU

PU PU

ki

iSimSim

Sim Sim

PU LPU L

DCG k iNDCG k

IDCG k IDCG k

Sim L QSim L Q

DCG k iNDCG k

IDCG k IDCG k