![Page 1: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/1.jpg)
Decentralization, Autonomy, and Participation in Multi‐User/AgentParticipation in Multi User/Agent
EnvironmentsJulita VassilevaMADMUC Lab,
Computer Science DepartmentComputer Science Department, University of Saskatchewan, Canada
![Page 2: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/2.jpg)
Evolution of computing architecturesEvolution of computing architectures
![Page 3: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/3.jpg)
1970 1980
Personal computing
1990Multi‐user terminals
Internet
![Page 4: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/4.jpg)
2000 ‐ present2000 present
Ubiquitous computingP2P computing: BitTorrent, Skype
![Page 5: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/5.jpg)
resulting in…resulting in…
![Page 6: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/6.jpg)
Evolution of e‐learning architectures
![Page 7: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/7.jpg)
History of e‐learning architecturesy g
1960, 1970
Multi‐user terminals
teacher server
TN
T
S
L
SC
S
UD E
N LI
E NT
Lecture ModelLecture Model
![Page 8: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/8.jpg)
1980‐1990
Individualized Instruction
teacher
student
Tutor modelIntelligent tutoring system
![Page 9: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/9.jpg)
1990‐present
teacherdesigner
teacher
discussion on‐line resources
teacher
forum
S
TU E
NT
S
TU
T
SSS
NS
C
L SUD E D E
NC
LI E N
TS L
IE N
TS
![Page 10: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/10.jpg)
2000 ‐ presentpEmphasis on collaboration
teacher
Community of Peer LearnersP2P Architecture
![Page 11: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/11.jpg)
![Page 12: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/12.jpg)
Why did we do all that researchWhy did we do all that research
Individualized learning?gLearner Modelling?
Instructional Planning? g….
even Collaborative Learning? g
All that seems important now is pgraphics, multimedia, the next social thing.
![Page 13: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/13.jpg)
So, let’s buy an island in SecondLife!
![Page 14: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/14.jpg)
no place for AI in Ed on this islandno place for AI in Ed on this island
YetYet..
![Page 15: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/15.jpg)
• Knowledge is built gradually: – can students learn by themselves, without any guidance?
• We want teachers and students to participate:– 85% of users do not participate p p
• We want some order and predictability:– many people put together usually make a crowdmany people put together usually make a crowd, not a team
• People learn in different ways:People learn in different ways:– will students be able to find the best way for them the best helpers / partners?them, the best helpers / partners?
![Page 16: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/16.jpg)
“no place for AI in ED”
![Page 17: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/17.jpg)
Implications from Web 2.0?Implications from Web 2.0?
• Decentralization of resources and controlDecentralization of resources and control– User contributed content (user = teacher, learner, designer )designer, …)
– Autonomous, self‐interested users
• Rule: hard/impossible to impose hard rules• Rule: hard/impossible to impose hard rules– Ease of use is very important
C l it f “i t lli t t h i ” h t b– Complexity of “intelligent techniques” has to be hidden
![Page 18: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/18.jpg)
Example ApplicationExample Application
• Comtella: social bookmark sharing systemComtella: social bookmark sharing system
• Used in a class
S d d h fi d b• Students do research, find web‐resources related to the class and share them
• They have to pick resources to summarize
one each week
![Page 19: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/19.jpg)
More examplesMore examples
• Open Learning Object repositoriesOpen Learning Object repositories
• Teachers sharing educational games they have developeddeveloped
• Teachers blogging about what worked in their h i d 5 l lphysics grade 5 class on planetary systems…
• Learners sharing digital photos from a school‐trip to the local swamp
![Page 20: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/20.jpg)
ProblemsProblems
How to find what you want?
How to contribute so that you (and others) can find it?find it?
Annotation
![Page 21: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/21.jpg)
How to ensure mutual understanding?How to ensure mutual understanding?
![Page 22: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/22.jpg)
Implementation of taxonomy‐based annotation
![Page 23: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/23.jpg)
OR
![Page 24: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/24.jpg)
Solution: in the middleSolution: in the middle
DATA MINING OF USER CONTENT ONTOLOGYDATA MINING OF USER CONTENT
“Snap to grid” (Gruber)
Ch. Brooks, N. Montanez. (2006)Improved Annotation of the
Suggest tags
pBlogopshere via Autotagging and Hierarchical ClusteringProc WWW06, Edinburgh, May 2006.
![Page 25: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/25.jpg)
Features of the solutionFeatures of the solution
• Easy for the user – just like a folksonomyEasy for the user just like a folksonomy
• The AI happens in the background, user is not aware of itaware of it
• Simplicity and ease of use preserved, d f l dd dadvantages of ontology added
• User in the loop
![Page 26: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/26.jpg)
How to stimulate participation and contributions?
U tUsers are autonomousThey won’t follow hard rules
![Page 27: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/27.jpg)
Designing an incentive mechanism in the system (like a game)the system (like a game)
Mechanism design – a branch of economics / game theory
Nobel Prize in
Economicseconomics / game theory
I i b i i l
Economics2007
Incentives can be economic, social
![Page 28: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/28.jpg)
Design to allow for social comparisonDesign to allow for social comparison
S i l P h l (F i )Social Psychology (Festinger)Upwards: positive, leads to growth through competition, peers
that are better off serve as role modelsthat are better off serve as role models
Downwards: leads to feeling good about oneself
![Page 29: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/29.jpg)
Incentive Mechanism DesignIncentive Mechanism Design
• Comtella 2004Comtella 2004
• User participation is rewarded by status (user model)model)
• Participation and status are shown in a i i li icommunity visualization
![Page 30: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/30.jpg)
Incentive: StatusIncentive: Status
Customer Loyalty Programs
Image from depts.washington.edu/.../painting/4reveldt.htm
![Page 31: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/31.jpg)
Why does it work?Why does it work?
• Social Psychology:Social Psychology:
• Theory of Discrete Emotions: FearWh l f id f l i thi– When people are afraid of loosing something, they are very sensitive to messages about how to avoid the dangeravoid the danger
![Page 32: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/32.jpg)
Incentive mechanism llin Comtella 2004
• Rewarding participatory acts with points and
Ran ChengM.Sc.
• Rewarding participatory acts with points and status
Th i t b– The user earns points by:• sharing new links, rating links, etc.
P i t l t d lt i
Gold
Silver60%
10%
– Points accumulate and result in
higher status for the userBronze30%
• Memberships:
![Page 33: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/33.jpg)
![Page 34: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/34.jpg)
Comtella 2004: interactive vis.
Lingling SunM.Sc.
![Page 35: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/35.jpg)
Results: group contributionsDistribution of the Orginal Contributions on Each Topic over Time
220
160180200220
harin
g
80100120140
r of N
ew S
h
020406080
Num
be
01 2 3 4 5 6 7 8 9 10
Topics over TimeWithout status and visualization With status and vis1 2 3 4 5 6 7 8 9 10 topics1 2 3 4 5 6 7 8 9 10 topics
![Page 36: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/36.jpg)
Results: visualization usageResults: visualization usage
Correlation: 0.66
![Page 37: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/37.jpg)
Lessons learned
• User Status is very effective in increasing ti i ti i h i b tparticipation in sharing new papers, but
– stimulated low quality papers; excessive number of t ib ti t d t i th tcontributions, students gaming the system
cognitive overload and withdrawal
need to stimulate contributions early in the week– need to stimulate contributions early in the week
– Multi‐views in visualization not useful
Sun, L., Vassileva, J. (2006) Social Visualization Encouraging Participation in Online Communities, Proc. CRIWG’06, Springer LNCS 4154, 345-363.
Cheng, R., Vassileva J. (2005) User Motivation and Persuasion Strategy in P2P Communities, Proc. HICSS’38, Minitrack on Online Communities, IEEE Press.
![Page 38: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/38.jpg)
Orchestrating the desired behavioursOrchestrating the desired behaviours
• Adapt dynamically the incentivesAdapt dynamically the incentives– “Contributions needed early in the week – higher reward”reward
– “If one tends to contribute junk, do not reward him as much as one who contributes good stuff”him as much as one who contributes good stuff
• Teacher defines a target number of contributions each weekcontributions each week
![Page 39: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/39.jpg)
Comtella 2005Comtella 2005
• Adaptive rewards mechanismAdaptive rewards mechanism
![Page 40: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/40.jpg)
i fPoints for rating
![Page 41: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/41.jpg)
http://umtella usask cahttp://umtella.usask.ca
![Page 42: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/42.jpg)
Extrinsic incentive for ratingExtrinsic incentive for rating
• Currency as payment for rating ‐ C‐pointsCurrency as payment for rating C points– Earned with each act of rating
Can be invested to “sponsor” own links (like– Can be invested to sponsor own links (like Google’s sponsored links)
– Decay over time– Decay over time
![Page 43: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/43.jpg)
Comtella 2005 visualization
Colour (4) – membership (status)Colour (4) membership (status)
Brightness (4) – reputation (quality of contributions)
Size (4) – number of original contributions
128 images generated using OpenGL with parameters: size colour temperature/brightness
State (2) – offline or online
- size, colour, temperature/brightness
![Page 44: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/44.jpg)
Visualization – Final Design2005
g
![Page 45: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/45.jpg)
Lessons learnedLessons learned
• Incorporating an incentive mechanism can stimulate a desired p gbehaviour in an online community
– the c‐points stimulated twice as many ratings in controlled t dstudy• can be useful for collaborative filtering systems
• An adaptive rewards mechanism can orchestrate a desired ppattern of collective behaviour
– the time‐adaptation of the rewards stimulated users to make ib i li (71% 60% f ib i b i dcontributions earlier (71% vs 60% of contributions submitted
in the first 3 days)
• It is important to make the user aware of the rewards forIt is important to make the user aware of the rewards for different actions at any given time
![Page 46: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/46.jpg)
Implications from Web 2.0?Implications from Web 2.0?
• Decentralization of resources and controlDecentralization of resources and control– User contributed content (user = teacher, learner, designer )designer, …)
– Autonomous, self‐interested users
• Rule: hard/impossible to impose hard rules• Rule: hard/impossible to impose hard rules– Ease of use is very important
C l it f “i t lli t t h i ” h t b– Complexity of “intelligent techniques” has to be hidden
![Page 47: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/47.jpg)
Comtella‐D: using “gentler” socialComtella D: using gentler social incentives
• Users building relationshipsSupport users in building relationships Andrew Webster– Support users in building relationships
– Relationships may stimulate reciprocation
R i ti i i i l
M.Sc.
– Reciprocation is an emerging social norm
• “If he reads / rates / comments my postings, I ll l d / / h ”will also read / rate / comment his postings”
![Page 48: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/48.jpg)
Social Visualization
Shows the two directions ofreciprocity on a XY‐graph fromthe viewpoint of the userlooking at the visualization. Axis X how close the viewer is toAxis X – how close the viewer is toother users from their point of view, Axis Y – how close are others from the viewer’s point of view.Only the “closeness” and the“symmetry of relationship”between the viewer and other users is shown not any otherusers is shown, not any otherinformation.
![Page 49: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/49.jpg)
Incentive for ratingIncentive for rating
• Immediate reward after desirable actions –pleasing effect (makes rating more fun)pleasing effect (makes rating more fun)
• Showing immediately the social and personal i f h i iimpact of the given rating
![Page 50: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/50.jpg)
Community energyCommunity energy@work Energy Stored Energy
The quick red fox jumped over the lazy red dog.By Andrew
The quick red fox jumped over the lazy brown dog.By Andrew
The quick red fox jumped over the lazy brown dog.By Andrew
The quick red fox jumped over the lazy brown dog.By Andrew
By Andrew
All generalizations are false, including this one.By Mark Twain
All generalizations are false, including this one.By Mark Twain
![Page 51: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/51.jpg)
Immediate gratification for ratinghttp://fire.usask.ca
Topics and individual postings that are rated higherappear “hot”, those rated lower appear “cold”pp , pp
colours ease navigation in the contentaesthetically pleasing, intuitive
![Page 52: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/52.jpg)
Lessons LearnedLessons Learned
• The immediate reward stimulated ratings (2The immediate reward stimulated ratings (2 times more than in control group)
• The visualization stimulated reciprocation• The visualization stimulated reciprocation –more symmetrical relationships in test group
I l d th l k t ti i t i t t– Involved the lurkers to participate more in test group
Webster A.S., Vassileva J. (2006) Visualizing Personal Relations inWebster A.S., Vassileva J. (2006) Visualizing Personal Relations in Online Communities, (2006) in Adaptive Hypermedia and Adaptive Web-Based Systems, Dublin, Ireland, Springer LNCS 4018, 223-233.
![Page 53: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/53.jpg)
Link to Open Learner ModelingLink to Open Learner Modeling
To harvest the advantages of multi‐user system, need to consider g y ,the user features NOT in isolation, but in relation to those of other users in the community
Make the learner aware of her Social Context!
Stimulate reflection, activate social norms
Social Visualization
![Page 54: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/54.jpg)
Open Learner Modeling (in AI‐Ed)Open Learner Modeling (in AI Ed)
• Ensure learner’s awareness of her progress towardsEnsure learner s awareness of her progress towards her learning goals and stimulate reflection
• Provide a way for the learner to annotate or correct yerrors in the learner model and thus involve the user in construction of the user model or engage the user in dialogue / argument
• Provide for the teacher an ongoing evaluation of the l ’ flearner’s performance
![Page 55: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/55.jpg)
• Bull S & McEvoyBull, S. & McEvoy
Bull, S. & McEvoy
CourseViz, Mazza & Dimitrova
Zapata‐Rivera & Greer
Brusilovsky, P. & Sosnovsky
![Page 56: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/56.jpg)
Interaction Analysis (in CSCL)Interaction Analysis (in CSCL)
• provide the teacher with an overview of the learners’provide the teacher with an overview of the learners progress so that she can take remedial actions or carry out evaluation
• provide a model of collaborative activities for the teacher so that she can influence the process and make it more productive
• provide the teacher with an overview of the h finteractions in the group, e.g. if someone is
isolated or dominating the discussion
![Page 57: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/57.jpg)
Sociogram for a class discussion forum
Dark nodes indicate facilitators (TAs, staff, faculty), lighter nodes indicate learners.
The inner circle is made up of participants, four of which are very important to the community (as which are very important to the community (as shown by having a larger node size).
A casual observation of this network indicates that, while some learners write a fair bit (many interconnected nodes in the middle), there are lots ,of learners who haven’t ever read anything (the outer ring of delinquents), and many lurkers who read very little.
Note that the ring of delinquents includes a di i l hi h b f f ili
I‐Help: discussion forum for a 1‐styear computer science class
disproportionately high number of facilitators as our currently deployment gives access to this forum to most staff and faculty in the department.C. Brooks, R. Panesar, J. Greer. (2006) Awareness and
Collaboration in the iHelp Courses Content Management System. 1st European Conference on Technology Enhanced Learning (EC‐TEL 2006), October 1‐4, 2006. Crete, Greece. g
![Page 58: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/58.jpg)
Sociograms of large communities
In this visualization of a high school’s empirical g pfriendship network from the scientists’ data, the different colored (blue, green, purple, orange) nodes represent students in different grades. Links between nodes are drawn when a student Links between nodes are drawn when a student nominates another student as a friend.
![Page 59: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/59.jpg)
Social Visualization (in HCI)Social Visualization (in HCI)
• provide social awareness about the otherprovide social awareness about the other users’ existence or actions and contributions toto
• encourage social norms and participation
Tom Erickson: The Babble Chat System.
![Page 60: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/60.jpg)
AI in Education
UMVisualization
Cartography
Open Learner Modelling (OLM)
Interaction Analysis(IA)Social
visualizationFor what purpose we want to
CSCLCommunity Visualization(CV)
For what purpose we want to open the model?
Which data to visualize?How do represent visually
CSCW
user info so that it is understandable and effective?
HCIHCI
![Page 61: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/61.jpg)
Learner Modeling ArchitecturesLearner Modeling Architectures
• Autonomous and heterogeneous servicesAutonomous and heterogeneous services, mashups – Variety of user features modeled– Variety of user features modeled, variety of representations, variety of adaptation techniques (what and how is y p q (adapted).
• User data fragments everywhere g y
• Decentralized architectures for UM
![Page 62: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/62.jpg)
Context is important!Context is important!
D Draw a picture of me p fplease!
![Page 63: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/63.jpg)
Decentralized / Active User Modeling ( )(DUM)
• User Modeling Serversg– Loss of context– Need to adhere to a common representation schema (ontology needed)(ontology needed)
– But it is hard to impose an ontology to autonomous services
• DUM– Every application / agent / service stores learner data locally in its own representation formatlocally in its own representation format
– Partial mapping of formats is sufficient– Data is close to the context of its harvesting and use
![Page 64: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/64.jpg)
DUMDUM
• Applications/ agents/ services share user data pp / g /– only on a “need to know” basis – for particular purposed t f diff t t ( t t ) i l t f– data from different agents (contexts) is relevant for different purposes
– need just to know “whom do ask”
Vassileva, J.I., Greer, J.E., McCalla, G.I. (1999) "Openness and Disclosure in Multi-agent Learner Models", in Proceedings of the Workshop on Open, Interactive, and Other Overt Approaches to Learner Modelling, International Conference on
McCalla G., Vassileva G., Greer J., Bull, S. (2000) Active Learner Modelling, Proceedings of ITS'2000 Springer LNCS 1839 53-62
pp g,AI in Education, Lemans, France.
Proceedings of ITS 2000, Springer LNCS 1839, 53 62.
![Page 65: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/65.jpg)
DUMDUM
• User modeling:g– Searching, retrieving and integrating fragmented learner information from diverse sources at the time when it is needed for a particular purpose.when it is needed for a particular purpose.
– Emphasis on the process not the data‐structure; “to model” (verb)
Vassileva J., McCalla G., Greer J. (2003) Multi-Agent Multi-User Modeling,Vassileva J., McCalla G., Greer J. (2003) Multi Agent Multi User Modeling, User Modeling and User-Adapted Interaction, 13:(1), 179-210.
![Page 66: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/66.jpg)
Knowledge Representation
Modelling Process
Maintain Consistency Determine Relevance
L T M d lli J i i C iLong Term Modelling Just‐in‐time Computing
![Page 67: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/67.jpg)
Centralized vs Decentralized UMCentralized vs Decentralized UM
• Centralized– collecting at one place as much information as possible– about many users, – make sure it is correct and consistent, ,– so that it can be used for many purposes.
• DecentralizedDecentralized– user information fragmented among many agents/services– each agent/service models one or more users– inherently inconsistent (gathered in different contexts by– inherently inconsistent (gathered in different contexts, by
autonomous services created by different designers)– fragments are retrieved and combined just in time for one
specific purpose onlyp p p y
![Page 68: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/68.jpg)
Example: Trust and reputationExample: Trust and reputation
• Trust: subjective evaluation of the reliability, quality,Trust: subjective evaluation of the reliability, quality, competence which one agent has of another agent based in its own experiences and interactions. (in context)R i bj i l i f h• Reputation: objective evaluation of the …. Based on the experience of many agents. (decontextualized, like a centralized UM)
0.9
0.45
0.67
0.45ReputationService
(usually centralized)
![Page 69: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/69.jpg)
Trust and ReputationTrust and ReputationSimple trust update formula: reinforcement learning
T *T (1 )* Tnew=α*Told + (1‐α)*ε, where ε − the new evidence,
α – the agent’s conservatism• Gossiping:
– two agents sharing their trust values about a third agent
• Two kinds of trust:• Two kinds of trust: – Basic trust – in an agent as provider of a service– Trust as a referee –similar tastes, interests, benevolent, not lying.
![Page 70: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/70.jpg)
Trust‐based Community Formation h llMechanism in Comtella
Users share read and rate papersUsers share, read and rate papers– Personal agents keep track of their user’s download history and ratingshistory and ratings
User agents compute Trust in other usersAbility to provide “good” papers– Ability to provide good papers
– Subjective – depends on compatibility of tastes of the usersthe users
Agents compute also Trust in communitiesC ll ti t t i th b f it– Collective trust in the members of a community
![Page 71: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/71.jpg)
Updating trust from direct evidenceUpdating trust from direct evidence
0 8
Tnew=a*Told + (1-a)*e
0.8
Rating 1
![Page 72: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/72.jpg)
Trust is asymmetricTrust is asymmetric
0 4
Tnew=a*Told + (1-a)*e
0.4
Rating -1
![Page 73: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/73.jpg)
Updating trust through gossipingUpdating trust through gossiping
How much do you trust C? T 0 4944How much do you trust C?
Tc=0.5Tc=0.7*0.5+0.3*0.8*0.6
Tc=0.4944
Tb=0.8AB
C
Tc=0.6
![Page 74: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/74.jpg)
Community formation based on trust and reputation
Wang Y., Vassileva J. (2004) Trust-Based Community Formation in Peer-to-Peer g ( ) yFile Sharing Networks, Proc. of IEEE/WIC/ACM International Conference on Web Intelligence (WI 2004), Beijing, China.
![Page 75: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/75.jpg)
Individual Trust can be computed in d ffdifferent ways
• Reinforcement learningReinforcement learning
• An explicit way of computing trust using different types of evidence (trust aspects) e gdifferent types of evidence (trust‐aspects), e.g. Bayesian Belief Network
Trust in A
A as a baby sitter
A as a cook A as a teacher A as a secret-keeper
![Page 76: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/76.jpg)
Combining trust from refereesCombining trust from referees
Simplest approach: weighted sumSimplest approach: weighted sum
Trust in A based on referees X, Y, Z
Tnew = aTold + (1‐a) (Tx*TxA+Ty*TyA +Tz*TzA)Tnew = aTold + (1 a) (Tx TxA+Ty TyA +Tz TzA)
This works since trust is a single numberThis works since trust is a single number
How to combine evidence in more complexHow to combine evidence in more complex Decentralized User Models?
![Page 77: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/77.jpg)
P f d liPurposes for user modeling
• A “Purpose” is like a recipe – a procedural knowledge representation constructknowledge representation construct– Retrieval – which are the relevant sources to get user data from
– Interpretation – mapping information to own representation / context
– Integration – reasoning based on the user data and possibly generating new user datag g
– Adaptation – using the user data to make a decision about adaptation of interface or functionality.
![Page 78: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/78.jpg)
Example of a purposeExample of a purpose
• Selecting new graduate studentsg g
– Retrieve data from transcripts, ask for letters of reference (but not his mom)
– Interpret the marks: 6 in Bulgaria corresponds to 1 in Germany, to A+ in USA, to 93‐95% in Saskatchewan
– Integrate the interpreted data from all sources for allIntegrate the interpreted data from all sources, for all considered students
– Adaptation – generate a ranked list
![Page 79: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/79.jpg)
Collections of purposesCollections of purposes
D i d l lib i• Designed separately – libraries
• Can be searched by services / agents
• Use standard language for representing UM features (ontology, taxonomy, mapping)( gy, y, pp g)
X. Niu, G. I. McCalla, and J. Vassileva, (2004) Purpose-based Expert Finding in a Portfolio Management System. Computational Intelligence Journal, Vol. 20,No. 4, 548-561
![Page 80: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/80.jpg)
Example: Distributed UM in communities
• Many communities exist• Few collaborate and share users yet, but in the future they will.
• One day, users will be traveling seamlessly across y, g yonline communities, as they travel from city to city in the real world.
• How to share user data (interests, status, friends, resources) across?
• Authentication and Identity?y• How to update and synchronize models of users who are members of many communities?
![Page 81: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/81.jpg)
Policies in Online Communities
• UM in OC are based on policies describing the role, status,
Policies in Online Communities
and rights of each user • Roles, status, imply rights and adaptation of the
functionality and interface of the OC to the user.• Examples:
– “New users can not delete links” = If user_participation_C1< threshold
disable “delete link” functionality.y– “Users from community C2 are not treated as new users”.
If user_participation_C2 <> 0, user_participation_C1 = user_participation_c2
• The purpose‐based approach can be implemented through The purpose based approach can be implemented throughpolicies – Transparent– Editable by users in certain roles (moderators)Editable by users in certain roles (moderators)
![Page 82: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/82.jpg)
Comtella Framework for OCs
• Every user can create a community “owner”
Comtella Framework for OCs
• Communities can be hosted at different websites (Comtellanodes)
• Every owner defines the policies for rewarding participationEvery owner defines the policies for rewarding participation (e.g. bronze, silver, gold status), the privileges with each status level, the roles that users can take (e.g. guest, member, moderator) and the rights associated with the role.
• Policies are like decision making procedures that use LM data to generate new LM data or to make an adaptation g pdecision – enabling or disabling a particular interface feature.
• LM data can be from any community in the NWy y
82
![Page 83: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/83.jpg)
Examples of policiesExamples of policies
![Page 84: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/84.jpg)
Policies in Comtella: user editable UM processes
CA1Node A Node B
CA1
CB1
CB3CA2
CB2
CC1
User models created by different policies in different communities
Node C Policies created by different community owners
84Muhammad T., Vassileva, J. (2007) Policies for Distributed User Modeling in Online Communities, Proc. Workshop UbiDeUM’2007, at the 11th International Conference UM’2007, Corfu.
![Page 85: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/85.jpg)
Transfer policy between two communitiesTransfer policy between two communities
Owner of Visitor from
“picture”community
from“Gardening”
![Page 86: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/86.jpg)
Implications from Web 2.0?Implications from Web 2.0?
• Decentralization of resources and controlDecentralization of resources and control– User contributed content (user = teacher, learner, designer )designer, …)
– Autonomous, self‐interested users
• Rule: hard/impossible to impose hard rules• Rule: hard/impossible to impose hard rules– Ease of use is very important
C l it f “i t lli t t h i ” h t b– Complexity of “intelligent techniques” has to be hidden
![Page 87: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/87.jpg)
Summary: Web 2.0 needs AI!Summary: Web 2.0 needs AI!AIED Web 2.0
• Knowledge representation –ontologies
• Tagging: user‐based, automatic, hybrid with ont.
• Instructional planning • Orchestration of participation through incentive mechanism
• Learner modeling
design
• Community ModelingS i l i li ti– Open learner modeling
– Interaction analysis
– Centralized LM servers
– Social visualization
– Decentralized LM: trust mechanisms, purpose‐based
d li LM li i fCentralized LM servers modeling, LM policies for communities
![Page 88: Decentralization, Autonomy, and Participation in Multi](https://reader031.vdocuments.net/reader031/viewer/2022022109/6212021d898653015858570c/html5/thumbnails/88.jpg)
A d
Yao(trust and reputation)
Andrew(mechanism design)
Tariq(policy‐based user modeling)
http://madmuc.usask.ca