evaluation of the use of semantic web technology
DESCRIPTION
In this study, a semantic web bookmarking tool called Twine was used in a graduate level course for K-12 educators. It was found that collaborative teams using the semantic web application developed high levels of expertise.Andrew LumpeDavid WicksTRANSCRIPT
![Page 1: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/1.jpg)
EVALUATION OF THE USE OF SEMANTIC WEB TECHNOLOGY IN A COLLABORATIVE LEARNING ENVIRONMENT
Andrew LumpeDavid WicksSeattle Pacific University
![Page 2: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/2.jpg)
OBJECTIVES
• Describe the application of a semantic web application in a collaborative learning environment.
• Report the results on student learning.• Provide recommendations for future research
and applications of semantic web technologies in educational environments.
![Page 3: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/3.jpg)
Overall Goal of Education
• The overall goal of education is to develop expertise• Expert learners vs. Novice learners
– Have greater access to content– Are more skilled at retrieving content– Are better at adapting, changing, and recognizing when
to apply knowledge
Semantic technologies MAY be one way to help develop expertise
(Bransford et al, 1999)
![Page 4: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/4.jpg)
dullhunk
![Page 5: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/5.jpg)
![Page 6: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/6.jpg)
Collaborative Learning ResearchThen Now
Unit of Analysis: Individual group member Unit of Analysis: The group
Is collaborative learning more effective than learning alone?
How can we make collaborative learning more effective?
Establish and Control Independent Variables
Understand role of independent variables in mediating interaction
Product-oriented analysis Process-oriented analysis
Cooperative learning: Division of labor Collaborative learning – Mutual engagement
(Dillonbourg et al, 1996)
![Page 7: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/7.jpg)
Personal Learning Networks
Using Web 2.0 tools to create connects with
others which: •Extends learning environment•Encourages reflection•Increase opportunities to ask questions and receive help compared to normal face-to-face interactions
Building PLNs allows students to:
•Make connections with followed users (Twitter) •Participate in collaborative communities (Twine, Delicious) •Follow and search feeds from Web 2.0 sites (Pageflakes, Google Reader)
Holotescu&Grosseck, 2009
![Page 8: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/8.jpg)
TWINE
![Page 9: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/9.jpg)
![Page 10: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/10.jpg)
![Page 11: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/11.jpg)
How is [Twine] different than other social bookmarking tools like Delicious?
“The difference between {the system} and most bookmarking services is that {the system} attempts to identify the resource the page is describing, rather than just recording the location of the page itself. “ (Clarke & Greig, 2009)
![Page 12: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/12.jpg)
Context• Online graduate education course with weekly, interactive modules –
Blackboard 9• N=60• Module 1
– General overview of course topics– Data used as preTest– TWINE not used
• Modules 2-6– Specific Topics = Advance Organizers, Collaborative Learning,
Inquiry/Induction, Conceptual Understanding, Multiple Intelligences– TWINE used throughout– Data used at postTest
![Page 13: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/13.jpg)
Methods• Quasi Experimental Design• Experimental group used TWINE • Data sources = All text posts - discussion posts, blog entries, research
papers, TWINE comments• WordStat 5.1 – “a text mining tool for fast extraction of themes and
trends”– Build Dictionaries
• Related Words and Phrases• Word exclusion list• Key Word in Context (KWIC)
• MANCOVA– IV = group assignment– DV = module posts by five categories– Covariate = pretest posts
![Page 14: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/14.jpg)
Results
• Incoming GPAs not different (F = .22, p = .64)• Students posted many resources and comments in
their twines• These resources were regularly used in students’ posts• Others outside the course joined and contributed to
the twines• 356,322 total words used in posts• 8,612 related words/phrases included in analyses• Equal variances on all DVs (Levene's Test)
![Page 15: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/15.jpg)
COLLABORATION
![Page 16: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/16.jpg)
SourceDependent Variable
Type III Sum of Squares df
Mean Square F Sig.
Partial Eta Squared
Corrected Model
postADVANCE ORGANIZER
2470.859a 17 145.345
1.222 .290 .331
postCOLLABORATION
12038.862b 17 708.168
2.116 .025 .461
postCONCEPT UNDER
20538.358c 17 1208.139
2.113 .025 .461
postINQUIRY 16993.833d 17 999.637
1.579 .114 .390
postINTELLIGENCE
24017.727e 17 1412.807
6.288 .000 .718
a. R Squared = .331 (Adjusted R Squared = .060)b. R Squared = .461 (Adjusted R Squared = .243)c. R Squared = .461 (Adjusted R Squared = .243)d. R Squared = .390 (Adjusted R Squared = .143)e. R Squared = .718 (Adjusted R Squared = .604)
![Page 17: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/17.jpg)
![Page 18: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/18.jpg)
Conclusions
• Use of a Personal Learning Network (TWINE) helped students develop richer, more coherent expertise in 3 out of 5 content categories.
• TWINE served as a collaborative repository of resources, ideas, and connections.
• The impact of the semantic nature of TWINE was not apparent.
![Page 19: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/19.jpg)
Next Steps
• Further explore the qualitative differences in the students’ postings (latent semantic analysis)
• Extended use may be needed in order for semantic technologies to learn interests and provide recommendations
• Continue to explore the use of collaborative, semantic technologies to enhance learning– Twine T2?– http://www.opencalais.com/– http://www.puffinwarellc.com/ (iMetaSearch)– http://www.stumpedia.com/ – http://imindi.com/
![Page 20: Evaluation Of The Use Of Semantic Web Technology](https://reader033.vdocuments.net/reader033/viewer/2022060110/555bd689d8b42adf478b5241/html5/thumbnails/20.jpg)
Questions?