Student Assessment using Moodle for Software Engineering

It is the work done by team members-Team 5 of C-DAC NOIDA remote centre(RCID: 1290) as part of the AICTE approved FDP on Use of ICT in Education for Online and Blended Learning. Team members Details: RC1290_Team5 Dr. Lakshmi Kalyani(Team Leader) Santosh Kumar(Team Member) Sanjay Saxena(Team Member) Rosy Verma(Team Member) Topic Name: Student Assessment using Moodle for Software Engineering License : Creative Common using Open Source Learning Management System-MOODLE

This OER Submission by CDAC, NOIDA, is licensed under the Creative Commons Attributions- ShareAlike 4.0 International license using open source MOODLE. You can view copy of this license using the URL: https://creativecommons.org/licenses/by-sa/4.0/ You are free to use, distribute and modify it, including for commercial purposes, provided you acknowledge the source and share-alike.

Table of Contents

Section 1: Open Education Resource: Student Assessment using Moodle for Software Engineering

I. About the OER Learning Objectives II. Helpful Documentation for Tool Use

Section 2: Design Decisions

I. Nature of Decisions taken Section 3: OER Description

I. Active OER II. Lesson Settings

III. How to use this OER IV. Best Practices with Lesson Activity

Section 4: Evaluating Effectiveness of OER

I. Effectiveness at the student level II. Effectiveness at consumer level

Section 5: Consolidated Log of Team Work Section 6: Building a Community for Assessment Strategy using MOODLE Works Cited

RC1290_005 Dr. Lakshmi Kalyani

Santosh Kumar Sanjay Saxena

Rosy Verma

Open Education Resource: Student Assessment using Moodle for Software Engineering About the OER: The open education resource is a collection of online quiz activities (multiple choice questions as well as subjective types questions) using moodle for assessing and evaluating student’s performance. These are useful for student performance evaluation and assessment on weekly and monthly basis. This OER is useful for teachers well as students for using online assessment technology for student evaluation and grading. The subject software engineering has been chosen for creating student assessment and evaluating student’s knowledge in the subject. There are two types of assessments that have been created -objective as well subjective assessments. This OER can be accessed from following URL: https://www.elearn-mhrd.in/moodle/mymoodle/course/view.php?id=148 Username: fdpcoursecreater Password:Fdp@1234 Target Audience: Post Graduate students pursuing MCA, M.Tech( in IT and CS streams) Tags: MOODLE, Quiz, Assessment Technology, Post Graduate Students, software engineering, Software Engineering Models, Software Requirement Specification, Software Project Planning, Online assessment, SRS. This OER is licensed under CC-BY-SA ver 4.0. You are free to use, distribute and modify it, including for commercial purposes, provided you acknowledge the source and share-alike. You can get more details by using the URL:

https://creativecommons.org/licenses/by-sa/4.0/ Learning Objectives:

After using this OER, teachers will be able to: • Conduct online assessment in Software Engineering • Check and grade the student’s performance • Use online assessment technology for creating assessments • Familiarize themselves with MOODLE Helpful Documentation for Tool Use [1] For design and development of quiz activity in MOODLE (an Open Source Tool) [2] https://docs.moodle.org/31/en/Main_page

Section 2: Design Decisions Nature of Decisions taken We have used following 3 design decisions for creating this OER: 1. Content Decisions 2. Pedagogic Decisions 3. Technology Decisions Content Decisions: The content decisions related to: a. Earmarking specific segment for in-class activity to be covered – Decided on the subject of software engineering-MCQ and subjective questions on various topics covering software engineering. b. The research papers/publications and other materials to be provided –on software engineering Pedagogic Decisions: Typically in an online mode of class conduction the blended mode of teaching could be preferred. For the In-class strategy MCQ and subjective type questions on various topics covering software engineering can be used for the online assessment.

These questions could be asked among various cognitive levels –mostly from recall level to apply level. Technology Decisions: During creation of OER , the major technology decisions were taken: a. Tool to be used for creating Quizzes – MOODLE b. Publishing of the quiz for student’s evaluation and assessment using MOODLE Platform.

Section 3: OER Description Active OER: The developed OER can be accessed using login credentials shown below . URL: https://www.elearn-mhrd.in/moodle/mymoodle/course/view.php?id=148 Username: fdpcoursecreater Password:Fdp@1234 Quiz Settings: For creating a quiz, first of all we need to create a course with some course title. We have created a course with title as software engineering. Screenshots 1-4 shows the general settings of a course. Screenshot 1: General and Description setting in MOODLE

You should choose the format for the course such as Topic format, Weekly Format etc. as shown below. Screenshot 2: Course format and Appearance

Screenshot 3: Course format and Appearance

Now once you filled all the course details, click to Save Changes Button as shown below. Screenshot 4: Role renaming and Save changes option

Now a topic wise course layout structure will display out. You should edit the name of default topic name by your own course topics like software engineering model, software requirement specification and software project planning etc. This can be done by first enabling the edit mode by clicking to a “Turn editing on” button being displayed on top right corner of the page by default. Screenshot 5: Topic wise course structure with related Quiz

Once the edit mode is enabled, you should create the Quiz activity. This can be done by using the option “Add an activity or resource” and then adding the “Quiz” as an activity.

Screenshot 6: Addition of Quiz as an activity

You should choose the appropriate setting as per your program requirement like timing for the access of the quiz, grade settings, behavior of the questions etc. Once you have made the setting for the quiz activity, to save it, click to save and display options as shown below in screenshot 10.

Screenshot 7: General and timing setting for quiz

Screenshot 8: Grade, Layout and Question Behavior setting for quiz

Screenshot 9: Review options, Appearance setting for quiz

Screenshot10: Overall feedback and common module setting for quiz

Now once “quiz” activity has added under a topic. We should start adding the questions within the “quiz” activity. This can be done by clicking to the “quiz” activity option and then by clicking to “edit the quiz “button. Then click to “Add” button and start adding the questions by selecting the type of question format like multiple choice, true/false, essay etc. as shown below.

Screenshot 11: Creating multiple choice questions with General and Answer settings

Screenshot 12: Creating multiple choice questions with combined feedback settings

Screenshot 13: Creating multiple choice questions with multiple tries, Tags etc. settings

Screenshot 14: Glimpse of Question Bank

Screenshot 15: Student Preview option of the Created Quiz

Screenshot 16: Student Preview of Question in the Quiz

How to use this OER: For usages of this OER, you need to login into your individual MOODLE as admin account or you can ask your site administrator to restore this course backup in your own course. Step 1: Download the Course Backup option from https://www.elearn-mhrd.in/moodle/mymoodle/mod/resource/view.php?id=1010 Step 2: Now, you should go into the individual MOODLE course under which you need to import this course. In the Administration section click “Restore”.

Step 3: Drag and drop the course backup into the “Files” area and click restore. Step 4: Verify the questions of the restore by going back to the Quiz, under all the software engineering topics.

Step 5: After verifying, assign the restored course (i.e. software engineering) to your registered students into the MOODLE. Step 6: Ask to your students to attempt the Quiz in presence of teacher. Step 7: Now, it is advised to teacher to check the progress reports of the students before start of the next class. Additionally, if there are some common grades achieved by few students, you may conduct the quiz on another day for those particular students to verify their results. Best Practices with Assessment Activity: There are some best practices from our experience for using this assessment strategy in your Classroom: 1. Conduct this activity topic wise, once the same topic has been covered in the class. 2. Conduct the quiz in vigilance of the class teacher to prevent the copying among the students. 3. Inform to students the impact of such assessment to academics, so that students were interested in the assessment. 4. It would be good if some model question paper were separately provided to students before conduction of such assessment.

Section 4: Evaluating Effectiveness of OER The OER effectiveness can be assessed and evaluated at two levels: 1. At the student level 2. At the consumer level Effectiveness at the student level The Moodle is provided with quiz (MCQs) questions and subjective questions on topic Software Engineering. The quiz is divided into three sub topics as Software Engineering Models, Software Requirement Specification and Software Project Planning. The subjective questions are on various topics of Software Engineering. By attempting the quiz in a given time frame the students can evaluate themselves and judge their knowledge about the topics. Also by attempting the subjective questions they can evaluate and judge themselves. The teachers can also evaluate the students according to the marks score. The effectiveness can be checked by the number of students logged in and number of attempts they have taken to complete the answers. Effectiveness at consumer level Here the consumers are teachers who have taught the Software Engineering to the target students. The targets students are the students who are dong the BCA, MCA and M.Tech (CS/IT) course. In the Moodle the teachers can upload their quiz and subjective questions as an assignment. They can evaluate the students based on the timely submission and completion of the assignments. The teachers can create the score card and evaluate the students. Finally the teachers can upload the final result on the Moodle. For a practice the Moodle contain the file Software Engineering Evaluation method which contains the questions on the various topics of Software Engineering. Students and teachers can access that, attempt and judge themselves, and accordingly study the topic based on their performance.

Section 5: Consolidated Log of Team Work Activity Team Member Amount of Time Additional Logs

Discussion Team Leader 3 Hour Team Member 1 3 Hour Team Member 2 3 Hour Team Member 3 3 Hour

Tool Exploration Team Leader 1 Hour Team Member 1 1 Hour Team Member 2 1 Hour Team Member 3 1 Hour

OER Creation Team Leader 4 Hour Plan uploaded in IIT Bombay Moodle

Team Member 1 4 Hour Team Member 2 4 Hour Team Member 3 4 Hour

OER Documentation

Team Leader 2 Hour OER

Documentation uploaded in IIT Bombay Moodle

Team Member 1 2 Hour Team Member 2 2 Hour Team Member 3 2 Hour

Individual Reflection (Diary Logging)

Team Leader 1 Hour E-mail Logs uploaded in IIT Bombay Moodle

Team Member 1 1 Hour Team Member 2 1 Hour Team Member 3 3 Hour

OER Evaluation Team Leader 2 Hour SE Evaluation Method Uploaded at https://www.elearn-mhrd.in/moodle/mymoodle/login/index.php

Team Member 1 2 Hour Team Member 2 2 Hour Team Member 3 2 Hour

Section 6: Building a Community for Assessment Strategy using MOODLE As we have created and submitted the OER assignment during FDP. On the successful assessed and evaluation by the peer assessment group and IIT Bombay team, we will make the community. The community will consist of Students and Teachers.

Works Cited

[1] https://docs.moodle.org/31/en/Main_page [URL of the MOODLE]

[2] Roger S. Pressman: Software Engineering: A Practioner's Approach (Sixth Edition, International Edition). McGraw-Hill, 2005.

[3] K.K. Aggarwal and Yogesh Singh: Software Engineering 3Rd Edition, New Age Publications, 2015

[4] Pankaj Jalote : An Integrated Approach to Software Engineering, Wiley

[5] Software Engineering ,8/e, Sommerville, Pearson.

[6] Software Engineering principles and practice, W S Jawadekar, TMH

[7] Software Engineering concepts, R Fairley, TMH