I D E A LI D E A L

International Database for Enhanced Assessments & Learning

R-type Item Writing WizardPC & Intranet Versions

I D E A L

Also, some basic medical science teachers have difficulty assessing their students’ reasoning abilities within a clinically relevant context

R-type selected response items (also referred to as Extended Matching Questions [EMQ]) are particularly suitable for measuring medical students’ scientific & clinical reasoning abilities

However, some teachers find that composing an R-type item is difficult and/or time-consuming

Background

I D E A L

The R-type item writing wizard is designed to assist basic & clinical science teachers to compose well designed R-Type items more easily & quickly

Objective

I D E A L

Two Versions of the Wizard

PC

- wizard requires MS Word 97 or later installed on the PC

- option sets are stored in text file labeled ROptionSet.txt

Intranet

minimal system requirement requires a server with IDEAL Intranet installed & preferably also IDEAL’s non restricted bank

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Installing the Wizard on a PC

I D E A L

Download PC version

To access the R-type wizard, go to

http://www.hkwebmed.org/rtypewizard/

Login

I D E A L

Download & Install PC Version of the Wizard

I D E A L

Download & Install PC Version (cont’d)

I D E A L

Creating a Shortcut for the R-type Wizard

Done

I D E A L

Launching the R-type Wizard (PC version)

Double click the R-type Wizard icon on the PC’s desktop

R-type Wizard will appear on top of a new MS Word document

I D E A L

To Access Wizard within MS Word, click the ‘Show R-Type Wizard’ button; (if using Office 2007, first click “Add-Ins” to see the button)

Wizard closes when Word is closed; to re-launch wizard, click its icon on the desktop

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Using the Wizard to

Develop an R-type Item

I D E A L

Select a Discipline, Topic & Theme from the respective lists provided by the wizard

After selecting a theme, a set of options list will be provided. More than one set of options may be offered.

Select a Lead-In Question (if none are appropriate, enter [type] the lead-in needed)

I D E A L

Next, compose a relevant, appropriate scientific or clinical scenario

Two yr-old boy is brought to clinic complaining of generalized rash & fever for 1 day. Rash initially appeared on face & trunk then spread to limbs. Intensity of rash in axilla & groin region has recently increased. Skin feels like sand-paper & there is also circumoral pallor. Throat is congested & examination is otherwise uneventful.

I D E A L

Vignette composed within the wizard or copied & pasted from Word Pad or other source except MS Word

I D E A L

Specify the Option Which is the Correct Answer

I D E A L

Compose Relevant Feedback for Students

Feedback can be provided to the students after the assessment for formative purposes

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

If another clinical scenario is relevant for the same option set, compose a 2nd

vignette

I D E A L

Example of a 2nd Scenario Applicable for the Same Option Set

Six yr-old girl, who has had cold & fever for 3 days, is sent

home from school because she is feeling so poorly. Later in the

same day she develops a maculopapular rash on her face &

trunk. She does not want to get out of bed, preferring the

bedroom curtains to be closed. On examination, there is

grayish spot on the mucous membrane of her mouth.

I D E A L

Click button ‘Add Scenario’; - scenario text box will clear;

- enter the second vignette

I D E A L

Sequential order for this 2nd Scenario will be indicated

I D E A L

By default feedback from previous (first) scenario is included automatically; modify where appropriate

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Several vignettes can be generated under the

same option set

I D E A L

Example of a 3rd Scenario

One yr-old boy is admitted to the A&E department due to

high fever & generalized rash. His mother claims that the

boy was still playful a few hours ago & his condition has

deteriorated very quickly. On examination, the rash is

non-blanching , irregular in size, with a necrotic centre.

I D E A L

Editing a Draft Scenario

To modify any scenario, click ‘<‘ (back button) or ‘>’ (forward button) & navigate to the appropriate entry & then edit the text within the wizard

Click ‘Remove Scenario’ button to delete a currently displayed scenario

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Transferring the R-Type Item(s) to MS Word

I D E A L

Using this protocol, the exported item will be displayed in MS Word only after all the other R-type items have been created

If finished entering scenarios for a particular theme & wish to develop more items using different themes, click ‘Export and Continue’

I D E A L

When one has finished composing all the items, click button “Export and Exit”

Using this protocol, the wizard will close & a MS Word document will appear (see next slide)

Example of an R-type Item Displayed in MS Word

After the item(s) is (are) displayed, go to MS Word’s menu bar and - click View - select Print Layout

I D E A L

If no appropriate option set is presently available in the Wizard, add a new option set for use (now & for the future)

- to achieve this, see following slides

The Wizard can Increase in its CapabilityThe Wizard can Increase in its Capability

I D E A L

Click the Tab ‘Input/Edit Option Set(s)’

I D E A L

Select an existing DisciplineSelect an existing TopicSelect an existing Theme

I D E A L

Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the

button ‘Add’

The options will be added to above option set text box

I D E A L

Example of New Option Set for Theme ‘Chest Pain’

Asthma

Costochondritis (Tietze Syndrome)

Conversion Disorder

Esophagitis

Foreign Body

Myocarditis

Muscle strain

Pericarditis

Pneumonia

Pneumothorax

Precordial Catch Syndrome

Supraventricular Tachycardia

I D E A L

Creating the New Option Set

Click ‘Create New Option Set’ button & the new option set is added to the wizard & the Wizard’s total number of option sets is appropriately increased (e.g., 271)

I D E A L

A message will confirm that the new option set has been added

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Wizard also enables you to add additional sets

of

Disciplines / Topics / Themes

I D E A L

Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’

I D E A L

A message will confirm the new discipline has been added to the Wizard’s list of

Disciplines/Panels

I D E A L

To edit this discipline, select the relevant discipline from the list & click button ‘Edit Discipline/Panel’

I D E A L

Editing a Discipline

Enter the modification in the pop up window & click button ‘Confirm Exit’ in order to save the change

To cancel the changes, click the button ‘Exit’

Message will confirm that the change has been accepted

I D E A L

After an option (or a discipline / topic / theme set) has been saved by the wizard, the particular entry cannot be deleted but it can be edited (modified)

Same Steps Used to Add new Topics & Same Steps Used to Add new Topics & ThemesThemes

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Saving the changes made to Discipline / Topic / Theme

I D E A L

Click button ‘Save Changes Permanently’

I D E A L

A message will confirm that the new Discipline / Topic / Theme set has been accepted

When the wizard is used the next time, this new set for a Discipline / Topic / Theme will be accessible for generating further R-type items

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Accessing List of All Option Sets Stored in Wizard

I D E A L

Create a file for listing all the option sets in the wizard

Select ‘Input/Edit Option Set(s)’ tab Click ‘Create File for all option sets’ button

I D E A L

A message confirms that the file containing all option sets has been created

The file will be in text format with the label ‘ROptionSetsOut.txt’

I D E A L

To view the list of option sets - navigate to the R-Type Wizard directory in the PC - double click the file ‘ROptionSetsOut.txt’

I D E A L

The list of option sets will be displayed in MS Notepad

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

R-type Intranet Wizard

I D E A L

Installing the Intranet R-type Wizard

Intranet R-type wizard is available by downloading the latest version of IDEAL Intranet:

go to http://www.hkwebmed.org/

Login as a member

Login

I D E A L

Installing the Intranet Wizard (cont’d)

Scroll down the page to the Intranet IIDEAL 4.1

Click “Upgrade to latest IIDEAL 4.1”

I D E A L

Installing the Intranet Wizard (cont’d)

Click to download the file “Iideal41Patch.exe”

I D E A L

Installing the Intranet Wizard (con’t)

When extracting the zipped files, navigate to the directory where IIDEAL is to be installed (e.g., inetpub/wwwroot/ideal)

Run the “Iideal 4.1 Patch” file on the IIDEAL Server

I D E A L

To Start the Intranet R-type Wizard

Log into IDEAL Intranet

Click the button ‘Input/Edit/Delete Items’

I D E A L

Click the Button ‘Use R-type Wizard’

Button is displayed only if the Intranet R-type Wizard also has been installed on the IDEAL intranet server

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Develop an R-type item Using the Intranet Wizard

I D E A L

Click the Button ‘Input R-type Item(s)’

Dimmed button (illustrated above) indicates that the Input R-type Item(s) page is already being displayed

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

Can Add Further Option Sets for

Use in the Future

I D E A L

To create a new option setclick the button ‘Input/Edit Options’

I D E A L

To create (or modify) the list of Disciplines/Topics/ Themes, click the button ‘Add/Edit Classifiers’

I D E A L

The R-type Wizard Intranet Version has all the same features as the PC Version.

and in addition, items created with the Intranet Wizard can be saved to the IDEAL non-restricted item bank if this item bank is kept on the same server

I D E A L

To enter the item into the non-restricted IDEAL bank, click button ‘Save Item and Continue Edit’

I D E A L

Message confirms the item was saved in IDEAL’s

non-restricted item bank with an item ID (e.g., 450)

I D E A L

To transfer an item to MS Word without saving it in the IDEAL bank, click button ‘Export to

Word File’

I D E A L

Right click the link & select ‘Save Target As…’ to download the file.

I D E A L

Click the button ‘Open’ to view the downloaded file

How an R-type item will be Displayed in MS Word

After the item(s) is (are) displayed, go to MS Word’smenu bar - click View - select Print Layout

I D E A LI D E A L

International Database for Enhanced Assessments & Learning

User’s Guide and Help Menu

I D E A L

Help within the Wizard (PC version)

A Concise User Guide is accessible by selecting the 3rd tab

I D E A L

A complete user’s guide in PDF format is also available in the R-type wizard folder

I D E A L

Acknowledgements

Development of this R-type Item Writing Wizard was made

possible with the support of a Teaching Development Grant

from The Chinese University of Hong Kong (CUHK) and by

the Hong Kong government’s University Grants Commission

(UGC)

I D E A L

Suggestions are Welcomed

If you have any difficulties or suggestions for improving the wizard, please email the IDEAL Coordination Centre

at secretariat@hkwebmed.org