Kellar Instructional Handheld data System (KIHd System)

3rd Advisory Board Members Meeting

Date: February 12th, 2007

George Mason University Team Members

• Co-PI: Shuangbao Wang, PhD

• Co-PI: Yoosun Chung, PhD• Senior Researcher:

Michael Behrmann, EdD • Project Coordinator:

Heidi Graff• Research Assistants:

YouRi Shim, Kavita Mittapalli

Reliability

• Accuracy (Formula calculation – Agreement / Disagreement * 100)

• Time period late October 2006- ongoing• Average three days/week

Graph (accuracy)(October 31, 2006- January 31, 2007)

0

10

20

30

40

50

60

70

80

90

100

110

1 5 9 13 17 21 25 29 33 37 41Data sessions per month

October2006-January 2007

Accu

racy

per

cent

age

Fidelity

• Purpose - To provide a way to record and evaluate if the program is following the protocol proposed earlier (as a reality check)- Internal validity- To record the day-to-day process of data collection by the researcher (when on-site) and teachers (in presence of researchers)- To record instances, if any, where technical assistance was needed by the teachers- To record the overall general attitude of the teachers towards technology, training and the data collection process- To record the efficiency and reliability of the technology

Fidelity contd..• Instrument

- Paper based form used by the researcher each time s/he goes to collect data- Five open-ended questions- Additional two paper-based surveys to record teachers’perceptions on trainings received thus far (administered in October and December 2006)

• Fidelity data have been collected 4 out of 5 times a week (Number of days we collected fidelity check list/ how many possible days * 100) - 80%

Logic model of fidelity criteria(Donabedian, 1982)

Structure(protocol for service delivery)

Process(How services are delivered)

Fidelity criteria includes- specification of the length, intensity, and durationof the service (or dosage); content, procedures, and activities over the length of the service; roles, responsibilities of staff/researchers and characteristics of target population (Kelly, Heckman, Stevenson, & Williams, 2000)

References

Donabedian, A. (1982). The criteria and standards of quality. Ann Arbor, MI: Health Administration Press.

Kelly, J.A., Heckman, T.G., Stevenson, L.Y., & Williams, P.N. (2000).Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12,87-98.

System Modifications

• Ability to change labels & prompts• Add multiple treatment phases• Task is added to graph• Interactive graph to better meet single subject

design standards• PDA offline data collecting (standalone

application) will be tested in March

Update of KIHd System Graph

• Task is added to the graph.

Standalone Application

• PDA offline data collecting (standalone application) will be tested in March.

• The data collection procedure are:– Synchronizing PDA with database– Data collections– Send data back to database– System merge the data based on the time tag

and device id.

Sites to visit

• KIHd System Project Websitehttp://kihdsystem.gmu.edu/stepstone/index.html• KIHd Systemhttp://kihdsystem.gmu.edu

Advisory Board MembersTom Scruggs tscruggs@gmu.eduMaureen Schepis mschepis@bellsouth.netMargo Mastropieri mmastrop@gmu.eduTed Hasselbring t.hasselbring@vanderbilt.eduMartha Snell snell@virginia.eduBarry Romich bromich@aol.comCherie Takemoto takemoto@peatc.orgRobert Zuckerman dcwz@kent.edu

Date to Remember

• Next Advisory Board Meeting– April 18th at 10:00am (will contact you if

changed)

Contact Information

Helen A. Kellar Institute for Human disAbilities

(703) 993-3670 (voice/TTY)(703) 993-3681 (fax)

http://kihd.gse.gmu.edu