balance of state continuum of care (boscoc) nh hmis training evaluation 08/08/2012 1nh-hmis training...

Balance of State Continuum of Care (BoSCoC)

NH HMIS Training Evaluation 08/08/2012

1NH-HMIS Training on 8/8/2012 - BoSCoC

Overview of BoSCoC Training• Date: 8/8/2012• Purpose: Training for all users and Agency Admins was required

because there was a software upgrade to ServicePoint 5.0.• Where: Mandatory training held at DOT Computer Resource Center, 7

Hazen Drive in Concord, NH. • Number of Attendees: 18 users/Admins in the morning and afternoon

sessions.• Training lasted 2 hours for end users; Admins were required to stay an

extra hour to review Reports and Administrative tasks.• Attendees were given a training binder that included 300 pages of

documentation and a DVD with videos. They were asked to fill out an evaluation form, but everyone did not fill out a form, and some did not complete every question. • Users knew before training that there was a test to verify knowledge

and that passing the test was a requirement for access into the new version of ServicePoint 5.• After passing test, users were emailed their HMIS certificate and given

access to SP5.• Donna held make up training at Nashua and Manchester location and

also online.

NH-HMIS Training on 8/8/2012 - BoSCoC 2

Agencies Represented


Agency Name # of Attendees # of Users # of AdminsSalvation Army 3 1 2

My Friend’s Place – Dover 2 1 1

Friends Emergency Housing Program

2 0 2

The Housing Partnership – Portsmouth

2 1 1

Crossroads House – Portsmouth

2 2 0

Laconia Area Community Land Trust

2 1 1

BHHS 2 0 2

Community Partners 1 0 1

Bridge House – Plymouth 1 0 1

Southwestern Community Services

1 0 1

TOTALS 18 6 12

NH-HMIS Training Evaluation Form

DATE: ___________________ LOCATION: □BOSCoC □MCoC □GNCoC NH HMIS would like your comments about this ServicePoint 5 training session. Your feedback helps us improve the effectiveness and content of future training and improve our services. We appreciate and value your time in responding to these questions. Please answer the questions below using the numbers 1-5 with 1 being the least accurate and 5 being the most accurate. Thank you for filling out the evaluation! 1. Is this your first time attending HMIS training? (check one) □Yes □ No 2. Would you say the length of the training was: □ Too brief □ Just Right □ Too long

If not just right, please explain: 3. Please rate your overall knowledge/skill level on HMIS Software (circle one in each category):

BEFORE attending this session/event: (Low) 0 1 2 3 (Moderate) 4 5 6 7 (High) 8 9 10AFTER attending this session/event: (Low) 0 1 2 3 (Moderate) 4 5 6 7 (High) 8 9 10

4. What did you hope to gain from the session? (Please check all that apply)

□ How to enter a client record □ How to check a client into a bed

□ How to look up resources □ Other (Please specify)_________________________ 5. The registration process from the Eventbrite website was: □ Easy □ Just right □ Too difficult

If difficult, please explain: 6. Would you say the frequency of reminder emails was: □ Too many □ Just right □ Not enough

If not just right, please explain: 7. How well did this session meet its stated objectives? (circle one): (low) 1 2 3 4 5 (high)

Please explain: 8. Was the content organized and presented well? (circle one): (low) 1 2 3 4 5 (high) 9. How would you rate the delivery of the content? (circle one): (low) 1 2 3 4 5 (high) 10. How would you rate the trainer? (circle one): (low) 1 2 3 4 5 (high) 11. How would you rate the handouts? (circle one): (low) 1 2 3 4 5 (high) 13. How would you rate the location? (circle one): (low) 1 2 3 4 5 (high) 14. How would you rate the room? (circle one): (low) 1 2 3 4 5 (high)


15. Rate your comfort level (after the training) with the following:

entering a single client (circle one): (low) 1 2 3 4 5 (high)

assessing a client (circle one): (low) 1 2 3 4 5 (high)

entering a family record (circle one): (low) 1 2 3 4 5 (high)

checking a client into a bed (circle one): (low) 1 2 3 4 5 (high)

looking up a client (circle one): (low) 1 2 3 4 5 (high) 16. How will this training help you in your day to day work?

Please explain: 17. If online training videos were available 24/7, how likely

would you be to watch the videos? (circle one): (low) 1 2 3 4 5 (high) 18. Which type of training method do you prefer?:

□ watching videos showing the computer screen only

□ watching videos showing the instructor interaction with the screen and class

□ traveling to a location with a live trainer on site

□ other _________________________________ I would like to attend additional training on (please check all that apply):

□Another User training □Administration training □Basic Report Writing□Advanced Report Writing □User Group (interactive group with other users) □Other:___________________________________________________

How often would you like to have refresher training?

□Monthly □Every 3 months □Every 6 months □Once a year □Other:___________________________________________________ Contact Information: Name:_____________________________________ Agency:___________________________________ Job/Role (please check appropriate box):□Case Manager □Program Manager □Agency Administrator □Executive Director□Volunteer Other:__________________________________________________ More comments:


Is this your first time attending HMIS training?

# Answer Response %

1 Yes 1 6%

2 No 16 94%

Total 17 100%


Would you say the length of the training was:

# Answer Response %

1 Too Brief 3 17%

2 Just Right 14 78%

3 Too Long 1 6%

Total 18 100%


Please rate your overall knowledge/skill level using the HMIS software (circle one in each category)

Rating: 0 indicates the least knowledge and 11 indicates the most knowledge.

# Question 0 1 2 3 4 5 6 7 8 9 10 11 Responses Mean

1 Before attending this session/event 1 1 2 0 3 0 0 3 3 5 0 0 18 6.94

2 After attending this session/event 0 0 1 0 2 1 0 4 3 6 1 0 18 8.28


What did you hope to gain from this session?

# Answer Response %

1 How to enter a client record

6 38%

2 How to look up resources 4 25%

3 How to check a client into a bed

6 38%

4 Other (Please specify) 10 63%


The registration process from the Eventbrite website was:

# Answer Response %

1 Easy 10 63%

2 Just Right 5 31%

3 Too Difficult 1 6%

Total 16 100%


Would you say the frequency of reminder emails was:

# Answer Response %

1 Too many 3 17%

2 Just Right 15 83%

3 Not Enough 0 0%

Total 18 100%


How well did this session meet its stated objectives?

Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 0 0%

4 4 7 41%

5 5 10 59%

Total 17 100%


Was the content organized and presented well? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 0 0%

4 4 6 35%

5 5 11 65%

Total 17 100%


How would you rate the delivery of the content? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 1 6%

4 4 3 18%

5 5 13 76%

Total 17 100%


How would you rate the trainer? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 1 6%

4 4 1 6%

5 5 16 89%

Total 18 100%


How would you rate the handouts? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 0 0%

4 4 4 22%

5 5 14 78%

Total 18 100%


How would you rate the location and room? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 1 6%

2 2 0 0%

3 3 3 17%

4 4 1 6%

5 5 13 72%

Total 18 100%


After the training, rate your comfort level with these ServicePoint tasks:


# Question 1 2 3 4 5 Responses Mean

1 entering a single client 0 0 1 5 12 18 4.61

2 assessing a client 0 0 1 6 11 18 4.56

3 entering a family record 0 0 3 7 7 17 4.24

4 checking a client into a bed 0 0 2 5 11 18 4.50

5 looking up a client 0 0 1 4 13 18 4.67


If online training videos were available 24/7, how likely would you be to watch the videos?


# Answer Response %

1 1 1 9%

2 2 1 9%

3 3 2 18%

4 4 4 36%

5 5 3 27%

Total 11 100%


Which type of training method do you prefer?

# Answer Response %

1 watching videos showing the computer screen only

1 6%

2 watching videos showing the instructor interaction with the screen and class

5 29%

3 traveling to a location with a live trainer on site

15 88%

4 other: 1 6%


I would like to attend additional training on: Choose all that apply.

# Answer Response %

1 Another User Training 4 33%

2 Administration Training 5 42%

3 Basic Report Writing 5 42%

4 Advanced Report Writing 3 25%

5 User Group (interactive group with other users)

1 8%

6 Other: 2 17%


How often would you like to have a refresher training?

# Answer Response %

1 Monthly 0 0%

2 Every 3 months 2 11%

3 Every 6 months 3 17%

4 Once a year 10 56%

5 Other: 3 17%

Total 18 100%


Job Type/Role

# Answer Response %

1 Case Manager 3 17%

2 Program Manager 3 17%

3 Agency Administrator 9 50%

4 Executive Director 1 6%

5 Volunteer 0 0%

6 Other: 4 22%


Summary

• Tim from Bowman Systems trained 85 users in 5 days, 3 locations and 10 sessions (morning/afternoon each day)

• Most users, not their first training and thought length of training was just right

• Using Eventbrite to register was easy • Most everyone improved their knowledge or skill level• 83% said the several emails sent by HMIS as reminders about

the training were just the right amount• Content organization, delivery, handouts and the trainer all

received favorably high ratings

NH-HMIS Training on 8/6/2012 - GNCoC 24

Summary (cont’d)

• Comfort level of using the system after the training was markedly higher

• Mixed review on watching videos• 56% of users want to travel to be trained by a live trainer

every year; 17% wanted refresher training every 6 months• Users want additional training on Basic Report Writing and

Administration tasks

NH-HMIS Training on 8/6/2012 - GNCoC 25

balance of state continuum of care (boscoc) nh hmis training evaluation 08/08/2012 1nh-hmis training...

Documents

boscocnhhmis training

training session

mandatory training

training binder

content of future training

hmis certificate

hmis software circle

boscoc mcoc gncocnh