NIMAC AU & AMP Survey Results

Julia MyersNicole Gaines

March 2012 Survey • The NIMAC provided a customer satisfaction

survey to AUs & AMPs to collect information and gather feedback in these areas:– Formats being produced by users– Satisfaction with NIMAC system performance, use of

features, and suggested system changes– Satisfaction with NIMAC and OverDrive staff support– Interest in future trainings

• The NIMAC received responses from 66 AUs and 64 AMPs.

AU Recent Downloads

AU Recent Downloads

• 70% of AUs downloaded at least one file set in the prior 6 months.

• 44% of AUs downloaded 1 to10 file sets.

• Only 4.5% downloaded more than 100 file sets.

• This finding confirms that file downloading varies dramatically among AUs.

AU Formats Produced

AU Formats Produced

• Over half of respondents produce embossed braille from NIMAS while 39% produce BRF.

• This finding was surprising in light of the fact that braille readers are a minority of those eligible for NIMAS from NIMAC and that braille transcription software is still unable to directly import NIMAS XML.

• This highlights the importance of NIMAS in braille production.

AU File Assignments

Formats Assigned to AMPs

AU File Assignments• Assignment of files for braille production was

higher than for other formats.• 55% of respondents assigned NIMAS for the

production of embossed braille. • 51% assigned files for BRF files.• 35% assigned files for DAISY text.• 25% assigned files for Large Print.• 25% assigned files for DAISY Audio.• Over 36% had not assigned any files in the

previous six months.

AU Use of Contact Info

NIMAC System: AU Responses

NIMAC System: AU Responses

NIMAC System

• Overall responses regarding NIMAC system were very positive!

• Lack of familiarity of some respondents with the AMP and Publisher Contact Information and the Reports functionality points to the need to emphasize these features in upcoming trainings this fall.

Recommended System Changes

• Respondents were also asked for their recommendations on future NIMAC system development; the items below are compiled from both the AU and AMP responses.

• System development recommendations:– Improve system response time– Provide 10- and 13-digit ISBN search for all files– Ensure all files validate to 2005 NIMAS DTD– Provide Bookshare and Learning Ally results in

NIMAC search

Recommended System Changes: Status

• Improved system response time: In progress– OverDrive has moved the NIMAC system to a more robust

server and is looking into ways to further improve response time.

• Searchability by 10 and 13-digit ISBNs: Under review – NIMAC is working with OverDrive to explore an automated

process to supply ISBNs not provided by publisher.

• File validation improvement: Resolved– In March 2012, OverDrive released and NIMAC announced new

validation wizard with enhanced DTD feedback.

• Provide unified search capability: Resolved– APH has implemented Louis Plus. Bookshare has agreed to

participate in the unified search. Learning Ally and AccessText Network have also been invited to participate.

AU Webinar Interest

AU Webinars

• In response to the high interest in webinar trainings, NIMAC will be offering its AU, AMP, and Publisher & Vendor webinars again this fall!

• As in the past, once the trainings are scheduled, users will receive an email notification of the trainings and instructions on how to register.

• We will also post this information on the NIMAC web site.

AU NIMAC Staff Ratings

AU OverDrive Support Ratings

NIMAC and OverDrive Support

• Responses were overwhelmingly positive!

• Of those respondents who had contacted NIMAC, the majority reported “Excellent” in all four areas surveyed: Promptness of Response, Knowledge, Helpfulness, and Availability.

• 100% rated NIMAC staff “Excellent” or “Good” for Knowledge and Availability and 98% gave those ratings for Promptness and Helpfulness.

NIMAC and OverDrive Support

• Over 70% of respondents indicated that they had not contacted OverDrive support.

• Of those who had contacted OverDrive, the vast majority indicated “Excellent” or “Good” in all four surveyed areas.

AMP Survey Results

• AMPs were surveyed in the same areas as AUs, with the exception of ratings on AU system functions that did not apply.

• In general, AMP survey feedback was similar to that provided by AUs.

• 64 AMPs participated in the survey, which is a remarkably good response rate given that there are 82 active AMP accounts in the system (i.e., AMPs that have been assigned at least one file).

AMP Downloads

AMP Downloads• 60% of respondents downloaded at least one file

in the prior 6 months.• 42% of respondents downloaded 1 to10 files in

the prior 6 months.• No AMPs reported downloading more than 50

files in that period.• One caveat: Because the survey was conducted

in March, and winter is a less busy time for many AMPs, results may be lower than had the survey been conducted at a different time of year.

AMP Formats Produced

AMP Formats Produced• 65.5% of respondents produce embossed

braille; 45.5% produce BRF.• As with the AU responses, this underscores the

importance of NIMAS in braille production, despite the lack of software that can directly import NIMAS XML for braille transcription.

• One-fourth of respondents produce large print; this is good news as it indicates producers beyond APH have developed workflows to successfully convert NIMAS into that format.

AMP Use of Contact Info

AMP NIMAC System Ratings

AMP Webinar Interest

AMP System Ratings & Training

• While the overall responses were positive, the presence of some “Fair” ratings for system navigation and other features probably indicate a need for more training for AMPs.

• This is echoed in the overwhelmingly positive response to the offer of future webinar trainings.

• We plan to use the upcoming trainings to solicit additional input from AMPs as to any specific issues or difficulties they are encountering.

AMP NIMAC Staff Ratings

AMP OverDrive Ratings

NIMAC and OverDrive Support• Roughly 40% of respondents indicated they had

not contacted NIMAC in the past; 70% had not contacted OverDrive support.

• Of those who had contacted NIMAC, 100% rated NIMAC staff “Excellent” or “Good” for Promptness and Knowledge; 97% gave these ratings for Availability and 94% for Helpfulness.

• Of those who had contacted OverDrive, ratings were similarly positive, although one respondent gave them a “Poor” rating in all four areas.

Survey Comments and Responses The AU and AMP surveys also asked for any additional

comments or questions. Many of the comments related to “big picture” issues beyond the purview of the NIMAC. The NIMAC has actively shared these issues with others so that the overall system of AIM provision can be made more efficient and effective.

• Comment: There is a need for information regarding state edition classroom compatibility.

NIMAC response: This is a long-standing concern of braille producers. It was discussed on last NIMAC User Group call. A publisher representative in the group is investigating further.

Survey Comments and Responses

Comment: There is a need for local training on AIM and how the bigger system of AIM provision works.

NIMAC response: Raised with OSEP and fellow NIMAS grantees

Comment: Need for unified search of Bookshare, Learning Ally and NIMAC materials

NIMAC response: Louis Plus went live in July 2011. Bookshare participation in progress; Learning Ally contacted again

Survey Comments and Responses

Comment: Need for information on which AMPs produce Nemeth braille

NIMAC response: Information is available at the AMP Database at APH; more outreach/training in the works to increase awareness

Comment: Need to know who to contact if a NIMAC file will not open in Read:OutLoud/cannot be successfully converted into an EPUB

NIMAC response: Raised at OSEP meeting in May. Bookshare has offered to follow-up with Don Johnston to create a technical support and feedback loop.

Reflections and Next Steps• The survey gave much positive feedback to the NIMAC

and indicated high satisfaction from users. However, respondents also indicated a continuing need for assistance with broader NIMAS implementation and support.

• We will reach out with additional NIMAC trainings, and continue to seek ways to work collaboratively with the other NIMAS-related projects to improve the overall system of AIM provision.

• To further follow up on issues related to braille: APH & NIMAC have plans to work with Frances Mary D’Andrea of BANA on a survey of how NIMAS is being used in braille production.