DIAGRAM Survey on Teaching with Accessible Image Description

Report of FindingsDate: March 15, 2013Respectfully Submitted By: Yue-Ting Siu, TVI & Educational Consultant; UC Berkeley

Other contributing project members: Anh Bui, Benetech Lore Schindler, Los Angeles Unified School District Laurie Vasquez, Santa Barbara Community College Lucia Hasty, Rocky Mountain Braille Associates

Executive summaryThe DIAGRAM center was established to make it faster, easier and more cost effective

to create and use accessible digital images for students with print disabilities. This work focuses on two broad areas: research and development; and implementation and production. In order to support this mission, we first needed to determine the current climate of use of, and need for accessible descriptions in the educational environment. We focused first on image descriptions as part of secondary and post-secondary education.

This survey gathered information from personnel who are tasked with providing accessible materials to students with visual impairments. The purpose was to illustrate how and if image description is currently handled in schools, and to identify needs in the field. The results should be considered to inform development and refinement of tools for describers (such as Poet), and refine the scope of future training programs for improved implementation.

All of the respondents preferred embedded image descriptions in textbooks as long as they were of high quality, and appropriate for the subject matter. The use of the term “embedded” refers to image descriptions that are within the digital framework of a textbook. A recurring theme in responses reflected priorities for flexibility in meeting different students’ needs, and to account for the range of descriptions from those that did not need to be described, to those that required supplementary tactile representation. All of the respondents attributed the benefit of image description to enhancing students’ independent learning.

Methods

ParticipantsA total of 59 people responded to an online survey using SurveyGizmo. The survey was

disseminated through Benetech’s networks, and included respondents from 23 of the United States, Canada, and Norway. Data were gathered throughout the fall and winter of 2012. Respondents included personnel working in k-12 (37 people), postsecondary programs (15 people), other educational programs (i.e. in a museum or an alt. media designer), and assistive technologists (5 people). Most of the respondents reported serving less than 10 students who required accessible educational materials in a typical semester. Four of the respondents served 16-20 students per semester, and five of the respondents served over 20 students who needed accessible educational materials.

The survey consisted of eight questions, and was purposefully brief with the goal of providing a snapshot of needs in the field to target relevant training programs in the use of Poet. The following questions were included in the survey:

1. In a typical semester (fall or spring), how many students do you serve (on average) who require accessible educational materials?

2. In what capacity do you teach or provide alternate materials?3. What subject matters do you typically teach or provide alternate materials for? 4. Currently, how do you typically represent visual images in educational materials to

students who are visually impaired?5. Of all the materials you need to adapt for accessibility, how often do you feel the need

to describe images?6. Do you think students who are visually impaired could benefit from having images in

course materials described so they may independently access the descriptions on their own?

7. Do you think descriptions of images in a digital textbook can enhance student learning?8. To provide better accessible materials to students who are visually impaired, how

could image description be most effectively used?

Answers were provided as a multiple-choice response, with an option to fill in a short answer for most questions. Please refer to Appendix 1 for a copy of the survey.

ResultsProviding alternate materials for different subject matter (question #3)

Over half of the respondents reported teaching or providing alternate materials for the following subject matters: Physical/Earth/Biological/Life Sciences, Math, History/Social Sciences, and Language and Literature. Less than 30% of the respondents reporting teaching or providing alternate materials for engineering/computer science, and visual/performing arts. Other subjects that some respondents reported using alternate materials for included: web accessibility, health, vocational, business education, and tests. Since respondents may have had differing caseloads with varying student needs, these subjects happened to be those that students were currently enrolled in, and should not be interpreted to mean that certain subjects should be necessarily prioritized over others for providing alternate materials.

Current methods of representing visual images in educational materials (question #4)The respondents were asked to rank the methods they used most often to represent

visual images in educational materials. “1” represented the most used method, “2” for the next most used method, and so on with “5” representing the least used method. “n/a” denotes the number of respondents who did not rank the method at all. The following four bar charts summarize how each method was ranked according to how often it was used. The data are aggregated in a single table.

1 2 3 4 5 n/a0

5

10

15

20

25

Image descriptions embedded into a digital textbook

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 n/a0

5

10

15

20

25

Image descriptions paired with a tactile representation

of the image

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 n/a0

5

10

15

20

25

Images described verbally and informally by a teacher/

peer/auxiliary aide as the ma-terial is covered

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 n/a0

5

10

15

20

25

Images are not verbally de-scribed, but represented

tactually

Ranking

# o

f Res

pon

den

ts

Table of bar chart data, summarizing how respondents ranked how often they used each method:

Most used

2 3 4 Least used

n/a

Image descriptions embedded into a digital textbook 8 12 7 7 3 22Image descriptions paired with a tactile representation of the image

14 9 15 4 0 17

Images described verbally and informally by a teacher/peer/auxiliary aide as the material is covered

22 13 2 5 5 12

Images are not verbally described, but represented tactually

8 8 13 8 7 15

The method “images described verbally and informally by a teacher/peer/auxiliary aide as the material is covered” was ranked number “1” by the largest proportion of respondents (22). The method least used was “image descriptions embedded into a digital textbook” (22). It should be noted that of all the methods suggested, the least used method is one that currently cannot be manipulated by the respondent. All the other methods rely on instructional materials that may be constructed by anyone. At the time of this survey,

embedded image descriptions in textbooks were dependent on the availability of packaged descriptions that accompanied a digital text.

Time spent describing images (question #5)When asked how often the respondents described images given all the materials they

needed to adapt, the majority (66.1%) reported spending less than half of their time describing images. In contrast, only 13.6% of the respondents reported spending most of their time describing images.

Different images serve different functions, and these statistics may be affected by the subject matter, and whether or not the instructional materials necessitated description. Some images do not require description at all, and others are better suited with a tactile representation. The data here should therefore be interpreted with caution, as it does not necessarily correlate to whether or not image descriptions are valued in the field, and cannot support any definitive conclusions regarding respondents’ needs.

Perceived student benefits of image descriptions (question #6)

36%

42%

22%

Do you think students could benefit from independently accessing image descriptions in course materials?

No. A teacher/peer/auxiliary aide could describe the image as it is covered in class.

Perhaps, depending on the quality of the description and subject matter

Yes, it would make less work for the teacher and increase student independence

Yes, but I would like to be able to edit/annotate the descriptions

The majority of respondents (64%) reported that image descriptions would indeed benefit their students. Of these respondents, roughly one-third expressed wanting the option to edit/annotate given descriptions to better suit their students. 36% of the respondents were more cautious, and could perceive image descriptions benefitting their students only if they were of high quality, and appropriate. Given the option of having images in course materials already described, none of the respondents preferred having a teacher/peer/auxiliary aide describe the image for the student as it is covered in class.

These responses indicate an overall positive attitude toward use of image descriptions with students, and reflect the need for appropriate, high quality descriptions. Since none of the respondents preferred having another person describe an image for a student, a possible benefit of having ready image descriptions in course materials may be that the student who is visually impaired can achieve another level of independence in the learning process.

Enhancing student learning with image descriptions in digital textbooks (question #7)A majority of the respondents (81.4%) believed image descriptions in digital textbooks

could enhance student learning. No respondents thought otherwise. Of those who reported “sometimes”, they commented that image descriptions would only enhance student learning if the information was appropriate for the student’s learning level, and if the description itself was appropriate for the image. In other words, for some images where description would not sufficiently convey the information, it would be important to have the image represented

otherwise such as in tactile format. Some of these respondents expressed concerns that more complex images would require tactile representation in addition to the description. Other respondents maintained that a description would only enhance student learning if the image was relevant/important to the course material. One respondent expressed a need to turn image descriptions on or off according to the students’ need and learning style.

Most effective use of image description (question #8)The respondents were asked to rank a variety of applications of image description,

with “1” being the most effective method, “2” for the next most effective method, and so on. “n/a” represents methods that were not ranked at all. Those who chose “other” all expressed concerns that description was not always the most appropriate given an image. These respondents stated that alternatives should be considered based on a student’s preference, and whether or not an image was better conveyed via other media, or in conjunction with other media such as tactile, if at all. The method that ranked highest in being the most effective was “Image descriptions paired with a tactile representation”, followed by “Image descriptions embedded into a digital textbook”. The method that ranked lowest in effectiveness was “Images represented tactually”, followed by “Images described verbally and informally by a teacher/peer/auxiliary aide as the material is covered”. The method “Images described verbally and informally by a teacher/peer/auxiliary aide as the material is covered” was also noted in question #6 as the least preferred method that would benefit students. The following five bar charts summarize how each method was ranked according to the perceived effectiveness of each method. The data are aggregated in a single table.

1 2 3 4 5 other n/a0

5

10

15

20

25

Image descriptions in a digital textbook

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 other n/a0

5

10

15

20

25

Image descriptions paired with a tactile representation

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 other n/a0

5

10

15

20

25

Images described verbally and informally by a teacher/peer/

auxiliary aide as the material is covered

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 other n/a0

5

10

15

20

25

30

Images represented tactually

Ranking

# o

f Res

pon

den

ts

1 2 3 4 5 other n/a0

5

10

15

20

25

Image descriptions embedded into a digital textbook with the

option to edit/annotate

Ranking

# o

f Res

pon

den

ts

Table of bar chart data, summarizing how respondents ranked the effectiveness of each method:Most

effective2 3 4 Least

effectiveother n/a

Image descriptions in a digital textbook 14 10 9 9 1 1 15Image descriptions paired with a tactile representation

20 7 7 1 4 1 19

Images described verbally and informally by a teacher/peer/ auxiliary aide as the material is covered

3 7 9 9 6 3 22

Images represented tactually 2 2 5 11 10 3 26Image descriptions embedded into a digital textbook with the option to edit/annotate

6 12 8 3 4 2 24

Wrap-up

The survey respondents all served students with visual impairments in a variety of educational capacities who were studying a range of subjects. The use of alternate materials for various subjects likely differed due to the range of students served and their needs. Overall, respondents felt that image descriptions could benefit their students, but the potential benefit hinged upon the quality and appropriateness of description for a given image. Respondents ranked highest methods and approaches that allowed for flexibility in tailoring accessibility to images depending on student needs, and how/if information from the image needed to be conveyed. All of the respondents agreed that image descriptions in digital textbooks would enhance student learning, and everyone preferred this method to having the student depend on another person to describe images as they came up in the classroom.

Although the highest proportion of respondents ranked the most frequently used method as “images described verbally by a teacher/peer/auxiliary aide as the material is covered” (question #4), none of the respondents thought this method was the best for having students independently access course materials (#6). All of the respondents preferred embedded image descriptions in textbooks as long as they were of high quality, and appropriate for the subject matter.

LimitationsSince the survey was disseminated through Benetech’s networks, it may have been

biased toward people who are already connected to uses of alternate media and assistive technology. Therefore, this sample of respondents may be more open to the sort of technology that image descriptions in digital textbooks require. Although respondents represented 23 of the United States (55 respondents), Canada (3 respondents), and Norway (1 respondent), more specific information regarding the demographics of their teaching environment was not gathered. It is unknown within what kind of infrastructure they served students, and what kind of resources they had access to in providing alternate media. Other personnel not included in this survey may have varying access to different types of infrastructure and resources that affect use of alternate media. Information from this survey provides an anecdotal snapshot of the population sampled rather than support statistical conclusions that can be directly applied to the general population. Respondents may not have been truly representative of all personnel who work with students with visual impairments due to possible sampling bias.

Thoughts and considerations for future directions1. Image descriptions are relevant for a wide variety of subjects, and providing

descriptions across different subjects depend on students’ needs. Efforts to expand the use of image descriptions should encompass a breadth of subject matters, and not be limited to the ones reported here.

2. Respondents preferred students use image descriptions embedded in digital textbooks rather than rely on another person to describe an image. Having embedded image descriptions in course materials were perceived to increase overall independence in student learning. Efforts to provide image descriptions in textbooks should therefore be viewed as a way to improve independent learning in students who are visually impaired.

3. Image descriptions enhance student learning if they are appropriate to the content material, and to the type of representation needed

a. Some respondents noted that if descriptions were not necessary to the subject matter, they would rather have an option to “turn descriptions off”. Image

descriptions not relevant to conveying content material should be avoided, or else risk distracting the student from learning goals, and discouraging educators from using them at all.

b. Some respondents reported a need for tactile representations in addition to image description depending on the complexity and/or type of image. Image description is not an all-encompassing panacea for accessible educational materials. Tools should allow for flexibility to account for instances where images are not optimally represented by description, and may need additional tactile representation.

c. Some respondents reported that different students might benefit from more or less information regarding an image. They noted that flexibility in adjusting descriptions to student needs would be very important. Relevant use of image description is therefore dependent on student learning needs, and tools should allow for editing descriptions as necessary to suit the student.

4. Although all respondents preferred some use of embedded image descriptions in textbooks to having images described by another person, not all of the respondents reported using embedded image descriptions as the most often used method. This indicates that there is indeed a need in the field to expand the availability of embedded image descriptions in textbooks, and personnel working with students with visual impairments would prefer this method to having students lose independence in the learning process.

5. This survey did not ask who these respondents thought would be best qualified to provide descriptions, nor did it ask how the respondents would ideally like to be involved in producing image descriptions. Future research, development, implementation, and production should consider:

a. How to standardize descriptions so they adhere to guidelines and ensure the highest quality possible?

b. How to deliver tactile representations to supplement descriptions for those images that require both?

c. How to limit the number of images described so that only those that are relevant to conveying content are described?

d. How to deliver image descriptions within digital textbooks using pre-existing infrastructures/resources that are accessible to personnel and students?

e. How to build enough flexibility into image description tools to meet student needs?

f. How to design image description tools and train personnel in using them so that they may incorporate this method into their teaching toolkit?

As always, comments, feedback, and ongoing discussions are welcome and appreciated.

Yue-Ting Siu, TVIEducational Consultant

Appendix 1: DIAGRAM Survey on Teaching with Accessible Image Description

Please complete each survey question with the answer that best describes your approach to providing accessible materials to students who are visually impaired.

1. In a typical semester (fall or spring), how many students with visual impairments do you serve (on average) who require accessible educational materials?

o Noneo 1-5o 6-10o 11-15o 16-20o More than 20

2. In what capacity do you teach or provide alternate materials?o High school – Resource roomo High school – Itineranto High school – Self-contained classroom for students with visual impairmentso High school - Collaborative Team Teaching classroom (CTT) with mainstream

students, and 1 general education teacher + 1 special education teachero High school - Administratoro College – Alternate media specialist o College – Disability student support services administrator, o College or District assistive technology specialist/trainero Other – what is your title and position?

3. What subject matters do you typically teach or provide alternate materials for? Please select all that apply.

o Physical and Earth Scienceo Biological and Life Scienceo Matho Engineering and Computer Scienceo History and Social Scienceo Language and Literatureo Visual and Performing Artso Other:

4. Currently, how do you typically represent visual images in educational materials to students who are visually impaired? Please rank the methods below, using 1 for the most used method, and 2 for the next most used, and so on. You do not need to rank all items:

o Images described verbally and informally by a teacher/peer/auxiliary aide as the material is covered

o Image descriptions paired with a tactile representation of the imageo Images are not verbally described, but represented tactually o Images embedded into a digital textbook

o Other (please describe):

5. Of all the materials you need to adapt for accessibility, how often do you feel the need to describe images?

o None of my time is spent describing imageso Very little of my time is spent describing images (less than 25%)o 25-50%o about half of the time, I need to describe imageso 50-75%o Most of my time is spent describing images (more than 75%)

6. Do you think students who are visually impaired could benefit from having images in course materials described so they may independently access the descriptions on their own?

o No. Students would be better off having a peer or teacher describe the image as it’s covered in class.

o Perhaps, depending on the quality of description and subject mattero Yes, it would make less work for the teacher and increase student independenceo Yes, but I would like to be able to edit or annotate the descriptionso Other:

7. Do you think descriptions of images in a digital textbook can enhance student learning?o Yeso Sometimes (please describe situations in which they do enhance learning and when

they do not: o No – please share why:

8. To provide better accessible materials to students who are visually impaired, how could image description be most effectively used? Please rank the methods below, using 1 for the most effective method, 2 for the next most effective, and so on. You do not need to rank all items:

o Image descriptions embedded into a digital textbook o Image descriptions paired with a tactile representation of the imageo Image descriptions embedded into a digital textbook, but with the option to edit or

annotate the descriptiono Images described verbally and informally by a teacher/peer/auxiliary aide as the

material is coveredo Images are not verbally described, but represented tactuallyo Other (please describe):