stemreader project:technology to support maths notation reading & understanding
TRANSCRIPT
STEMReader Project:Technology to support Maths
Notation reading & understanding
E.A. Draffan & Teresa Binks
ECS Partners
Why do we want to read aloud maths notation?
• Working memory & processing difficulties can have an impact on understanding & interpreting maths notation
• Research has shown increased performance associated with the computer-read text support
• Popular text-to-speech & screen tools provide limited support for maths notation
• Speech maths rules US-centric & primarily for screen-reader users
“Standard” text to speech
GCSE question:
Circle the expressions that is equivalent to 4 × 𝑥:
𝑥4 4𝑥 4𝑥 𝑥 × 𝑥 × 𝑥 × 𝑥
TTS reads as: “x 4” “4x” “4x” “x times x times x times x”
Quadratic Formula:
𝑥 =−𝑏 ± 𝑏2 − 4𝑎𝑐
2𝑎TTS reads as “x = b square root b 2 4 ac slash 2 a”
Struggling to read maths notation?
• Visually impaired students – 23,500 in FE
• Specific learning difficulties – 161,300 in FE
• Students with English as a second language
How large is the problem?
– Apprenticeship success rate 4.4% lower for dyslexia/dyscalculia; 5.1% for VI – differential increasing
– 61% of apprenticeships in business, health and engineering sectors
– Estimate 132 000 print disabled post-16 students studying STEM subjects
Potential Benefits of Platform independent TTS for maths equations
Independent access to learning & assessment materials
Reduce learners reliance on human support to access materials containing maths – whether in class, assessments or the workplace.
Assist with comprehending mathematical concepts
Offer a multi-sensory teaching tool for maths to support those who struggle to comprehend mathematical concepts.
Improve mathematical accuracy
Aid proof reading and checking of mathematical notation for those with reading/processing difficulties
Increased confidence in maths
Build users confidence in maths throughdeveloping mathematical vocabulary, re-enforcing concepts & assisting with proofing
Meet equality obligations
Stimulate organisations to provide accessible STEM materials by providing maths TTS & compliance checker
Barriers to reading maths
A mathematical expression or equation is like a sentence with grammar and semantic structure.
Simple expressions :
“I can run” ……
𝑥 + 2
Complex expressions:
"I can run like the wind if the grizzly bear chases after me“…
𝑥+2 2
𝑥+2
Therefore important to be able to navigate maths semantically
Mathematical semantics
To decode notation and semantics a reader must recognise:
– symbols
– location of symbols relative to other symbols
– mathematical context
If you can drill down into the semantics of an equation:
• Audio representation of the notation may be more valuable & put less strain on working memory.
• May solve lack of consistent use of vocabulary by teachers and academics.
STEMReader projectPhase 1 to develop proof of concept from Feb 2014 – July 2014 funded by BIS, Technology Strategy Board, managed by JISC Techdis.
Goals:
• Improve solutions for reading aloud maths notation for students studying from functional skills through to degree level maths and science
• Apply concept of semantic web to allow for navigation and visualisation of maths notation
Challenge – to develop a usable, sustainable tool for print-impaired students to use alongside their current support strategies.
Phase 2 objective
To continue the development of STEMReader so that we can launch a sustainable and commercially viable product for reading aloud Maths. STEMReader will be developed for deployment as:
• A basic online tool with limited free access.
• A tool that can work across applications offering Maths equation support for those with print impairments.
• An application that can be deployed across networks alongside other assistive tools using locally installed SAPI voices.
STEMReader Demo
• Platform independent tool for rendering MathML
• Through semantic tree able to provide:
– Synchronised highlighting
– Adaptable speech rules
– Visual representation of equation semantics
– Links to definitions
• Developing Windows installer with link to Office 2010/13.
STEMReader examples -fractions
STEMReader examples –order of operations
Phase 2 Release Timeline
Feb 2015 Windows tool available for trials. Testing with FE & HE institutions to May 2015.
Aug 2015 screen-reader, personalisation & navigation enhancements. Testing with range of organisations to Nov 2015.
Nov 2015 Network support & dictionary enhancements Beta phase to Apr 2015.
Jan 2016 Web tool launched, May 2016 desktop tool launched
How can you engage with STEMReader?
• Looking for tutors & students willing to trial STEMReader & feedback
– Individuals trialling the software or focus groups
• Opportunity for wider college trials in the Autumn
• Chance to influence software development to make sure it matches you and your students’ needs
Further information
E.A. Draffan
Teresa Binks
Further information on STEMReader:
www.stemreader.org
Interested in trailing STEMReader?