![Page 1: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/1.jpg)
Does measuring subtitle quality really make any difference?
Presentation byAlex Varley
![Page 2: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/2.jpg)
Welcome to the Future
![Page 3: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/3.jpg)
SubtitHAL 9000
![Page 4: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/4.jpg)
Automatic scanning result:
Reading speed = 182 wpm 91.87% accuracy
![Page 5: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/5.jpg)
This is your second offence.
Your broadcast license will be suspended for 20 hours. You will be automatically fined €40,000.
![Page 6: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/6.jpg)
Metrics are much better.
Easy to measure
Easy to understand
Easy to see errors
Easy to regulate
Clear rules
![Page 7: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/7.jpg)
This type of approach works best for everyone but the viewer
Viewer
Regulator, supplier, broadcaster
![Page 8: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/8.jpg)
Different countries = different rules
![Page 9: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/9.jpg)
Everybody agrees on some rules
Subtitles should be accurate
Non-live subtitles should be synchronised
Subtitles must not cover on-screen information
![Page 10: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/10.jpg)
100%-75%What does accuracy mean?
Accuracy
![Page 11: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/11.jpg)
Delay
Time lag for live subtitles:
3-7 secondsOr delay the broadcast
![Page 12: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/12.jpg)
1 hour4 hours
24 hours
72 hours
96 hours
?
A live program is
Before broadcast
![Page 13: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/13.jpg)
Reading speed
120 wpm – no limits
180 wpm used to be popular
![Page 14: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/14.jpg)
If you make everything measurable then people focus only on the metrics
![Page 15: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/15.jpg)
In Australia quality will be measured by:
• Readability• Synchronisation• Accuracy
The key outcome is can the viewer comprehend the program?
![Page 16: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/16.jpg)
In Australia we recognise that:
Live subtitling is where all of the errors and problems usually occur
So live subtitles should be a last resort,
Even for “Live” programs
![Page 17: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/17.jpg)
Live sport will have live scrolling subtitles
![Page 18: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/18.jpg)
News should have a mix of block and scrolling subtitles.
![Page 19: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/19.jpg)
These all impact on quality of live subtitles
Training
Preparation time
Complexity of output
Regulation
Market pricing
![Page 20: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/20.jpg)
• Do viewers know what to expect?• Are quality errors repeated?• Is every supplier doing the same thing?• Are you acting consistently?• Do you work with suppliers to fix issues?• Is the market working?
As a regulator it is better to focus on:
![Page 21: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/21.jpg)
Punishing one-off errors is a waste of time
![Page 22: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/22.jpg)
But letting cowboys into the market means that everybody has to be a cowboy.
![Page 23: Languages and media presentation alex varley slide share](https://reader033.vdocuments.net/reader033/viewer/2022052412/5581a2e9d8b42afd4c8b4981/html5/thumbnails/23.jpg)
Contact: [email protected]
Thanks to Chris Mikul who sits through the hours of regulator meetings and helped research this presentation.