centralized workflow process for multilanguage subtitling … · • tv subtitling • problems for...
Post on 24-Jul-2020
16 Views
Preview:
TRANSCRIPT
CENTRALIZED WORKFLOW PROCESS FOR MULTILANGUAGE SUBTITLING OF LIVE EVENTS
• Inmaculada Requena de la Riva Salud Madrid
Speakers:
• Maria Sonsoles Sastre PáezSalud Madrid
• Jesús Martínez BarberoTechnical Univ. Of Madrid
CONTENT
• INTRODUCTION
• PROPOSED METHODS
• SOCCER EXAMPLE
• FUTURE WORKS
INTRODUCTION
• The Nurse and persons with disabilities.
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• Multilanguage subtitling
• Live TV contribution
• Objective
INTRODUCTION
• The Nurse and persons with disabilities.
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
INTRODUCTION
• The Nurse and persons with disabilities• A Privileged position
• Detect problems in the day-to-day in the persons with disabilities
• We present an example of how nurses can detect and provide solutions
• Interdisciplinary work
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
INTRODUCTION
• Recommendations– File subtitling formats:
• Advanced SubStation Alpha (.ASS)
• AQ Title (.AQT)
• DKS Subtitle Format (.DKS)
• MicroDVD (.SUB)
• Sami Captioning (.SMI)
• SubStation Alpha (.SSA)
• SubRip (.SRT)
• WEBVTT (.VTT)
• Subviewer (.SUB)
INTRODUCTION
• Recommendations
– Examples
SUBVIEWER (.SUB)
INTRODUCTION
• Recommendations
– Examples
AQ TITLE (.AQT)
INTRODUCTION
• Recommendations
– ExamplesADVANCED SUBSTATION ALPHA (.ASS)
INTRODUCTION
• Recommendations
– File subtitling formats:
• Timed Text Markup Language TTML)
– Last version: 24 September 2013
Editor A
Editor B
Editor C
Editor D
Transcod. 1
TTML
Compilator Transcod. 2
MHP HTML 5 GEM
DVB-H, DVB-C,
DVB-T, DVB-S,
DCB-H
IPTV, Web TV,
3G
IPTV, Blue-ray,
Transcod. n
New Media
type
New Formats
INTRODUCTION
• Recommendations
– File subtitling formats:
• Timed Text Markup Language TTML)
– Structure
<tt xml:lang=""
xmlns="http://www.w3.org/ns/ttml">
<head>
<metadata/>
<styling/>
<layout/>
</head>
<body/>
</tt>
Source : W3C
INTRODUCTION
• Recommendations
– File subtitling formats:
• Timed Text Markup Language TTML)
– Styling
<style xml:id="s1"
tts:color="white"
tts:fontFamily="proportionalSansSerif"
tts:fontSize="22px"
tts:textAlign="center"
/>
Source : W3C
INTRODUCTION
• Recommendations
– File subtitling formats:
• Timed Text Markup Language TTML)
– Layout
<layout xmlns:tts="http://www.w3.org/ns/ttml#styling">
<region xml:id="subtitleArea"
style="s1"
tts:extent="560px 62px"
tts:padding="5px 3px"
tts:backgroundColor="black"
tts:displayAlign="after"
/>
</layout>
Source : W3C
INTRODUCTION
• Recommendations
– File subtitling formats:
• Timed Text Markup Language TTML)
– Body<body region="subtitleArea">
<div>
<p xml:id="subtitle1" begin="0.76s" end="3.45s">
It seems a paradox, does it not,
</p>
<p xml:id="subtitle2" begin="5.0s" end="10.0s">
that the image formed on<br/>
the Retina should be inverted?
</p>
<p xml:id="subtitle3" begin="10.0s" end="16.0s" style="s2">
It is puzzling, why is it<br/>
we do not see things upside-down?
</p>
</div>
</body>
Source : W3C
Source : W3C
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
TV Subtitling (Introduction)
• Pre-recorded Programs
• Live Programs
TV Subtitling (Introduction)
• Pre-recorded Programs
– Content Distribution
TV Subtitling (Introduction)
• Pre-recorded Programs
– Subtitling broadcast
Distributo
rDAM
Film
Subtitle data file
Playout
System
Browse copy
broadcast copy
User
TV TV
monitor
Subtitle
editor
Generate Closed
Caption file
BROADCASTER
SUBTITLING COMPANY
Video + audio
Data
MPEG2/4
TS
TV Subtitling
• Live Programs
– Programs with scripts (text)
• Eg: Opera, news
– Without script
• Eg:Soccer match
TV Subtitling
• Programs with scripts (text)
Teleprompter
Newsroom Systems
Close Caption System
TV Playout
TV Subtitling
• Programs without script (without text)
• Subtitle generation:
– Speech recognition
– Stenography
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
Problems for TV subtitling in live events
• Speech recognition
– Delay
– Errors
• Stenography
– Production cost
– A person need 2 years of experience.
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
MULTILANGUAGE SUBTITLING IN LIVE EVENTS
• Several efforts have been made in specific areas.
– Problems:
» Delay
» Errors
» Computer resources
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
Live TV Contribution
EventProducer
Decoder
Play out
Video+Audio
Output
TV CHANNEL 1
Decoder
Play out
Output
TV CHANNEL 2
Decoder
Play out
Output
TV CHANNEL N
INTRODUCTION
• The Nurse and persons with disabilities
• Recommendations
• TV subtitling
• Problems for TV subtitling in live events
• multilanguage subtitling
• Live TV contribution
• Objective
Objective
• Subtitle of Live events
– Program with scripts
» multilanguage subtitling
– Program without scripts (SPORTS)
» Cheaper and faster Subtitling
» multilanguage subtitling
CONTENT
• INTRODUCTION
• PROPOSED METHODS
• SOCCER EXAMPLE
• FUTURE WORKS
PROPOSED METHODS
• Multilanguage subtitling
– Live event with script
– Live event without script (SPORTS)
PROPOSED METHODS
• Multilanguage subtitling
– Live event with script
– Live event without script(SPORTS)
• What is best?
With signer or subtitle ?
Good morning ….
Usually We have the text. Why don´t use it?
Let me show you a detail……..Teleprompter
Text
LIVE EVENT WITH SCRIPT
• Remember
– We can subtitle all programs
• We don´t need special or complicated technology
• Why don´t use it instead signer?
• Why don´t subtitled all this types of programs as default production process?
LIVE EVENT WITH SCRIPT• Why don´t add subtitles with the video and
audio data as normal procedure?
LIVE EVENT WITH SCRIPT• Why don´t add subtitles with the video and
audio data as normal procedure?
Producer
Decoder
Sub.
System
Play outSubtitle Data
Subtitle Data
Video+Audio
Output
TV CHANNEL 1
Decoder
Sub.
System
Play outSubtitle Data
Output
TV CHANNEL 2
Decoder
Sub.
System
Play outSubtitle Data
Output
TV CHANNEL N
LIVE EVENT WITH SCRIPT
• Multilanguage subtitlingPaper: Multilanguage Opera Subtitling Exchange Between Production and Broadcaster Companies , Jesús Martínez Barbero,
Manuel Bollaín Pérez. 2009 . Book 14 - New Trends in Intelligent Technologies
– Preproduction
• Each phrase has a code
• The entire text is translated to all languages desired – It could be don by producer or broadcaster
Original DataBroadcasters Translation
Language n
Language 1
LIVE EVENT WITH SCRIPT
• Multilanguage subtitlingPaper: Multilanguage Opera Subtitling Exchange Between Production and Broadcaster Companies , Jesús Martínez
Barbero, Manuel Bollaín Pérez. 2009 . Book 14 - New Trends in Intelligent Technologies
– Production
Producer
Decoder
Sub. System
Play out
Subtitle Data
Subtitle Data
Video+Audio
Output
TV CHANNEL 1
Decoder
Sub. System
Play out
Subtitle Data
Output
TV CHANNEL 2
Decoder
Sub. System
Play out
Subtitle Data
Output
TV CHANNEL N
Code data
PROPOSED METHODS
• Multilanguage subtitling
– Live event with script
– Live event without script (SPORTS)
LIVE EVENT WITHOUT SCRIPT (SPORTS)
• Basis:
– Sport has a set of phrases:
• We use “Predefined phrases” in Controlled Natural Language (CNL)
• Producer send the identification number + [variables]
• The system generates the phrases in all the languages suported
LIVE EVENT WITHOUT SCRIPT (SPORTS)
Server
CommentatorsMux
Cloud Platform
Web Services
TabletsPhones
Language selection
Video + Audio + Subtitles
DVB
Several languages
HttpHttpWeb Services
Mux
Video + Audio + Subtitles
DVB
Customization
Web
LIVE EVENT WITHOUT SCRIPT (SPORTS)
• Commentator terminal [Soccer]
Scenarios Phrases types
Team management
Event Detection
Changesituation
Phraseselection
Player selection
Teamselection
Waiting
NeedPlayer
Yes
No
Titlewaiting
Yes
No
Send Title
Sow Title
Change
Situat.
Yes
NoLoad Sentences
Load PlayersChange
team.
Yes
No
Wait Event
LIVE EVENT WITHOUT SCRIPT (SPORTS)
• For one match
Comment.1..N
Server
Languages1..K
TV Channels1..M
Languages1..K
Web Platforms1..L
1 Language K Languages
LIVE EVENT WITHOUT SCRIPT (SPORTS)
• Server Flowchart
Data
ExtractorInbox
Msg from
commetator program
Phrase_ID (Var_1,
Var_2,…, VarN
El arbol del ahorcado
Ve peligrar su suerte
El mecenaxfo
De lo valido u no válido
Para un juego de pelota vasa
Phrase
Selector
LANGUAJE module 1
Send msg
WS clients
HTTP
clients
Set
NPhrase 1Set
Phrases 1
WS
msg
HTTML
PAGE
Id
El arbol del ahorcado
Ve peligrar su suerte
El mecenaxfo
De lo valido u no válido
Para un juego de pelota vasa
Phrase
Conf.
El arbol del ahorcado
Ve peligrar su suerte
El mecenaxfo
De lo valido u no válido
Para un juego de pelota vasa
Phrase
Selector
LANGUAJE module M
Send msg
WS clients
HTTP
clients
Set
NPhrase 1Set
Phrases 1
WS
msg
HTTML
PAGE
Id
El arbol del ahorcado
Ve peligrar su suerte
El mecenaxfo
De lo valido u no válido
Para un juego de pelota vasa
Phrase
Conf.
LIVE EVENT WITHOUT SCRIPT (SPORTS)
• Entire system (for several matches)
Matches1..O
CONTENT
• INTRODUCTION
• PROPOSED METHODS
• SOCCER EXAMPLE
• FUTURE WORKS
CONTENT
• INTRODUCTION
• PROPOSED METHODS
• SOCCER EXAMPLE
• FUTURE WORKS
CONTENT
• INTRODUCTION
• PROPOSED METHODS
• SOCCER EXAMPLE
• FUTURE WORKS
FUTURE WORKS
• Refine the phrase types
• Aggregate more phrases to phrase types
• Create Levels of subtitling
• Aggregate languajes
• Aggregate sports
CONTENT• INTRODUCTION• PROPOSED METHODS• SOCCER EXAMPLE• FUTURE WORKS
Thank you
????????
top related