quality dashboard-may-2015
TRANSCRIPT
TAUS Presents:
The Quality DashboardMeasuring and benchmarking quality, productivity and efficiency of
translation on an industry-shared platformwww.taus.net
What About Translation Quality
Old School: “One size fits all”Since the 1980’s
LISA QA Model, SAE J2450 prescribe today’s quality processes:
1. Static:• One quality fits all purposes, all content, all audiences
2. Subjective:• Evaluations are often subjective and anecdotal
3. Costly:• QE causes friction, delays• QE can cost up to 25% of total translation costs
4. Non-transparent:• Necessity without remedy
Dynamic Quality Framework
Industry Collaborative ProgramDQF started in 2011
AdobeAppenAutodeskAVBCA TechnologiesCiscoCrestecCrosslangDellDFKIeBay EMCGoogleHewlett PackardIntelLDS ChurchLingo24
This slide may not be used or copied without permission from TAUS
Participating members
LionbridgeMedtronicMicrosoftMoraviaNikonOraclePacteraPangeanicPaypalPhilipsPTCSiemensSpil GamesSystranVMwareWelocalizeYahoo!
From DQF Tools to Quality Dashboard
DQF ToolsSince January 2014
Tools on TAUS web site:to measure:• Productivity• Adequacy• Fluency
to review and count:• Translation errors
to get:• Stats and reports
Used by 100+ members
Quality DashboardLaunched June 2015
DQF integrated in:• TRADOS Studio• MateCat• Memsource (planned)• WorldServer (planned)
Use of DQF plug-in provides:• Enhanced statistics• Benchmarking
Open to everyone
TRADOS Studio Plug-in
MateCat Plug-In
The Power and Value of the Quality Dashboard
• DQF collects data and generates reports on the Dashboard real-time
• Translators, managers, buyers, developers get their own stats, benchmarks and analytics
• Not only track and benchmark against your own data, but also against industry averages, between translators, customers
Quality Evaluation
Business Intelligence
i
>
August 31, 2015: 566,987,756 words have been measured
May-150
50
100
150
200
250
300
350
287
ProductivityAcross all languages, industries, technologies,
processes, content, translators
Num
ber
of
Word
s p
er
Hour
Quality DashboardProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
What is the average productivity?
i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
MT+PE TM+Human0
50
100
150
200
250
300
350
400
450
Productivity
What is the average productivity of MT vs. TM?
i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
Industry Average My Productivity0
50
100
150
200
250
300
350
400
287
345
My Productivity Compared to Industry AverageN
um
ber
of
Word
s p
er
Hou
r
ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
What is my productivity compared to industry?
i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
20%
40%
20%
15%
5%
My Distribution of segments
TM + Human TM + MT + Human + PE
MT + PE TM only
MT only
ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
Where do my translations come from?
i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
Me Industry Average0%
20%
40%
60%
80%
100%
120%
My Distribution of Segments Compared to Industry
TM+Human TM+MT+Human+PEMT+PE TM onlyMT only
ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
Where do my translations come from vs. industry?
i
>
August 31, 2015: 566,987,756 words have been measured
Quality Dashboard
Quality Dashboard
Content profiling
Quality evaluation Adequacy/Fluency Error review
MT Ranking
Productivity measurement
DQF API
Home Services Academy Events Blog Membership My TAUS
Benchmark
More information
Review
Project A Project B Project C Project D0
50
100
150
200
250
300
350
400
Productivity by Language by Project
FRDEZHKONL
Projects
Num
ber o
f wor
ds p
er h
our
ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project
What is my productivity by language and by project?
Benefits of the Quality Dashboard
DQF elevates the discussion about quality to an industry level.
The resulting benefits are:
1. Sharing knowledge and standard references
2. Increased credibility
3. Lower cost
4. Increased satisfaction
5. Increased flexibility
What’s next?
Find out more on the TAUS web site:
Download the Quality Dashboard description
Find the API specifications and integrate your translation tool
This slide may not be used or copied without permission from TAUS